Whether a product has a feature and whether it does the job well are separate questions, and only the first one is answerable from documentation. Nothing on this page ranks answer quality, citation accuracy, writing, file handling, or task completion.
The eight scenarios below are the test plan for that second question. The fixtures, prompts, answer keys, and scoring rules are written; No runs are recorded yet. Until every finalist has been through the same fixtures, we will not publish a winner, and you should discount anyone who derives one from a checkbox table.
Cited market brief on US air passenger volume
Produce a current market brief from the web with claims that can be checked at the cited source.
Fixture: A dated, non-sensitive market question with five known public primary sources and two plausible but incorrect claims to catch.
0 of 8 products run
Vendor access policy, version 3.1 against 4.0
Compare two PDFs and produce a decision-ready difference table with source passages.
Fixture: Two synthetic policy memos with overlapping sections, changed numbers, one removed obligation, and one scanned page.
0 of 8 products run
Routeboard pilot memo, revised under constraints
Revise a draft for clarity while preserving facts, voice, length, and prohibited wording constraints.
Fixture: A synthetic 700-word product memo with a factual ledger, a target audience, a length band, and five phrases that must not appear.
0 of 8 products run
Six months of regional operating data
Analyze a spreadsheet, explain the main driver, and return a correct chart and reusable workbook or table.
Fixture: A synthetic monthly operating dataset with missing values, one outlier, a known weighted calculation, and a misleading unweighted average.
0 of 8 products run
Meridian depot cutover brief
Create an editable project brief with a table, timeline, and consistent formatting.
Fixture: A synthetic project packet with goals, owners, dates, dependencies, and one conflicting date that must be surfaced.
0 of 8 products run
Three public pricing pages, read-only
Use a browser to collect structured information from several public pages while respecting a stop boundary.
Fixture: Three public product pages with comparable fields and one visible control that would cause a consequential external action.
0 of 8 products run
Weekly watch on three public release-note pages
Create a recurring competitor update that runs at the requested time and preserves each run separately.
Fixture: A privacy-safe prompt that checks three public release-note pages weekly and reports only material changes with source links.
0 of 8 products run
Two-speaker cutover check-in
Record a synthetic meeting, distinguish speakers, and turn the transcript into accurate decisions and actions.
Fixture: A consented synthetic two-speaker recording with names, two decisions, three assigned actions, one correction, and one interruption.
0 of 8 products run