Workloads
Every edition runs the same versioned workloads — real finance tasks, not trivia. Each page publishes the task design, the pass criteria, the latest results, and the verbatim prompt — identical across all models, no model-specific tuning (methodology §2.1).
- Order-to-cash apply.cash.v1
Apply 20 customer payments to an open AR ledger of 30 invoices: multi-invoice payments, valid and invalid early-pay discounts, short-pays, overpays, loosely formatted remittance memos, and payments referencing unknown invoices (15 scenarios).
Apply 1,000 remittances - Controls & audit audit.expenses.v1
Audit 40 expense lines against a company T&E policy whose limits vary per scenario — meal per-diems, receipt thresholds, hotel nightly caps, mileage rates, prohibited categories, and EUR conversions — flagging 12 planted violations by rule id, with boundary-exact amounts as clean traps (15 scenarios).
Audit 1,000 expense lines - Credit & treasury compute.covenant.v1
Compute LTM Adjusted EBITDA, net leverage, and fixed charge coverage from four quarters of financials under a credit agreement's own definitions — capped restructuring add-backs (greater/lesser of a fixed amount and a percentage), litigation add-backs allowed or excluded, cash netting capped or prohibited — and state compliance with each covenant (15 borrower scenarios).
Test a quarter's covenant package - Procure-to-pay extract.invoice.v1
Extract structured data (vendor, dates, currency, line items, totals) from 15 synthetic invoices with planted edge cases: multi-page, credit note, foreign currency, discount lines.
Process 1,000 invoices - Procure-to-pay match.threeway.v1
Three-way match 40 supplier invoices against purchase orders and goods receipts, flagging 12 planted exceptions by type: price variance beyond tolerance, quantity over receipt, missing receipt, and item mismatch — with boundary-exact tolerances, split receipts, and partial invoicing as clean traps (15 scenarios).
Match 1,000 invoices - Data & reporting query.nl2sql.v1
Answer 15 natural-language finance questions of graded difficulty by writing SQL against a synthetic finance database (GL, AP, AR, dimension tables).
Answer 100 ad-hoc finance questions - Record-to-report reconcile.ledger.v1
Reconcile a month of 200 bank transactions against a shuffled general-ledger extract containing 12 planted discrepancies: missing entries, duplicates, amount mismatches, and date drift (15 monthly scenarios).
Reconcile a month of transactions - Procure-to-pay triage.ap-inbox.v1
Sort 15 batches of 20 synthetic accounts-payable emails into invoice, statement, dunning notice, PO response, or other.
Sort 1,000 AP emails