Example 01 / Financial judgment · Contingent liabilities
When the cash is not the company’s
Decision window March to May 2020
The question
Whose cash is on the balance sheet, and how much of the refund obligation falls on the platform rather than on event creators?
Situation
A listed ticketing platform faces widespread event cancellations. A private-credit lender is considering senior secured financing. Some creators have already received and spent the ticket proceeds.
The evidence
Ticket proceeds, obligations to creators, refund and chargeback exposure, and dated financing terms. Each task must use only the information available at its decision date.
The issue
Claude Fable 5ModelIf creators cannot fund refunds, chargebacks can fall on the platform. A lender needs to establish how much cash is available to meet that obligation before judging whether the loan can be repaid.
How the models answeredWhat they got right and what they missed
Dissei’s findings across this case. These describe patterns in the answers, rather than a scored assessment of one response.
Correct calculations
The answers computed the financial ratios correctly.
The key question
The answers focused on when live events would return. They missed whose cash the platform held and how much of the refund obligation it would have to fund.
Accurate covenant citations
The answers cited the covenant package accurately and produced competent-sounding committee memos.
A clear conclusion
The grader notes describe generic committee language without a verdict. The answers did not turn the ratios and covenant terms into a conclusion about repayment.
From the grader’s notes
“generic bank-committee language, never committed to a verdict”
“answers the obvious question instead of the real one.”
These comments come from the grader. They are not quotations from a model’s answer.
The financingStaged funding and equity participation
The May 2020 documents show these terms. A task set in March cannot rely on these later terms.
- Total facility
- Up to $225M
- Initial loan
- $125M, expected to be drawn in May, according to the filing.
- Delayed draw
- Up to $100M, available December 31, 2020 through September 30, 2021, subject to conditions.
- Equity participation
- 2,599,174 Class A common shares at $0.01 per share.
Our interpretationStaged funding limited initial exposure while the refund liability became more observable. Equity participation offered compensation for risk that spread alone might not capture. The documents establish the terms; this interpretation is Dissei’s.
Refunds can consume cash needed for debt service. That does not mean every refund claim has legal priority over secured debt.
The later evidenceThe reserve, the platform’s payments and creators’ refunds
- Increase in reserves
- $76.5M
For potential chargebacks and refunds.
First quarter of 2020. - Paid by the platform
- <$3M
Refunds and chargebacks.
Start of March through the May 11 report. - Refunded by creators
- >$150M
Payments funded by event creators.
Same disclosed period.
The reserve increase is an estimate of potential chargebacks and refunds. The payment figures show cash paid during a stated period. They do not establish the final loss or prove that the reserve was excessive.
What this showsA reviewer can check whether an answer separates the potential exposure from the amounts paid by the platform and by creators. Later disclosures help test the earlier reasoning. They must not be treated as facts the model could have known at the decision date.
What to checkDecision date, ownership of cash and the meaning of loss
Use these checks when reading an answer. A pass or fail requires the recorded response; none is assigned here.
- Use only what was known then
- Keep May financing terms and later payments out of a task anchored in March.
- Establish whose cash it is
- Separate the platform’s own funds from ticket proceeds owed to creators and refunds owed to buyers.
- Distinguish exposure from loss
- A reserve, cash paid during a period and a final loss measure different things. The disclosed payment figures do not establish the final loss.
The resultsResults across two model families and three attempts per task
Two unnamed model families used identical environments and sealed rubrics, at three rollouts per task. The rates below describe those two families across this case. They are not an individual score for Claude Fable 5.
Difference in pass@1
Pass@1 measures success with one attempt. The families had similar rates of passing critical grading requirements, but their graded outcomes differed. Close rates alone do not establish statistical equivalence.
| Measure | Family A | Family B |
|---|---|---|
| Critical-gate pass rate | 82.3% | 83.0% |
| Low-graded outcomes | 24.8% | 11.3% |
Three specific tasks scored 0.000 across every rollout and model in the reported run set. One concerned the all-in financing cost and repeatedly failed a critical criterion. This is a task-level result, not a score for the entire case.
The weaker run also produced shorter answers. This observation does not establish a cause. The summary does not include raw counts, a definition of low-graded outcomes or uncertainty intervals, so it cannot establish a general model ranking or statistical significance.