A constructed board paper and its cost model, with reviewer comments in the margins. Four prompts, in this order, scored against a 17-point answer key. I ran Claude for Word on Fable 5.1. Here is the pack so you can run the same test on whatever you use.
Watch the original test: https://www.youtube.com/watch?v=BDhnS5WEaTE
The project is fictional. Names, companies, dates and figures are invented. It contains no client, employer, colleague or personal data.
What you need
- The Word paper. This is the input. Do not clean the comments or the numbers first.
- The cost model spreadsheet. Attach it before prompt 2.
- The answer key. Sealed at the bottom of this page. Do not open it until you have scored.
Downloads
Finity_Revised_Business_Case_v0.7_DRAFT.docx
Finity_cost_model_v3.xlsx
How to run it
- Make a copy of
Finity_Revised_Business_Case_v0.7_DRAFT.docx and of Finity_cost_model_v3.xlsx. Work from the copies.
- Open the Word copy in the tool you are testing. Keep tracked changes on if the tool can write them.
- Send prompt 1 exactly as written. Do not add context.
- Attach or open the cost model, then send prompt 2 exactly as written.
- Send prompt 3, then prompt 4, in that order. One pass each. Do not iterate.
- Score against the 17-point key. Only then open the answer key.
The four prompts
Use this wording, this order.
Prompt 1: