A constructed board paper and its cost model, with reviewer comments in the margins. Four prompts, in this order, scored against a 17-point answer key. I ran Claude for Word on Fable 5.1. Here is the pack so you can run the same test on whatever you use.

Watch the original test: https://www.youtube.com/watch?v=BDhnS5WEaTE

The project is fictional. Names, companies, dates and figures are invented. It contains no client, employer, colleague or personal data.

What you need

  1. The Word paper. This is the input. Do not clean the comments or the numbers first.
  2. The cost model spreadsheet. Attach it before prompt 2.
  3. The answer key. Sealed at the bottom of this page. Do not open it until you have scored.

Downloads

Finity_Revised_Business_Case_v0.7_DRAFT.docx

Finity_cost_model_v3.xlsx

How to run it

  1. Make a copy of Finity_Revised_Business_Case_v0.7_DRAFT.docx and of Finity_cost_model_v3.xlsx. Work from the copies.
  2. Open the Word copy in the tool you are testing. Keep tracked changes on if the tool can write them.
  3. Send prompt 1 exactly as written. Do not add context.
  4. Attach or open the cost model, then send prompt 2 exactly as written.
  5. Send prompt 3, then prompt 4, in that order. One pass each. Do not iterate.
  6. Score against the 17-point key. Only then open the answer key.

The four prompts

Use this wording, this order.

Prompt 1: