agenticlegalteam.online

Rehearse a legal team’s response to an AI incident

For legal operations leads, supervising attorneys and staff who use AI-assisted work products.

If someone finds an unsupported quotation shortly before a document goes out, who can stop release and who needs to know?

Use a time-limited rehearsal to find out. Give the team a fictional draft and a planted error, then observe who can pause distribution, locate affected copies, reach the responsible attorney and verify a correction.

Define success in actions an observer can see

Choose a facilitator, a person playing the discovering staff member, the accountable attorney and a recorder. One person can play several roles on a small team. Identify an alternate decision-maker. Give each role a short private card describing what that person knows and what they can control.

Agree on the boundary first. All names and records are fictional. Messages are spoken to the facilitator or written inside the exercise. The observer records decisions and times, including uncertainty about whether release can actually be paused.

Introduce the problem in stages

First reveal that the quote in a draft differs from the source. Ask the discoverer to identify the exact item and the release owner. Next reveal that a second document reused the quotation. Ask who checks which versions were shared and who has authority to decide on any correction.

Finally make the primary attorney unavailable. Ask the team to use its actual backup route in simulation. If there is no backup or the draft has already been delivered in the scenario, record the unresolved decision and the person responsible for addressing it. Counsel determines real obligations and communications from the actual facts.

Retest the weakest handoff

Compare the observations with the success criteria. Record a concrete gap, its owner and a retest date. If several people knew whom to notify but nobody knew how to identify the current draft or control release, changing the contact list alone will not fix the failure. Repeat the difficult handoff with the revised instructions.

Worked example

Illustrative exercise. At minute zero, a reviewer flags an unsupported sentence in draft 4. At minute four, the facilitator reports that a summary contains the same sentence. At minute eight, the lead attorney is unavailable. The observer records whether a backup accepted responsibility, whether both items were accounted for and who would verify the source before release. Scoring follows observed actions, not how quickly someone says the issue is resolved.

Primary sources

Related work at Agentic Attorney

This rehearsal is part of the shared Agentic Attorney resource collection. Its main site describes AI consulting and implementation for legal teams. Explore Agentic Attorney’s approach to AI implementation.