AI vs lawyers: 3 takeaways from the latest legalbenchmarks report
Before releasing the next round of interviews, I wanted to give you this quick breakdown of the new legalbenchmarks report.
Hi everyone
I’ll be releasing the rest of my interviews very soon, but I didn’t want to wait to share this.
The LegalBenchmarks team just published their latest research comparing lawyers and AI tools on contract drafting. It’s one of the few places you can find a structured, reliable assessment of how these systems actually perform and the findings are worth paying attention to.
I’ve put together a short video highlighting three insights from the report:
AI is already as good as lawyers in many instances, and the “human-in-the-loop” idea is less relevant for quality than many assume.
Workflow integration is the real differentiator. Accuracy only gets you so far.
Big funding rounds don’t automatically mean better tools.
Watch the video, and if you want to go deeper, I recommend reading the full report on LegalBenchmarks.
The rest of my interviews are coming soon, but this was too important not to share.
LLMs for LL.Ms: practical observations on AI, law, and building legal technology. Roughly twice a month.
Originally published on Substack →