We Asked ChatGPT, Claude, Gemini, and SimpleAI to Review the Same Contract

AI tools like ChatGPT, Claude, and Gemini are rapidly finding their way into legal workflows. Teams are experimenting with them to summarize agreements, draft language, and increasingly, to review contracts.

But an important question remains: what actually happens when these systems are asked to analyze a contract in a meaningful way?

To explore that question, we ran a simple test. Using the same agreement and the same instructions, we asked ChatGPT, Claude, Gemini, and SimpleAI to review the contract.

The responses revealed some interesting patterns and raised broader questions about how different AI systems approach legal analysis.

In this session, Electra Japonas will walk through the comparison and discuss what legal teams should think about as AI becomes part of contract review workflows.

During the session, we’ll explore:
‍

• How different AI systems approach the same contract review task
• What becomes visible when you compare the outputs side by side
• The role of legal context in AI-assisted contract review
• What legal teams should consider when evaluating AI tools

If your team is exploring how AI fits into contract review, this session offers a chance to see how several widely used systems behave when given the same task.

‍