Meridiano

Add Article

No Image Available

Article Details

Title

Article: Analyse this: AI faster at evaluating contracts than human lawyers in Alibaba contest

Impact Score

5 / 10

AI Summary (Processed Content)

In a competition between 16 lawyers and an AI program, the AI evaluated legal contracts significantly faster and with 96% accuracy, outperforming the human lawyers alone. However, the highest number of risks in the contracts was identified by a team combining human lawyers and AI, highlighting the value of collaboration.

The AI, based on Alibaba's "Alice" deep learning framework, was trained on nearly 10,000 legal contracts. Participants noted that while AI excels at information retrieval and checking details, human lawyers are better at handling complex, nuanced problems.

The main topics covered are an AI vs. human competition in legal contract review, the superior results of human-AI collaboration, and the capabilities of Alibaba's Alice deep learning model.

Original URL

https://www.scmp.com/tech/innovation/article/3113058/analyse-ai-faster-evaluating-contracts-human-lawyers-alibaba?utm_source=rss_feed

Source Feed

Innovation - South China Morning Post

Published Date

2020-12-09 00:00

Fetched Date

2026-03-04 14:33

Processed Date

2026-03-04 15:05

Embedding Status

Present

Cluster ID

Not Clustered

Raw Extracted Content

Analyse this: AI faster at evaluating contracts than human lawyers in Alibaba contest
- Sixteen lawyers competed against an AI program based on Alibaba Damo Academy’s Alice deep learning framework
- AI found more risks in legal contracts than lawyers by themselves, but the best results come from humans and AI working together
When a group of 16 lawyers and law students met in a small auditorium at Zhejiang University’s Guanghua Law School last week, they were facing a unique opponent: an artificial intelligence (AI) program designed by Alibaba Group Holding’s Damo Academy.
In the first competition of its kind in China, humans were pitted against AI on Friday in reviewing contracts, one of the most common tasks conducted at law firms. The AI program passed with flying colours, sending its results within a minute after the competition started, state-owned newspaper China Daily reported. The program recorded an accuracy rate of 96 per cent, beating the lawyers.
Still, the best results came from a team consisting of both lawyers and AI, which found the highest number of risks. The contestants, who were divided into groups either working with the program or working independently, went through five contracts totaling nearly 20,000 lines of text in 30 minutes.
“Human lawyers are good at dealing with difficult problems, while AI is very strong in retrieving information and checking and mending weak points,” Chen Yunzhou, a Zeda Law Firm lawyer who took part in the competition, told China Daily.
The program used in the competition is based on a deep learning model called Alice, short for Alibaba Collection of Encoder-decoders, created by the natural language processing (NLP) unit of the Damo Academy, Alibaba’s science and technology research division. To train for the competition, the program analysed nearly 10,000 legal contracts.
Alibaba is the parent company of the South China Morning Post.