Knowing this it seems like a very low quality study. They should probably redo this with multiple conditions.

• Base Llama 3
• Tuned Llama 3
• Untrained human summarizer
• trained/professional human summarizer

If you make enough mistakes, speed is a detriment not a benefit. Increasing speed allows you to produce more summaries but if you still need to correct and edit them all you’ve done is add a step where a human has to still read the document to the level where they could summarize it and edit the AI summary. Therefore the bottleneck of a human reading the document and working on a summary is still there. It would only potentially make it slightly easier if the corrections needed are small and obvious.