Anthropic’s new AI leads freelance benchmarks, yet fails 58% of the tasks

Poin penting

• Anthropic has launched its new Fable 5.2 model, which currently leads Scale's Remote Labor Index benchmark.
• This index evaluates complete deliverables against professional reference work for freelance tasks.
• Despite taking the top spot on the leaderboard, the AI model still failed to successfully complete 58 percent of the assigned tasks during testing.

Diringkas otomatis oleh Kryptokite dari laporan CryptoSlate. Baca sumber aslinya untuk detail lengkap. Untuk saat ini berita dan ringkasan masih dalam bahasa Inggris.