Apple study finds minimal agent outperforms multi-agent systems in ML tasks
Summary
A new study by Apple Machine Learning Research suggests that advancements in automated machine learning (ML) engineering are largely driven by models and runtimes, rather than the complex scaffolding surrounding them. The research highlights a coding agent equipped with shell and file access that outperformed or matched four multi-agent ML systems, indicating that simpler setups may yield better results. This aligns with a broader trend in recent AI research, which underscores that direct execution capabilities often surpass traditional layered orchestration systems in coding tasks. The study re-evaluated common frameworks, showing that the only critical change was providing the model with shell access instead of a chat interface, leading to significant improvements in performance.
Analysis
Categories
Related sources
- https://epoch.ai/models/glm-5-2
- https://www.newsdigitales.com/nota/339319/z-ai-desafia-a-anthropic-con-glm-5-2-quedo-casi-a-la-par-de-claude-opus-4-8/
- https://claudefa.st/blog/models/glm-5-2
- https://aitoolsreview.co.uk/tool/glm-5-2
- https://arxiv.org/abs/2609.40303
- https://huggingface.co/blog/zai-org/glm-52-blog
- https://wearecoded.com/en/articles/apple-harness-silen-agent.html
- https://machinelearning.apple.com/research/harness-autonomous-ml-engineering
- https://machinelearning.apple.com/research/sclate-agent-training-evaluation
- https://arxiv.org/html/2609.40303