Meta, Carnegie Mellon study shows RL-trained models outperform Llama-4-Maverick in tool selection
Summary
A recent study by Meta and Carnegie Mellon reveals that small models trained with reinforcement learning (RL) significantly outperform larger models, such as the 402B Llama-4-Maverick, in selecting the right tools from an extensive catalog of over 10,000 options. The research demonstrates that an 8B model, trained to break down requests and choose tools based on specific steps, achieved a 41.5% accuracy rate in tool selection, compared to Maverick's best performance of 30.6%. This approach highlights the potential of compact models to efficiently manage complex tasks without the need for extensive retraining, positioning them as viable alternatives to larger models in AI agents.
Analysis
Meta: Meta conducts extensive AI research focused on advancing large language models and agentic systems. Researchers from the company co-authored a recent paper on training smaller models with reinforcement learning for improved tool selection in agents handling large tool catalogs. The work positions Meta's Llama-4-Maverick as the baseline outperformed by the RL-trained approach. Qwen3: Qwen3 is Alibaba's family of open-weight language models released and updated throughout 2026. The Meta-Carnegie Mellon paper fine-tunes Qwen3 variants with supervised learning followed by reinforcement learning on a plan-retrieve-select workflow. The resulting models demonstrate strong generalization across tool benchmarks without further training. Maverick: Llama-4-Maverick is Meta's mixture-of-experts model designed for high-capability multimodal and reasoning tasks. The recent research paper evaluates prompted versions of Maverick on tool selection and finds it surpassed by smaller RL-trained Qwen3 models on ToolBench and transfer benchmarks. Carnegie Mellon: Carnegie Mellon University participates in collaborative AI research projects with industry partners. Faculty and affiliates contributed to the paper on transferable tool selection using RL-trained small models. The university's involvement underscores academic efforts to enhance efficiency in LLM agent workflows. Agent Tool Selection: Recent research shows reinforcement learning can train compact open models to decompose instructions and select tools from large catalogs more effectively than prompting frontier-scale systems. Efficiency in AI Agents: Meta's latest work emphasizes training compact models as alternatives to proprietary large language models for handling complex multi-step tool use in agents. Open Model Post-Training: Developments in 2026 highlight how supervised warm-up combined with RL enables smaller models to acquire specialized agent skills that transfer zero-shot to new domains and retrievers.
Categories
aitechmachine_learning
Related sources
- https://aicomparison.ai/meta-llama-models-guide/
- https://superpowerdaily.com/models/qwen3-8-27b
- https://arxiv.org/html/2512.19126
- https://benchlm.ai/compare/llama-4-maverick-vs-qwen3-6-35b-a3b
- https://www.fool.com/earnings/takeaways/2026/10/21/meta-3-key-takeaways-for-long-term-investors/
- https://openrouter.ai/compare/meta-llama/llama-4-maverick/meta-llama/llama-4-scout
- https://papers.cool/arxiv/2610.31483
- https://www.rfp.wiki/artificial-intelligence/ai-language-models/amazon-nova-premier/llama-4-maverick
- https://www.ventureatlas.org/company/qwen
- https://x.com/dair_ai/status/2113638581818556920
- https://arxiv.org/abs/2610.31483
- https://huggingface.co/buckets/hf-doc-build/blog/tree/llama4-release.md
- https://about.fb.com/news/category/technologies/meta/
- https://about.fb.com/news/page/2/
- https://llmprices.today/compare/llama-4-maverick-vs-llama-4-scout/
- https://benchlm.ai/providers/alibaba
- https://benchlm.ai/best/alibaba-models
- https://ai.meta.com/research/publications/learning-to-program-retrievals-composing-search-primitives-via-reinforcement-learning/
- https://www.benchleader.com/providers/alibaba
- https://about.fb.com/news/
- https://arxiv.org/html/2610.24854v1
- https://about.fb.com/news/page/3/
- https://arxiv.org/html/2610.31483v1