Chutes AI presents 8B model trained on distributed gaming GPUs
Summary
At the @ExploitSummit, Jon Durbin of @chutes_ai announced the development of an 8 billion parameter AI model that operates effectively on a phone's CPU, achieving nearly 60 tokens per second for an investment of about $6,500 in GPU rental. This initiative highlights the broader trend towards decentralized AI, emphasizing how open-source development and decentralized training can empower users with control over AI from its creation to everyday use, enabling high-performance on-device inference even on standard hardware.
Analysis
Chutes AI: Chutes AI operates as a platform focused on secure AI inference for applications. In the context of this news, it is the organization behind the presented work on distributed model training using gaming GPUs and efficient on-device inference. Jon Durbin: Jon Durbin is a backend developer associated with Chutes AI. He delivered the keynote at Exploit Summit highlighting open-source approaches to AI development and decentralized training methods. Exploit Summit: Exploit Summit is a technology event featuring presentations on emerging AI and development topics. The news centers on Durbin's keynote there discussing control over AI through open-source and decentralized methods. Decentralized AI: Open-source development and decentralized training are positioned as ways to increase user control over AI systems from creation to use. On-Device Inference: Models trained in distributed environments can achieve high performance running locally on standard hardware like phone CPUs.
Categories
aimachine_learningtech
Related sources
- https://x.com/i/status/2105345802180927601
- https://arxiv.org/html/2305.18619v1
- https://www.worldradiohistory.com/Archive-All-Music/Billboard/60s/1969/BB-1969-01-25.pdf
- https://x.com/i/status/2105343598027813111
- https://x.com/i/status/2105353248836362289
- https://www.govinfo.gov/content/pkg/CZIC-gb1399-3-s52-1994/html/CZIC-gb1399-3-s52-1994.htm
- https://issuu.com/shackoulshonorscollege/docs/spring_2026_urs_booklet
- https://bsky.app/profile/kevinahogan.bsky.social
- https://x.com/i/user/592146834
- https://x.com/i/user/1854245626797498376
- https://www.facebook.com/youngcountyarena76450/posts/up-next-kjra-rodeo-association-finals-all-the-information-is-listed-belowfriday-/1631765198953517/
- https://x.com/i/user/407956573
- https://x.com/i/user/173524056
- https://x.com/i/user/1687644499072208896
- https://www.researchgate.net/publication/394259981_BurstGPT_A_Real-World_Workload_Dataset_to_Optimize_LLM_Serving_Systems
- https://x.com/i/user/982939260
- https://x.com/i/status/2105345285396287547
- https://bittensor.nl/ecosysteem/the-incentive-layer/
- https://www.mvs.usace.army.mil/Portals/54/docs/navigation/SEIS/Library/Site_Specific_Environmental_Assessments/Mosenthein_Ivory_Landing_Phase_4_Final_EA_and_FONSI_April_2014.pdf?ver=2016-06-23-100654-370
- https://x.com/i/status/2105352182698746266