Podcast Archives - Software Engineering Daily
News:Tech News
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops.
Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting larger, but the smallest models that are commercially relevant are getting smaller. The company was started in 2023 and has raised money from General Catalyst and other industry leaders.
Atila Orhon is the founder of Argmax and he previously worked at Apple and NVIDIA. He joins the show to talk about working in computer vision, building ML tooling at Apple, optimizing ML models, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
Bonus Episode: The N64 Decompilation Scene with Ethan Roseman and Mark Street
The State of CSS with Rachel Andrews
Modern SecOps with Maxime Lamothe-Brassard
Microsoft Copilot with Justin Harris
Pinata and the Interplanetary File System with Matt Ober
Animal Well with Billy Basso
LLMs for Data Queries with Sarah Nagy
Implementing KYC and User Verification with Alex Grinman
Nuxt JS with Anthony Fu
Anaconda and Accelerating AI Development with Rob Futrick
Engineering the Playdate Gaming Handheld with James Moore and Dave Hayden
Using LLMs for Training Data Preparation with Nihit Desai
AI-Driven Observability at Kentik with Avi Freedman
SolidJS with Ryan Carniato
Database Scaling at Figma with Sammy Steele
Bonus Episode: How to Build a Self-Driving Car with Ian Williams
Security Engineering with Ben Huber
Startup Investing with George Mathew
Hookdeck and Building an Event Gateway with Alex Bouchard
Create your
podcast in
minutes
It is Free
WSJ Tech News Briefing
Rebel Tech
The 404 Media Podcast
CyberWire Daily
The WAN Show