Podcast Archives - Software Engineering Daily
News:Tech News
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops.
Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting larger, but the smallest models that are commercially relevant are getting smaller. The company was started in 2023 and has raised money from General Catalyst and other industry leaders.
Atila Orhon is the founder of Argmax and he previously worked at Apple and NVIDIA. He joins the show to talk about working in computer vision, building ML tooling at Apple, optimizing ML models, and more.
Sean’s been an academic, startup founder, and Googler. He has published works covering a wide range of topics from information visualization to quantum computing. Currently, Sean is Head of Marketing and Developer Relations at Skyflow and host of the podcast Partially Redacted, a podcast about privacy and security engineering. You can connect with Sean on Twitter @seanfalconer .
Please click here to see the transcript of this episode.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
Tonic and Synthetic Data with Andrew Colombi and Adam Kamor
Netlify and Edge Computing with Erica Pisani
C# Compiler and Language Design at Microsoft with Jared Parsons
Biotech Special: Life Science Data Analysis with Nicholas Larus-Stone
VMware’s Spring AI with Ryan Morgan and Mark Pollack
Biotech Special: Computational Drug Discovery with Patrick Finneran
Design at GitHub Copilot with Adrián Mato Gondelle
Biometric Authentication with Vincent Delitz
Biotech Special: Life Sciences at Snowflake with Harini Gopalakrishnan
Iceberg at Netflix and Beyond with Ryan Blue
Bringing Godot to Mobile with Hein-Pieter van Braam
Biotech Special: Scientific Computing Pipelines with Evan Floden
Stately with Laura Kalbag
Graphical Photorealism with Andrew Price the Blender Guru
Biotech Special: AI Protein Engineering with Eddie Abrams
Portal 64 with James Lambert
Waymo and Autonomous Driving with David Margines
NVIDIA and the Future of 3D Development with Aaron Luk
SimpleWebAuthn with Matthew Miller
Biotech Special: a16z and the Biotech Revolution with Vijay Pande
Create your
podcast in
minutes
It is Free
The WAN Show
Cyber Security Headlines
gm! crypto
Cybersecurity Today
Techmeme Ride Home