In this episode of ACM ByteCast, Bruke Kifle hosts Matei Zaharia, computer scientist, educator, and creator of Apache Spark. Matei is the Chief Technologist and Co-Founder of Databricks and an Assistant Professor of Computer Science at Stanford. He started the Apache Spark project during his PhD at UC Berkeley in 2009 and has worked broadly on other widely used data and machine learning software, including MLflow, Delta Lake, and Apache Mesos. Matei's research was recognized through the 2014 ACM Doctoral Dissertation Award, an NSF Career Award, and the US Presidential Early Career Award for Scientists and Engineers.
Matei, who was born in Romania and grew up mostly in Canada, describes how he developed Spark, a framework for writing programs that run on a large cluster of nodes and process data in parallel, and how this led him to co-found Databricks around this technology. Matei and Bruke also discuss the new paradigm shift from traditional data warehouses to data lakes, as well as his work on MLflow, an open-source platform for managing the end-to-end machine learning lifecycle. He highlights some recent announcements in the field of AI and machine learning and shares observations from teaching and conducting research at Stanford, including an important current gap in computing education.
Partha Talukdar - Episode 52
Rosalind Picard - Episode 51
Edward Y. Chang - Episode 50
Jacki O'Neill - Episode 49
Ranveer Chandra - Episode 48
Yael Tauman Kalai - Episode 47
Noriko Arai - Episode 46
Eugenio Zuccarelli - Episode 45
Regina Barzilay - Episode 44
Kush Varshney - Episode 43
Anima Anandkumar - Episode 42
Mor Peleg - Episode 41
Robert Metcalfe - Episode 40
H.-S. Philip Wong - Episode 39
Pattie Maes - Episode 38
Whitfield Diffie and Martin Hellman- Episode 37
Holly Urban - Episode 36
Pat Pataranutaporn - Episode 35
Team V Bionic - Episode 34
Neil Trevett - Episode 33
Create your
podcast in
minutes
It is Free
DNA Today: A Genetics Podcast
Museum of the Missing
Strange by Nature Podcast
Sasquatch Chronicles
Hidden Brain