Scaling TensorFlow at LinkedIn with Jonathan Hung - #314

Today we’re joined by Jonathan Hung, Sr. Software Engineer at LinkedIn, who we caught up with at TensorFlow World last week. In our conversation, we discuss: 

Jonathan’s presentation at the event focused on LinkedIn’s efforts scaling Tensorflow. Jonathan’s work as part of the Hadoop infrastructure team, including experimenting on Hadoop with various frameworks, and their motivation for using TensorFlow on their pre-existing Hadoop clusters infrastructure.  TonY, or TensorFlow on Yard, LinkedIn’s framework that natively runs deep learning jobs on Hadoop, and its relationship with Pro-ML, LinkedIn’s internal AI Platform, which we’ve discussed on earlier episodes of the podcast (Link). Finally, we discuss how far LinkedIn’s Hadoop infrastructure has come since 2017, and their foray into using Kubernetes for research. 

The complete show notes can be found at twimlai.com/talk/314.