The concept of literate programming, or the idea of programming in a document, was first introduced in 1984 by Donald Knuth. And as of today, notebooks are now the defacto tool for doing data science work. So as the data tooling space continues to evolve at breakneck speed, what are the possible directions the data science notebook can take?
In this episode of DataFramed, we talk with Dr. Jodie Burchell, Data Science Developer Advocate at JetBrains, to find out how data science notebooks evolved into what they are today, what her predictions are for the future of notebooks and data science, and how generative AI will impact data teams going forward.
Jodie completed a Ph.D. in clinical psychology and a postdoc in biostatistics before transitioning into data science. She has since worked for 7 years as a data scientist, developing products ranging from recommendation systems to audience profiling. She is also a prolific content creator in the data science community.
Throughout the episode, Jodie discusses the evolution of data science notebooks over the last few years, noting how the move to remote-based notebooks has allowed for the seamless development of more complex models straight from the notebook environment.
Jodie and Adel’s conversation also covers tooling challenges that have led to modern IDEs and notebooks, with Jodie highlighting the importance of good database tooling and visibility. She shares how data science notebooks have evolved to help democratize data for the wider organization, the tradeoffs between engineering-led approaches to tooling compared to data science approaches, what generative AI means for the data profession, her predictions for data science, and more.
Tune in to this episode to learn more about the evolution of data science notebooks and the challenges and opportunities facing the data science community today.
Links to mentioned in the show:
More on the topic:
#218 Designing AI Applications with Robb Wilson, Co-Founder & CEO at Onereach.ai
#217 Data & AI at Tesco with Venkat Raghavan, Director of Analytics and Science at Tesco
#216 Perplexity & the Future of AI with Denis Yarats, Co-Founder and CTO at Perplexity AI
#215 Seeing the Data Layer Through Spatial Computing with Cathy Hackl and Irena Cronin
#214 Learning & Memory, For Brains & AI, with Kim Stachenfeld, Senior Research Scientist at Google DeepMind
#213 Building Trust Through Data with Prukalpa Sankar, Co-Founder of Atlan
#212 The History of Data and AI, and Where It's Headed with Cristina Alaimo, Assistant Professor at Luiss Guido Carli University
#211 What is AIOps? With Assaf Resnick, Co-Founder & CEO of BigPanda
#210 Trust and Regulation in AI with Bruce Schneier, Internationally Renowned Security Technologist
#209 Effective Data Engineering with Liya Aizenberg, Director of Data Engineering at Away
#208 Monetizing Data & AI with Vin Vashishta, Founder & AI Advisor at V Squared, & Tiffany Perkins-Munn, MD & Head of Data & Analytics at JPMC
#207 Data Driven Venture Capital with Andre Retterath, Partner at Earlybird VC
#206 The Venture Mindset with Ilya Strebulaev, Economist & Professor at Stanford Graduate School of Business
#205 The 2nd Wave of Generative AI with Sailesh Ramakrishnan & Madhu Iyer, Managing Partners at Rocketship.vc
#204 Data & AI Trends in 2024, with Tom Tunguz, General Partner at Theory Ventures
#203 How a Chief AI Officer Works with Philipp Herzig, Chief AI Officer at SAP
#202 Making Data Governance Fun with Tiankai Feng, Data Strategy & Data Governance Lead at ThoughtWorks
#201 The Database is the Operating System with Mike Stonebraker, CTO & Co-Founder At DBOS
#200 50 Years of SQL with Don Chamberlin, Computer Scientist and Co-Inventor of SQL
#199 Creating an AI-First Culture with Sanjay Srivastava, Chief Digital Strategist at Genpact
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast