The concept of literate programming, or the idea of programming in a document, was first introduced in 1984 by Donald Knuth. And as of today, notebooks are now the defacto tool for doing data science work. So as the data tooling space continues to evolve at breakneck speed, what are the possible directions the data science notebook can take?
In this episode of DataFramed, we talk with Dr. Jodie Burchell, Data Science Developer Advocate at JetBrains, to find out how data science notebooks evolved into what they are today, what her predictions are for the future of notebooks and data science, and how generative AI will impact data teams going forward.
Jodie completed a Ph.D. in clinical psychology and a postdoc in biostatistics before transitioning into data science. She has since worked for 7 years as a data scientist, developing products ranging from recommendation systems to audience profiling. She is also a prolific content creator in the data science community.
Throughout the episode, Jodie discusses the evolution of data science notebooks over the last few years, noting how the move to remote-based notebooks has allowed for the seamless development of more complex models straight from the notebook environment.
Jodie and Adel’s conversation also covers tooling challenges that have led to modern IDEs and notebooks, with Jodie highlighting the importance of good database tooling and visibility. She shares how data science notebooks have evolved to help democratize data for the wider organization, the tradeoffs between engineering-led approaches to tooling compared to data science approaches, what generative AI means for the data profession, her predictions for data science, and more.
Tune in to this episode to learn more about the evolution of data science notebooks and the challenges and opportunities facing the data science community today.
Links to mentioned in the show:
More on the topic:
#157 Is AI an Existential Risk? With Trond Arne Undheim, Research Scholar in Global Systemic Risk at Stanford University
#156 Making Better Decisions using Data & AI with Cassie Kozyrkov, Google's First Chief Decision Scientist
#155 Building Diverse Data Teams with Tracy Daniels, Chief Data Officer at Truist
#154 Building Ethical Machines with Reid Blackman, Founder & CEO at Virtue Consultants
#153 From Data Literacy to AI Literacy with Cindi Howson, Chief Data Strategy Officer at ThoughtSpot
Introducing Data & AI Literacy Month
#152 How Data can Enable Effective Leadership with Dr. Constance Dierickx, The Decision Doctor
#151 How Data Science Can Sustain Small Businesses with Kendra Vant, Executive GM Data & AI Products at Xero
#150 Unlocking the Power of Data Science in the Cloud
#149 Expanding the Scope of Generative AI in the Enterprise with Bal Heroor, CEO and Principal at Mactores
#148 Why AI is Eating the World with Daniel Jeffries, Managing Director at AI Infrastructure Alliance
#147 The Past, Present & Future of Generative AI—With Joanne Chen, General Partner at Foundation Capital
#146 Do Spreadsheets Need a Rethink? With Hjalmar Gislason, CEO of GRID
#145 Why AI will Change Everything—with Former Snowflake CEO, Bob Muglia
#144 Intel CTO Steve Orrin on How Governments Can Navigate the Data & AI Revolution
#143 Fighting the Climate Crisis with Data
#142 Is Data Science Still the Sexiest Job of the 21st Century?
#141 How Data Science is Transforming the NBA
#140 How this Accenture CDO is Navigating the AI Revolution
#139 How Data Scientists Can Thrive in the FMCG Industry
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast