The concept of literate programming, or the idea of programming in a document, was first introduced in 1984 by Donald Knuth. And as of today, notebooks are now the defacto tool for doing data science work. So as the data tooling space continues to evolve at breakneck speed, what are the possible directions the data science notebook can take?
In this episode of DataFramed, we talk with Dr. Jodie Burchell, Data Science Developer Advocate at JetBrains, to find out how data science notebooks evolved into what they are today, what her predictions are for the future of notebooks and data science, and how generative AI will impact data teams going forward.
Jodie completed a Ph.D. in clinical psychology and a postdoc in biostatistics before transitioning into data science. She has since worked for 7 years as a data scientist, developing products ranging from recommendation systems to audience profiling. She is also a prolific content creator in the data science community.
Throughout the episode, Jodie discusses the evolution of data science notebooks over the last few years, noting how the move to remote-based notebooks has allowed for the seamless development of more complex models straight from the notebook environment.
Jodie and Adel’s conversation also covers tooling challenges that have led to modern IDEs and notebooks, with Jodie highlighting the importance of good database tooling and visibility. She shares how data science notebooks have evolved to help democratize data for the wider organization, the tradeoffs between engineering-led approaches to tooling compared to data science approaches, what generative AI means for the data profession, her predictions for data science, and more.
Tune in to this episode to learn more about the evolution of data science notebooks and the challenges and opportunities facing the data science community today.
Links to mentioned in the show:
More on the topic:
#177 Avoiding Burnout for Data Professionals with Jen Fisher, Human Sustainability Leader at Deloitte
#176 Data Trends & Predictions 2024 with DataCamp's CEO & COO, Jo Cornelissen & Martijn Theuwissen
#175 Inside Algorithmic Trading with Anthony Markham, Vice President, Quantitative Developer at Deutsche Bank
#174 The Future of Marketing Analytics with Cory Munchbach, CEO at BlueConic
#173 Building Trustworthy AI with Alexandra Ebert, Chief Trust Officer at MOSTLY AI
#172 Data Storytelling and Visualization with Lea Pica from Present Beyond Measure
#171 Data Security in the Age of AI with Bart Vandekerckhove, Co-founder at Raito
#170 What Fortune 1000 Executives Believe about Data & AI in 2024 with Randy Bean, Innovation Fellow, Data Strategy, Wavestone
#169 Unlocking Efficiency Gains Through Process Mining with Wil van der Aalst and Cong Yu, Chief Scientist and VP Engineering at Celonis
#168 Causal AI in Business with Paul Hünermund, Assistant Professor, Copenhagen Business School
#167 What to Expect from AI in 2024 with Craig S. Smith, Host of the Eye on A.I Podcast
#166 Optimizing Cloud Data Warehouses with Salim Syed, VP, Head of Engineering at Capital One Software
#165 Data & AI for Good, with Marga Hoek, Founder & CEO, Business for Good
#164 Driving Data Democratization with Lilac Schoenbeck, Vice President of Strategic Initiatives at Rocket Software
#163 Upgrading Company Culture Using The Geek Way with Andrew McAfee, Principal Research Scientist at the MIT Sloan School of Management
#162 Scaling Data Engineering in Retail with Mohammad Sabah, SVP of Engineering & Data at Thrive Market
#161 Fighting for Algorithmic Justice with Dr. Joy Buolamwini, Artist-in-Chief and President of The Algorithmic Justice League
#160 Adapting to the AI Era with Jason Feifer, Editor in Chief of Entrepreneur Magazine
#159 Building Trustworthy AI with Beena Ammanath, Global Head of the Deloitte AI Institute
#158 Building Human-Centered AI Experiences with Haris Butt, Head of Product Design at ClickUp
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Lex Fridman Podcast