Utilizing Tech: The Podcast Series About Emerging Technology

08x12: Revolutionizing Data Infrastructure for AI with WEKA

Fore more episodes: https://www.utilizingtech.com/Storage software running on modern hardware can deliver incredible performance and capability to support AI applications. This episode of Utilizing Tech wraps up our season with a discussion of WEKA's data platform for AI with Alan McSeveney, Scott Shadley of Solidigm, and host Stephen Foskett. Modern hardware is capable of incredible performance, but bottlenecks remain. The limiting factor for AI processors is memory capacity: GPUs are hungry for data and must be refreshed from storage quickly enough to keep them running at scale. Storage can also be used to share data between GPUs across the data center and to cache working data to accelerate calculation. The secret to scalability, from storage to applications to AI, is distribution and parallel processing. Modern software runs at incredible scale, and all elements of the stack must match. Technologies like Kubernetes allow applications to use huge clusters of workers all contributing to scale and performance. WEKA runs this way, matching the GPU clusters and web applications we rely on today.Guest: Alan McSeveney, Field CTO of Media and Entertainment, WEKAHosts: ⁠⁠⁠Stephen Foskett⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠Solidigm⁠⁠⁠ ⁠⁠⁠Scott Shadley⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠Solidigm⁠⁠⁠Follow Tech Field Day ⁠⁠⁠on LinkedIn⁠⁠⁠, ⁠⁠⁠on X/Twitter,⁠⁠⁠ ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠. Visit the ⁠⁠⁠Tech Field Day website⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠the dedicated website⁠⁠⁠ and follow the show ⁠⁠⁠on X/Twitter⁠⁠⁠, ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠.

08x11: Long Live Immersion Cooled Servers with Hypertec

More episodes and seasons of Utilizing Tech: https://utilizingtech.com/Immersion cooling requires specialized servers designed to operate submerged in a tank of coolant, but there are many benefits. In this episode of Utilizing Tech, sponsored by Solidigm, we continue our conversation on immersion cooling with Patrick Scateni of Hypertec, the leading manufacturer of immersion-cooled servers. Most of the current demand for immersion cooling is in the datacenter, but edge computing is rapidly adopting this technology thanks to the demands of AI applications. Hypertec calls their servers immersion born, since they are designed for this specific application rather than being modified for use in a coolant tank. Sustainability is growing in importance and immersion cooled solutions are much more power efficient, much closer to a PUE of 1 compared to 1.5 for a conventional air-cooled server. It also uses no water, while air-cooled data centers often use evaporative cooling equivalent to an olympic-sized pool every day or two. Immersion cooled servers can be packed closer, enabling smaller datacenters, and are cheaper, more reliable, and longer-lived than conventional equipment.Guest: Patrick Scateni, VP of Global Sales at HypertecHosts: ⁠⁠⁠Stephen Foskett⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠Solidigm⁠⁠⁠ ⁠⁠⁠Scott Shadley⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠Solidigm⁠⁠⁠Follow Tech Field Day ⁠⁠⁠on LinkedIn⁠⁠⁠, ⁠⁠⁠on X/Twitter,⁠⁠⁠ ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠. Visit the ⁠⁠⁠Tech Field Day website⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠the dedicated website⁠⁠⁠ and follow the show ⁠⁠⁠on X/Twitter⁠⁠⁠, ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠.

08x10: Cooling at the Edge with DUG

More episodes and seasons of Utilizing Tech: https://utilizingtech.com/Modern AI servers generate a lot of heat, but the industry is ready with revolutionary technologies like immersion cooling. This episode of Utilizing Tech features Micah Jordan from DUG, discussing specialized server solutions with Jeniece Wnorowski of Solidigm and Stephen Foskett. Although it sounds exotic, companies like DUG have been using immersion cooling for decades. Once they proved the value of the technology in their own datacenter, DUG began delivering immersion cooled containers wherever they are needed, especially at the edge. This uniform and efficient cooling allows servers to work harder while also extending their lifespan and reducing the risk of component failure. DUG’s containerized AI racks are being deployed around the world closer to users, lowering the latency and enabling rapid response to demands. DUG is working with partners like Hypertec to build, certify, and support immersion cooling for end customers, achieving higher density and lower energy consumption. Guest: Micah Jordan, Account Executive at DUGLinkedIn: https://www.linkedin.com/in/micah-jordan1/Hosts: ⁠⁠⁠Stephen Foskett⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠Solidigm⁠⁠⁠ ⁠⁠⁠Scott Shadley⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠Solidigm⁠⁠⁠Follow Tech Field Day ⁠⁠⁠on LinkedIn⁠⁠⁠, ⁠⁠⁠on X/Twitter,⁠⁠⁠ ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠. Visit the ⁠⁠⁠Tech Field Day website⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠the dedicated website⁠⁠⁠ and follow the show ⁠⁠⁠on X/Twitter⁠⁠⁠, ⁠⁠⁠on Bluesky⁠⁠⁠, and ⁠⁠⁠on Mastodon⁠⁠⁠.

08x09: Building Data Driven AI Applications with Metrum AI

As enterprises roll out production applications using AI model inferencing, they are finding that they are limited by the amount of memory that can be addressed by a GPU. This episode of Utilizing Tech features Steen Graham, founder of Metrum AI, discussing modern RAG and agentic AI applications with Ace Stryker and Stephen Foskett. Achieving the promise of AI requires access to data, and the memory required to deliver this is increasingly a focus of AI infrastructure providers. Technologies like DiskANN allow workloads to be offloaded to solid-state drives rather than system memory, and this surprisingly results in better performance. Another idea is to offload a large AI model to SSDs and deploy larger models on lower-cost GPUs, and this is showing a great deal of promise. Agentic AI in particular can be run in an asynchronous model, enabling them to take advantage of lower-spec hardware including older GPUs and accelerators, reduced RAM capacity and performance, and even all-CPU infrastructure. All of this suggests that AI can be run with less financial and power resources than generally assumed.Guest: Steen Graham is the Founder and CEO of Metrum AI. You can connect with Steen on LinkedIn and learn more about Metrum AI on their website.Guest Host: Ace Stryker is the Director of Product Marketing at Solidigm. You can connect with Ace on LinkedIn and learn more about Solidigm and their AI efforts on their dedicated AI landing page or watch their AI Field Day presentations from the recent event.Hosts:⁠⁠⁠⁠Stephen Foskett⁠⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠⁠Solidigm⁠⁠⁠⁠ ⁠⁠⁠⁠Scott Shadley⁠⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠⁠Solidigm⁠⁠⁠⁠Follow Tech Field Day ⁠⁠⁠⁠on LinkedIn⁠⁠⁠⁠, ⁠⁠⁠⁠on X/Twitter,⁠⁠⁠⁠ ⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠, and ⁠⁠⁠⁠on Mastodon⁠⁠⁠⁠. Visit the ⁠⁠⁠⁠Tech Field Day website⁠⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠⁠the dedicated website⁠⁠⁠⁠ and follow the show ⁠⁠⁠⁠on X/Twitter⁠⁠⁠⁠, ⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠, and ⁠⁠⁠⁠on Mastodon⁠⁠⁠⁠.

08x08: Spreading Standards and Ideas with Dr. J Metz

Standards bodies don't just set technical specifications, they also drive greater understanding of topics like storage. This episode of Utilizing Tech, brought to you by Solidigm, features Dr. J Metz, Chair of SNIA and the Ultra Ethernet Consortium and technical director at AMD. Over decades of advancement, enterprise storage has evolved to be a central requirement of modern systems, especially where AI is concerned. And storage is a lot more than just capacity: It's about performance and power, connectivity and throughput, availability and reliability. Standards bodies like SNIA and UEC help raise awareness of these requirements while also setting standards to address them. Technological developments made in one area often have unexpected applications in others. This makes it even more important to foster open communication to enable ideas to spread.Host:J Metz is the Chair of both the Ultra Ethernet Consortium and SNIA, as well as a Technical Director at AMD. You can connect with J on LinkedIn or on X/Twitter. Learn more about The Ultra Ethernet Consortium on their website. Learn more about SNIA on their website. Learn more about AMD here.Hosts: ⁠⁠⁠⁠Stephen Foskett⁠⁠⁠⁠, President of the Tech Field Day Business Unit and Organizer of the ⁠⁠⁠⁠Tech Field Day Event Series⁠⁠⁠⁠⁠⁠⁠⁠Jeniece Wnorowski⁠⁠⁠⁠, Head of Influencer Marketing at ⁠⁠⁠⁠Solidigm⁠⁠⁠⁠ ⁠⁠⁠⁠Scott Shadley⁠⁠⁠⁠, Leadership Narrative Director and Evangelist at ⁠⁠⁠⁠Solidigm⁠⁠⁠⁠Follow Tech Field Day ⁠⁠⁠⁠on LinkedIn⁠⁠⁠⁠, ⁠⁠⁠⁠on X/Twitter,⁠⁠⁠⁠ ⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠, and ⁠⁠⁠⁠on Mastodon⁠⁠⁠⁠. Visit the ⁠⁠⁠⁠Tech Field Day website⁠⁠⁠⁠ for more information on upcoming events. For more episodes of Utilizing Tech, head to ⁠⁠⁠⁠the dedicated website⁠⁠⁠⁠ and follow the show ⁠⁠⁠⁠on X/Twitter⁠⁠⁠⁠, ⁠⁠⁠⁠on Bluesky⁠⁠⁠⁠, and ⁠⁠⁠⁠on Mastodon⁠⁠⁠⁠.