Flexential CIO Jason Carolan Unpacks the Data Center Industry’s NVIDIA Moment

For this episode of the DCF Show podcast, we interview Jason Carolan, Chief Innovation Officer at data center operator Flexential. He’s a 25-year expert in the enterprise IT industry, with experience leading companies through technological evolutions like the one we’re experiencing right now. 

Carolan believes there is a bigger story to uncover from the sheer dollar amount of Nvidia’s recent blockbuster valuation. In response to Nvidia’s market dominance in AI and data centers, Carolan wanted to discuss larger trends that may follow from this specific news moment. 

According to Carolan:  “Nvidia's earnings results and forecasts for a continued AI boom doesn't come as too much of a surprise with the volume of businesses that are increasingly testing and utilizing the technology.

Nvidia's data center business is a combination of GPU and their network technologies, which further showcases the importance of high performance architectures that can support next generation AI demands. The company is currently forecasted to ship 4-5 times more GPUs this coming year – indicating another trend line with little competition in sight. 

As inference matures, we will see more diversity in chip suppliers but that is a ways off. The bottom line is that, now with accelerating AI rollouts, companies will need more compute capacity, ultra-high bandwidth and very low latency in order to succeed.”