Momentum Shift: Private AI in the Enterprise

Welcome to the sixth episode of the Virtually Speaking Podcast's VCF 9 series! In this installment, hosts Pete Flecha and John Nicholson explore "Momentum Shift: Private AI in the Enterprise" with Chris Wolf, Global Head of AI and Advanced Services.

 

Key Highlights:

• VMware's explosive momentum in Private AI services
• Key AI use cases for enterprises:

  - GPU as a Service with intelligent resource provisioning

  - Back-office contact center efficiency (10-35% productivity gains)

  - Enterprise document search (50-60% productivity improvements)

  - AI-assisted software development and test case automation

 

• VCF 9 AI-specific innovations:

  - Full support for VLLM open-source inference engine

  - OpenAI compatible API gateway

  - Token rate limiting to prevent resource overload

  - Data indexing and retrieval service

  - AI agent builder

  - vGPU reservations and intelligent GPU load balancing

  - Automated AI workload deployment (setup in under an hour)

 

• Strategic Partnerships:

  - Expanded collaboration with Microsoft Azure

  - Hybrid AI approach (build in cloud, deploy at edge)

  - Significant cost savings (3-5x cheaper than public cloud alternatives)

 

Join us as we dive into the transformative Private AI capabilities of VMware Cloud Foundation 9 in this exciting podcast series.