Join the 155,000+ IMP followers

electronics-journal.com

Broadcom Announces VMware AI Factory

New AI Infrastructure Automation and Private AI Services Deliver a Single Consistent Environment for Deploying, Governing, and Securing AI Workloads from Bare Metal to Inference.

  www.broadcom.com
Broadcom Announces VMware AI Factory

Broadcom announced the launch of VMware AI Factory, providing enterprises with an automated, software-defined architecture to deploy and manage production-ready artificial intelligence workloads on-premises. The platform brings AI applications directly to private enterprise data stores, reducing deployment timelines from bare-metal configuration to first-model inference from weeks to hours.

Automated Infrastructure Provisioning and Private AI Services
VMware AI Factory integrates hardware and software lifecycle management into VMware Cloud Foundation (VCF), pooling and sharing hardware accelerator capacity across business units to optimize compute efficiency and resource utilization:
  • Multi-Tenant Model Sharing: Enables secure sharing of models across business lines via isolated namespaces, preventing redundant model deployments and reclaiming unused GPU capacity.
  • AI Gateway: Unifies governance across local and multi-cloud footprints through a centralized interface offering intelligent prompt routing, token consumption rate-limiting, and application authorization.
  • Secure AI Sandboxes: Provides isolated containerized execution environments to contain dynamic agent-generated code, enforcing policy-driven access controls and output validation before execution.
  • Unified Model Gallery: Equips IT and data science teams with a single management console to orchestrate inference and retrieval-augmented generation (RAG) pipelines across virtual machines and containers, backed by observability into token throughput, latency, and memory utilization.
  • Model Ecosystem Support: Supports on-premises deployment of over 150 commercial and open-source models, including Nemotron 3, Gemma 4, cotomi, Qwen, and GLM 5.2.
Hardware Ecosystem and Bare-Metal Automation
Broadcom announced an integration with MetalSoft to incorporate heterogeneous bare-metal provisioning directly into the VCF management console, allowing IT administrators to provision and repave multi-vendor physical servers in minutes without vendor-specific management tools.

The platform supports certified hardware architectures including Dell PowerEdge systems and VCF AI ReadyNodes from Cisco, Lenovo, and Supermicro. Additionally, Broadcom is collaborating with AMD to integrate VCF with AMD Instinct GPUs and the open AMD ROCm software stack, leveraging zero-touch provisioning to orchestrate everything from vSphere and vSAN to Kubernetes, the AMD GPU operator, and AMD DVX drivers for virtualized GPU attachment.

Edited by Romila DSilva, Induportals Editor, with AI assistance.

www.broadcom.com

  Ask For More Information…

LinkedIn
Pinterest

Join the 155,000+ IMP followers