Managed Services Become Critical to Neocloud Success as GPU Providers Scale

The proliferation of neoclouds has accelerated as artificial intelligence labs and enterprises seek access to dedicated graphics processing unit resources, yet launching a cluster represents only the initial phase of the challenge. For emerging providers operating at smaller scales, the availability of managed services from hardware manufacturers has become a determining factor in whether that infrastructure remains functional and generates returns following its initial deployment.

Specialized AI infrastructure providers are establishing themselves as distinct players operating in parallel with major cloud providers, particularly in markets where regulatory frameworks mandate specific data residency and governance structures. Smaller operators cannot independently manage every component of a sophisticated GPU infrastructure deployment, according to Tom Richer, executive vice president of Alpha Compute Corp.

You can cobble together a lot of different providers, but then when stuff goes wrong, the finger-pointing starts. You just want that integrated solution provider who can ensure success, help you with all of the build-out, then all of the … managed services to keep it going healthy and to keep everything performing in line with [service-level agreements].

Tom Richer, Alpha Compute Corp

Richer shared his perspective during an exclusive conversation with theCUBE Research's Dave Vellante at the Dell Technologies New York Symposium, broadcast through theCUBE, SiliconANGLE Media's livestreaming platform. The discussion covered managed service frameworks, sovereign AI infrastructure architecture and financing mechanisms for neocloud operations.

Managed services support anchors a sovereign neocloud

Alpha Compute entered the AI infrastructure sector less than one year ago, transitioning from its origins in digital assets, and now specializes in sovereign and confidential computing built on Dell Technologies Inc. and Intel Corp. platforms. The company's methodology, termed sovereign by design, begins at the processor level and maintains data within national borders for organizations operating under regulations including the EU AI Act and the General Data Protection Regulation, Richer noted.

We start with the hardware. Think of a stack. All the way down to the chip level, we are creating enclaves. We're a Dell partner, so we use Dell technology as well as Intel technology.

Tom Richer, Alpha Compute Corp

The infrastructure stack is already operational in production environments. Alpha Compute's 72-node cluster in St. Louis combines Nvidia Blackwell systems supplied by Dell with InfiniBand connectivity and direct liquid cooling housed within a converted industrial data center facility. The company has announced intentions to establish additional Blackwell clusters and secured a binding term sheet for a $31.9 million nonrecourse loan facility backed by Nvidia B300 hardware.

There's kind of a trinity there, though. You need the off-taker, a good off-taker. But also you need that kind of land, power [and] shell.

Tom Richer, Alpha Compute Corp

Following cluster activation, Alpha Compute maintains direct ownership of customer relationships, with support tickets, problem resolution and equipment replacements flowing through a collaborative team structure with Dell, which has positioned AI factories as a cornerstone of its enterprise strategy. Alpha Compute's current client base consists primarily of AI research organizations seeking comprehensive management of infrastructure layers beneath the operating system. Enterprise customers are anticipated to require expanded service offerings, according to Richer.

With Dell as our managed services partner, we can go above the [operating system] on day two. The powerful thing with Dell and their integrated approach is we can go to any level.

Tom Richer, Alpha Compute Corp

The scope of managed services support also influences Richer's perspective on how neoclouds will position themselves competitively. Rather than displacing public cloud infrastructure, specialized providers offering isolated environments without shared resource contention will assume responsibility for the most computationally intensive and confidential GPU applications, he suggested.

https://www.youtube.com/embed/U1BWDVkIvek?feature=oembed

I really see neoclouds now accompanying and fusing with public cloud for enterprise choices in that hybrid manner. For those superintelligence workloads that are really demanding, enterprises can send those sensitive, intense high-performance computing workloads over to the neocloud, so they can work in concert.

Tom Richer, Alpha Compute Corp