Enterprise

OpenStack improves support for AI workloads

Comment

Portrait of a Caracal (Felis Caracal) laying down
Image Credits: Heinrich van den Berg / Getty Images

OpenStack allows enterprises to manage their own AWS-like private clouds on-premises. Even after 29 releases, it’s still among the most active open source projects in the world and this week, the OpenInfra Foundation that shepherds the project announced the launch of version 29 of OpenStack. Dubbed “Caracal,” this new release emphasizes new features for hosting AI and high-performance computing (HPC) workloads.

The typical OpenStack user is a large enterprise company. That may be a retailer like Walmart or a large telco like NTT. What virtually all enterprises have in common right now is that they’re thinking about how to put their AI models into production, all while keeping their data safe. For many, that means keeping total control of the entire stack.

OpenInfra Foundation CEOO Mark Collier
OpenInfra Foundation COO Mark Collier. Image Credits: Frederic Lardinois/TechCrunch
Image Credits: Frederic Lardinois/TechCrunch

As Nvidia CEO Jensen Huang recently noted, we’re at the cusp of a multitrillion-dollar investment wave that will go into data center infrastructure. A large chunk of that is investments by the large hyperscalers, but a lot of it will also go into private deployments — and those data centers need a software layer to manage them.

That puts OpenStack into an interesting position right now as one of the only comprehensive alternatives to VMware’s offerings, which is facing its own issues as many VMware users aren’t all that happy about its sale to Broadcom. More than ever, VMware users are looking for alternatives. “With the Broadcom acquisition of VMware and some of the licensing changes they’ve made, we’ve had a lot of companies coming to us and taking another look at OpenStack,” OpenInfra Foundation executive director Jonathan Bryce explained.

Image Credits: Frederic Lardinois/TechCrunch
Image Credits: Frederic Lardinois/TechCrunch

A lot of OpenStack’s growth in recent years was driven by its adoption in the Asia-Pacific region. Indeed, as the OpenInfra Foundation announced this week, its newest Platinum Member is Okestro, a South Korean cloud provider with a heavy focus on AI. But Europe, with its strong data sovereignty laws, has also been a growth market and the U.K.’s Dawn AI supercomputer runs OpenStack, for example.

“All the things are lining up for a big upswing and open source adoption for infrastructure,” OpenInfra Foundation COO Mark Collier told TechCrunch. “That means OpenStack primarily, but also Kata Containers and some of our other projects. So it’s pretty exciting to see another wave of infrastructure upgrades give our community some important work to complete for many years to come.”

In practical terms, some of the new features added to this release include the ability to support vGPU live migrations in Nova, OpenStack’s core compute service. This means users now have the ability to move GPU workloads from one physical server to another with minimal impact on the workloads, something enterprises have been asking for because they want to be able to manage their costly GPU hardware as efficiently as possible. Live migration for CPUs has long been a standard feature of Nova, but this is the first time it’s available for GPUs as well.

The latest release also brings a number of security enhancements, including rule-based access control for more core OpenStack services like the Ironic bare-metal-as-a-service project. That’s in addition to networking updates to better support HPC workloads and a slew of other updates. You can find the full release notes here.

A general view of atmosphere at the 7-Eleven 88th birthday celebration at 7-Eleven on July 10, 2015 in Burbank, California. Image Credits: Photo by Chris Weeks/Getty Images for 7-Eleven
Image Credits: Chris Weeks/Getty Images for 7-Eleven / Getty Images

This update is also the first since OpenStack moved to its “Skip Level Upgrade Release Process” (SLURP) a year ago. The OpenStack project cuts a new release every six months, but that’s too fast for most enterprises — and in the early days of the project, most users would describe the upgrade process as “painful” (or worse).

Today, upgrades are much easier and the project is also far more stable. The SLURP cadence introduces something akin to a long-term release version, where, on an annual basis, every second release is a SLURP release that’s easy to upgrade to, even as the teams still produce major updates on the original six-month cycle for those who want a faster cadence.

Throughout the years, OpenStack has gone through its up-and-down cycles in terms of perception. But it’s now a mature system and backed by a sustainable ecosystem — something that wasn’t necessarily the case at the height of its first hype cycle 10 years ago. In recent years, it found a lot of success in the telco world, which allowed it to go through this maturation phase and today, it may just find itself in the right place and time to capitalize on the AI boom, too.

More TechCrunch

The pharma giant won’t say how many patients were affected by its February data breach. A count by TechCrunch confirms that over a million people are affected.

Pharma giant Cencora is alerting millions about its data breach

Self-driving technology company Aurora Innovation is looking to raise hundreds of millions in additional capital as it races toward a driverless commercial launch by the end of 2024.  Aurora is…

Self-driving truck startup Aurora Innovation to sell up to $420M in shares ahead of commercial launch

Payments infrastructure firm Infibeam Avenues has acquired a majority 54% stake in Rediff.com for up to $3 million, a dramatic twist of fate for the 28-year-old business that was the…

Rediff, once an internet pioneer in India, sells majority stake for $3M

The ruling confirmed an earlier decision in April from the High Court of Podgorica which rejected a request to extradite the crypto fugitive to the United States.

Terraform Labs co-founder and crypto fugitive Do Kwon set for extradition to South Korea

A day after Meta CEO Mark Zuckerberg talked about his newest social media experiment Threads reaching “almost” 200 million users on the company’s Q2 2024 earnings call, the platform has…

Meta’s Threads crosses 200 million active users

TechCrunch Disrupt 2024 will be in San Francisco on October 28–30, and we’re already excited! Disrupt brings innovation for every stage of your startup journey, and we could not bring you this…

Connect with Google Cloud, Aerospace, Qualcomm and more at Disrupt 2024

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the…

A comprehensive list of 2024 tech layoffs

Intel announced it would layoff more than 15% of its staff, or 15,000 employees, in a memo to employees on Thursday. The massive headcount is part of a large plan…

Intel to lay off 15,000 employees

Following the recent lawsuit filed by the Recording Industry Association of America (RIAA) against music generation startups Udio and Suno, Suno admitted in a court filing on Thursday that it did, in…

AI music startup Suno claims training model on copyrighted music is ‘fair use’

In spite of a drop for the quarter, iPhone remained Apple’s most important category by a wide margin.

iPad sales help bail out Apple amid a continued iPhone slide

Molly Alter wears a lot of hats. She’s a mocumentary filmmaker working on a project about an alternate reality where charades is big business. She’s a caesar salad connoisseur and…

How filming a cappella concerts and dance recitals led Northzone’s newest partner Molly Alter to a career in VC

Microsoft has a long and tangled history with OpenAI, having invested a reported $13 billion in the ChatGPT maker as part of a long-term partnership. As part of the deal,…

Microsoft now lists OpenAI as a competitor in AI and search

The San Jose-based startup raised $60 million in a round that values it lower than the $500 million valuation it garnered in its most recent round, according to multiple sources.

Sequoia-backed Knowde raises Series C at a valuation cut

X (formerly Twitter) can no longer be accessed in the Mac App Store, suggesting that it has been officially delisted.  Searches for both “Twitter” and “X” on Apple’s platform no…

Twitter disappears from Mac App Store

Google Thursday said that it is introducing new Gemini-powered features for Chrome’s desktop version, including Lens for desktop, tab compare for shopping assistance, and natural language integration for search history.…

Google brings Gemini-powered search history and Lens to Chrome desktop

When Xiaoyin Qu was growing up in China, she was obsessed with learning how to build paper airplanes that could do flips in the air. Her parents, though, didn’t have…

Heeyo built an AI chatbot to be a billion kids’ interactive tutor and friend

While the company was awarded a massive, $4.2 billion contract to accelerate Starliner development in 2014, it was structured as a “fixed-price” model.

Boeing bleeds another $125M on Starliner program, bringing total losses to $1.6B

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Summer road…

Anthony Levandowski bets on off-road autonomy, Nuro plots a comeback and Applied Intuition gets more investor love

Google’s new features include Gemini in BigQuery and Looker to help users with data engineering and analysis.

Google Cloud expands its database portfolio with new AI capabilities

Rad Power Bikes, the Seattle-based e-bike startup that has raised more than $300 million from investors, went through another round of layoffs in July, TechCrunch has exclusively learned. This is…

VC darling Rad Power Bikes hit with another round of layoffs

Five years ago, as robotaxis and self-driving truck startups were still raking in millions in venture capital, Anthony Levandowski turned to off-road autonomy. Now, that decision — which brought the…

Why Anthony Levandowski returned to his off-road autonomous vehicle roots with AV startup Pronto

Commercial space station company Vast is building a private microgravity research lab as part of its wider Haven-1 station plans. The module is set to launch no earlier than the…

Vast plans microgravity lab on its Haven-1 private space station

Google Cloud is giving Y Combinator startups access to a dedicated, subsidized cluster of Nvidia graphics processing units and Google tensor processing units to build AI models. It’s part of…

Google Cloud now has a dedicated cluster of Nvidia GPUs for Y Combinator startups

StackShare is one of the more popular platforms for developers to discuss, track, and share the tools they use to build applications.

Open source startup FOSSA is buying StackShare, a site used by 1.5M developers

Featured Article

Indian startups gut valuations ahead of IPO push

Ola Electric and FirstCry are set to test investor appetite with public listing, both pricing their shares below their previous valuation asks.

Indian startups gut valuations ahead of IPO push

The European Union’s risk-based regulation for applications of artificial intelligence has come into force starting from today.

The EU’s AI Act is now in force

The company also said it has received regulatory clearance to start Phase 2 clinical trials for a new drug in the U.S. later this year.

Healx, an AI-enabled drug discovery platform for rare diseases, raises $47M

The European Commission (EC) has given the go-ahead to HPE’s planned megabucks acquisition of Juniper Networks.

EU greenlights HPE’s $14B Juniper Networks acquisition

Meta, which develops one of the biggest foundational open source large language models, Llama, believes it will need significantly more computing power to train models in the future. Mark Zuckerberg…

Zuckerberg says Meta will need 10x more computing power to train Llama 4 than Llama 3

Axle Energy is a B2B, back-end infrastructure business focused on connecting flexible assets, such as electric vehicles and home batteries, to energy markets that aren’t otherwise available for consumers to…

Axle Energy’s sprint to decarbonize the grid lights up with $9M seed led by Accel