- Larger data centers could drive costs to between $10 billion and $25 billion in five years
- Demand for upstream components could rise 30% or more by 2026, creating next chip shortage
- “Sovereign AI” and enterprise concerns on cost and data privacy create opportunities for small language models
SAN FRANCISCO, Sept. 25, 2024 /PRNewswire/ — The market for AI-related hardware and software is expected to grow between 40% and 55% annually, reaching between $780 billion and $990 billion by 2027, according to new research released today by Bain & Company.
The fifth annual Global Technology Report provides insights on the new waves of growth in the technology sector as a result of disruptions from the fast-changing AI advancements. Three areas of opportunities – bigger models and larger data centers, enterprise and sovereign AI initiatives, and software efficiency and capabilities – could enable the AI hardware and software market to come close to a trillion-dollar industry in the next three years.
“Generative AI is the prime mover of the current wave of change, but it is complicated by post-globalization shifts and the need to adapt business processes to deliver value. Companies are moving beyond the experimentation phase and are beginning to scale generative AI across the enterprise. As they do, CIOs will need to maintain production-grade AI solutions that will enable companies to adapt to a landscape that is quickly shifting. Essentially, they need to adopt an ‘AI everywhere’ approach,” said David Crawford, chairman of Bain’s Global Technology practice.
As AI scales, so will data centers; industry could face next wave of chip shortage
AI workloads could grow 25% to 35% per year through 2027, Bain estimates. As AI scales, the need for computing power will radically expand the scale of large data centers over the next five to 10 years. AI will spur growth in data centers, from today’s 50–200 megawatts to more than a gigawatt, Bain reports. This means that if large data centers cost between $1 billion and $4 billion today, they could cost between $10 billion and $25 billion five years from now. These changes are expected to have huge implications on the ecosystems that support data centers including infrastructure engineering, power production, and cooling, as well as strain supply chains.
In addition to the need for more data centers, the AI-driven surge in demand for graphics processing units (GPUs) could increase total demand for certain upstream components by 30% or more by 2026, Bain predicts. Just as the pandemic created a surge in PC demand, surging demand for AI computing power will strain supply chains for data center chips, personal computers, and smartphones. These trends, when paired with geopolitical tensions, could trigger the next shortage of semiconductors, Bain warns. If data center demand for current-generation GPUs were to double by 2026, not only would suppliers of key components need to increase their output, but makers of chip packaging components would need to nearly triple their production capacity to keep up with demand.
Emergence of sovereign AI presents both challenges and opportunities
Another area that Bain says will add an additional layer of complexity for technology companies is the emergence of “sovereign” AI blocs. The post-globalization movement in technology is spreading from the pandemic-era chip shortage to current data, security, and AI privacy concerns. Governments worldwide—including Canada, France, India, Japan, and the United Arab Emirates— are spending billions of dollars to subsidize sovereign AI. They’re investing in domestic computing infrastructure and AI models developed within their borders and trained on local data. As the sovereign AI push picks up steam, those who emerge as leaders will be based on several determining factors.
“Establishing successful sovereign AI ecosystems will be time-consuming and incredibly expensive,” said Anne Hoecker, head of Bain’s Global Technology practice. “While less complex in some ways than building semiconductor fabs, these projects require more than securing local subsidies. Hyperscalers and other big tech firms may continue to invest in localized AI operations that will ensure significant competitive advantages.”
Similarly, as enterprises face rising challenges in managing suppliers, protecting data, and controlling total cost of ownership, small language models with algorithms that use RAG (retrieval-augmented generation) and vector embeddings (numeric representations of data) could see demand increase as these handle a lot of the computing, networking, and storage tasks close to where the data is stored.
More efficient software development needed to drive value
The arrival of generative AI has added pressure on software development companies to demonstrate greater efficiency. Generative AI appears to save about 10% to 15% of total software engineering time, according to Bain’s survey of more than 200 companies from across industries. However, most companies aren’t making the most of these savings, Bain found.
“When implemented properly, generative AI could result in efficiency gains of 30% or more,” said Roy Singh, global head of Bain’s Advanced Analytics practice. “Using generative AI to achieve meaningful improvements in software development is possible but requires efforts that stretch beyond the introduction of coding assistants. When it comes to AI deployment, engineering teams should drive end-to-end efficiencies by incorporating other advanced techniques such as static analysis and covering the full software development lifecycle including product management, refactoring, code reviews, testing and build/release management.”
The above pressures come as software companies see slows in revenue growth. The median annual revenue growth for a group of about 90 publicly traded software-as-a-service (SaaS) companies declined by 16 percentage points in the last two years, Bain’s analysis shows. As growth slowed, SaaS companies significantly scaled back spending on sales and marketing, while spending on R&D has proved more robust. Software companies’ sales and marketing budgets have shrunk from 41% of revenue in 2022 to 33% of revenue in 2024, while spending on R&D shrunk by just 3 percentage points declining from 21% to 18% of revenue during the same period.
Software companies will need to ensure they’re producing what customers need, make the most of their R&D spend, and rein in inflating operating expenses. Software vendors, on the other hand, should be more disciplined in deciding what to build and sell, and be clearer about their product strategy.
M&A in tech becomes more unpredictable
Bain’s research shows that persistent regulatory obstacles have prompted tech companies to shift their M&A activity away from deals intended to capture scale and toward deals intended to acquire access to new capabilities, products, or markets—which Bain refers to as “scope deals.” From 2015 to 2018, the percentage of tech industry scope deals increased from 50% to 80%, holding steady ever since. Over the past six years, scope deals have accounted for nearly 80% of all tech industry M&A. That’s a bigger share than in most other industries. Bain’s research shows that tech is still heavily scrutinized and there’s no sign that the popularity of tech scope deals will give way to a return to massive scale deals any time soon. If anything, M&A in the industry has become more unpredictable, Bain concludes.
“The technology sector is no stranger to disruptions, and as a result, we are used to seeing massive changes across the industry leaderboard every 10 years. Recently, however, the most valuable technology companies have shown remarkable resilience, holding spots at the top for many years and expanding their share of market value. Their success relies on their ability to identify disruptive trends and successfully scale and commercialize them, creating ‘winner takes most’ dynamics. For this decade, whoever masters the AI disruption will win big,” concluded Crawford.
Other topics covered in this year’s report include areas where generative AI is already delivering, and why some software companies are seeing drops in customer success.
Media contacts
To arrange an interview or for any questions, please contact:
Dan Pinkney (Boston) — Email: dan.pinkney@bain.com
Gary Duncan (London) — Email: gary.duncan@bain.com
Ann Lee (Singapore) — Email: ann.lee@bain.com
About Bain & Company
Bain & Company is a global consultancy that helps the world’s most ambitious change makers define the future.
Across 65 cities in 40 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition, and redefine industries. We complement our tailored, integrated expertise with a vibrant ecosystem of digital innovators to deliver better, faster, and more enduring outcomes. Our 10-year commitment to invest more than $1 billion in pro bono services brings our talent, expertise, and insight to organizations tackling today’s urgent challenges in education, racial equity, social justice, economic development, and the environment. We earned a platinum rating from EcoVadis, the leading platform for environmental, social, and ethical performance ratings for global supply chains, putting us in the top 1% of all companies. Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry.
SOURCE Bain & Company