Firmus: Half-Yearly Highlights

Our commitment to sustainable technology has recently garnered significant attention, underscoring our achievements and the transformative role we're playing in the industry.

28 June 2024Behind The Scenes
Firmus: Half-Yearly Highlights

At Firmus, we’re dedicated to making a meaningful impact in AI through our groundbreaking platform, Sustainable Metal Cloud (SMC). Our commitment to sustainable technology has recently garnered significant attention, underscoring our achievements and the transformative role we’re playing in the industry. The first half of 2024 has shown us that our efforts are not just about cutting-edge technology but also about making a positive environmental impact. As we expand our footprint across Asia and globally, we remain committed to our mission of leading the AI revolution sustainably.

Some of our highlights so far include:

World-first MLPerf Training power consumption results

SMC has set a new benchmark in the industry by publishing the first-ever comprehensive power consumption data alongside performance results in the MLPerf Training benchmark. Utilizing our proprietary single-phase immersion platform, we achieved remarkable energy efficiency, training the GPT-3 175B model with 512 NVIDIA H100 Tensor Core GPUs while consuming only 468 kWh of total energy.

Consultation with Tony Blair Institute for Global Change

We are honoured to have been consulted by the Tony Blair Institute for Global Change. Our insights, provided by Tim Rosenfield, co-CEO of SMC, contributed to the institute’s policy agenda on practical solutions to manage the energy demands of the growing AI sector. This collaboration highlights the critical intersection of AI development and energy sustainability.

Sustainable AI Infrastructure Presentation at ATxSG24

Our Chairman, Edward (Ted) Pretty, joined delegates from NVIDIA, The World Bank, Alibaba Cloud, and the Tony Blair Institute for Global Change on stage at ATxSG24 to debate ‘Godzilla vs Kong – The Sustainability & Compute Showdown!’

Ted emphasized, “In the next couple of years, it is predicted that in the US, data centres will consume 9% of the energy grid. In some countries, it is already 15%.” Highlighting the significance of sustainable practices, he asked, “What if you could have a technology that could give 150MW of that back to the nation? What if we could give power back and at the same time reduce our carbon footprint by 50%?” Ted concluded, “That’s what our business is. We consider ourselves right in the center of solving these problems today—reducing energy consumption today.”

Hypercube Update

Our infrastructure arm consists of 700 people across the globe currently installing the world’s first fleet of Sustainable AI Factories – the HyperCube. HyperCube employs advanced cooling technology that dramatically cuts energy consumption when hosting and delivering AI GPU clusters by up to 50% with current generation H100 HGX GPUs. SemiAnalysis predicts AI will propel data centres to use 4.5% of global energy generation by 2030. We’re scaling sustainably to counteract this.

Panelists at NVIDIA GTC 2024

We shared insights on sustainable AI infrastructure with our partners NVIDIA, Deloitte, and WEKA in San Jose at two different panels that we were part of. We’re thrilled we get to continue these collaborations, through direct work with our partners.

 

Driving Forward

Join us in our journey to create a future where AI and sustainability go hand in hand. We’re incredibly proud of how 2024 is shaping up and look forward to the second half.