Powering The Future: Meet The Scaling Energy Demands Of Generative AI

  • 📰 ForbesTech
  • ⏱ Reading Time:
  • 32 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 16%
  • Publisher: 59%

Marc Bolitho Notizia

Italia Ultime Notizie,Italia Notizie

Marc Bolitho is the CEO of Recogni, developer of AI-based inference processing solutions for Gen AI and intelligent autonomous platforms. Read Marc Bolitho's full executive profile here.

The massive increase in data center power consumption to support generative AI technology including Large Language Models is challenging America’s electrical grid in ways not seen since the

However, others are taking a more novel approach to the problem, focusing instead on increasing efficiencies by lowering the power consumption of generative AI inference operations. These factors make retrofitting existing data centers a challenge as the existing power infrastructure only supports a quarter of the GPUs as it would CPUs. Such retrofits require additional hardware and cooling system installations, and potentially engineering work on the building itself. The center’s networking requirements will also increase due to added traffic load from the increased compute capacity.and to maintain response accuracy.

 

Grazie per il tuo commento. Il tuo commento verrà pubblicato dopo essere stato esaminato.
Abbiamo riassunto questa notizia in modo che tu possa leggerla velocemente. Se sei interessato alla notizia puoi leggere il testo completo qui. Leggi di più:

 /  🏆 318. in İT

Italia Ultime Notizie, Italia Notizie

Similar News:Puoi anche leggere notizie simili a questa che abbiamo raccolto da altre fonti di notizie.

Powering the future with new-age microinvertersDiscover the game-changing technology of Hoymiles microinverters, revolutionizing solar energy with advanced features, and global recognition.
Fonte: IntEngineering - 🏆 287. / 63 Leggi di più »