PolyThrottle: Energy-efficient Neural Network Inference on Edge Devices: Experimental Results

  • 📰 hackernoon
  • ⏱ Reading Time:
  • 22 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 12%
  • Publisher: 51%

Energy Energy Headlines News

Energy Energy Latest News,Energy Energy Headlines

This paper investigates how the configuration of on-device hardware affects energy consumption for neural network inference with regular fine-tuning.

This paper is available on arxiv under CC BY-NC-ND 4.0 DEED license. Authors: Minghao Yan, University of Wisconsin-Madison; Hongyi Wang, Carnegie Mellon University; Shivaram Venkataraman, myan@cs.wisc.edu. Table of Links Abstract & Introduction Motivation Opportunities Architecture Overview Proble Formulation: Two-Phase Tuning Modeling Workload Interference Experiments Conclusion & References A. Hardware Details B. Experimental Results C. Arithmetic Intensity D.

These results underline the interesting observation that the energy consumption patterns vary for the same model operating on different devices. Furthermore, even for the same model device pairing, the optimization landscape can be significantly influenced by the batch size. This underlines the complexities of energy optimization and the need for an adaptive framework that can take these factors into account.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 532. in ERROR

Energy Energy Latest News, Energy Energy Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Using Machine Learning & Neural Networks to Maximize Solar Energy GloballyOther ways to generate solar energy that just trying to make solar cells efficient potential of luminescent solar concentration
Source: cleantechnica - 🏆 565. / 51 Read more »

CPS Energy progressing towards cleaner energy goals; set to shut down older plantsSAN ANTONIO- Cleaner energy: that's the goal cps energy is working toward -- by closing down coal and older natural gas plants. CPS energy announced they will b
Source: News4SA - 🏆 251. / 63 Read more »

Yellen: Pushing Green Energy to Lower Energy Costs ‘Over Time’ Is Key Part of Fighting InflationSource of breaking news and analysis, insightful commentary and original reporting, curated and written specifically for the new generation of independent and conservative thinkers.
Source: BreitbartNews - 🏆 610. / 51 Read more »

$22 Million to Improve Siting & Permitting for Large-Scale Renewable Energy & Energy StorageInvests $22 Million to Improve Siting and Permitting for Large-Scale Renewable Energy and Energy Storage in NC
Source: cleantechnica - 🏆 565. / 51 Read more »

$50 Million for Tribal Clean Energy Projects: Funding Doubled, Now Available for Clean Energy Technology DeploymentFOA Update: DOE Doubles Funding to $50 Million for Tribal Clean Energy Projects, FOA Update: DOE Doubles Funding to $50 Million
Source: cleantechnica - 🏆 565. / 51 Read more »