article thumbnail

Don’t be fooled by the size of Microsoft’s 1-Bit LLM

Dataconomy

The computational efficiency of 1-bit LLMs also leads to lower energy consumption, making them more environmentally friendly and cost-effective to operate. Less computing power equals less energy used. adopts components similar to those found in the popular LLaMA model architecture. Featured image credit : Freepik.

article thumbnail

4 paths to sustainable AI

CIO Business Intelligence

Concerns that AI contributes to global warming stem from estimates that GPUs used to develop and keep AI models running use four times as much energy as those serving conventional cloud applications, and that AI could be on track to use as much electricity as Ireland. We see it as a recruiting and retention factor.” Our theory is no.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Groq sparks LPU vs GPU face-off

Dataconomy

This week, Groq’s LPU astounded the tech community by executing open-source Large Language Models (LLMs) like Llama-2, which boasts 70 billion parameters, at an impressive rate of over 100 tokens per second. Their high-performance endeavors come at the cost of substantial energy consumption, posing challenges in power efficiency.

Energy 91
article thumbnail

Technology News and Hot Topics

CTOvision

About two years ago, we began investigating magnetic field architecture (MFA) and hover technology as a better way to build, move people and move materials,” said Arx Pax founder Greg Henderson. Steve Jobs once called the personal computer “a bicycle for our minds,” a tool that helps us go farther with the same amount of energy.

Big Data 272
article thumbnail

Emerging Technologies To Power Your Systems Of Insight

Forrester IT

In that report we defined a system of insight , which focused big data energy on implementing insights in software using closed loops that create action and continous learning. Open source and cloud have made it so easy for vendors to combine these technologies into a platform - but things don't stop there.

System 150
article thumbnail

Why AI and automation are critical for assuring smart services

TM Forum

Industrial sectors, including manufacturing, mining and energy production, are undergoing digital transformation to improve decision-making and to automate processes. The diversity in terms of open source and vendor proprietary technologies as the list of technology enablers grows.

article thumbnail

Nvidia H200: An AI-focused computing platform

Dataconomy

This latest innovation from Nvidia is tailored to power supercomputers that drive generative AI models, showcasing the prowess of the Nvidia Hopper architecture. It achieves this with improved energy efficiency and a more economical total ownership cost. What does Nvidia H200 offer? terabytes per second.