Thursday, March 4, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Machine Learning

AI algorithms ‘outpace Moore’s law’ • The Register

May 7, 2020
in Machine Learning
AI algorithms ‘outpace Moore’s law’ • The Register
586
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

ML eggheads, devs get more bang for their buck, say OpenAI duo

Oh well Gordon, never mind

You might also like

Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making

Companion Raises $8M Seed Round to Use Machine Learning and Computer Vision to Talk to Dogs

6 Ways Machine Learning Can Improve Supply Chain’s Bottom Line

Machine-learning algorithms are improving in performance at a rate faster than that of the underlying computer chips, we’re told.

AI software techniques have become so efficient, in fact, engineers can now train a neural network on ImageNet – a top dataset for image recognition systems – to about 79.1 per cent accuracy with 44 times less compute power compared to back in 2012. That’s according to a study [PDF], emitted this week by OpenAI, that estimated, at this rate of improvement, algorithmic efficiency doubled every 16 months over seven years.

“Notably, this outpaces the original Moore’s law rate of improvement in hardware efficiency (11x over this period),” the paper, by by Danny Hernandez and Tom Brown, stated.

That law is an observation by Intel co-founder Gordon Moore in the 1960s that the number of transistors on a chip doubles roughly every two years, leading people to expect processor performance to double over the same period. It’s also a law that’s been dying since at least 1999, and considered dead since 2018.

(We like to joke that Moore’s second law is that no journalist can write about Intel without mentioning the first law.)

An accuracy level of 79.1 per cent may seem low at first, yet it was chosen because that was the level of performance for AlexNet when it won the ImageNet challenge in 2012. AlexNet is celebrated as the first model that rekindled computer and data scientists’ obsession with neural networks.

ml

Moore’s Law isn’t dead, chip boffin declares – we need it to keep chugging along for the sake of AI

READ MORE

The improvement isn’t just for computer-vision models: it can also be seen in other types of neural network architectures for language translation and reinforcement learning too, OpenAI said.

“Increases in algorithmic efficiency allow researchers to do more experiments of interest in a given amount of time and money,” the OpenAI duo wrote. “In addition to being a measure of overall progress, algorithmic efficiency gains speed up future AI research in a way that’s somewhat analogous to having more compute.”

Although advances in algorithm performance are good news for the machine-learning community, it’s worth pointing out models are getting larger and more complex, and require significant resources and money to train. A recent paper by AI21, a research hub focused on natural language based in Israel, revealed that it costs anywhere from $2,500 to $50,000 to train a language model with 110 million parameters. When that number increases to 1.5 billion parameters – a number equivalent to OpenAI’s GPT-2 – the costs jump up to anywhere between $80,000 to a whopping $1.6m. ®

Sponsored:
Webcast: Build the next generation of your business in the public cloud

Credit: Google News

Previous Post

COVID Information on Telegram Bot using Python, Git and Heroku

Next Post

Ex-Windows boss Sinofsky: How pre-2K malware and lack of trust hurt Microsoft

Related Posts

Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making
Machine Learning

Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making

March 4, 2021
Companion Raises $8M Seed Round to Use Machine Learning and Computer Vision to Talk to Dogs
Machine Learning

Companion Raises $8M Seed Round to Use Machine Learning and Computer Vision to Talk to Dogs

March 3, 2021
6 Ways Machine Learning Can Improve Supply Chain’s Bottom Line
Machine Learning

6 Ways Machine Learning Can Improve Supply Chain’s Bottom Line

March 3, 2021
This Protein Therapeutics Company Integrates Wet Lab For High-Speed Characterization With Machine Learning Technologies To Guide The Search For Better Antibodies
Machine Learning

This Protein Therapeutics Company Integrates Wet Lab For High-Speed Characterization With Machine Learning Technologies To Guide The Search For Better Antibodies

March 3, 2021
Yum! Brands Acquires AI Company
Machine Learning

Yum! Brands Acquires AI Company

March 3, 2021
Next Post
Ex-Windows boss Sinofsky: How pre-2K malware and lack of trust hurt Microsoft

Ex-Windows boss Sinofsky: How pre-2K malware and lack of trust hurt Microsoft

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

Replacing EDR/NGAV with Autonomous XDR Makes a Big Difference for Small Security Teams
Internet Privacy

Replacing EDR/NGAV with Autonomous XDR Makes a Big Difference for Small Security Teams

March 4, 2021
Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making
Machine Learning

Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making

March 4, 2021
The Role Of Artificial Intelligence In The Fight Against COVID | by B-cube.ai | Feb, 2021
Neural Networks

The Role Of Artificial Intelligence In The Fight Against COVID | by B-cube.ai | Feb, 2021

March 4, 2021
MarTech is nearly here – log on next week!
Digital Marketing

Get your free MarTech pass now

March 4, 2021
13 challenges creating an open, scalable, and secure serverless platform – IBM Developer
Technology Companies

13 challenges creating an open, scalable, and secure serverless platform – IBM Developer

March 4, 2021
Ursnif Trojan has targeted over 100 Italian banks
Internet Security

Ursnif Trojan has targeted over 100 Italian banks

March 4, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • Replacing EDR/NGAV with Autonomous XDR Makes a Big Difference for Small Security Teams March 4, 2021
  • Las Vegas Valley Water District Selects VODA.ai’s Machine Learning to Support Decision-Making March 4, 2021
  • The Role Of Artificial Intelligence In The Fight Against COVID | by B-cube.ai | Feb, 2021 March 4, 2021
  • Get your free MarTech pass now March 4, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates