TechTalks

Share this post

Democratizing LLMs needs a revolution in AI hardware

bdtechtalks.substack.com

Discover more from TechTalks

In-depth discussions about machine learning, deep learning, reinforcement learning, neural networks, artificial general intelligence, AI business, and other technology trends.
Over 5,000 subscribers
Continue reading
Sign in

Democratizing LLMs needs a revolution in AI hardware

Ben Dickson
Aug 1, 2022
2
Share this post

Democratizing LLMs needs a revolution in AI hardware

bdtechtalks.substack.com
Share

There’s growing concern that artificial intelligence—namely deep learning—is becoming centralized within a few very wealthy companies. This shift does not apply to all areas of AI, but it is certainly the case for large language models, deep learning systems composed of billions of parameters and trained on terabytes of text data.

Accordingly, there has been growing interest in democratizing LLMs and making them available to a broader audience. However, while there have been impressive initiatives in open-sourcing models, the hardware barriers of large language models have gone mostly unaddressed.

Thanks for reading TechTalks Newsletter! Subscribe for free to receive new posts and support my work.

This is one of the problems that Cerebras, a startup that specializes in AI hardware, aims to solve with its Wafer Scale processor. In an interview with TechTalks, Cerebras CEO Andrew Feldman discussed the hardware challenges of LLMs and his company’s vision to reduce the costs and complexity of training and running large neural networks.

Read the interview on TechTalks.

More on AI:

  • “Sentience” is the wrong discussion to have on AI right now

  • A gentle introduction to model-free and model-based reinforcement learning

  • Machine learning has a backdoor problem

  • To be AI-first, do AI last

Thanks for reading TechTalks Newsletter! Subscribe for free to receive new posts and support my work.

2
Share this post

Democratizing LLMs needs a revolution in AI hardware

bdtechtalks.substack.com
Share
Comments
Top
New
Community

No posts

Ready for more?

© 2023 Ben Dickson
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing