BLOOM, AI research culture, and the problems of LLMs

This week, the BigScience research project released BLOOM, a large language model that, at first glance, it looks like another attempt to reproduce OpenAI’s GPT-3.

But what makes BLOOM different from other LLMs is the effort that went into researching, developing, training, and releasing the machine learning model.

While in recent years, big tech companies have hidden LLMs like closely guarded trade secrets, BigScience has put transparency in openness at the center of BLOOM since the beginning of the project.

The result is a large language model that is highly accessible for research and study and available to everyone. The open-source and open-collaboration example that BLOOM has set can be very beneficial to the future of research in LLMs and other areas of artificial intelligence. But some of the challenges that are inherent to large language models remain to be solved.

Read the full article on TechTalks

For more on large language models:

• Can large language models be democratized?

• Large language models have a reasoning problem

• “Sentience” is the wrong discussion to have on AI right now

• GitHub Copilot is among the first real products based on large language models