Discussion about this post

User's avatar
Kartik Singhal's avatar

Great article Ben! One thing would like to add for scaling is quantization. I think that with pruning is going to determine how can we better scale large language models more cost effectively.

Expand full comment
DATUMO's avatar

Ensuring the reliability and safety of LLM-based apps is essential. At DATUMO, we provide an LLM evaluation SaaS tool that automatically generates large-scale question datasets and assesses model reliability. It’s designed to enhance your model’s performance and stability before launch. Hope this helps anyone working on LLM development!

You can learn more about us at https://datumo.com

Expand full comment
1 more comment...

No posts