Creating foundational models through natural selection
bdtechtalks.substack.com
Model merging is a cost- and compute-efficient way to create models that combine the components and capabilities of existing foundational models. However, currently, model merging relies on human intuition, and with more than 500,000 models available on Hugging Face, the space of possible models is virtually impossible to explore manually.
Creating foundational models through natural selection
Creating foundational models through natural…
Creating foundational models through natural selection
Model merging is a cost- and compute-efficient way to create models that combine the components and capabilities of existing foundational models. However, currently, model merging relies on human intuition, and with more than 500,000 models available on Hugging Face, the space of possible models is virtually impossible to explore manually.