And now it's possible to run Bloom-7B1 on an M1 Pro, thanks to bloomz.cpp by Nouamane Tazi: github.com/NouamaneTazi/bloomz…
Bloom is a fun model: it was training used Jean Zay Public Supercomputer, provided by the French government and powered using mostly nuclear energy
It's under the RAIL license which allows (limited) commercial use, unlike LLaMA
Lots more details here: huggingface.co/bigscience/bloo…
GitHub - NouamaneTazi/bloomz.cpp: C++ implementation for BLOOM
C++ implementation for BLOOM. Contribute to NouamaneTazi/bloomz.cpp development by creating an account on GitHub.GitHub
reshared this
Lapo Luchini
in reply to Simon Willison • •