This is a new language model released by the same group as Stable Diffusion.
In my tests it seems pretty good. Maybe on par with LLAMA?
It also has a CC-BY-SA license so fewer licensing shenanigans than LLAMA.
It looks like this is using The Pile and a few other datasets.
Note quite a ChatGPT contender knowledge-wise, but very cool nonetheless!
1 Like