Petals collaborative model inference and fine tuning

https://petals.ml/

Run large language models like BLOOM-176B collaboratively — you load a small part of the model, then team up with people serving the other parts to run inference or fine-tuning.

1 Like