Ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++

Argos Translate
,
1

Inference of LLaMA model in pure C/C++

1 Like
2

I like it, dependency free!

1 Like
3

Tried it out, it works!

1 Like
4

LLAMA Live Demo

5

I’ve had some correspondence with the llama.cpp author, and he’s a fan of CTranslate2. Hopefully we can encourage cross-poulation in the open source ML world. LLAMA, and the open source work around it, is really impressive!

1 Like