It sounds like GPT-4 is coming out soon and is very powerful. Interestingly it looks like they’re using more sparsity like Human brains; this is something I’ve been predicting. Based on historical precedent I expect GPT-4 to be replicated in ~1-3 months by another group, there to be an open-source equivalent in 6-12 months, and for inference to be possible on consumer hardware in 12-24 months.
Argos Translate supports doing few-shot translation with the OpenAI API if anyone wants to use the LibreTranslate GUI with GPT-3 as a backend.
export ARGOS_MODEL_PROVIDER="OPENAI"
export OPENAI_API_KEY="XXX"
1 Like