We can now run Gemma3 models locally

Google just announced Gemma 3 QAT Models: Bringing state-of-the-Art AI to consumer GPUs - Google Developers Blog

I’ve tested the Gemma 3 27B model on translation tasks from English <=> Italian on my local machine and… it’s quite impressive!

I’ve used this prompt in my tests:

translate from English to Italian, only output the best translation, no explanations, capturing the nuances of the sentence, paying attention to masculine/feminine/plural, proper use of articles and grammar.

<sentence>
1 Like