I installed libreTranslate (pip install libretranslate)
Start server (libretranslate --host 127.0.0.1)
I try to translate
But It only use my cpu
How to make it run on gpu ?
I have installed nvidia driver and cuda toolkit
The inference engine in LibreTranslate is argos-translate, so check the Readme on the argos-translate github.com repo for most frequent issues on configuration and installation.
To enable GPU acceleration, you should define the environment variable ARGOS_DEVICE_TYPE and set its value to auto or cuda.