Using Argos Translate without Nvidia dependencies

argosopentech · April 30, 2024, 9:56pm

I haven’t tried it but I think it should be possible to install Argos Translate without all of the (very large) Nvidia dependencies by disabling them for both CTranslate2 and Stanza.

From @Sohang_Chopra:

github.com/argosopentech/argos-translate

Feature Request: Allow installing without `nvidia-cuda` packages.

opened 12:17PM - 07 Feb 24 UTC

sohang3112

When I install `pip install argostranslate`, various `nvidia-cuda` packages are …also installed automatically. But I don't need these, since I am not using NVIDIA CUDA. I suggest that 2 packages be made available for install: one with cuda support: `argostranslate[cuda]` and one without: `argostranlate[no-cuda]`. To avoid breaking changes, we can make the default `argostranslate` same as `argostranslate[cuda]` - that is, cuda packages will be installed, unless we explicitly opt out by using `argostranslate[no-cuda]`. This will help to reduce time taken in installing `argostranslate`, which is quite helpful, especially in Docker.

Also, argostranslate REQUIRES stanza REQUIRES torch and torch requires NVIDIA libraries (eg. libcublas.so).

One fix for this is to install CPU version of PyTorch before installing argostranslate: pip install torch==2.0.1+cpu --extra-index-url https://download.pytorch.org/whl/cpu