MultiGPU training

[Allesanddro]

Basically I have 2 gpus on hand and I want to you both of them for training sadly im not able to do so,
I followed the opennmt docs and used the parameters --worldsize 2 --gpu_ranks 0 1 but it doesnt work; it then wants to use the cpu for training.

[argosopentech]

What command are you running to train? omnt_train?

You can try setting CUDA_VISIBLE_DEVICES

export CUDA_VISIBLE_DEVICES=0,1

[argosopentech]

Adding new model trained with ArgosTranslate

I’ve never used multiple GPUs; I just use a single RTX 3090. I think you may need to add -world_size 4 -gpu_ranks 0 1 2 3 like in this guide: https://opennmt.net/OpenNMT-py/FAQ.html#do-you-support-multi-gpu You would make the edit here. Argos Train is automation built on top of OpenNMT-py so you need to tell OpenNMT-py to use multiple GPUs.