Tag For Docker Hub With Models Included?

General
1

Hey there!

I was curious whether or not you guys would be open to having a tag for the Docker image on Docker Hub that includes the models with it, so that I don’t have to manually build and store the version of the Docker image with the models included.

1 Like
2

I think there was interest (https://github.com/LibreTranslate/LibreTranslate/issues/155) in adding this, but the effort didn’t go forward.

A PR would still be most welcome that implements this.

2 Likes
3

OK, cool, I might add that then. :+1: Thanks.

1 Like
4

This would also take some load off of the Argos Translate CDN and make model distribution more decentralized in case the CDN went down.

I’m not sure what the Docker/GitHub container repositories allow but models for one language pair are pretty small (~250 MB) and good for people who only want a single language or are trying to get started quickly. We could also build Docker images for common language groups, this would be especially useful if we train more direct (not pivoting through English) models, for example, a direct Spanish to Portuguese model.

All of the language models are currently around 7GB. We could also default/better support LibreTranslate to using a select group of popular models so as Argos Translate adds more languages everyone’s LibreTranslate setup times aren’t increasing.

5

Agreed, it would make the startup time faster too (once the image has been pulled from docker hub).

I can see some confusion with this if we don’t include all of the language models, or have different tags for different language groups, though.

1 Like