Integration with facebook/nllb-200-distilled-600M translation model

[viper-108]

Can I integrate infinity with "facebook/nllb-200-distilled-600M" model (huggingface model)? if yes, can anyone provide me the docker-compose file for the same

[michaelfeil]

This is a generating model? Generation models are not supported.

honestly, Llama-7b prompted will likely perform a good job, and has a open license.