You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Training a model with MP trainer on 4 GPUs creates model_0.pt, model_1.pt, model_2.pt, and model_3.pt.
We need to write a function that takes the local path of a directory where these pytorch files reside.
Each file must have the same number of parameters, i.e., the embedding matrices shapes are same.
Task is to we need to concat these 4 models horizontaly.
The text was updated successfully, but these errors were encountered:
Training a model with MP trainer on 4 GPUs creates model_0.pt, model_1.pt, model_2.pt, and model_3.pt.
We need to write a function that takes the local path of a directory where these pytorch files reside.
Each file must have the same number of parameters, i.e., the embedding matrices shapes are same.
Task is to we need to concat these 4 models horizontaly.
The text was updated successfully, but these errors were encountered: