Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extend artifact handling for an ML Model type #744

Open
5 tasks
keithmanville opened this issue Feb 6, 2025 · 0 comments
Open
5 tasks

Extend artifact handling for an ML Model type #744

keithmanville opened this issue Feb 6, 2025 · 0 comments
Labels
blocked Unable to move forward because a dependency has yet to be completed feature New feature to add to project

Comments

@keithmanville
Copy link
Collaborator

keithmanville commented Feb 6, 2025

Add a new artifact type to store models. The model type (matching to available types in ML Flow) must be specified as a part of this artifact type.

See here for an example call to log a keras model.
https://mlflow.org/docs/latest/python_api/mlflow.keras.html#mlflow.keras.save.log_model

This feature should work with the following MLFlow model types:

  • keras
  • scikit learn
  • pytorch
  • tensorflow

This should otherwise leverage that the artifacts extension to the task engine yaml uses.

Blocked by:

Definition of Done

  • Model artifacts can be stored as part of the outputs of a job
  • The model types defined above all work.
  • Extend the artifacts unit tests to include the model artifact type
  • The MNIST example should be updated to use this feature and still work
  • The feature is merged into dev.
@keithmanville keithmanville added feature New feature to add to project blocked Unable to move forward because a dependency has yet to be completed labels Feb 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked Unable to move forward because a dependency has yet to be completed feature New feature to add to project
Projects
None yet
Development

No branches or pull requests

1 participant