How do I make a dbt
asset depend on a Python asset from another job? They use the same daily partition definition
#28023
Unanswered
rob-apella
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have two scheduled jobs:
For a given partition, how do I ensure the dbt asset runs only after the Python asset finishes?
One option is to move the Python asset into the dbt job, ensuring correct execution order. However, the Python asset requires significantly more Kubernetes resources than the dbt assets.
How does Dagster handle resource allocation in this case? If assets within the same job specify different compute resources, do they still run on the same pod? Is there a better approach to structuring this dependency?
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions