Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dagster-airlift][federation-tutorial] Federation tutorial overview and setup #25883

Merged

Conversation

dpeng817
Copy link
Contributor

Summary & Motivation

How I Tested These Changes

Changelog

Insert changelog entry or delete this section.

@@ -0,0 +1,76 @@
# Airflow Migration Tutorial: Setup
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The title should be "Airflow Federation Tutorial" to maintain consistency with the rest of the documentation. The current "Migration Tutorial" appears to be a holdover from an earlier version.

Spotted by Graphite Reviewer

Is this helpful? React 👍 or 👎 to let us know.

Copy link

graphite-app bot commented Nov 13, 2024

Graphite Automations

"Add a 'docs-to-migrate' label to PRs with docs" took an action on this PR • (11/13/24)

1 label was added to this PR based on Christopher DeCarolis's automation.

Will be filled out in a future PR.
# Airflow Federation Tutorial

This tutorial demonstrates using `dagster-airlift` to observe DAGs from multiple Airflow instances, and federate execution between them using Dagster as a centralized control plane.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you think we'd benefit from defining federation?

Asking for a friend... 😅

@dpeng817 dpeng817 changed the title [dagster-airlift] Federation tutorial overview and setup [dagster-airlift][federation-tutorial] Federation tutorial overview and setup Nov 13, 2024
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 5429429 to 8c01a44 Compare November 13, 2024 19:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from ce20018 to 1b9ba9e Compare November 13, 2024 19:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 8c01a44 to b485698 Compare November 13, 2024 19:10
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 1b9ba9e to fd09a10 Compare November 13, 2024 19:10
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from b485698 to 243b03e Compare November 13, 2024 19:15
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from fd09a10 to 2d05d25 Compare November 13, 2024 19:15
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 243b03e to 7c56e9d Compare November 13, 2024 19:59
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 2d05d25 to e67e6ea Compare November 13, 2024 19:59
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 7c56e9d to 5449354 Compare November 13, 2024 20:01
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from e67e6ea to b29e016 Compare November 13, 2024 20:01
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 5449354 to a2e02a5 Compare November 13, 2024 22:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from b29e016 to 53c17ac Compare November 13, 2024 22:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from a2e02a5 to 5886971 Compare November 13, 2024 22:02
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 53c17ac to 2a4cd92 Compare November 13, 2024 22:03
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 5886971 to f38ff66 Compare November 13, 2024 22:18
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 2a4cd92 to 1ca3d88 Compare November 13, 2024 22:18
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from f38ff66 to 345d1cf Compare November 13, 2024 23:19
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 1ca3d88 to dbbf541 Compare November 13, 2024 23:19
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 345d1cf to 0a0e0fb Compare November 13, 2024 23:47
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from dbbf541 to 0be6ddb Compare November 13, 2024 23:47
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 0a0e0fb to 0cb0555 Compare November 14, 2024 00:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 0be6ddb to 714e55f Compare November 14, 2024 00:00
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-scaffold branch from 0cb0555 to ece661e Compare November 14, 2024 18:08
@dpeng817 dpeng817 force-pushed the dpeng817/fed-tutorial-overview-setup branch from 714e55f to 4c45c85 Compare November 14, 2024 18:08
Base automatically changed from dpeng817/fed-tutorial-scaffold to dpeng817/federation-tutorial November 14, 2024 18:10
@dpeng817 dpeng817 merged commit 4c45c85 into dpeng817/federation-tutorial Nov 14, 2024
1 of 2 checks passed
@dpeng817 dpeng817 deleted the dpeng817/fed-tutorial-overview-setup branch November 14, 2024 18:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs-to-migrate Docs to migrate to new docs site
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants