Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trying to go through Dagster Universite for dbt #20

Open
lokofoko opened this issue Apr 1, 2024 · 0 comments
Open

Trying to go through Dagster Universite for dbt #20

lokofoko opened this issue Apr 1, 2024 · 0 comments

Comments

@lokofoko
Copy link

lokofoko commented Apr 1, 2024

Can't get past this error. Did all the steps from the guide.

image
image

First part of deploy seems ok.

I already added step with dbt parse.

name: Serverless Prod Deployment
on:
push:
branches:
- "main"
- "master"

concurrency:
group: ${{ github.ref }}/deploy
cancel-in-progress: true
env:
DAGSTER_CLOUD_URL: "http://organiz.dagster.cloud"
DAGSTER_CLOUD_API_TOKEN: ${{ secrets.DAGSTER_CLOUD_API_TOKEN }}
ENABLE_FAST_DEPLOYS: 'false'
PYTHON_VERSION: '3.8'
DAGSTER_CLOUD_FILE: 'dagster_cloud.yaml'

jobs:
dagster_cloud_default_deploy:
name: Dagster Serverless Deploy
runs-on: ubuntu-20.04
outputs:
build_info: ${{ steps.parse-workspace.outputs.build_info }}
steps:
- name: Prerun Checks
id: prerun
uses: dagster-io/dagster-cloud-action/actions/utils/[email protected]

  - name: Launch Docker Deploy
    if: steps.prerun.outputs.result == 'docker-deploy'
    id: parse-workspace
    uses: dagster-io/dagster-cloud-action/actions/utils/[email protected]
    with:
      dagster_cloud_file: $DAGSTER_CLOUD_FILE

  - name: Checkout for Python Executable Deploy
    if: steps.prerun.outputs.result == 'pex-deploy'
    uses: actions/checkout@v3
    with:
      ref: ${{ github.head_ref }}
      path: project-repo

  - name: Parse dbt project and package with Dagster project
    if: steps.prerun.outputs.result == 'pex-deploy'
    run: |
      pip install pip --upgrade
      pip install dbt-duckdb
      cd project-repo/analytics
      dbt deps
      dbt parse
    shell: bash
      
  - name: Python Executable Deploy
    if: steps.prerun.outputs.result == 'pex-deploy'
    uses: dagster-io/dagster-cloud-action/actions/[email protected]
    with:
      dagster_cloud_file: "$GITHUB_WORKSPACE/project-repo/$DAGSTER_CLOUD_FILE"
      build_output_dir: "$GITHUB_WORKSPACE/build"
      python_version: "${{ env.PYTHON_VERSION }}"
    env:
      GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

dagster_cloud_docker_deploy:
name: Docker Deploy
runs-on: ubuntu-20.04
if: needs.dagster_cloud_default_deploy.outputs.build_info
needs: dagster_cloud_default_deploy
strategy:
fail-fast: false
matrix:
location: ${{ fromJSON(needs.dagster_cloud_default_deploy.outputs.build_info) }}
steps:
- name: Checkout
uses: actions/checkout@v3
with:
ref: ${{ github.head_ref }}
- name: Build and deploy to Dagster Cloud serverless
uses: dagster-io/dagster-cloud-action/actions/[email protected]
with:
dagster_cloud_api_token: ${{ secrets.DAGSTER_CLOUD_API_TOKEN }}
location: ${{ toJson(matrix.location) }}
base_image: "python:${{ env.PYTHON_VERSION }}-slim"
organization_id: ${{ secrets.ORGANIZATION_ID }}
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant