Dagster Serverless Deploy not working when importing dbt project

[juraurai]

Dagster Serverless Deploy not working when importing dbt project

[juraurai]

Thanks for the quick reply! This fixed it indeed.

FYI, I replaced dbt-snowflake with dbt-snowflake<1.8.0

[maximearmstrong]

Hey @juraurai - Thanks for reaching out. I was able to reproduce using the jaffleshop example, which resulted in the following error trace.

ERROR: launchpadlib 1.10.13 requires testresources, which is not installed.
ERROR: grpcio-health-checking 1.63.0 has requirement protobuf<6.0dev,>=5.26.1, but you'll have protobuf 4.25.3 which is incompatible.
ERROR: dbt-semantic-interfaces 0.4.4 has requirement importlib-metadata~=6.0, but you'll have importlib-metadata 7.1.0 which is incompatible.
ERROR: dbt-core 1.7.14 has requirement urllib3~=1.0, but you'll have urllib3 2.2.1 which is incompatible.
ERROR: dbt-duckdb 1.8.0 has requirement dbt-core>=1.8.0, but you'll have dbt-core 1.7.14 which is incompatible.

I managed to fix this by editing the setup.py file created by using the Import a dbt project function import in Dagster+. The setup.py file is added to the PR created by the process in the GitHub repo.

For the jaffleshop example, forcing dbt-duckdb<1.8 in setup.py fixed the problem. In your case, doing the same for Snowflake should temporarily fix your problem.

I think the problem comes from the version constraints of dbt-core which we use for our dagster-dbt library, see here - this will require a fix on our end.

[maximearmstrong]

@juraurai Glad to hear it worked! FYI, PR #21904 fixes the problem and should be used in production soon.