Comments (5)
Hi @kamegg13, thank you for the detailed report. I've opened up a PR to resolve this issue, which we should be able to get into this week's 1.7.6 release.
from dagster.
I am having the same problem after upgrading to 1.7.5 but my assets are dbt assets, not airbyte
from dagster.
Could you post full stack traces for the error?
from dagster.
dagster._core.errors.DagsterExecutionInterruptedError
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/execute_plan.py", line 282, in dagster_event_sequence_for_step
for step_event in check.generator(step_events):
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/execute_step.py", line 523, in core_dagster_event_sequence_for_step
for user_event in _step_output_error_checked_user_event_sequence(
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/execute_step.py", line 202, in _step_output_error_checked_user_event_sequence
for user_event in user_event_sequence:
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/execute_step.py", line 100, in _process_asset_results_to_events
for user_event in user_event_sequence:
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/compute.py", line 208, in execute_core_compute
for step_output in _yield_compute_results(step_context, inputs, compute_fn, compute_context):
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_core/execution/plan/compute.py", line 177, in _yield_compute_results
for event in iterate_with_context(
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_utils/__init__.py", line 465, in iterate_with_context
next_output = next(iterator)
^^^^^^^^^^^^^^
File "/Users/alauni/Code/dbt/orchestration_dagster/usercode/assets/dbt.py", line 122, in _databricks_nonincremental_assets
yield from dbt_databricks.cli(
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster_dbt/core/resources_v2.py", line 675, in stream
for event in self.stream_raw_events():
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster_dbt/core/resources_v2.py", line 692, in stream_raw_events
for log in self._stdout or self._stream_stdout():
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster_dbt/core/resources_v2.py", line 794, in _stream_stdout
self.process.wait(timeout=self.termination_timeout_seconds)
File "/opt/homebrew/Cellar/[email protected]/3.11.7_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/subprocess.py", line 1264, in wait
return self._wait(timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/homebrew/Cellar/[email protected]/3.11.7_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/subprocess.py", line 2040, in _wait
time.sleep(delay)
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_utils/interrupts.py", line 82, in _new_signal_handler
raise error_cls()
The above exception occurred during handling of the following exception:
dagster._core.errors.DagsterExecutionInterruptedError
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster_dbt/core/resources_v2.py", line 786, in _stream_stdout
for raw_line in self.process.stdout or []:
File "/Users/alauni/Code/dbt/.venv/lib/python3.11/site-packages/dagster/_utils/interrupts.py", line 82, in _new_signal_handler
raise error_cls()
from dagster.
downgrading to 1.7.4 restores normal behavior
from dagster.
Related Issues (20)
- Unexpected GraphQL error when deployed on AWS ECS HOT 1
- MLflow hook updates MLflow run state based on all op events, not the just the final op
- execute_in_process with FakeDatetimes do not work
- Number of assets are different in Dagster+ HOT 1
- Make it easier to define freshness checks for dbt models
- ImportError: cannot import name 'GenericAlias' from partially initialized module 'types' HOT 6
- Could not load job definition. dagster._check.CheckError: Invariant failed. Description: No metadata found for CacheableAssetsDefinition with unique_id airbyte / Using I/O Manager BigQuery
- `_get_infer_single_to_multi_dimension_deps_result` is to restrictive, can't handle identityMapped staticPartitionDefintions
- Freshness sensor does not run when assets are pending or failed HOT 3
- Table IO Managers should capture column schemas with appropriate metadata tag HOT 3
- i18n Language Support
- [Documentation Feedback] Problem on /getting-started/quickstart page HOT 1
- docker run launcher not dequeuing runs on dagster 1.7.6 / dagster-docker 0.23.6 HOT 2
- Cannot execute Docker runs HOT 1
- PipesDataBricksClient not accepting a task definition with an existing cluster ID
- CeleryK8sRunLauncher doesn't work with celery_executor HOT 3
- Hooks: slack_on_success and slack_on_failure fail silently to work
- [dagster-deltalake] GcsConfig ImportError and TypeError for partitioned assets
- Different UX when viewing runs locally than in production because of additional tags
- `load_asset_checks_from_module` sometimes returns `AssetsDefinition`s instead of `AssetChecksDefinition`s
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagster.