Comments (3)
To resolve the AttributeError: 'DbtRunLocalOperator' object has no attribute '_BaseOperator__init_kwargs'
when using Airflow 2.10 with Astronomer Cosmos 1.5.1, ensure that the DbtRunLocalOperator
is properly initialized. This error typically occurs when the base class's __init__
method is not called correctly.
Here's an example of how to ensure proper initialization:
from cosmos.operators.local import DbtRunLocalOperator
class CustomDbtRunLocalOperator(DbtRunLocalOperator):
def __init__(self, **kwargs):
super().__init__(**kwargs)
# Additional initialization if needed
# Usage
custom_operator = CustomDbtRunLocalOperator(
task_id='dbt_run_task',
profile_config=ProfileConfig(...), # Provide necessary profile configuration
invocation_mode=InvocationMode.SUBPROCESS, # or InvocationMode.DBT_RUNNER
install_deps=True,
callback=None,
should_store_compiled_sql=True,
append_env=True,
# other necessary parameters
)
Make sure that the super().__init__(**kwargs)
line is present in your custom operator's __init__
method to properly initialize the base class. This should resolve the AttributeError
. Additionally, ensure that you provide all required parameters such as profile_config
, invocation_mode
, and others as needed by the DbtLocalBaseOperator
class [1][2].
There are also known compatibility issues between Airflow 2.10 and Astronomer Cosmos 1.5.1 documented in the repository, which might be contributing to the problem [3].
To continue talking to Dosu, mention @dosu.
from astronomer-cosmos.
Feel free to submit a PR whenever you're ready. I'm happy to review and merge it.
from astronomer-cosmos.
It looks like a side effect of the changes in PR apache/airflow#41085. A quick workaround is to add the missing __init__
method, which I have added in #1162. Let's see how CI feel.
from astronomer-cosmos.
Related Issues (20)
- PoC to use Airflow 2.10.0b1 `DatasetAlias` in Cosmos
- Write blog post about multi-repo support with Cosmos
- Write blog post Journey to performance improvements in Cosmos
- Write blog post about source nodes support
- Write blog post dbt docs in Airflow with Cosmos
- Prepare talk "Overcoming performance hurdles in integrating dbt with Airflow"
- [Bug] Unable to create task group from folder when using DBT_MANIFEST HOT 9
- [Feature] Triggering dbt Exposure
- [Feature] Add Scarf-based telemetry to understand feature usage
- Airflow is unable to find dbt_project.yml HOT 5
- Extracting Run Results
- [Feature] New GCP Cloud Run Job Execution Mode
- [Bug] Cosmos on MWAA is too resource heavy HOT 3
- [Feature] Possibility to run a custom dbt command HOT 4
- [Test] Improve code coverage
- Make `SourceRenderingBehavior.ALL` the default value
- Make logging consistent from Cosmos operators
- Support creating Cosmos DAGs out of YML files (without Python)
- Automate Kubernetes DAG Phase-2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from astronomer-cosmos.