Comments (6)
I've same warnings but everything works. Not sure yet, but I think it's caused by airflow who doesn't call mysql_close before exiting (I tried w/ airflow backfill command)
from docker-airflow.
Have you tried this with boot2docker? The backfill seems to run, but the other example tasks that are in there don't seem to do anything for me. This is what I see printed out during the tutorial:
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-27T00:00:00
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-22T00:00:00
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/sleep/2015-06-01T00:00:00
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-31T00:00:00
mariadb_1 | 150731 5:02:55 [Warning] Aborted connection 178 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:55 [Warning] Aborted connection 181 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:55 [Warning] Aborted connection 168 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:55 [Warning] Aborted connection 175 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:55 [Warning] IP address '172.17.0.4' could not be resolved: Temporary failure in name resolution
mariadb_1 | 150731 5:02:55 [Warning] Aborted connection 199 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/sleep/2015-05-28T00:00:00
worker_1 | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-23T00:00:00
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 174 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 182 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 192 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 194 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 196 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1 | 150731 5:02:56 [Warning] Aborted connection 197 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
from docker-airflow.
I try with Boot2Docker-cli version: v1.7.0. Same warnings, but the backfilll works fine ๐
2015-07-31 13:25:14,011 INFO - [backfill progress] waiting: 0 | succeeded: 6 | kicked_off: 6 | failed: 0 | skipped: 0
2015-07-31 13:25:14,011 INFO - All done. Exiting.
from docker-airflow.
Right, the backfill works fine for me. When clicking run on the shell command task, does it do anything for you? I see the http get, then nothing else happens.
from docker-airflow.
This is still an issue. While you can kick off the backfill, any of the scheduling that uses the database likely won't work correctly. The problem is the database my.cnf file in that docker image, which isn't compatible with allowing connections from the docker host (172....).
A quick fix for me was to replace with the tutum/mysql image which does take care of this. The name of the database in the docker-compose.yml would need to be changed, but this worked:
mariadb:
image: tutum/mysql
restart: always
ports:
- "3306:3306"
environment:
- MYSQL_USER=airflow
- MYSQL_PASS=airflow
- ON_CREATE_DB=airflow
from docker-airflow.
Thanks for your feedback Nick. I pushed the changes.
from docker-airflow.
Related Issues (20)
- Latest Image is not working on for mac M1 Chip HOT 3
- Airflow - DAG Jobs fails but didn't show any logs
- REDIS_HOST not being used in redis URL
- Celery worker container should wait for already running jobs to complete before shutting down on worker TERM signal
- Some workers seem to have died and gunicorn did not restart them as expected HOT 3
- Issue with Installing PyICU package - build fails HOT 1
- Error fetching Celery task state HOT 1
- flower start fail HOT 1
- How to keep Airflow Variables when restarting the docker image? HOT 2
- Update Airflow Version to 2.1.0 HOT 2
- Is there any case of running a py file๏ผ
- Airflow 2.0 attempt by Generally Unstable HOT 1
- sqlalchemy.ext.declarative.clsregistry HOT 1
- Launching tensorflow-gpu inside docker-airflow
- ModuleNotFoundError: No module named 'wtforms.compat' HOT 5
- No s3 conn type for connection! HOT 1
- Multiple vulnerabilities on airflow image. HOT 1
- /usr/bin/env: โbash\rโ: No such file or directory HOT 1
- some workers seem to have died and gunicorn did not restart them as expected
- Detect and copy files in a shared windows folder from under the airflow docker container.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docker-airflow.