Giter Site home page Giter Site logo

Comments (6)

puckel avatar puckel commented on May 12, 2024

I've same warnings but everything works. Not sure yet, but I think it's caused by airflow who doesn't call mysql_close before exiting (I tried w/ airflow backfill command)

from docker-airflow.

rothnic avatar rothnic commented on May 12, 2024

Have you tried this with boot2docker? The backfill seems to run, but the other example tasks that are in there don't seem to do anything for me. This is what I see printed out during the tutorial:

worker_1    | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-27T00:00:00
worker_1    | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-22T00:00:00
worker_1    | Logging into: /usr/local/airflow/logs/tutorial/sleep/2015-06-01T00:00:00
worker_1    | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-31T00:00:00
mariadb_1   | 150731  5:02:55 [Warning] Aborted connection 178 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:55 [Warning] Aborted connection 181 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:55 [Warning] Aborted connection 168 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:55 [Warning] Aborted connection 175 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:55 [Warning] IP address '172.17.0.4' could not be resolved: Temporary failure in name resolution
mariadb_1   | 150731  5:02:55 [Warning] Aborted connection 199 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
worker_1    | Logging into: /usr/local/airflow/logs/tutorial/sleep/2015-05-28T00:00:00
worker_1    | Logging into: /usr/local/airflow/logs/tutorial/templated/2015-05-23T00:00:00
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 174 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 182 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 192 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 194 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 196 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)
mariadb_1   | 150731  5:02:56 [Warning] Aborted connection 197 to db: 'airflow' user: 'airflow' host: '172.17.0.4' (Unknown error)

from docker-airflow.

puckel avatar puckel commented on May 12, 2024

I try with Boot2Docker-cli version: v1.7.0. Same warnings, but the backfilll works fine ๐Ÿ‘

2015-07-31 13:25:14,011 INFO - [backfill progress] waiting: 0 | succeeded: 6 | kicked_off: 6 | failed: 0 | skipped: 0
2015-07-31 13:25:14,011 INFO - All done. Exiting.

from docker-airflow.

rothnic avatar rothnic commented on May 12, 2024

Right, the backfill works fine for me. When clicking run on the shell command task, does it do anything for you? I see the http get, then nothing else happens.

from docker-airflow.

rothnic avatar rothnic commented on May 12, 2024

This is still an issue. While you can kick off the backfill, any of the scheduling that uses the database likely won't work correctly. The problem is the database my.cnf file in that docker image, which isn't compatible with allowing connections from the docker host (172....).

A quick fix for me was to replace with the tutum/mysql image which does take care of this. The name of the database in the docker-compose.yml would need to be changed, but this worked:

mariadb:
    image: tutum/mysql
    restart: always
    ports:
        - "3306:3306"
    environment:
        - MYSQL_USER=airflow
        - MYSQL_PASS=airflow
        - ON_CREATE_DB=airflow

from docker-airflow.

puckel avatar puckel commented on May 12, 2024

Thanks for your feedback Nick. I pushed the changes.

from docker-airflow.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.