Giter Site home page Giter Site logo

Comments (5)

yangsishu avatar yangsishu commented on May 9, 2024

那个分支

from chunjun.

yangsishu avatar yangsishu commented on May 9, 2024

是yarnsession 模式吗,看下每个节点的jar是不是一样的

from chunjun.

yelijun avatar yelijun commented on May 9, 2024

提交yarn-session的 机器上 flink 版本 1.7
flinkx版本 v1.7.0_dev

其他节点flinkx版本:v1.5.0

由于之前 flink 1.7一下的版本启动yarn session 都不能执行同步任务。
所有尝试才尝试1.7_dev 并且能成功运行 + 同步数据

同步了9亿多数据 4个并行 执行了11个消失

file: '/data/software/flinkx/plugins/mysqlreader/flinkx-mysql-reader.jar' (valid JAR)
file: '/data/software/flinkx/plugins/hdfswriter/flinkx-hdfs-writer.jar' (valid JAR)
file: '/data/software/flinkx/plugins/common/flinkx-rdb.jar' (valid JAR)
这三个文件 第一台和 后面几台的确不一样
第一台是1.7_dev 后面都是1.5

from chunjun.

yangsishu avatar yangsishu commented on May 9, 2024

插件包的每台都是要一样的

from chunjun.

yelijun avatar yelijun commented on May 9, 2024

之前没个节点都是 1.5的时候 我没有执行成功过。standalone的集群 我试过1.5是可以成功的,
唯一遇到的问题是 任务失败了 界面上显示 tm 都是0

我一会试下 每台机器上 都换成1.7_dev的试试

thanks

from chunjun.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.