Giter Site home page Giter Site logo

Comments (3)

liwei-ch avatar liwei-ch commented on August 18, 2024

mr任务在启动的时候会通过‘DistributedCache.addFileToClassPath’,将依赖的jar分发到各个节点上后并设置到该任务的配置文件的;
所以检查下任务的conf中是否存在以下两项配置:
mapreduce.job.classpath.files
mapreduce.job.user.classpath.first

from poseidon.

shillyyour avatar shillyyour commented on August 18, 2024

已经在mapred-site.xml增加了两个配置,hadoop也读到了(因为路径错误,运行报错),但是运行start.sh,还是报错。hadoop上跑job是正常的,已经验证。能提供点思路,应该往哪个方向去定位呢?或者能否屏蔽掉这行代码?

from poseidon.

liwei-ch avatar liwei-ch commented on August 18, 2024

检查下 yarn-site.xml 检查下是否存在:yarn.application.classpath
或者检查下mapreduce-site.xml 是否存在:mapreduce.application.classpath
如果没有请自行加上;
如果还是不行,并且你的hadoop是单机版的,请自行将
yarn.application.classpath 或者mapreduce.application.classpath 中的protobuf-java-2.5.0.jar 替换成protobuf-java-3.1.0.jar;

from poseidon.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.