pierre/hfind

Find implementation for Hadoop

hfind's Issues

-mindepth

Hi,

I'm just asking since there hasn't been any major changes in the last 4 years of this project, but has anyone implemented a -mindepth to hfind?

Error Running against Hadoop 0.20.2 (Hadoop 0.20.2-cdh3u1)

When running the util against Hadoop 0.20.2-cdh3u1 It returns the error

Error crawling HDFS: Call to /192.168.1.2:8020 failed on local exception: java.io.EOFException

On the name node I see the following in the logs

2012-04-18 23:28:24,874 WARN org.apache.hadoop.ipc.Server: Incorrect header or version mismatch from 192.168.1.25:40305 got version 3 expected version 4

just build with plain 'mvn install'

... and the result is the same as stock binary hfind jar:

Error crawling HDFS: Server IPC version 9 cannot communicate with client version 3

mvn install downloaded default libraries for the building process.

My hadoop version is 2.5.0-cdh5.3.3

Thanks

Latest Cloudera hadoop bundles do not include org.apache.hadoop.fs in their hadoop-core jar file

Hey,

Trying to compile this with a later version of hadoop:

mvn -Dhadoop.version=2.0.0-mr1-cdh4.3.1 clean install

But when doing this I get a bunch of compile errors that it cannot find the package org.apache.hadoop.fs

[ERROR] /path/to/git/checkout/hfind/src/main/java/com/ning/hfind/FileStatusAttributes.java:[19,27] error: package org.apache.hadoop.fs does not exist

Any idea about this issue? I know it's old code and everything has probably changed since you released this. Maybe there is a native -find function now?

hfind compiles, but exeception thrown on execution

Hey There Pierre!

Thank you for your hard work on this. We use it quite a bit in our day-to-day hadoop activities. We've recently upgraded from cdh3u3 to cdh4.3.1. I had the exact same issue described in this thread:

#2

After executing the install via override of the hadoop.version parameter, hfind compiles successfully. However, executing hfind after compilation returns this error:

./hfind /user/pierre

Exception in thread "main" java.lang.VerifyError: (class: com/google/common/collect/Interners, method: newWeakInterner signature: ()Lcom/google/common/collect/Interner;) Incompatible argument to function
at org.apache.hadoop.util.StringInterner.(StringInterner.java:48)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1974)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1867)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1785)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:801)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:783)
at com.ning.hfind.config.HdfsConfig.configureHDFSAccess(HdfsConfig.java:20)
at com.ning.hfind.config.HdfsConfig.(HdfsConfig.java:12)
at com.ning.hfind.HdfsAccess.(HdfsAccess.java:27)
at com.ning.hfind.HdfsAccess.get(HdfsAccess.java:20)
at com.ning.hfind.primary.Expression.run(Expression.java:94)
at com.ning.hfind.Find.main(Find.java:151)

What am I doing wrong?

Thanks in advance!

--Nick