When I am trying to run Hadoop build in DFSCIOTest test application crash
[hdfs@hdptest-client1 ~]$ hadoop jar /usr/hdp/2.3.2.0-2950/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.2.3.2.0-2950-tests.jar DFSCIOTest -read
WARNING: Use “yarn jar” to launch YARN applications.
DFSCIOTest.0.0.1
15/11/16 12:40:35 INFO fs.DFSCIOTest: nrFiles = 1
15/11/16 12:40:35 INFO fs.DFSCIOTest: fileSize (MB) = 1
15/11/16 12:40:35 INFO fs.DFSCIOTest: bufferSize = 1000000
File /usr/hdp/2.3.2.0-2950/hadoop/libhdfs/libhdfs.so.1 does not exist
The library exist but in a different paths:
[hdfs@hdptest-client1 ~]$ find /usr/hdp/2.3.2.0-2950/ -name libhdfs.so
/usr/hdp/2.3.2.0-2950/usr/lib/libhdfs.so
Applying a workaround for this problem:
[root@hdptest-client1 ~]# mkdir -p /usr/hdp/2.3.2.0-2950/hadoop/libhdfs
[root@hdptest-client1 ~]# ln -s /usr/hdp/2.3.2.0-2950/usr/lib/libhdfs.so /usr/hdp/2.3.2.0-2950/hadoop/libhdfs/libhdfs.so.1
runn it again:
[hdfs@hdptest-client1 ~]$ hadoop jar /usr/hdp/2.3.2.0-2950/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.7.1.2.3.2.0-2950-tests.jar DFSCIOTest -read
WARNING: Use “yarn jar” to launch YARN applications.
DFSCIOTest.0.0.1
15/11/16 13:02:44 INFO fs.DFSCIOTest: nrFiles = 1
15/11/16 13:02:44 INFO fs.DFSCIOTest: fileSize (MB) = 1
15/11/16 13:02:44 INFO fs.DFSCIOTest: bufferSize = 1000000
File /usr/hdp/2.3.2.0-2950/hadoop/libhdfs/hdfs_read does not exist
It looks like some problem with build – it can’t load native library
