Hi all, I am trying to get hive-testbench to work. I build the generator, but when I run
./tpch-setup 2
I get the following:
ls: `/tmp/tpch-generate/2′: No such file or directory
Generating data at scale factor 2.
14/12/06 06:42:44 INFO Configuration.deprecation: mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
14/12/06 06:42:44 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.56.1:8040
14/12/06 06:42:46 INFO input.FileInputFormat: Total input paths to process : 1
14/12/06 06:42:46 INFO mapreduce.JobSubmitter: number of splits:2
14/12/06 06:42:46 INFO Configuration.deprecation: io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
14/12/06 06:42:47 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1417838876905_0002
14/12/06 06:42:47 INFO impl.YarnClientImpl: Submitted application application_1417838876905_0002
14/12/06 06:42:48 INFO mapreduce.Job: The url to track the job: http://debianAcer.anydomain:8088/proxy/application_1417838876905_0002/
14/12/06 06:42:48 INFO mapreduce.Job: Running job: job_1417838876905_0002
14/12/06 06:44:59 INFO mapreduce.Job: Job job_1417838876905_0002 running in uber mode : false
14/12/06 06:44:59 INFO mapreduce.Job: map 0% reduce 0%
14/12/06 06:45:37 INFO mapreduce.Job: Task Id : attempt_1417838876905_0002_m_000000_0, Status : FAILED
Error: java.io.IOException: Cannot run program “/tmp/nm-local-dir/usercache/user1/appcache/application_1417838876905_0002/container_1417838876905_0002_01_000002/./dbgen/tools/dbgen” (in directory “.”): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
at java.lang.Runtime.exec(Runtime.java:617)
at org.notmysock.tpch.GenTable$dbgen.map(GenTable.java:225)
at org.notmysock.tpch.GenTable$dbgen.map(GenTable.java:198)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.<init>(UNIXProcess.java:186)
at java.lang.ProcessImpl.start(ProcessImpl.java:130)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
… 11 more
How to solve this?
Thanks