Reply To: hadoop distcp error

Hi,

We have 2.1 HA enabled kerberized cluster.

I set up cross realm among cluster.

I am able to list files from one node to other.But unable to do distcp .Error as :

.

.
<p class=”MsoNormal”>15/08/31 19:02:57 INFO impl.YarnClientImpl: Application submission is not finished, submitted application application_1440506170094_2185 is still in NEW</p>
<p class=”MsoNormal”>15/08/31 19:02:59 INFO impl.YarnClientImpl: Application submission is not finished, submitted application application_1440506170094_2185 is still in NEW</p>
<p class=”MsoNormal”>15/08/31 19:03:00 INFO impl.YarnClientImpl: Submitted application application_1440506170094_2185</p>
<p class=”MsoNormal”>15/08/31 19:03:00 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/bdauser/.staging/job_1440506170094_2185</p>
<p class=”MsoNormal”>15/08/31 19:03:00 ERROR tools.DistCp: Exception encountered</p>
<p class=”MsoNormal”>java.io.IOException: Failed to run job : Call From gvlhdmpap02/39.7.56.2 to 10.234.22.56:8020 failed on socket timeout exception: org.apache.hadoop.net.ConnectTimeoutException: 20000 millis timeout while waiting for channel to be ready for connect. ch : java.nio.channels.SocketChannel[connection-pending local=/39.7.56.2:42716 remote=10.234.22.56/10.234.22.56:8020]; For more details see:  http://wiki.apache.org/hadoop/SocketTimeout</p>
<p class=”MsoNormal”>        at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)</p>
<p class=”MsoNormal”>        at java.security.AccessController.doPrivileged(Native Method)</p>
<p class=”MsoNormal”>        at javax.security.auth.Subject.doAs(Subject.java:415)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.tools.DistCp.run(DistCp.java:118)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)</p>
<p class=”MsoNormal”>        at org.apache.hadoop.tools.DistCp.main(DistCp.java:375)</p>
 
<p class=”MsoNormal”>bdauser@gvlengpap01:~></p>
<p class=”MsoNormal”></p>
<p class=”MsoNormal”>===================</p>
<p class=”MsoNormal”></p>
<p class=”MsoNormal”>hdfs.datanode.socket.write.timeout  parameter was already set to 0.</p>
<p class=”MsoNormal”></p>
<p class=”MsoNormal”>Please suggest.</p>