Hi,
we have an existing hadoop cluster installed on production ,
on centos 6 machines.
we are interested in upgrading to hadoop 2 , found some links but i am not sure they describe the right or the whole needed process .
http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_upgrading_hdp_manually/content/ch_upgrade_1_3.html
http://private-repo-1.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/upgrade-1.html
http://hadoop.apache.org/docs/r2.5.2/hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html
we have 2 alternatives :
1. do some kind of manuall upgrade
2. install hadoop 2 (we do have chef cookbook to install it) on a clean cluster , and copy out existing hdfs file from the current cluster and pointing the MR jobs to the new cluster .
what is missing is a comperhansive detailed process to do option 1, i need to know if one of the links cover all the bases , and if not have a document that describe all the needed steps .
and for option 2 i am missing a tool or a way to copy all the existing files from hadoop 1 existing cluster to the new cluster .
what is the recommended way to do it with minimal downtime , and can you provide the missing info on voth options ?
thanks!