Quantcast
Channel: Hortonworks » All Replies
Viewing all articles
Browse latest Browse all 3435

Reply To: Importing snapshots from Amazon S3 to HBase

$
0
0

Found problem, it was the S3 role was missing. I thought adding authentication would be enough but only allows to copy in but cannot copy out. So now export snapshot is successful and the snapshot-s3-util export now works. The import fails using s3 block store :-

sudo -u hbase HADOOP_CLASSPATH=YOURHADDOPPATH/lib/hbase/lib/* hadoop jar target/snapshot-s3-util-1.0.0.jar com.imgur.backup.SnapshotS3Util –import –snapshot test5-snapshot-20140822_090717 -d /hbase -k key -s secret –bucketName mybucket
14/08/22 09:12:02 WARN security.UserGroupInformation: PriviledgedActionException as:hbase (auth:SIMPLE) cause:org.apache.hadoop.fs.UnsupportedFileSystemException: No AbstractFileSystem for scheme: s3

and trying s3n it doesn’t pickup the secret key.

sudo -u hbase HADOOP_CLASSPATH=YOURHADOOPPATH/lib/hbase/lib/* hadoop jar target/snapshot-s3-util-2.0.0.jar com.imgur.backup.SnapshotS3Util –import –snapshot test1-snapshot-20140822_101514 -d /hbase -a true -k key -s secret –bucketName mybucket

java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3n URL, or by setting the fs.s3n.awsAccessKeyId or fs.s3n.awsSecretAccessKey

Will see if can fix this.


Viewing all articles
Browse latest Browse all 3435

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>