mercredi 28 janvier 2015

how to read data from s3 into emr hadoop cluster

So, I uploaded a jar on s3://myprivatebucket/jar/foo.jar And data at:



s3://myprivatebucket/data/foo.txt


And created a cluster using spark-ec2 script



http://ift.tt/1xoxLN1


Now, I ssh into that cluster.. using my private key.. but from that cluster.. when I do ./bin/hadoop jar s3://myprivatebucket/jar/foo.jar It throws an error that path not found


I have tried it with s3n://myprivatebucket/jar/foo.jar as well





Aucun commentaire:

Enregistrer un commentaire