mercredi 1 avril 2015

How to execute AWS emr and redshift scripts?

I require some help AWS job execution.


I have files in S3 folder. I have to use PiG scripts from EMR to do transformation and then load back to s3. After that I have created tables in redshift which are loaded from s3.


Currently: I have used sql work bench to load files from s3 and also I have executed pig script from AWS GUI window.


I would like to know how can I call the pig scripts from unix shell? How can I execute the redshift scripts apart from sqlworkbench? How can I run them sequentially?


Do I need to have EC2 linux setup to connect to EMR? Note (I have an windows EC2 instance also).


Please guide me here.





Aucun commentaire:

Enregistrer un commentaire