Is there documentation on running a script that can log into a spark cluster and run a script? I've been able to launch clusters with Linux Bash scripts but I'm wondering if there is anything more general (python would be great). I would like to have a script that reads certain parameters and then runs them automatically without having to have the user log in. I want this to be as easy and intuitive as possible (so someone less tech savy can just start the script without having to worry about dealing with spark or AWS) or be able to run in the background of a web app.
Aucun commentaire:
Enregistrer un commentaire