mardi 24 mars 2015

Mongodb data to AWS S3

I have per second data coming into MongoDB and I need to archive and delete the data every 15 minutes. I have no experience with S3 and I was wondering how I should store the data into S3.


1) What format should I store it as? I see S3 takes files. Does it mean I have to take the data out of Mongo, store it into a file and then upload it into S3? Doesn't that make retrieving the data a pain? Is it possible to just store them as key value pairs straight from Mongo?


2) If I write the archiver scheduler in node which I am not too familiar with but I hear it's very light compared to rails, is this the package I want to use? http://ift.tt/1ulCrUI


Any help would be appreciated.





Aucun commentaire:

Enregistrer un commentaire