samedi 8 août 2015

How to determine shard id for a specific partition key with KCL?

PutRequest API uses partition keys in order to determine the shard id for the record. Even though the response of PutRequest contains shard id, I couldn't find a way to determine the shard id for a specific partition key in consumer side.

It seems that AWS maps partition keys to 128-bit integer keys but the hashing algorithm is not explained in the documentation. What I want to do is to process records in a Kinesis stream that has a specific partition key, which means that they will be in a specific shard so that I can just fetch data in a particular shard but I couldn't find the appropriate API in the documentation.




Aucun commentaire:

Enregistrer un commentaire