vendredi 17 avril 2015

Reading data record on Kinesis Stream only for a particular partition key

First of all thank you very much for considering my question. Hope it's not too silly.


I am just wondering whether there is a way to filtering data on Kinesis Stream at the point of getting the data record out of the stream. The AWS official doc says the partition key is used to


"allows the consumer that processes a particular shard to be designed with the assumption that records with the same partition key would only be sent to that consumer"


There is no way to specify (neither using the REST API, nor using KCL) which partition key that I am interested in reading data record of directly.




Data record with same partition key will be hashed to same shards but how we could know which shard it is by just knowing the partition key ?


Ultimate question is: How Can I create a consumer that only receiving data of a particular partition key ? / How can I create consumer that only receiving data that it is interested in.


Thank you very much for your time considering my question and sharing you thoughts !





Aucun commentaire:

Enregistrer un commentaire