Watermarking and Timestamp on Kafka stream union

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Watermarking and Timestamp on Kafka stream union

G.S.Vijay Raajaa
HI,

I am having a union of 3 kafka topic stream, i am joining them by a timestamp field. I would like to order the join by timestamp. How do I assign a watermark and extract timestamp from a union stream?

Regards,
Vijay Raajaa GSĀ 
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Watermarking and Timestamp on Kafka stream union

Aljoscha Krettek
Hi,

You would apply a assignTimestampsAndWatermarks() operation on the unioned stream. However, this would not allow you to sort the join by timestamp, since no sorting is supported out-of-box in Flink.

Best,
Aljoscha

> On 26. Jul 2017, at 21:37, G.S.Vijay Raajaa <[hidden email]> wrote:
>
> HI,
>
> I am having a union of 3 kafka topic stream, i am joining them by a timestamp field. I would like to order the join by timestamp. How do I assign a watermark and extract timestamp from a union stream?
>
> Regards,
> Vijay Raajaa GS

Loading...