Does RichFilterFunction work on multiple thread?

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Does RichFilterFunction work on multiple thread?

luutuan
Hi, when I have a set of objects goes through a RichFilterFunction, by default, will the filter handle all objects in 1 single thread or will divide the work to multiple threads?
Thank you.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Does RichFilterFunction work on multiple thread?

Kostas Kloudas
Your objects will be processed by a single thread.

Kostas

> On May 26, 2017, at 4:50 PM, luutuan <[hidden email]> wrote:
>
> Hi, when I have a set of objects goes through a RichFilterFunction, by
> default, will the filter handle all objects in 1 single thread or will
> divide the work to multiple threads?
> Thank you.
>
>
>
> --
> View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Does-RichFilterFunction-work-on-multiple-thread-tp13346.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Does RichFilterFunction work on multiple thread?

Aljoscha Krettek
Hi,

To expand a bit on that, each function is only invoked by one Thread concurrently but the function might be serialised and sent to several executors (TaskManagers) for parallel execution. For more information, check out [1] and [2].

Best,
Aljoscha


On 26. May 2017, at 17:21, Kostas Kloudas <[hidden email]> wrote:

Your objects will be processed by a single thread.

Kostas

On May 26, 2017, at 4:50 PM, luutuan <[hidden email]> wrote:

Hi, when I have a set of objects goes through a RichFilterFunction, by
default, will the filter handle all objects in 1 single thread or will
divide the work to multiple threads?
Thank you.



--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Does-RichFilterFunction-work-on-multiple-thread-tp13346.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.


Loading...