When using udaf, the startup job has a “Cannot determine simple type name 'com' ” exception(Flink version 1.7.2)

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

When using udaf, the startup job has a “Cannot determine simple type name 'com' ” exception(Flink version 1.7.2)

mailtolrl
My flink streaming job use a udaf, set 60 parallelisms,submit job in yarn cluster mode,and then happens every time I start.


 

Reply | Threaded
Open this post in threaded view
|

Re: When using udaf, the startup job has a “Cannot determine simple type name 'com' ” exception(Flink version 1.7.2)

vino yang
Hi mailtolrl,

Can you share more context about your program and UDAF.

Best,
Vino

mailtolrl <[hidden email]> 于2019年11月7日周四 下午3:05写道:
My flink streaming job use a udaf, set 60 parallelisms,submit job in yarn cluster mode,and then happens every time I start.


 

Reply | Threaded
Open this post in threaded view
|

Re:Re: When using udaf, the startup job has a “Cannot determine simple type name 'com' ” exception(Flink version 1.7.2)

mailtolrl
Hi, vino:
    Thanks for your answer. When I set 20 parallelism, I can run job succeed every time. When setting 40 parallelism, sometimes I can submit it successfully, sometimes throw the exception. When setting 60 parallelism at the time, it has not been submitted successfully, always this exception.So I don't think it has anything to do with my program.




在 2019-11-07 15:20:13,"vino yang" <[hidden email]> 写道:
Hi mailtolrl,

Can you share more context about your program and UDAF.

Best,
Vino

mailtolrl <[hidden email]> 于2019年11月7日周四 下午3:05写道:
My flink streaming job use a udaf, set 60 parallelisms,submit job in yarn cluster mode,and then happens every time I start.