Question on the SQL "GROUPING SETS" and "CUBE" syntax usability

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Question on the SQL "GROUPING SETS" and "CUBE" syntax usability

Weike Dong
Hi,

From the Flink 1.10  official document (https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/queries.html), we could see that GROUPING SETS is only supported in Batch mode. 

image.png

However, we also found that in https://issues.apache.org/jira/browse/FLINK-12192, stream query using GROUPING SETS and CUBE is already a fixed issues in 1.9.

Here I would like to know if SQL support for GROUPING SETS, ROLLUP, CUBE is ready for use or not, and whether the document needs to be updated or not.

Thank you

Best regards,
Weike
Reply | Threaded
Open this post in threaded view
|

Re: Question on the SQL "GROUPING SETS" and "CUBE" syntax usability

Arvid Heise-3
Hi Weike,

according to the linked documentation, the operations are ready but as you have mentioned only for SQL batch mode, which is not surprising as they don't have a well-behaved semantics on streams. See also Calcites explanations [1].

Could you maybe outline your use case and what you'd expect these operations to be? Would you like to combine them with windows?

I'm CCing Jark, as he knows SQL much better than me.


On Mon, Mar 9, 2020 at 8:27 AM DONG, Weike <[hidden email]> wrote:
Hi,

From the Flink 1.10  official document (https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/queries.html), we could see that GROUPING SETS is only supported in Batch mode. 

image.png

However, we also found that in https://issues.apache.org/jira/browse/FLINK-12192, stream query using GROUPING SETS and CUBE is already a fixed issues in 1.9.

Here I would like to know if SQL support for GROUPING SETS, ROLLUP, CUBE is ready for use or not, and whether the document needs to be updated or not.

Thank you

Best regards,
Weike
Reply | Threaded
Open this post in threaded view
|

Re: Question on the SQL "GROUPING SETS" and "CUBE" syntax usability

Jark Wu-3
Thanks Arvid for reminding me this topic. 

Actually, it is supported in streaming mode in blink planner (since Flink v1.9), but we missed to update the documentation. 
You can also find it is supported in the integration tests [1].

I created an issue to update docs [2]. 

Best,
Jark


On Tue, 10 Mar 2020 at 16:11, Arvid Heise <[hidden email]> wrote:
Hi Weike,

according to the linked documentation, the operations are ready but as you have mentioned only for SQL batch mode, which is not surprising as they don't have a well-behaved semantics on streams. See also Calcites explanations [1].

Could you maybe outline your use case and what you'd expect these operations to be? Would you like to combine them with windows?

I'm CCing Jark, as he knows SQL much better than me.


On Mon, Mar 9, 2020 at 8:27 AM DONG, Weike <[hidden email]> wrote:
Hi,

From the Flink 1.10  official document (https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/sql/queries.html), we could see that GROUPING SETS is only supported in Batch mode. 

image.png

However, we also found that in https://issues.apache.org/jira/browse/FLINK-12192, stream query using GROUPING SETS and CUBE is already a fixed issues in 1.9.

Here I would like to know if SQL support for GROUPING SETS, ROLLUP, CUBE is ready for use or not, and whether the document needs to be updated or not.

Thank you

Best regards,
Weike