== Physical Plan ==
* Sort (61)
+- * HashAggregate (60)
   +- Exchange (59)
      +- * HashAggregate (58)
         +- * HashAggregate (57)
            +- Exchange (56)
               +- * HashAggregate (55)
                  +- * Project (54)
                     +- * BroadcastHashJoin Inner BuildRight (53)
                        :- * Project (47)
                        :  +- * BroadcastHashJoin Inner BuildRight (46)
                        :     :- * Project (40)
                        :     :  +- * BroadcastHashJoin Inner BuildRight (39)
                        :     :     :- SortMergeJoin LeftSemi (33)
                        :     :     :  :- * Sort (17)
                        :     :     :  :  +- Exchange (16)
                        :     :     :  :     +- SortMergeJoin LeftSemi (15)
                        :     :     :  :        :- * Sort (5)
                        :     :     :  :        :  +- Exchange (4)
                        :     :     :  :        :     +- * Filter (3)
                        :     :     :  :        :        +- * ColumnarToRow (2)
                        :     :     :  :        :           +- Scan parquet default.web_sales (1)
                        :     :     :  :        +- * Project (14)
                        :     :     :  :           +- * SortMergeJoin Inner (13)
                        :     :     :  :              :- * Sort (10)
                        :     :     :  :              :  +- Exchange (9)
                        :     :     :  :              :     +- * Filter (8)
                        :     :     :  :              :        +- * ColumnarToRow (7)
                        :     :     :  :              :           +- Scan parquet default.web_sales (6)
                        :     :     :  :              +- * Sort (12)
                        :     :     :  :                 +- ReusedExchange (11)
                        :     :     :  +- * Project (32)
                        :     :     :     +- * SortMergeJoin Inner (31)
                        :     :     :        :- * Sort (25)
                        :     :     :        :  +- Exchange (24)
                        :     :     :        :     +- * Project (23)
                        :     :     :        :        +- * SortMergeJoin Inner (22)
                        :     :     :        :           :- * Sort (19)
                        :     :     :        :           :  +- ReusedExchange (18)
                        :     :     :        :           +- * Sort (21)
                        :     :     :        :              +- ReusedExchange (20)
                        :     :     :        +- * Sort (30)
                        :     :     :           +- Exchange (29)
                        :     :     :              +- * Filter (28)
                        :     :     :                 +- * ColumnarToRow (27)
                        :     :     :                    +- Scan parquet default.web_returns (26)
                        :     :     +- BroadcastExchange (38)
                        :     :        +- * Project (37)
                        :     :           +- * Filter (36)
                        :     :              +- * ColumnarToRow (35)
                        :     :                 +- Scan parquet default.customer_address (34)
                        :     +- BroadcastExchange (45)
                        :        +- * Project (44)
                        :           +- * Filter (43)
                        :              +- * ColumnarToRow (42)
                        :                 +- Scan parquet default.web_site (41)
                        +- BroadcastExchange (52)
                           +- * Project (51)
                              +- * Filter (50)
                                 +- * ColumnarToRow (49)
                                    +- Scan parquet default.date_dim (48)


(1) Scan parquet default.web_sales
Output [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Batched: true
Location [not included in comparison]/{warehouse_dir}/web_sales]
PushedFilters: [IsNotNull(ws_ship_date_sk), IsNotNull(ws_ship_addr_sk), IsNotNull(ws_web_site_sk)]
ReadSchema: struct<ws_ship_date_sk:int,ws_ship_addr_sk:int,ws_web_site_sk:int,ws_order_number:int,ws_ext_ship_cost:decimal(7,2),ws_net_profit:decimal(7,2)>

(2) ColumnarToRow [codegen id : 1]
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]

(3) Filter [codegen id : 1]
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Condition : ((isnotnull(ws_ship_date_sk#1) AND isnotnull(ws_ship_addr_sk#2)) AND isnotnull(ws_web_site_sk#3))

(4) Exchange
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Arguments: hashpartitioning(ws_order_number#4, 5), true, [id=#7]

(5) Sort [codegen id : 2]
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Arguments: [ws_order_number#4 ASC NULLS FIRST], false, 0

(6) Scan parquet default.web_sales
Output [2]: [ws_warehouse_sk#8, ws_order_number#4]
Batched: true
Location [not included in comparison]/{warehouse_dir}/web_sales]
PushedFilters: [IsNotNull(ws_order_number), IsNotNull(ws_warehouse_sk)]
ReadSchema: struct<ws_warehouse_sk:int,ws_order_number:int>

(7) ColumnarToRow [codegen id : 3]
Input [2]: [ws_warehouse_sk#8, ws_order_number#4]

(8) Filter [codegen id : 3]
Input [2]: [ws_warehouse_sk#8, ws_order_number#4]
Condition : (isnotnull(ws_order_number#4) AND isnotnull(ws_warehouse_sk#8))

(9) Exchange
Input [2]: [ws_warehouse_sk#8, ws_order_number#4]
Arguments: hashpartitioning(ws_order_number#4, 5), true, [id=#9]

(10) Sort [codegen id : 4]
Input [2]: [ws_warehouse_sk#8, ws_order_number#4]
Arguments: [ws_order_number#4 ASC NULLS FIRST], false, 0

(11) ReusedExchange [Reuses operator id: 9]
Output [2]: [ws_warehouse_sk#10, ws_order_number#11]

(12) Sort [codegen id : 6]
Input [2]: [ws_warehouse_sk#10, ws_order_number#11]
Arguments: [ws_order_number#11 ASC NULLS FIRST], false, 0

(13) SortMergeJoin [codegen id : 7]
Left keys [1]: [ws_order_number#4]
Right keys [1]: [ws_order_number#11]
Join condition: NOT (ws_warehouse_sk#8 = ws_warehouse_sk#10)

(14) Project [codegen id : 7]
Output [1]: [ws_order_number#4 AS ws_order_number#4#12]
Input [4]: [ws_warehouse_sk#8, ws_order_number#4, ws_warehouse_sk#10, ws_order_number#11]

(15) SortMergeJoin
Left keys [1]: [ws_order_number#4]
Right keys [1]: [ws_order_number#4#12]
Join condition: None

(16) Exchange
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Arguments: hashpartitioning(cast(ws_order_number#4 as bigint), 5), true, [id=#13]

(17) Sort [codegen id : 8]
Input [6]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Arguments: [cast(ws_order_number#4 as bigint) ASC NULLS FIRST], false, 0

(18) ReusedExchange [Reuses operator id: 9]
Output [2]: [ws_warehouse_sk#8, ws_order_number#4]

(19) Sort [codegen id : 10]
Input [2]: [ws_warehouse_sk#8, ws_order_number#4]
Arguments: [ws_order_number#4 ASC NULLS FIRST], false, 0

(20) ReusedExchange [Reuses operator id: 9]
Output [2]: [ws_warehouse_sk#14, ws_order_number#15]

(21) Sort [codegen id : 12]
Input [2]: [ws_warehouse_sk#14, ws_order_number#15]
Arguments: [ws_order_number#15 ASC NULLS FIRST], false, 0

(22) SortMergeJoin [codegen id : 13]
Left keys [1]: [ws_order_number#4]
Right keys [1]: [ws_order_number#15]
Join condition: NOT (ws_warehouse_sk#8 = ws_warehouse_sk#14)

(23) Project [codegen id : 13]
Output [1]: [ws_order_number#4]
Input [4]: [ws_warehouse_sk#8, ws_order_number#4, ws_warehouse_sk#14, ws_order_number#15]

(24) Exchange
Input [1]: [ws_order_number#4]
Arguments: hashpartitioning(cast(ws_order_number#4 as bigint), 5), true, [id=#16]

(25) Sort [codegen id : 14]
Input [1]: [ws_order_number#4]
Arguments: [cast(ws_order_number#4 as bigint) ASC NULLS FIRST], false, 0

(26) Scan parquet default.web_returns
Output [1]: [wr_order_number#17]
Batched: true
Location [not included in comparison]/{warehouse_dir}/web_returns]
PushedFilters: [IsNotNull(wr_order_number)]
ReadSchema: struct<wr_order_number:bigint>

(27) ColumnarToRow [codegen id : 15]
Input [1]: [wr_order_number#17]

(28) Filter [codegen id : 15]
Input [1]: [wr_order_number#17]
Condition : isnotnull(wr_order_number#17)

(29) Exchange
Input [1]: [wr_order_number#17]
Arguments: hashpartitioning(wr_order_number#17, 5), true, [id=#18]

(30) Sort [codegen id : 16]
Input [1]: [wr_order_number#17]
Arguments: [wr_order_number#17 ASC NULLS FIRST], false, 0

(31) SortMergeJoin [codegen id : 17]
Left keys [1]: [cast(ws_order_number#4 as bigint)]
Right keys [1]: [wr_order_number#17]
Join condition: None

(32) Project [codegen id : 17]
Output [1]: [wr_order_number#17]
Input [2]: [ws_order_number#4, wr_order_number#17]

(33) SortMergeJoin
Left keys [1]: [cast(ws_order_number#4 as bigint)]
Right keys [1]: [wr_order_number#17]
Join condition: None

(34) Scan parquet default.customer_address
Output [2]: [ca_address_sk#19, ca_state#20]
Batched: true
Location [not included in comparison]/{warehouse_dir}/customer_address]
PushedFilters: [IsNotNull(ca_state), EqualTo(ca_state,IL), IsNotNull(ca_address_sk)]
ReadSchema: struct<ca_address_sk:int,ca_state:string>

(35) ColumnarToRow [codegen id : 18]
Input [2]: [ca_address_sk#19, ca_state#20]

(36) Filter [codegen id : 18]
Input [2]: [ca_address_sk#19, ca_state#20]
Condition : ((isnotnull(ca_state#20) AND (ca_state#20 = IL)) AND isnotnull(ca_address_sk#19))

(37) Project [codegen id : 18]
Output [1]: [ca_address_sk#19]
Input [2]: [ca_address_sk#19, ca_state#20]

(38) BroadcastExchange
Input [1]: [ca_address_sk#19]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [id=#21]

(39) BroadcastHashJoin [codegen id : 21]
Left keys [1]: [ws_ship_addr_sk#2]
Right keys [1]: [ca_address_sk#19]
Join condition: None

(40) Project [codegen id : 21]
Output [5]: [ws_ship_date_sk#1, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Input [7]: [ws_ship_date_sk#1, ws_ship_addr_sk#2, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6, ca_address_sk#19]

(41) Scan parquet default.web_site
Output [2]: [web_site_sk#22, web_company_name#23]
Batched: true
Location [not included in comparison]/{warehouse_dir}/web_site]
PushedFilters: [IsNotNull(web_company_name), EqualTo(web_company_name,pri), IsNotNull(web_site_sk)]
ReadSchema: struct<web_site_sk:int,web_company_name:string>

(42) ColumnarToRow [codegen id : 19]
Input [2]: [web_site_sk#22, web_company_name#23]

(43) Filter [codegen id : 19]
Input [2]: [web_site_sk#22, web_company_name#23]
Condition : ((isnotnull(web_company_name#23) AND (web_company_name#23 = pri)) AND isnotnull(web_site_sk#22))

(44) Project [codegen id : 19]
Output [1]: [web_site_sk#22]
Input [2]: [web_site_sk#22, web_company_name#23]

(45) BroadcastExchange
Input [1]: [web_site_sk#22]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [id=#24]

(46) BroadcastHashJoin [codegen id : 21]
Left keys [1]: [ws_web_site_sk#3]
Right keys [1]: [web_site_sk#22]
Join condition: None

(47) Project [codegen id : 21]
Output [4]: [ws_ship_date_sk#1, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Input [6]: [ws_ship_date_sk#1, ws_web_site_sk#3, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6, web_site_sk#22]

(48) Scan parquet default.date_dim
Output [2]: [d_date_sk#25, d_date#26]
Batched: true
Location [not included in comparison]/{warehouse_dir}/date_dim]
PushedFilters: [IsNotNull(d_date), GreaterThanOrEqual(d_date,1999-02-01), LessThanOrEqual(d_date,1999-04-02), IsNotNull(d_date_sk)]
ReadSchema: struct<d_date_sk:int,d_date:date>

(49) ColumnarToRow [codegen id : 20]
Input [2]: [d_date_sk#25, d_date#26]

(50) Filter [codegen id : 20]
Input [2]: [d_date_sk#25, d_date#26]
Condition : (((isnotnull(d_date#26) AND (d_date#26 >= 10623)) AND (d_date#26 <= 10683)) AND isnotnull(d_date_sk#25))

(51) Project [codegen id : 20]
Output [1]: [d_date_sk#25]
Input [2]: [d_date_sk#25, d_date#26]

(52) BroadcastExchange
Input [1]: [d_date_sk#25]
Arguments: HashedRelationBroadcastMode(List(cast(input[0, int, true] as bigint)),false), [id=#27]

(53) BroadcastHashJoin [codegen id : 21]
Left keys [1]: [ws_ship_date_sk#1]
Right keys [1]: [d_date_sk#25]
Join condition: None

(54) Project [codegen id : 21]
Output [3]: [ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Input [5]: [ws_ship_date_sk#1, ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6, d_date_sk#25]

(55) HashAggregate [codegen id : 21]
Input [3]: [ws_order_number#4, ws_ext_ship_cost#5, ws_net_profit#6]
Keys [1]: [ws_order_number#4]
Functions [2]: [partial_sum(UnscaledValue(ws_ext_ship_cost#5)), partial_sum(UnscaledValue(ws_net_profit#6))]
Aggregate Attributes [2]: [sum(UnscaledValue(ws_ext_ship_cost#5))#28, sum(UnscaledValue(ws_net_profit#6))#29]
Results [3]: [ws_order_number#4, sum#30, sum#31]

(56) Exchange
Input [3]: [ws_order_number#4, sum#30, sum#31]
Arguments: hashpartitioning(ws_order_number#4, 5), true, [id=#32]

(57) HashAggregate [codegen id : 22]
Input [3]: [ws_order_number#4, sum#30, sum#31]
Keys [1]: [ws_order_number#4]
Functions [2]: [merge_sum(UnscaledValue(ws_ext_ship_cost#5)), merge_sum(UnscaledValue(ws_net_profit#6))]
Aggregate Attributes [2]: [sum(UnscaledValue(ws_ext_ship_cost#5))#28, sum(UnscaledValue(ws_net_profit#6))#29]
Results [3]: [ws_order_number#4, sum#30, sum#31]

(58) HashAggregate [codegen id : 22]
Input [3]: [ws_order_number#4, sum#30, sum#31]
Keys: []
Functions [3]: [merge_sum(UnscaledValue(ws_ext_ship_cost#5)), merge_sum(UnscaledValue(ws_net_profit#6)), partial_count(distinct ws_order_number#4)]
Aggregate Attributes [3]: [sum(UnscaledValue(ws_ext_ship_cost#5))#28, sum(UnscaledValue(ws_net_profit#6))#29, count(ws_order_number#4)#33]
Results [3]: [sum#30, sum#31, count#34]

(59) Exchange
Input [3]: [sum#30, sum#31, count#34]
Arguments: SinglePartition, true, [id=#35]

(60) HashAggregate [codegen id : 23]
Input [3]: [sum#30, sum#31, count#34]
Keys: []
Functions [3]: [sum(UnscaledValue(ws_ext_ship_cost#5)), sum(UnscaledValue(ws_net_profit#6)), count(distinct ws_order_number#4)]
Aggregate Attributes [3]: [sum(UnscaledValue(ws_ext_ship_cost#5))#28, sum(UnscaledValue(ws_net_profit#6))#29, count(ws_order_number#4)#33]
Results [3]: [count(ws_order_number#4)#33 AS order count #36, MakeDecimal(sum(UnscaledValue(ws_ext_ship_cost#5))#28,17,2) AS total shipping cost #37, MakeDecimal(sum(UnscaledValue(ws_net_profit#6))#29,17,2) AS total net profit #38]

(61) Sort [codegen id : 23]
Input [3]: [order count #36, total shipping cost #37, total net profit #38]
Arguments: [order count #36 ASC NULLS FIRST], true, 0

