|
1 |
| -# blaze-v2.0.8 |
| 1 | +# blaze-v2.0.9 |
2 | 2 |
|
3 | 3 | ## Features
|
4 |
| -* Enables nested complex data types by default. |
5 |
| -* Supports writing parquet table with dynamic partitions. |
6 |
| -* Supports partial aggregate skipping. |
7 |
| -* Enable first() aggregate function converting. |
8 |
| -* Add spill metrics. |
9 |
| -* |
| 4 | +* Upgrades datafusion/arrow dependency version to v36/v50. |
| 5 | +* Supports max/min aggregation with complex types. |
| 6 | +* Supports json_tuple. |
| 7 | +* Introduce sonic-rs for json parsing. |
| 8 | +* Add stage id in operator metrics. |
| 9 | +* Implements writing table with dynamic partitions (not tested in spark303/spark333). |
| 10 | + |
10 | 11 | ## Performance
|
11 |
| -* Implement batch updating/merging in aggregates. |
12 |
| -* Use slim box for storing bytes. |
13 |
| -* get_json_object use Cow to avoid copying. |
14 |
| -* Reduce the probability of unexpected off-heap memory overflows. |
15 |
| -* Introduce multiway merge sort to SortExec and SortRepartitioner. |
16 |
| -* SortExec removes redundant columns from batch. |
17 |
| -* Implement loser tree with inlined comparable traits. |
18 |
| -* Use unchecked index in LoserTree to get slightly performance improvement. |
19 |
| -* Remove BucketRepartitioner. |
20 |
| -* Reduce number of awaits in sort-merge join. |
21 |
| -* Pre-merge records in sorting mode if cardinality is low. |
22 |
| -* Use gxhash as default hasher in AggExec. |
23 |
| -* Optimize collect_set/collect_list function with SmallVec. |
24 |
| -* Implement async ipc reader. |
| 12 | +* Improves batch serialization format and reduce compressed size. |
| 13 | +* Implements radix-based k-way merging used in shuffling and aggregating. |
| 14 | +* Improves performance of on-heap spilling. |
| 15 | +* Improves performance of SortExec. |
| 16 | +* Improves performance of AggExec. |
| 17 | +* Improves performance of collect_set/collect_list. |
25 | 18 |
|
26 | 19 | ## Bugfix
|
27 |
| -* Fix buggy GetArrayItem/GetMapValue native converter pattern matching. |
28 |
| -* Fix parquet pruning with NaN values. |
29 |
| -* Fix map type conversion with incorrect nullable value. |
30 |
| -* Fix ffi-export error in some cases. |
31 |
| -* Fix incorrect behavior of get_index_field with incorrect number of rows. |
32 |
| -* Fix task hanging in some cases with ffi-export. |
| 20 | +* Fix concat_ws with empty batches. |
| 21 | +* Fix spark333 RenameExec incorrect ordering expressions. |
| 22 | +* Fix incorrect join type mapping in BroadcastNestedLoopJoin. |
| 23 | +* Fix decimal dividing with zero. |
0 commit comments