forked from heterodb/pg-strom
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGELOG
127 lines (110 loc) · 5.69 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
* Fri Dec 15 2023 KaiGai Kohei <[email protected]> - 5.0-1
- The code base has been re-designed entirely with various improvement.
- Process model was revised to concentrate GPU resource management to
multi-threaded background worker process (PG-Strom GPU Service).
Unlike v3.x or older, this new design reduces GPU resource consumption
and overhead of task-switching.
- GPU device code in v5.0 operates individual tasks according to the pseudo
code (called 'kexp') generated from the supplied SQL clauses. Unlike v3.x or
older, it never generates CUDA C++ native code (thus, run-time compiler
stuff by NVRTC was removed).
It improves agility of query execution, and helps software quality assurance
due to code stability. It is also a groundwork for the future support of CSD
(computational storage drives), DPU (data processing unit) or others.
- GPU-Cache is now built on CUDA managed memory that allows memory
overcommit, larger than the physical size of GPU DRAM.
- xPU device type definition was modified to optimize for wide-band GPU
memory with utilization of coleasced memory access. kvec_datum_t (or its
inherited) type internally declared with small array for each fields to access
these values simultaneously.
- gpupreagg tends to use GPU shared memory for more lightweight aggregation
as long as number of groups are less than the capacity.
- gpujoin extracts tuples once per depth, unlike v3.x or older.
- partition-wise gpujoin is still works-in-progress, so we will re-activate
the feature at v5.1.
- ...and fixed various bugs.
* Sat Dec 11 2021 KaiGai Kohei <[email protected]> - 3.3-2
- Rebuild for CUDA11.5 Update 1; contains compiler optimization bugfix
- A critical bug fix on nogroup_reduction
- Various bug fixes
* Sun Nov 14 2021 KaiGai Kohei <[email protected]> - 3.3-1
- Support of heterodb-extra API version 20211018
- Allows multiple optimal GPUs
- GpuPreAgg: fix optimizer error if ORDER BY is used together.
- Various bug fixes
* Tue Oct 5 2021 KaiGai Kohei <[email protected]> - 3.2-1
- GpuPreAgg: reduction logic reworked (local+global hybrid hash)
- GpuPreAgg: add hyper-log-log cardinarity estimation with hll_count(X)
- Add information views for CUDA programs/shared memory chunks
- Add truncate handler for PG14
- Various bug fixes
* Sat Aug 21 2021 KaiGai Kohei <[email protected]> - 3.1-1
- Arrow_Fdw supports min/max statistics as like BRIN index
- GpuCache: BEFORE TRUNCATE trigger is not needed on PG13
- GpuCache: add corruption state if failed on redo-log-apply
- Now PG-Strom can be built standalong (w/o heterodb-extra)
- various bug fixes
* Wed Jun 30 2021 KaiGai Kohei <[email protected]> - 3.0-2
- Built for CUDA11.4
* Tue Jun 29 2021 KaiGai Kohei <[email protected]> - 3.0-1
- several PostGIS functions are added for GPU execution
- GiST-index support was added for GpuJoin
- GpuCache was added for small data workloads
- experimental support of NVIDIA GPUDirect Storage
- support of custom GPU types/functions with 3rd party modules
- pg2arrow/arrow_fdw support wider Arrow files than PG limit
- pcap2arrow was added to capture network packets as Arrow files
- experimental support of 8bit-integer type (int1)
- add support of Ampere GPUs (A100) and CUDA11.3
- add support of PostgreSQL 13.x, drop support of PostgreSQL 10.x
- add support of ScaleFlux CSD drives as source of GPUDirect SQL
- error reports in GPU kernels were more human readable
- ...and miscellaneous improvement and fix various bugs
* Tue Mar 24 2020 KaiGai Kohei <[email protected]> - 2.3-1
- GpuJoin supports parallel execution on inner hash/heap table.
- Partition-wise GpuJoin was refactored for better query plan.
- Arrow_Fdw now supports INSERT/TRUNCATE commands.
- mysql2arrow was added, for collaboration with MySQL database.
- CuPy_Strom enables to share data frame between DB and Python.
- PL/CUDA was deprecated, CuPy + CuPy_Strom can do same jobs.
- Gstore_Fdw was deprecated, Arrow_Fdw is successor
* Wed Dec 25 2019 KaiGai Kohei <[email protected]> - 2.2-2
- support of RHEL8/CentOS8
- pg2arrow supports the latest Arrow 0.15 format; upcoming 1.0
- add support of ANALYZE on arrow_fdw
- PostgreSQL v9.6 is dropped from the supported list.
* Thu Sep 5 2019 KaiGai Kohei <[email protected]> - 2.2-1
- fixes of various bugs
- support of Apache Arrow columnar store (Arrow_Fdw)
- pg2arrow utility command is added
- support of JSONB data type
- pre-built GPU binary for quick code compilation/optimization
- support of nvme_strom v2; enables to handle cached disk pages
- asymmetric partition-wise JOIN support
* Wed Feb 20 2019 KaiGai Kohei <[email protected]> - 2.1-1
- hotfixes for various bugs
- Device Numeric is now based on 128bit
- Various groundwork to support Apache Arrow in the next version
* Thu Dec 27 2018 KaiGai Kohei <[email protected]> - 2.0-181227
- hotfixes for various bugs
- Add PostgreSQL 11 support
- columnar cache was removed
- Gstore_Fdw can be used for source relation of SELECT, with GpuSort
- add partitioning and multi-GPUs support
- PL/CUDA design revised
* Thu Jul 12 2018 KaiGai Kohei <[email protected]> - 2.0-180712
- hotfixes for various bugs
- add BRIN index support
* Thu Jun 7 2018 KaiGai Kohei <[email protected]> - 2.0-180607
- hotfixes for various bugs
- add partition-wise GpuJoin/GpuPreAgg (experimental)
* Tue May 15 2018 KaiGai Kohei <[email protected]> - 2.0-180515
- hotfixes for various bugs
* Mon Apr 30 2018 KaiGai Kohei <[email protected]> - 2.0-180430
- hotfixes for reported bugs
- CUDA C code builder is re-designed as background worker, instead of
the worker thread of GpuContext.
* Tue Apr 17 2018 KaiGai Kohei <[email protected]> - 2.0-1
- PG-Strom v2.0 release
* Sat Jan 20 2018 KaiGai Kohei <[email protected]> - 1.9-180120
- initial RPM specfile