You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG.md
+40-30
Original file line number
Diff line number
Diff line change
@@ -8,85 +8,95 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
8
8
9
9
## [0.120.0] - 2024-01-01
10
10
11
+
Happy New Year! 🎉🎉🎉
12
+
Here's the first release of 2024, the biggest ever with 280+ commits! qsv 0.120.0 continues to focus on performance, stability and reliability as we continue setting the stage for qsv's big brother - qsv pro.
13
+
14
+
Apart from wrapping qsv with a User Interface, qsv pro also comes with a retinue of related cloud-based data cleaning, enrichment and enhancement services along with expanded metadata inferencing to make your _*Data Useful, Usable and Used!*_
15
+
16
+
qsv pro draws inspiration from [OpenRefine](https://openrefine.org), but reimagined without its file size and speed limitations, with qsv pro having ability to process multi-gigabyte files in seconds.
17
+
18
+
It incorporates hard lessons we learned in the past 12 years deploying Data Portals and Data Pipelines to create a new Data/Metadata Wrangling and AI-assisted Data Publishing service that's easy to use for casual Excel users and Data Publishers, yet powerful enough for data scientists and data engineers.
19
+
20
+
But it's not quite ready for release yet, so stay tuned!
21
+
22
+
We're now taking signups for a preview release however, so if you're interested, please [sign up here](https://dathere.com/qsv-feedback-form/)!
23
+
24
+
Excitingly, qsv was also mentioned on Hacker News in [this thread](https://news.ycombinator.com/item?id=38733617) Dec 23, 2023! As a result, we're now almost at 2,000+ stars on GitHub from 900 stars on Dec 22! 🎉🎉🎉
25
+
26
+
Stay tuned for more advancements in 2024 – it's set to be a landmark year for qsv! 🦄🦄🦄
27
+
28
+
---
29
+
11
30
### Added
12
-
*`cat`: add rowskey --group options; increased perf of rowskey by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1508
13
-
*`validate`: add --trim and --quiet options by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1452
14
-
*`apply` & `applydp`: `operations regex_replace` now supports empty `--replacement` with the "<EMPTY>" special value by @jqnatividad inhttps://github.com/jqnatividad/qsv/pull/1470
15
-
*align `apply`/`applydp` with `replace` to use <NULL> case-insensitive… by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1471
16
-
*`exclude`: also consider rows with empty fields by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1498
31
+
*`cat`: add rowskey --group options; increased perf of rowskey https://github.com/jqnatividad/qsv/pull/1508
32
+
*`validate`: add --trim and --quiet options https://github.com/jqnatividad/qsv/pull/1452
33
+
*`apply` & `applydp`: `operations regex_replace` now supports empty `--replacement` with the "<NULL>" special value https://github.com/jqnatividad/qsv/pull/1470 andhttps://github.com/jqnatividad/qsv/pull/1471
34
+
*`exclude`: also consider rows with empty fields https://github.com/jqnatividad/qsv/pull/1498
*`validate`: Faster RFC4180 validation with byterecords and SIMD-accelerated utf8 validation by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1440
20
-
*`excel`: minor performance tweaks by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1446
21
-
* use one `replace_column_value` helper fn in util.rs by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1456
22
-
*`excel`: bump calamine from 0.22 to 0.23 by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1473
23
-
* Autocheck for updates 10% of the time by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1494
24
-
* refactor commands that accept multiple input files to use improved process_input helper by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1496
25
-
*`fetch` & `fetchpost`: get_response refactor by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1507
26
-
38
+
*`validate`: Faster RFC4180 validation with byterecords and SIMD-accelerated utf8 validation https://github.com/jqnatividad/qsv/pull/1440
39
+
*`excel`: minor performance tweaks https://github.com/jqnatividad/qsv/pull/1446
40
+
*`apply`, `applydp`, `explode`, `geocode`, `pseudo`: consolidate redundant code and use one `replace_column_value` helper fn in util.rs https://github.com/jqnatividad/qsv/pull/1456
41
+
*`excel`: bump calamine from 0.22 to 0.23 https://github.com/jqnatividad/qsv/pull/1473
42
+
*`excel` & `joinp`: use atoi_simd for faster &[u8] to int conversion https://github.com/jqnatividad/qsv/commit/9521f3e3fb73f600e6691188a65e19eda6cd317e
43
+
*`cat`, `describegpt`, `headers`, `sqlp`, `to`, `tojsonl`: refactor commands that accept multiple input files to use improved process_input helper https://github.com/jqnatividad/qsv/pull/1496
44
+
*`fetch` & `fetchpost`: get_response refactor for maintainability and performance https://github.com/jqnatividad/qsv/pull/1507
45
+
*`luau`: replaced --no-colindex option with --colindex option. --col-index slows down processing and is not often used, so make it an option, not the default. https://github.com/jqnatividad/qsv/commit/a0c856807c47f00f531837ae124d412fca834cd2
46
+
* make thousands crate optional with apply feature in https://github.com/jqnatividad/qsv/pull/1453
27
47
* build(deps): bump uuid from 1.6.0 to 1.6.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1430
28
48
* build(deps): bump serde from 1.0.192 to 1.0.193 by @dependabot in https://github.com/jqnatividad/qsv/pull/1432
29
49
* build(deps): bump data-encoding from 2.4.0 to 2.5.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1435
30
50
* build(deps): bump mlua from 0.9.1 to 0.9.2 by @dependabot in https://github.com/jqnatividad/qsv/pull/1436
31
51
* build(deps): bump url from 2.4.1 to 2.5.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1437
32
-
* make thousands crate optional with apply feature by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1453
33
-
34
52
* build(deps): bump jql-runner from 7.0.6 to 7.0.7 by @dependabot in https://github.com/jqnatividad/qsv/pull/1439
35
53
* build(deps): bump jql-runner from 7.0.7 to 7.1.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1447
36
54
* build(deps): bump jql-runner from 7.1.0 to 7.1.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1457
37
55
* build(deps): bump jql-runner from 7.1.1 to 7.1.2 by @dependabot in https://github.com/jqnatividad/qsv/pull/1486
38
-
39
56
* build(deps): bump hashbrown from 0.14.2 to 0.14.3 by @dependabot in https://github.com/jqnatividad/qsv/pull/1441
40
-
41
57
* build(deps): bump redis from 0.23.3 to 0.23.4 by @dependabot in https://github.com/jqnatividad/qsv/pull/1442
42
58
* build(deps): bump redis from 0.23.3 to 0.24.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1455
43
-
44
59
* build(deps): bump atoi_simd from 0.15.3 to 0.15.4 by @dependabot in https://github.com/jqnatividad/qsv/pull/1444
45
60
* build(deps): bump atoi_simd from 0.15.4 to 0.15.5 by @dependabot in https://github.com/jqnatividad/qsv/pull/1445
46
61
* build(deps): bump atoi_simd from 0.15.5 to 0.15.6 by @dependabot in https://github.com/jqnatividad/qsv/pull/1512
47
-
48
62
* build(deps): bump actions/setup-python from 4.7.1 to 4.8.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1454
49
63
* build(deps): bump actions/setup-python from 4.8.0 to 5.0.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1459
50
-
51
64
* build(deps): bump actions/stale from 8 to 9 by @dependabot in https://github.com/jqnatividad/qsv/pull/1463
52
65
* build(deps): bump itoa from 1.0.9 to 1.0.10 by @dependabot in https://github.com/jqnatividad/qsv/pull/1464
53
-
54
66
* build(deps): bump tokio from 1.34.0 to 1.35.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1465
55
67
* build(deps): bump tokio from 1.35.0 to 1.35.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1483
56
-
57
68
* build(deps): bump ryu from 1.0.15 to 1.0.16 by @dependabot in https://github.com/jqnatividad/qsv/pull/1466
58
69
* build(deps): bump file-format from 0.22.0 to 0.23.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1468
59
-
60
70
* build(deps): bump github/codeql-action from 2 to 3 by @dependabot in https://github.com/jqnatividad/qsv/pull/1476
61
71
* build(deps): bump geosuggest-utils from 0.5.1 to 0.5.2 by @dependabot in https://github.com/jqnatividad/qsv/pull/1479
62
72
* build(deps): bump geosuggest-core from 0.5.1 to 0.5.2 by @dependabot in https://github.com/jqnatividad/qsv/pull/1478
63
73
* build(deps): bump reqwest from 0.11.22 to 0.11.23 by @dependabot in https://github.com/jqnatividad/qsv/pull/1480
64
74
* build(deps): bump calamine from 0.23.0 to 0.23.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1481
65
75
* build(deps): bump qsv-sniffer from 0.10.0 to 0.10.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1484
66
76
* build(deps): bump anyhow from 1.0.75 to 1.0.76 by @dependabot in https://github.com/jqnatividad/qsv/pull/1485
67
-
68
77
* build(deps): bump futures from 0.3.29 to 0.3.30 by @dependabot in https://github.com/jqnatividad/qsv/pull/1492
69
78
* build(deps): bump futures-util from 0.3.29 to 0.3.30 by @dependabot in https://github.com/jqnatividad/qsv/pull/1491
70
79
* build(deps): bump crossbeam-channel from 0.5.9 to 0.5.10 by @dependabot in https://github.com/jqnatividad/qsv/pull/1490
71
-
72
80
* build(deps): bump sysinfo from 0.29.10 to 0.29.11 by @dependabot in https://github.com/jqnatividad/qsv/pull/1443
73
-
* Bump sysinfo from 0.29.11 to 0.30 by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1489
81
+
* Bump sysinfo from 0.29.11 to 0.30 https://github.com/jqnatividad/qsv/pull/1489
74
82
* build(deps): bump sysinfo from 0.30.0 to 0.30.1 by @dependabot in https://github.com/jqnatividad/qsv/pull/1495
75
83
* build(deps): bump sysinfo from 0.30.1 to 0.30.2 by @dependabot in https://github.com/jqnatividad/qsv/pull/1504
76
84
* build(deps): bump sysinfo from 0.30.2 to 0.30.3 by @dependabot in https://github.com/jqnatividad/qsv/pull/1509
77
-
78
85
* build(deps): bump tabwriter from 1.3.0 to 1.4.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1500
79
86
* build(deps): bump tempfile from 3.8.1 to 3.9.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1502
80
87
* build(deps): bump qsv_docopt from 1.4.0 to 1.5.0 by @dependabot in https://github.com/jqnatividad/qsv/pull/1503
81
-
82
88
* build(deps): bump ahash from 0.8.6 to 0.8.7 by @dependabot in https://github.com/jqnatividad/qsv/pull/1510
83
89
* build(deps): bump serde_json from 1.0.108 to 1.0.109 by @dependabot in https://github.com/jqnatividad/qsv/pull/1511
90
+
* apply select clippy suggestions
91
+
* update several indirect dependencies
92
+
* pin Rust nightly to 2023-12-23
84
93
85
94
### Fixed
86
-
* Fix for apply `dynfmt` and `calcconv` not working in release mode by @jqnatividad in https://github.com/jqnatividad/qsv/pull/1467
95
+
*`apply`: Fix for `dynfmt` and `calcconv` subcommands not working in release mode https://github.com/jqnatividad/qsv/pull/1467
96
+
*`luau`: fix check for excess mapped columns earlier. Otherwise, we'll get a CSV different field count error https://github.com/jqnatividad/qsv/commit/db1581159590205af9befaade5c047d316c9c8b3
87
97
88
98
### Removed
89
-
*`luau`: remove `--jit` option by @jqnatividad inhttps://github.com/jqnatividad/qsv/pull/1438
99
+
*`luau`: remove unneeded `--jit` option as we precompile luau scripts to bytecodehttps://github.com/jqnatividad/qsv/pull/1438
0 commit comments