Releases: bluelabsio/records-mover
Releases · bluelabsio/records-mover
v1.6.1 bump version to publish on PyPI
v1.6.0 Support SQLAlchemy 2.0, upgrade db-facts
What's Changed
- RM-101 max PyYAML version by @ryantimjohn in #251
- RM-104: upper bound mypy < 1.5.0 to fix typechecking by @Brunope in #253
- RM-96-rewrite-DBDriver-so-current-db-becomes-a-connection-db_engine-takes-all-Engine-responsibilities by @ryantimjohn in #250
- use composition in RM-87 by @ryantimjohn in #255
- Rm 87 upgrade to sql alchemy 2.0 by @ryantimjohn in #245
- remove engineering-general from config.yml by @ryantimjohn in #256
- Rm 95 remove sql injection possibilities by @ryantimjohn in #254
- RM-105: Adding Dockerfile by @naswierczek in #257
- RM-108 remove upper bound on google-api-python-cli by @ryantimjohn in #259
- RM-63 Update for compatibility with Pandas 2 by @ryantimjohn in #258
- Rm 109 remove upper bound on grpcio by @ryantimjohn in #260
- Rm 110 remove upper bound on awscli by @ryantimjohn in #261
- RM-117 update to use keyring by @ryantimjohn in #262
- Rm 111 remove upper bound on s3 concat by @ryantimjohn in #263
- Rm 112 remove upper bound on oauth2client by @ryantimjohn in #264
- RM-113 remove upper bound pyyaml by @ryantimjohn in #265
- RM-114 remove upper bounds on db-facts by @ryantimjohn in #266
- RM-116 remove upper bound on config-resolver by @ryantimjohn in #268
- RM-115-remove-upper-bound-on-chardet by @ryantimjohn in #267
- RM-119 fix tbl2tbl test by @ryantimjohn in #270
- RM-118: Removing deprecrated dependency by @naswierczek in #269
- release 1.6.0 by @Brunope in #271
New Contributors
- @naswierczek made their first contribution in #257
Full Changelog: v1.5.4...v1.6.0
v1.5.4 CI improvements, better pandas dependency, internal code complexity fixes
What's Changed
- RM-74 ignore fileobject type for mypy typecheck by @Brunope in #238
- RM-42 job config schema too complex by @Brunope in #231
- RM-45-records_mover-db-redshift-records_copy.py-13-1-C901-redshift_copy_options-is-too-complex-27 by @ryantimjohn in #237
- RM-80 add slack notifications for fail and deploy by @ryantimjohn in #241
- RM-82 add circleCI passing badge by @ryantimjohn in #240
- RM-44 Wrap determine_input_date_order_style in a handler object by @Brunope in #239
- Rm 62 rewrite dependencies so we require pandas 1.3.5 and above and below 2.0.0 by @ryantimjohn in #243
- RM-86 Error on Future and Deprecation Warnings by @ryantimjohn in #244
- Change build fail slack channel by @Brunope in #248
- release v1.5.4 by @Brunope in #249
Full Changelog: v1.5.3...v1.5.4
v1.5.3 Downgrade sqlalchemy-redshift, generate CLI docs, internal changes
What's Changed
- RM-49 Reduce field_to_sqlalchemy_type complexity by @ryantimjohn in #224
- RM-50 Simplify run_test into smaller functions by @Brunope in #229
- RM-65 Add sphinx argparse by @Brunope in #226
- Remove sphinx_requirements.txt - readthedocs build now uses setup.py by @Brunope in #225
- RM-46 Simplify redshift records_unload by @ryantimjohn in #227
- RM-43 Simplify records_mover-db-mysql-load_options.py by @ryantimjohn in #230
- RM-48 Simplify to_pandas_dtype by @ryantimjohn in #233
- RM-70 Cap sqlalchemy-redshift < 0.8.13 by @Brunope in #235
- RM-69 Remove bigfiles check by @Brunope in #232
- RM-56 Uncomment all requirements for deploy workflow in CircleCI by @ryantimjohn in #217
Full Changelog: v1.5.2...v1.5.3
v1.5.2 Update to compatibility with SQLAlchemy 1.4
What's Changed
- RM-39 update to sqlalchemy 1.4 by @ryantimjohn in #208
- RM-54 update version to 1.5.2 by @ryantimjohn in #218
Full Changelog: v1.5.1...v1.5.2
v1.5.1 Update version in version.py
What's Changed
- RM-39 Update to version 1.5.1 by @ryantimjohn in #214
Full Changelog: v1.5.0...v1.5.1
v1.5.0 Add Airflow 2.0 support, fix broken tests, update many dependencies
What's Changed
- RM-3 fix postgres integration tests by @Brunope in #181
- Update all Python 3.6 tests to 3.9 by @ryantimjohn in #180
- RM-17-fix-flake-8-violations by @ryantimjohn in #182
- redshift-s3-itest-old-pandas breaks when it has to actually install dependencies by @Brunope in #186
- Fix readthedocs build by @Brunope in #189
- RM-33-migrate-from-nose-to-pytest by @ryantimjohn in #191
- add 3.11 test by @ryantimjohn in #190
- Update to Pytest by @ryantimjohn in #192
- Add github actions job to run unit tests for 3.8, 3.9 by @Brunope in #188
- RM-4 Add Bigquery No GCS Integration Tests by @ryantimjohn in #196
- Rm 5 fix bigquery gcs integration tests by @ryantimjohn in #198
- RM-34-upgrade-syntax-to-support-airflow-2-0 by @ryantimjohn in #193
- RM-21-Add-tests-for-Python-3.10-build by @ryantimjohn in #195
- RM-22-Add-CircleCI-tests-for-Python-3.11-build by @ryantimjohn in #200
- RM-14-fix-my-sql-integration-test by @ryantimjohn in #201
- RM-18 fix docs build by @Brunope in #194
- Fix Table to Table integration tests by @ryantimjohn in #177
- RM-41 remove requires from circleCI config by @ryantimjohn in #203
- RM-13-fix-vertica-no-s-3-integration-test by @ryantimjohn in #204
- Rm 9 enable test 3.7 job in circle ci config fix typecheck problems by @ryantimjohn in #205
- RM-28 remove float128 references by @ryantimjohn in #206
- RM-55-remove-upper-bound-error-on-ratcheting-tests by @ryantimjohn in #212
- RM-36 bump tenacity version by @ryantimjohn in #207
- Ignore flake8 complexity warning for pandas/read_csv_options by @Brunope in #210
- Bump cryptography from 39.0.0 to 39.0.1 in /docs/source by @dependabot in #209
- Bump werkzeug from 2.2.2 to 2.2.3 in /docs/source by @dependabot in #211
New Contributors
- @Brunope made their first contribution in #181
- @dependabot made their first contribution in #209
Full Changelog: v1.4.0...v1.5.0
v1.4.0 - Remove outdated dependencies, fix CircleCI build, add keepalives, handle np.float128 exceptions
What's Changed
- Removing Nose-Progressive Dependency by @archetypalsxe in #171
- Add keepalives by default to redshift db connection url by @austinweisgrau in #173
- Handle exception when machine has no np.float128 by @austinweisgrau in #174
New Contributors
- @austinweisgrau made their first contribution in #173
Full Changelog: v1.3.0...v1.4.0
v1.3.0 - Bigquery parameterized types and dep bumps
Breaking Changes
- pybigquery was renamed sqlalchemy-bigquery, and this release now depends on this new package name. Please make sure you remove pybigquery from any existing environments and requirements files.
New features
- Support bigquery parameterized types by @cwegrzyn in #168
- Support newer versions of smart_open by @cwegrzyn in #167
Full Changelog: v1.2.0...v1.3.0
v1.2.0 - BigQuery improvements, date/time improvements, nullable ints and more
Breaking changes:
- None
New features:
- Add Avro support for Redshift import #137 (vinceatbluelabs)
- Add support for BigQuery bulk export (to Avro, for now) #136 (vinceatbluelabs)
- Prefer pandas nullable integers for int fields #159 (cwegrzyn)
- Use dataset location for bigquery load job #162 (cwegrzyn)
Bug fixes / reliability improvements:
- Improve date/time hint handling based on better testing for:
- Redshift #149 (vinceatbluelabs)
- Pandas #148 (vinceatbluelabs)
- Vertica #147 (vinceatbluelabs)
- Postgres #146 (vinceatbluelabs)
- MySQL #151 (vinceatbluelabs)
- Support more date/time hints during Pandas-based generation of CSV files #155 (vinceatbluelabs) (fixes #142 and #143)
Other updates:
- Loosen validation and mypy type requirements for date/time types, start increased testing #144 (vinceatbluelabs)
- Drop overly-complected Christmas tree tests #145 (vinceatbluelabs)
- Fix Pandas date formatting, add date/time integration tests #153 (vinceatbluelabs)
- MySQL time column to dataframe fix for Pandas 1.x, increase MySQL integration testing #152 (vinceatbluelabs)
- Ensure close() is called on result of pandas.read_sql(chunksize=...) #150 (vinceatbluelabs)
- Various dependency tweaks:
- Tweak collections.abc import to resolve mypy issue #163 (cwegrzyn)