Code

Sqlalchemy#240

Code

Merged

nickeopti merged 118 commits intomainDHI/terracotta:mainfrom sqlalchemyDHI/terracotta:sqlalchemyCopy head branch name to clipboardFeb 21, 2022

+2,095-2,018

Commits

Commits on Dec 2, 2021

• Implement base SQLAlchemy raster driver

  nickeopti

  committed
  fdbfc84

  Copy full SHA for fdbfc84

• Add String size on table creation

  nickeopti

  committed
  b6602fa

  Copy full SHA for b6602fa

• Use readonly properties for db_version and key_names

  nickeopti

  committed
  4465d0e

  Copy full SHA for 4465d0e

• Adhere flake8 and mypy, and introduce DB_SCHEME

  nickeopti

  committed
  abf5e85

  Copy full SHA for abf5e85

• Use RelationalDriver

  nickeopti

  committed
  50ed8e4

  Copy full SHA for 50ed8e4

• Use default ParseResult structure instead of specific MySQLCredentials object

  nickeopti

  committed
  7037793

  Copy full SHA for 7037793

• Remove leftover print statements

  nickeopti

  committed
  b657bd3

  Copy full SHA for b657bd3

• Let functions optionally use unverified databases when connecting

  nickeopti

  committed
  35a5ce8

  Copy full SHA for 35a5ce8

• Fix column creation error and create tables on unverified database connection

  nickeopti

  committed
  fc5504c

  Copy full SHA for fc5504c

Commits on Dec 3, 2021

• Use indices on the keys in the DB to recreate correct order

  nickeopti

  committed
  cba5f5b

  Copy full SHA for cba5f5b

Commits on Dec 7, 2021

• index on sqlalchemy: cba5f5b Use indices on the keys in the DB to recreate correct order

  nickeopti

  committed
  50608a5

  Copy full SHA for 50608a5

• WIP on sqlalchemy: cba5f5b Use indices on the keys in the DB to recreate correct order

  nickeopti

  committed
  172cabf

  Copy full SHA for 172cabf

• Align handling of errors with previous version

  nickeopti

  committed
  b0116cb

  Copy full SHA for b0116cb

Commits on Dec 14, 2021

• Check for missing scheme instead of missing hostname

  nickeopti

  committed
  627bc30

  Copy full SHA for 627bc30

• Tidy mysql driver code up a bit

  nickeopti

  committed
  ac1cbbd

  Copy full SHA for ac1cbbd

• Remove leftover debugging stuff

  nickeopti

  committed
  658d7cf

  Copy full SHA for 658d7cf

• Add sqla InvalidRequestError to list of exceptions to convert (and tidy up a bit)

  nickeopti

  committed
  0d71226

  Copy full SHA for 0d71226

• Refactor sqlite driver to use the common RelationalDriver

  nickeopti

  committed
  63b2c70

  Copy full SHA for 63b2c70

Commits on Dec 17, 2021

• Ugly hack to make sqlite remote driver work with new and old structures

  nickeopti

  committed
  a5d9a1b

  Copy full SHA for a5d9a1b

• Require SQLAlchemy

  nickeopti

  committed
  e21fdee

  Copy full SHA for e21fdee

Commits on Dec 21, 2021

• Cleanup driver code and adhere flake8, mypy

  nickeopti

  committed
  e239d09

  Copy full SHA for e239d09

• Rename common to relational_base

  nickeopti

  committed
  d26ebc7

  Copy full SHA for d26ebc7

• Add and use ._local_path field on RemoteSQLiteDriver instead of inherited .path

  nickeopti

  committed
  f51175b

  Copy full SHA for f51175b

• Allow Path input and clean code

  nickeopti

  committed
  6d435bc

  Copy full SHA for 6d435bc

• Let drivers handle path resolving internally

  nickeopti

  committed
  2b14c83

  Copy full SHA for 2b14c83

• Add test for parsing of invalid schemes

  nickeopti

  committed
  48f7d25

  Copy full SHA for 48f7d25

• Only test invalid scheme for mysql

  nickeopti

  committed
  98ebb7d

  Copy full SHA for 98ebb7d

• Handle paths such that they hopefully work on Windows as well

  nickeopti

  committed
  f5bc5f9

  Copy full SHA for f5bc5f9

• Merge branch 'main' into sqlalchemy

  nickeopti

  committed
  0add2dc

  Copy full SHA for 0add2dc

Commits on Jan 4, 2022

• Cache drivers within each process only

  nickeopti

  committed
  ddda1bc

  Copy full SHA for ddda1bc

• Set connection transaction isolation level to READ UNCOMMITTED to enable proper upserts

  nickeopti

  committed
  faf8f64

  Copy full SHA for faf8f64

• Satisfy mypy

  nickeopti

  committed
  4a4657c

  Copy full SHA for 4a4657c

• Cleanup code

  nickeopti

  committed
  2a2c57f

  Copy full SHA for 2a2c57f

Commits on Jan 7, 2022

• Fix failing url_parse test

  nickeopti

  committed
  0aa63c4

  Copy full SHA for 0aa63c4

• Use docstring instead of comments

  Show description for 3a8144d
  

  nickeopti

  and

  dionhaefner

  authored
  3a8144d

  Copy full SHA for 3a8144d

• Describe the verify argument in connect method

  nickeopti

  committed
  d71d2d6

  Copy full SHA for d71d2d6

• Rename SQL_DATABASE_SCHEME to SQL_URL_SCHEME

  nickeopti

  committed
  8b95b20

  Copy full SHA for 8b95b20

• Don't echo anymore

  nickeopti

  committed
  38d7880

  Copy full SHA for 38d7880

• Describe assertion check better

  Show description for 5078bc3
  

  nickeopti

  and

  dionhaefner

  authored
  5078bc3

  Copy full SHA for 5078bc3

• Merge branch 'sqlalchemy' of https://github.com/DHI-GRAS/terracotta into sqlalchemy

  nickeopti

  committed
  7f53124

  Copy full SHA for 7f53124

• Restore mysql primary key size calculation

  nickeopti

  committed
  c4bb17c

  Copy full SHA for c4bb17c

• Describe the max primary key length

  nickeopti

  committed
  f391f86

  Copy full SHA for f391f86

• Improve exception convertions

  nickeopti

  committed
  bcd9a52

  Copy full SHA for bcd9a52

• Use cleaner exception handling in connect()

  nickeopti

  committed
  0d104c4

  Copy full SHA for 0d104c4

• Undo renaming of _connection_callback

  nickeopti

  committed
  813ebc7

  Copy full SHA for 813ebc7

• fix mypy error

  dionhaefner

  committed
  1b6a7f5

  Copy full SHA for 1b6a7f5

Commits on Jan 11, 2022

• Reimplement lazy loading max shape

  nickeopti

  committed
  25c594b

  Copy full SHA for 25c594b

• Merge branch 'sqlalchemy' of https://github.com/DHI-GRAS/terracotta into sqlalchemy

  nickeopti

  committed
  d5cf935

  Copy full SHA for d5cf935

• Don't echo anywhere

  nickeopti

  committed
  e850659

  Copy full SHA for e850659

• Explicitly define mysql tables with specific charset

  nickeopti

  committed
  2f7eff2

  Copy full SHA for 2f7eff2

• Just use Pathlib resolve method

  nickeopti

  committed
  a634b39

  Copy full SHA for a634b39

• Move _METADATA_COLUMNS out as a class variable again

  nickeopti

  committed
  229bcc4

  Copy full SHA for 229bcc4

• Improve parsing of paths

  nickeopti

  committed
  36e9e8e

  Copy full SHA for 36e9e8e

• Set mysql driver encoding to uft8mb4 as well

  nickeopti

  committed
  421acb3

  Copy full SHA for 421acb3

Commits on Jan 13, 2022

• Remove now unused code

  nickeopti

  committed
  f455edd

  Copy full SHA for f455edd

Commits on Jan 17, 2022

• update to most recent COG validate script

  dionhaefner

  committed
  da2bc5b

  Copy full SHA for da2bc5b

Commits on Jan 31, 2022

• Split Driver

  nickeopti

  committed
  c1b7bb0

  Copy full SHA for c1b7bb0

• Create TerracottaDriver

  nickeopti

  committed
  d587759

  Copy full SHA for d587759

• Move functionality up into Driver

  nickeopti

  committed
  959ecbf

  Copy full SHA for 959ecbf

• Split Driver

  nickeopti

  committed
  e4fff5d

  Copy full SHA for e4fff5d

• Rename accordingly to Driver refactor

  nickeopti

  committed
  c936905

  Copy full SHA for c936905

• Update tests according to Driver refactor

  nickeopti

  committed
  230d081

  Copy full SHA for 230d081

• Merge branch 'sqlalchemy' into sqlalchemy-compositional

  nickeopti

  committed
  8447a12

  Copy full SHA for 8447a12

• Remove leftover debugging prints

  nickeopti

  committed
  19b84dc

  Copy full SHA for 19b84dc

• move most logic from raster driver to raster.py module

  dionhaefner

  committed
  5161aec

  Copy full SHA for 5161aec

• go straight to :walrus: jail

  dionhaefner

  committed
  9477bf7

  Copy full SHA for 9477bf7

• ... and to py3.6 jail

  dionhaefner

  committed
  56256ac

  Copy full SHA for 56256ac

• Add test for key standardization

  nickeopti

  committed
  afd865a

  Copy full SHA for afd865a

• Merge branch 'sqlalchemy-compositional' of https://github.com/DHI-GRAS/terracotta into sqlalchemy-compositional

  nickeopti

  committed
  ac19a83

  Copy full SHA for ac19a83

• Test raster retrieval with all resampling methods

  nickeopti

  committed
  6e5b95a

  Copy full SHA for 6e5b95a

• Add test for raster.get_raster_tile

  nickeopti

  committed
  37cb0d0

  Copy full SHA for 37cb0d0

• Test unknown resampling method

  nickeopti

  committed
  76185e3

  Copy full SHA for 76185e3

• Test raster.get_metadata with large_raster_threshold exceeded

  nickeopti

  committed
  0d1096f

  Copy full SHA for 0d1096f

Commits on Feb 1, 2022

• bump coverage

  dionhaefner

  committed
  551ae7c

  Copy full SHA for 551ae7c

• resolve merge conflicts

  dionhaefner

  committed
  a2ab041

  Copy full SHA for a2ab041

• replace type ignore with assertion

  dionhaefner

  committed
  8d7ad06

  Copy full SHA for 8d7ad06

• 💄

  dionhaefner

  committed
  33373e1

  Copy full SHA for 33373e1

• Rename driver files and make key standardization a method

  nickeopti

  committed
  36eaf1d

  Copy full SHA for 36eaf1d

• Remember the new/renamed files!

  nickeopti

  committed
  046720d

  Copy full SHA for 046720d

• Use underscores in meta_store and raster_store

  nickeopti

  committed
  bd45e00

  Copy full SHA for bd45e00

• Also standardize the where/keys for get_datasets()

  nickeopti

  committed
  d5d1b09

  Copy full SHA for d5d1b09

• Rename to squeeze

  nickeopti

  committed
  3fdd90a

  Copy full SHA for 3fdd90a

• Improve repr

  nickeopti

  committed
  84a5219

  Copy full SHA for 84a5219

• Rename to GeoTiffRasterStore

  nickeopti

  committed
  1086d52

  Copy full SHA for 1086d52

• Rename to RelationalMetaStore

  nickeopti

  committed
  65cd29a

  Copy full SHA for 65cd29a

• Don't use too implicit hacks

  Show description for fed5a66
  

  nickeopti

  and

  dionhaefner

  authored
  fed5a66

  Copy full SHA for fed5a66

• Update test to new repr

  nickeopti

  committed
  ab6449f

  Copy full SHA for ab6449f

• Merge branch 'sqlalchemy-compositional' of https://github.com/DHI-GRAS/terracotta into sqlalchemy-compositional

  nickeopti

  committed
  9ad93b4

  Copy full SHA for 9ad93b4

• Rename filepath to handle

  nickeopti

  committed
  4ab4bdd

  Copy full SHA for 4ab4bdd

• Don't print anything

  nickeopti

  committed
  f89052e

  Copy full SHA for f89052e

• Rename *_stores

  nickeopti

  committed
  ca15c4a

  Copy full SHA for ca15c4a

• Re-rename keys to where

  nickeopti

  committed
  401728a

  Copy full SHA for 401728a

Commits on Feb 4, 2022

• Check for missing dataset in get_metadata, not in squeeze

  nickeopti

  committed
  62be08d

  Copy full SHA for 62be08d

• Define keystype explicitly

  nickeopti

  committed
  236f677

  Copy full SHA for 236f677

• Make keys standardization type check

  nickeopti

  committed
  c8d93ee

  Copy full SHA for c8d93ee

• Improve descriptiveness of metadata reload comment

  nickeopti

  committed
  f523ebe

  Copy full SHA for f523ebe

• Re-rename handle to path

  nickeopti

  committed
  0cce1b7

  Copy full SHA for 0cce1b7

Commits on Feb 20, 2022

• update docstrings

  mrpgraae

  committed
  8aad626

  Copy full SHA for 8aad626

• pin pytest<7.0

  mrpgraae

  committed
  0c1c94c

  Copy full SHA for 0c1c94c

Commits on Feb 21, 2022

• do not assemble rio env in driver

  dionhaefner

  committed
  06a6d1a

  Copy full SHA for 06a6d1a

• Update filename in module docstring

  Show description for da9f20f
  

  mrpgraae

  and

  dionhaefner

  authored
  da9f20f

  Copy full SHA for da9f20f

• docstring polish 📝

  Show description for 891185a
  

  mrpgraae

  and

  dionhaefner

  authored
  891185a

  Copy full SHA for 891185a

• Improve reprs and satisfy flake8

  nickeopti

  committed
  dc835a6

  Copy full SHA for dc835a6

• Improve normalised path from sqlite metastores and update relevant docs

  nickeopti

  committed
  7e75ff4

  Copy full SHA for 7e75ff4

• Update filenames in first line of files to reflect their actual filenames

  nickeopti

  committed
  69b7876

  Copy full SHA for 69b7876

• Always stringify url_or_path

  Show description for 06d6d49
  nickeopti

  committed
  06d6d49

  Copy full SHA for 06d6d49

• Rename *Driver classes to *MetaStore

  nickeopti

  committed
  722e7df

  Copy full SHA for 722e7df

• Remove references to rasters in meta stores's documentation

  nickeopti

  committed
  41a26e7

  Copy full SHA for 41a26e7

• Simplify docstrings in internal base_classes.py

  nickeopti

  committed
  3b65c8f

  Copy full SHA for 3b65c8f

• Fix bug (on Windows paths) in sqlite metastore _normalize_path

  nickeopti

  committed
  5a9969e

  Copy full SHA for 5a9969e

• Specify arguments to MetaStore.insert

  nickeopti

  committed
  d8b1ea2

  Copy full SHA for d8b1ea2

• Specify path in meta stores to be of type str

  nickeopti

  committed
  cd0fe1d

  Copy full SHA for cd0fe1d

• Use SQLAlchemy dialect+driver terminology

  nickeopti

  committed
  1556dce

  Copy full SHA for 1556dce

• fix API docs

  dionhaefner

  committed
  b2ebcba

  Copy full SHA for b2ebcba

• Merge pull request #248 from DHI-GRAS/sqlalchemy-compositional

  Show description for a8ee100
  dionhaefner

  authored
  a8ee100

  Copy full SHA for a8ee100

• merge

  dionhaefner

  committed
  bfa90a8

  Copy full SHA for bfa90a8

• Merge branch 'main' into sqlalchemy

  dionhaefner

  committed
  007fa95

  Copy full SHA for 007fa95

• unpin pytest

  dionhaefner

  committed
  2f7f9bb

  Copy full SHA for 2f7f9bb