Test failure: `test_migrate_external_table_hiveserde_in_place`

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_ur1m not found in dummy_cdl2r.hiveserde_in_place_ur1m (5m11.625s)

AssertionError: parquet_serde_ur1m not found in dummy_cdl2r.hiveserde_in_place_ur1m
assert False
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gsumdlmm1ef6pyue no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_osbpwqfv3eih3nyq no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pmsqwnkcyp34jzlm no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wub0ogd48witfc53 no longer exists. Skipping checking its migration status.
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] fetching tables inventory
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s4oya`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] crawling new set of snapshot data for tables
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m] listing tables and views
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] found 3 new records for tables
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/avro_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/parquet_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/orc_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/avro_serde_ur1m' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757740633')
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/orc_serde_ur1m' TBLPROPERTIES ('transient_lastDdlTime'='1757740631')
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/parquet_serde_ur1m' TBLPROPERTIES ('transient_lastDdlTime'='1757740631')
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m: [RequestId=0ba76def-fbe8-405c-999c-778359e22cd9 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=57397d89-f476-492f-83c0-f7eec910628a
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m: [RequestId=d597f50b-7f9e-42fc-9a98-e2114027719f ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=ba20c1fd-24f0-48f0-b604-ae2ff3f87491
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m: [RequestId=0ef1515a-ba9b-4edc-b185-85e888531dd1 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=26d55c0d-b1b4-42b7-bdba-3e119e2665cc
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gsumdlmm1ef6pyue no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_osbpwqfv3eih3nyq no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pmsqwnkcyp34jzlm no longer exists. Skipping checking its migration status.
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wub0ogd48witfc53 no longer exists. Skipping checking its migration status.
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] fetching tables inventory
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s4oya`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] crawling new set of snapshot data for tables
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m] listing tables and views
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m] fetching table metadata
05:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s4oya.tables] found 3 new records for tables
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/avro_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/parquet_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ur1m/orc_serde_ur1m
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/avro_serde_ur1m' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757740633')
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/orc_serde_ur1m' TBLPROPERTIES ('transient_lastDdlTime'='1757740631')
05:22 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m using SQL query: CREATE TABLE dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_ur1m/parquet_serde_ur1m' TBLPROPERTIES ('transient_lastDdlTime'='1757740631')
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.parquet_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.parquet_serde_ur1m: [RequestId=0ba76def-fbe8-405c-999c-778359e22cd9 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=57397d89-f476-492f-83c0-f7eec910628a
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.avro_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.avro_serde_ur1m: [RequestId=d597f50b-7f9e-42fc-9a98-e2114027719f ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=ba20c1fd-24f0-48f0-b604-ae2ff3f87491
05:22 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_ur1m.orc_serde_ur1m to dummy_cdl2r.hiveserde_in_place_ur1m.orc_serde_ur1m: [RequestId=0ef1515a-ba9b-4edc-b185-85e888531dd1 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=26d55c0d-b1b4-42b7-bdba-3e119e2665cc
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #627}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_w5ei not found in dummy_cr4qf.hiveserde_in_place_w5ei (5m2.56s)

AssertionError: parquet_serde_w5ei not found in dummy_cr4qf.hiveserde_in_place_w5ei
assert False
[gw7] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_2myp094n6gquaauj no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ffhc9e2t1jv82r4x no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gkxwz2vfxiyttuva no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_vozati1ftz1ythhk no longer exists. Skipping checking its migration status.
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] fetching tables inventory
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sbydt`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] crawling new set of snapshot data for tables
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei] listing tables and views
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] found 3 new records for tables
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/orc_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/parquet_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/avro_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/orc_serde_w5ei' TBLPROPERTIES ('transient_lastDdlTime'='1757827015')
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/parquet_serde_w5ei' TBLPROPERTIES ('transient_lastDdlTime'='1757827014')
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/avro_serde_w5ei' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757827016')
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei: [RequestId=9d4f79e0-7234-467d-b104-2bdea33c3cbb ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=5caf9ecc-929c-45f5-8613-974e1c0e56b3
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei: [RequestId=0dbe3921-ae76-95d4-a618-59363509a9c4 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=10585d6c-afea-4fdf-9213-e04798d752bf
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei: [RequestId=020fc975-3899-4aeb-98c0-2ecf0a62bd55 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=37f75271-bc21-444e-b158-e7740ca5b0f9
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_2myp094n6gquaauj no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ffhc9e2t1jv82r4x no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_gkxwz2vfxiyttuva no longer exists. Skipping checking its migration status.
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_vozati1ftz1ythhk no longer exists. Skipping checking its migration status.
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] fetching tables inventory
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sbydt`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] crawling new set of snapshot data for tables
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei] listing tables and views
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei] fetching table metadata
05:21 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbydt.tables] found 3 new records for tables
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/orc_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/parquet_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_w5ei/avro_serde_w5ei
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/orc_serde_w5ei' TBLPROPERTIES ('transient_lastDdlTime'='1757827015')
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/parquet_serde_w5ei' TBLPROPERTIES ('transient_lastDdlTime'='1757827014')
05:21 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei using SQL query: CREATE TABLE dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_w5ei/avro_serde_w5ei' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757827016')
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.orc_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.orc_serde_w5ei: [RequestId=9d4f79e0-7234-467d-b104-2bdea33c3cbb ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=5caf9ecc-929c-45f5-8613-974e1c0e56b3
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.parquet_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.parquet_serde_w5ei: [RequestId=0dbe3921-ae76-95d4-a618-59363509a9c4 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=10585d6c-afea-4fdf-9213-e04798d752bf
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_w5ei.avro_serde_w5ei to dummy_cr4qf.hiveserde_in_place_w5ei.avro_serde_w5ei: [RequestId=020fc975-3899-4aeb-98c0-2ecf0a62bd55 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=37f75271-bc21-444e-b158-e7740ca5b0f9
[gw7] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #628}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_9sei not found in dummy_cf1hf.hiveserde_in_place_9sei (5m5.642s)

AssertionError: parquet_serde_9sei not found in dummy_cf1hf.hiveserde_in_place_9sei
assert False
[gw2] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_rhtjwclx5t9s891u no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_xqsmsdggp5geklpi no longer exists. Skipping checking its migration status.
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] fetching tables inventory
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_slrxv`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] crawling new set of snapshot data for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei] listing tables and views
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] found 3 new records for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/avro_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/orc_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/parquet_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/avro_serde_9sei' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757913544')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/orc_serde_9sei' TBLPROPERTIES ('transient_lastDdlTime'='1757913543')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/parquet_serde_9sei' TBLPROPERTIES ('transient_lastDdlTime'='1757913542')
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei: [RequestId=898ade7b-2899-4dec-812b-455f7cc414dc ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=be0cf96d-166e-46fe-86e3-74ca43478d44
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei: [RequestId=ddf25eb1-0786-44a1-8ce5-87c7de7d2c82 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=39f1452a-73c7-4e9a-a240-74da00e3060f
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei: [RequestId=676a0bbf-e8a4-43f2-abe2-f4092c3982d5 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=f8d5679e-ca96-4f60-804b-ffd757e77a86
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_rhtjwclx5t9s891u no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_xqsmsdggp5geklpi no longer exists. Skipping checking its migration status.
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] fetching tables inventory
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_slrxv`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] crawling new set of snapshot data for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei] listing tables and views
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_slrxv.tables] found 3 new records for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/avro_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/orc_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_9sei/parquet_serde_9sei
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/avro_serde_9sei' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757913544')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/orc_serde_9sei' TBLPROPERTIES ('transient_lastDdlTime'='1757913543')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei using SQL query: CREATE TABLE dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_9sei/parquet_serde_9sei' TBLPROPERTIES ('transient_lastDdlTime'='1757913542')
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.parquet_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.parquet_serde_9sei: [RequestId=898ade7b-2899-4dec-812b-455f7cc414dc ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=be0cf96d-166e-46fe-86e3-74ca43478d44
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.orc_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.orc_serde_9sei: [RequestId=ddf25eb1-0786-44a1-8ce5-87c7de7d2c82 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=39f1452a-73c7-4e9a-a240-74da00e3060f
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_9sei.avro_serde_9sei to dummy_cf1hf.hiveserde_in_place_9sei.avro_serde_9sei: [RequestId=676a0bbf-e8a4-43f2-abe2-f4092c3982d5 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=f8d5679e-ca96-4f60-804b-ffd757e77a86
[gw2] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #629}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_csyv not found in dummy_cxgnv.hiveserde_in_place_csyv (5m19.387s)

AssertionError: parquet_serde_csyv not found in dummy_cxgnv.hiveserde_in_place_csyv
assert False
[gw8] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5avfqjpbxq4ovf33 no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_eqratz9kqoiq7dbz no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_q1grmooxcjcpzao1 no longer exists. Skipping checking its migration status.
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] fetching tables inventory
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sbvdg`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] crawling new set of snapshot data for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv] listing tables and views
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] found 3 new records for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/avro_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/parquet_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/orc_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/parquet_serde_csyv' TBLPROPERTIES ('transient_lastDdlTime'='1757999924')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/avro_serde_csyv' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757999926')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/orc_serde_csyv' TBLPROPERTIES ('transient_lastDdlTime'='1757999925')
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv: [RequestId=fa23a19b-d044-4425-a88d-1f63ef5817a8 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=2d2118ac-a870-4127-b8c3-d9bffecd6021
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv: [RequestId=bcb2b49e-2d59-4224-ac3f-e38a3838fba6 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=55d22458-f3df-4d1c-887c-5796186997c8
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv: [RequestId=402924ab-69b4-41d0-b0cc-e018845ddb25 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=b383405d-0e9a-4e32-bed0-55c225cd4352
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5avfqjpbxq4ovf33 no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_eqratz9kqoiq7dbz no longer exists. Skipping checking its migration status.
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_q1grmooxcjcpzao1 no longer exists. Skipping checking its migration status.
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] fetching tables inventory
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sbvdg`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] crawling new set of snapshot data for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv] listing tables and views
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv] fetching table metadata
05:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sbvdg.tables] found 3 new records for tables
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/avro_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/parquet_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_csyv/orc_serde_csyv
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/parquet_serde_csyv' TBLPROPERTIES ('transient_lastDdlTime'='1757999924')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/avro_serde_csyv' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1757999926')
05:23 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv using SQL query: CREATE TABLE dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_csyv/orc_serde_csyv' TBLPROPERTIES ('transient_lastDdlTime'='1757999925')
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.orc_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.orc_serde_csyv: [RequestId=fa23a19b-d044-4425-a88d-1f63ef5817a8 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=2d2118ac-a870-4127-b8c3-d9bffecd6021
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.avro_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.avro_serde_csyv: [RequestId=bcb2b49e-2d59-4224-ac3f-e38a3838fba6 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=55d22458-f3df-4d1c-887c-5796186997c8
05:23 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_csyv.parquet_serde_csyv to dummy_cxgnv.hiveserde_in_place_csyv.parquet_serde_csyv: [RequestId=402924ab-69b4-41d0-b0cc-e018845ddb25 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=b383405d-0e9a-4e32-bed0-55c225cd4352
[gw8] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #630}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_prlg not found in dummy_c0qo4.hiveserde_in_place_prlg (5m47.809s)

AssertionError: parquet_serde_prlg not found in dummy_c0qo4.hiveserde_in_place_prlg
assert False
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_b5ygpvvs84khfazh no longer exists. Skipping checking its migration status.
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dlzd8mye0e0g2fsd no longer exists. Skipping checking its migration status.
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] fetching tables inventory
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sy9bh`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] crawling new set of snapshot data for tables
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg] listing tables and views
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] found 3 new records for tables
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/avro_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/parquet_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/orc_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/avro_serde_prlg' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758086408')
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/orc_serde_prlg' TBLPROPERTIES ('transient_lastDdlTime'='1758086407')
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/parquet_serde_prlg' TBLPROPERTIES ('transient_lastDdlTime'='1758086406')
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg: [RequestId=ea5b497a-eb95-4e74-b015-08997bb27c44 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=c1742a9b-454a-49af-a026-e0a560f60685
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg: [RequestId=2fc15fa7-ac0e-44ba-8a72-512b1f07a914 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=49a4ed33-5356-4e62-94c1-22e06e20b615
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg: [RequestId=9b4c4b43-03c5-4987-ba57-6e2d26cbffeb ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=c93d3abd-8f3b-4373-8bf1-8c62a3d5fa14
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_b5ygpvvs84khfazh no longer exists. Skipping checking its migration status.
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dlzd8mye0e0g2fsd no longer exists. Skipping checking its migration status.
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] fetching tables inventory
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sy9bh`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] crawling new set of snapshot data for tables
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg] listing tables and views
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg] fetching table metadata
05:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sy9bh.tables] found 3 new records for tables
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/avro_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/parquet_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_prlg/orc_serde_prlg
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/avro_serde_prlg' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758086408')
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/orc_serde_prlg' TBLPROPERTIES ('transient_lastDdlTime'='1758086407')
05:25 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg using SQL query: CREATE TABLE dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_prlg/parquet_serde_prlg' TBLPROPERTIES ('transient_lastDdlTime'='1758086406')
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.orc_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.orc_serde_prlg: [RequestId=ea5b497a-eb95-4e74-b015-08997bb27c44 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=c1742a9b-454a-49af-a026-e0a560f60685
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.avro_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.avro_serde_prlg: [RequestId=2fc15fa7-ac0e-44ba-8a72-512b1f07a914 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=49a4ed33-5356-4e62-94c1-22e06e20b615
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_prlg.parquet_serde_prlg to dummy_c0qo4.hiveserde_in_place_prlg.parquet_serde_prlg: [RequestId=9b4c4b43-03c5-4987-ba57-6e2d26cbffeb ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=c93d3abd-8f3b-4373-8bf1-8c62a3d5fa14
[gw5] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #631}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_kdmf not found in dummy_c32bs.hiveserde_in_place_kdmf (5m39.458s)

AssertionError: parquet_serde_kdmf not found in dummy_c32bs.hiveserde_in_place_kdmf
assert False
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_slyz5 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ggqlu2jqjcb10v6y no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_oalugpcbsar3msof no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wilg4yqhbsu3yuro no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wjupbbza0efbllnp no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wveqp2souq7qg96j no longer exists. Skipping checking its migration status.
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] fetching tables inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_so2aa`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] crawling new set of snapshot data for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf] listing tables and views
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] found 3 new records for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/parquet_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/avro_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/orc_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/parquet_serde_kdmf' TBLPROPERTIES ('transient_lastDdlTime'='1758172733')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/orc_serde_kdmf' TBLPROPERTIES ('transient_lastDdlTime'='1758172734')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/avro_serde_kdmf' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758172735')
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf: [RequestId=a185a4cf-5722-91f0-8196-1351ea5bd9db ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=3fe12825-148d-4bf7-b492-868ed4786e51
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf: [RequestId=1d088c9f-3d71-43db-9fd7-1a703ef3ee2c ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=4f7dc0a6-7520-4246-a6e3-63980d6c747b
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf: [RequestId=71a0af6a-b816-4566-8d6d-cc9e8b8376c6 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=fd6f09ff-50d5-4740-9344-7a6134f7a366
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_slyz5 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ggqlu2jqjcb10v6y no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_oalugpcbsar3msof no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wilg4yqhbsu3yuro no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wjupbbza0efbllnp no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_wveqp2souq7qg96j no longer exists. Skipping checking its migration status.
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] fetching tables inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_so2aa`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] crawling new set of snapshot data for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf] listing tables and views
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_so2aa.tables] found 3 new records for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/parquet_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/avro_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_kdmf/orc_serde_kdmf
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/parquet_serde_kdmf' TBLPROPERTIES ('transient_lastDdlTime'='1758172733')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/orc_serde_kdmf' TBLPROPERTIES ('transient_lastDdlTime'='1758172734')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf using SQL query: CREATE TABLE dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_kdmf/avro_serde_kdmf' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758172735')
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.parquet_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.parquet_serde_kdmf: [RequestId=a185a4cf-5722-91f0-8196-1351ea5bd9db ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=3fe12825-148d-4bf7-b492-868ed4786e51
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.orc_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.orc_serde_kdmf: [RequestId=1d088c9f-3d71-43db-9fd7-1a703ef3ee2c ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=4f7dc0a6-7520-4246-a6e3-63980d6c747b
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_kdmf.avro_serde_kdmf to dummy_c32bs.hiveserde_in_place_kdmf.avro_serde_kdmf: [RequestId=71a0af6a-b816-4566-8d6d-cc9e8b8376c6 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=fd6f09ff-50d5-4740-9344-7a6134f7a366
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #632}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: AssertionError: parquet_serde_jhlw not found in dummy_c8ucm.hiveserde_in_place_jhlw (5m40.092s)

AssertionError: parquet_serde_jhlw not found in dummy_c8ucm.hiveserde_in_place_jhlw
assert False
[gw8] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_sg1vn no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5o9kixkpzmsdnas3 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_d4w9pr9jlplqim1c no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dlgfdzquu7csepe1 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_hs5dhcds9rc7ixup no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_noilibxwbxkhgx0e no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_tihnefedfmz3iquk no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_z3xy9cjir2kkmbcy no longer exists. Skipping checking its migration status.
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] fetching tables inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s9abq`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] crawling new set of snapshot data for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw] listing tables and views
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] found 3 new records for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/avro_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/parquet_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/orc_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/avro_serde_jhlw' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758259170')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/parquet_serde_jhlw' TBLPROPERTIES ('transient_lastDdlTime'='1758259168')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/orc_serde_jhlw' TBLPROPERTIES ('transient_lastDdlTime'='1758259169')
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw: [RequestId=e72009f9-7fa4-4772-b4c9-b3a32f7c7f73 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=e7da3397-8092-409b-b1a8-e0e4effe1316
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw: [RequestId=b48c62fc-653c-41d9-8764-b6da00963fc2 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=453ac4cd-408b-47b9-a8b2-7c80ce78c2fa
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw: [RequestId=cb337186-867f-486a-8727-328d5925f63b ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=7301f897-0f43-4a82-911e-59e7d3db27be
05:21 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_sg1vn no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_5o9kixkpzmsdnas3 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_d4w9pr9jlplqim1c no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_dlgfdzquu7csepe1 no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_hs5dhcds9rc7ixup no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_noilibxwbxkhgx0e no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_tihnefedfmz3iquk no longer exists. Skipping checking its migration status.
05:24 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_z3xy9cjir2kkmbcy no longer exists. Skipping checking its migration status.
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] fetching tables inventory
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/tables.py", line 458, in _try_fetch
    for row in self._fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_s9abq`.`tables` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] crawling new set of snapshot data for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw] listing tables and views
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw] fetching table metadata
05:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s9abq.tables] found 3 new records for tables
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/avro_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/parquet_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.locations] Replacing location dbfs:/mnt/TEST_MOUNT_NAME/a with TEST_MOUNT_CONTAINER/a in dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jhlw/orc_serde_jhlw
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/avro_serde_jhlw' TBLPROPERTIES ('avro.schema.literal'='{\n                            "namespace": "org.apache.hive",\n                            "name": "first_schema",\n                            "type": "record",\n                            "fields": [\n                                { "name":"id", "type":"int" },\n                                { "name":"region", "type":"string" }\n                            ] }', 'transient_lastDdlTime'='1758259170')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/parquet_serde_jhlw' TBLPROPERTIES ('transient_lastDdlTime'='1758259168')
05:24 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw using SQL query: CREATE TABLE dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_jhlw/orc_serde_jhlw' TBLPROPERTIES ('transient_lastDdlTime'='1758259169')
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.orc_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.orc_serde_jhlw: [RequestId=e72009f9-7fa4-4772-b4c9-b3a32f7c7f73 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=e7da3397-8092-409b-b1a8-e0e4effe1316
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.avro_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.avro_serde_jhlw: [RequestId=b48c62fc-653c-41d9-8764-b6da00963fc2 ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=453ac4cd-408b-47b9-a8b2-7c80ce78c2fa
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migrate] failed-to-migrate: Failed to migrate table hive_metastore.hiveserde_in_place_jhlw.parquet_serde_jhlw to dummy_c8ucm.hiveserde_in_place_jhlw.parquet_serde_jhlw: [RequestId=cb337186-867f-486a-8727-328d5925f63b ErrorClass=INVALID_STATE.UC_CLOUD_STORAGE_ACCESS_FAILURE] Failed to access cloud storage: [AbfsRestOperationException] () exceptionTraceId=7301f897-0f43-4a82-911e-59e7d3db27be
[gw8] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #633}

[github-actions]

❌ test_migrate_external_table_hiveserde_in_place: KeyError: 'DATABRICKS_HOST' (1ms)

KeyError: 'DATABRICKS_HOST'
[gw3] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #645}