Test failure: `test_migrate_table_in_mount`

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (4m48.948s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw0] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_1fqzn1val0tjsenh no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ebsbvzk6l4gpas3r no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_mggy8eezknkrg8pk no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_svqcdjcbkays9wss no longer exists. Skipping checking its migration status.
05:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_swgu5.tables] fetching tables inventory
05:28 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_qbtp', name='dummy_tof9z', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/jiu0/qbtp', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_c5xkf', src_schema='mounted_TEST_MOUNT_NAME_qbtp', dst_schema='dummy_sdgyk', src_table='TEST_MOUNT_CONTAINER/a/jiu0/qbtp', dst_table='dummy_tof9z', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:28 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_1fqzn1val0tjsenh no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ebsbvzk6l4gpas3r no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_mggy8eezknkrg8pk no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_svqcdjcbkays9wss no longer exists. Skipping checking its migration status.
05:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_swgu5.tables] fetching tables inventory
05:28 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_qbtp', name='dummy_tof9z', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/jiu0/qbtp', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_c5xkf', src_schema='mounted_TEST_MOUNT_NAME_qbtp', dst_schema='dummy_sdgyk', src_table='TEST_MOUNT_CONTAINER/a/jiu0/qbtp', dst_table='dummy_tof9z', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:28 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw0] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #627}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (4m57.549s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw1] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_sjrfp no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_eblnyxbxsbnunjas no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_httach6eiiwgkwww no longer exists. Skipping checking its migration status.
05:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sivsk.tables] fetching tables inventory
05:28 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_cwwn', name='dummy_teyxi', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/lkms/cwwn', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cw7b7', src_schema='mounted_TEST_MOUNT_NAME_cwwn', dst_schema='dummy_sr15t', src_table='TEST_MOUNT_CONTAINER/a/lkms/cwwn', dst_table='dummy_teyxi', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:28 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:25 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Schema main.dummy_sjrfp no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_eblnyxbxsbnunjas no longer exists. Skipping checking its migration status.
05:28 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_httach6eiiwgkwww no longer exists. Skipping checking its migration status.
05:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sivsk.tables] fetching tables inventory
05:28 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_cwwn', name='dummy_teyxi', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/lkms/cwwn', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cw7b7', src_schema='mounted_TEST_MOUNT_NAME_cwwn', dst_schema='dummy_sr15t', src_table='TEST_MOUNT_CONTAINER/a/lkms/cwwn', dst_table='dummy_teyxi', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:28 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw1] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #628}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (4m50.14s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_hwlmqzk1m1yvssvf no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_lzxymexqoelcswym no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pseqkxmivm7gt0bc no longer exists. Skipping checking its migration status.
05:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_scinh.tables] fetching tables inventory
05:30 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_rplv', name='dummy_t1doi', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/hph1/rplv', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cw8bv', src_schema='mounted_TEST_MOUNT_NAME_rplv', dst_schema='dummy_szyqp', src_table='TEST_MOUNT_CONTAINER/a/hph1/rplv', dst_table='dummy_t1doi', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:30 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_hwlmqzk1m1yvssvf no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_lzxymexqoelcswym no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pseqkxmivm7gt0bc no longer exists. Skipping checking its migration status.
05:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_scinh.tables] fetching tables inventory
05:30 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_rplv', name='dummy_t1doi', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/hph1/rplv', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cw8bv', src_schema='mounted_TEST_MOUNT_NAME_rplv', dst_schema='dummy_szyqp', src_table='TEST_MOUNT_CONTAINER/a/hph1/rplv', dst_table='dummy_t1doi', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:30 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #629}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (5m2.282s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw7] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_aqw7wwa0wz7xgdew no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_fevgkdl7z4fdzszh no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_k1c215y8rpp1aacp no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_l2chbtl2d4y7g1fe no longer exists. Skipping checking its migration status.
05:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sqv2i.tables] fetching tables inventory
05:30 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_41wy', name='dummy_txdyt', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/3beo/41wy', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cbxud', src_schema='mounted_TEST_MOUNT_NAME_41wy', dst_schema='dummy_stqni', src_table='TEST_MOUNT_CONTAINER/a/3beo/41wy', dst_table='dummy_txdyt', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:30 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_aqw7wwa0wz7xgdew no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_fevgkdl7z4fdzszh no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_k1c215y8rpp1aacp no longer exists. Skipping checking its migration status.
05:30 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_l2chbtl2d4y7g1fe no longer exists. Skipping checking its migration status.
05:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sqv2i.tables] fetching tables inventory
05:30 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_41wy', name='dummy_txdyt', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/3beo/41wy', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cbxud', src_schema='mounted_TEST_MOUNT_NAME_41wy', dst_schema='dummy_stqni', src_table='TEST_MOUNT_CONTAINER/a/3beo/41wy', dst_table='dummy_txdyt', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:30 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw7] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #630}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (5m49.105s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3nicyhxxd2xedt4v no longer exists. Skipping checking its migration status.
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_s29ij88xtojdh0cj no longer exists. Skipping checking its migration status.
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_tnltrpxoja6cmm51 no longer exists. Skipping checking its migration status.
05:32 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_ssgxd.tables] fetching tables inventory
05:32 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_ijwj', name='dummy_t1j5e', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/f2xp/ijwj', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cluu6', src_schema='mounted_TEST_MOUNT_NAME_ijwj', dst_schema='dummy_spswj', src_table='TEST_MOUNT_CONTAINER/a/f2xp/ijwj', dst_table='dummy_t1j5e', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:32 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_3nicyhxxd2xedt4v no longer exists. Skipping checking its migration status.
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_s29ij88xtojdh0cj no longer exists. Skipping checking its migration status.
05:32 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_tnltrpxoja6cmm51 no longer exists. Skipping checking its migration status.
05:32 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_ssgxd.tables] fetching tables inventory
05:32 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_ijwj', name='dummy_t1j5e', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/f2xp/ijwj', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_cluu6', src_schema='mounted_TEST_MOUNT_NAME_ijwj', dst_schema='dummy_spswj', src_table='TEST_MOUNT_CONTAINER/a/f2xp/ijwj', dst_table='dummy_t1j5e', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:32 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw4] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #631}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (5m27.644s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw2] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_fguknkllblz1ooxj no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ugcjkzr5voaqtoft no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_xcp3rfw12hdjnxgh no longer exists. Skipping checking its migration status.
05:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sta8h.tables] fetching tables inventory
05:33 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_2llt', name='dummy_tdpap', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/4h6k/2llt', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_ccsqm', src_schema='mounted_TEST_MOUNT_NAME_2llt', dst_schema='dummy_s6dxk', src_table='TEST_MOUNT_CONTAINER/a/4h6k/2llt', dst_table='dummy_tdpap', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:33 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_fguknkllblz1ooxj no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_ugcjkzr5voaqtoft no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_xcp3rfw12hdjnxgh no longer exists. Skipping checking its migration status.
05:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sta8h.tables] fetching tables inventory
05:33 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_2llt', name='dummy_tdpap', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/4h6k/2llt', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_ccsqm', src_schema='mounted_TEST_MOUNT_NAME_2llt', dst_schema='dummy_s6dxk', src_table='TEST_MOUNT_CONTAINER/a/4h6k/2llt', dst_table='dummy_tdpap', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:33 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw2] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #632}

[github-actions]

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration. (5m39.806s)

databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
[gw6] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_erpjkayhprr9sgte no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_kafpeuzq5jasrbpu no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_l4s7x1dunrstneiu no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pzaqzbdnnyqb644b no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_thxaz2am7kemaozw no longer exists. Skipping checking its migration status.
05:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s0eft.tables] fetching tables inventory
05:33 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_3kgv', name='dummy_ts6em', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/qrke/3kgv', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_crw78', src_schema='mounted_TEST_MOUNT_NAME_3kgv', dst_schema='dummy_sfcoy', src_table='TEST_MOUNT_CONTAINER/a/qrke/3kgv', dst_table='dummy_ts6em', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:33 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_erpjkayhprr9sgte no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_kafpeuzq5jasrbpu no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_l4s7x1dunrstneiu no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_pzaqzbdnnyqb644b no longer exists. Skipping checking its migration status.
05:33 WARNING [databricks.labs.ucx.hive_metastore.table_migration_status] Catalog ucx_thxaz2am7kemaozw no longer exists. Skipping checking its migration status.
05:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s0eft.tables] fetching tables inventory
05:33 ERROR [databricks.labs.blueprint.parallel] checking all database properties(TableToMigrate(src=Table(catalog='hive_metastore', database='mounted_TEST_MOUNT_NAME_3kgv', name='dummy_ts6em', object_type='EXTERNAL', table_format='DELTA', location='TEST_MOUNT_CONTAINER/a/qrke/3kgv', view_text=None, upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='dummy_crw78', src_schema='mounted_TEST_MOUNT_NAME_3kgv', dst_schema='dummy_sfcoy', src_table='TEST_MOUNT_CONTAINER/a/qrke/3kgv', dst_table='dummy_ts6em', recon_tolerance_percent=0, compare_rows=False)), True) task failed: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 168, in inner
    return func(*args, **kwargs), None
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/mapping.py", line 273, in _get_table_in_scope_task
    for value in properties:
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 505, in _raise_if_needed
    raise error_class(error_message)
databricks.sdk.errors.platform.BadRequest: PERMISSION_DENIED: Failed to get credentials: Storage Credential TEST_STORAGE_CREDENTIAL is not configured correctly. Please contact the owner or your account admin to update the configuration.
05:33 CRITICAL [databricks.labs.blueprint.parallel] All 'checking all database properties' tasks failed!!!
[gw6] linux -- Python 3.10.18 /home/runner/work/ucx/ucx/.venv/bin/python

_{Running from nightly #633}