Test: Customization migration settings and location deprecation notices

[aeschli]

Refs: #334518

• anyOS Robo (@deepak1556)
• anyOS Kyle Cutler (@kycutler)

Complexity: 2

Authors: Martin Aeschlimann (@aeschli)

Create Issue

---

Customization migrations are controlled by separate settings for prompt files, user data, and configured locations. Deprecated customization location settings use an informational message with links to the relevant migration page.

Test setup

Use a build with an agent-host harness active. Create migration candidates for at least two migration categories. For example:

• Create a *.prompt.md prompt file.
• Configure a custom agent, instruction, mode, or skill location that is unsupported by the active harness and add a valid customization there.

Ensure the migration enablement settings are not explicitly configured before starting.

Verify the migration settings

• Open Agent Customizations.
• In Settings, verify these three settings exist:
  • chat.customizations.promptMigration.enabled, enabled by default.
  • chat.customizations.userDataMigration.enabled, disabled by default.
  • chat.customizations.locationsMigration.enabled, disabled by default.
• Verify Migrate Prompt Files is offered by default when prompt candidates exist.
• Verify Migrate User Data Customizations and Migrate Location Settings are not offered by default, even when candidates exist.
• Enable chat.customizations.userDataMigration.enabled and verify only the applicable user-data migration card and sidebar shortcut are added.
• Enable chat.customizations.locationsMigration.enabled and verify only the applicable configured-location migration card and sidebar shortcut are added.
• Disable chat.customizations.promptMigration.enabled and verify the prompt migration card and sidebar shortcut disappear without hiding the enabled user-data and configured-location migrations.
• Verify chat.customizations.migration.enabled is not present in Settings.

Verify location-setting deprecation messages

Open Settings and inspect these settings:

• chat.agentFilesLocations
• chat.modeFilesLocations
• chat.agentSkillsLocations
• chat.instructionsFilesLocations
• chat.promptFilesLocations

For each setting, verify:

• The deprecation notice is presented as informational guidance with an info icon rather than an error/warning icon.
• The info icon has the accessible label Info.
• The message text uses the normal foreground color, while the info icon and links remain visually distinct.
• There is comfortable spacing between the setting control and the informational notice.
• The notice explains that the setting and Local agent harness will be removed in a future release.

Verify migration links

Enable chat.customizations.locationsMigration.enabled before testing the configured-location links.

• From chat.agentFilesLocations, chat.modeFilesLocations, chat.agentSkillsLocations, and chat.instructionsFilesLocations, activate Migrate Location Settings and verify the Agent Customizations editor opens the Migrate Location Settings page.
• From chat.promptFilesLocations, activate Migrate Prompt Files and verify the Agent Customizations editor opens the Migrate Prompt Files page.
• Verify both links work with keyboard activation.
• Verify the links continue to use the normal Settings link styling in Dark, Light, and a High Contrast theme.

[kycutler]

Martin Aeschlimann (@aeschli) I see just one setting that is enabled by default:

Is this wrong, or is the TPI incorrect?

[kycutler]

Verify chat.customizations.migration.enabled is not present in Settings.

Just saw this. So it seems things are not as expected. Verified I'm on the correct build / commit too: de8cc55

[kycutler]

Assigned the settings manually and even then not seeing any recommendations in the customizations panel. So this doesn't seem to be working. Martin Aeschlimann (@aeschli)

[aeschli]

Kyle Cutler (@kycutler) Sorry for the chaos, on friday i made mutltiple commits, including setting rename that I reverted.
We need a new build.

[deepak1556]

I still see a single migration setting chat.customizations.migration.enabled on latest insider

Version: 1.137.0-insider (user setup)
Commit: 94b021b519e8e3e99777a1ff72c77e32e0d4b1d3
Date: 2026-09-07T01:46:17Z
Electron: 42.10.0
ElectronBuildId: 15109253
Chromium: 148.0.7778.280
Node.js: 24.18.1
V8: 14.8.178.38-electron.0
@github/copilot: 1.0.84-canary.70.gdb75d0d.unsigned
@github/copilot-sdk: 1.0.13-preview.4
OS: Windows_NT x64 10.0.26200

Was able to verify prompt file migration case but unable to verify location-setting deprecation messages couldn't find any of those settings except for chat.agentSkillsLocations which didn't have a deprecation message.