fix(hubs): make ADF trigger startTime Z-suffix conditional on UTC fallback - #2291
Conversation
…lback FinOps hub deployments to regions not covered by timeZones.bicep's region-to-Windows-timezone map (e.g. Sweden Central) fail with InvalidWorkflowTriggerRecurrence. Data Factory requires startTime to end in 'Z' when timeZone resolves to 'UTC', but the three schedule triggers (config_DailySchedule, config_MonthlySchedule, queries_DailySchedule) hardcoded startTime without a trailing 'Z', which is only valid when timeZone is non-UTC. Emit the 'Z' suffix only when timeZones.outputs.Timezone resolves to the 'UTC' fallback, so mapped, non-UTC regions keep scheduling on local wall-clock time as before. Fixes #2157 Note: the reporter also saw a failure in Norway East, which IS in the timezone map (non-UTC), so this fix does not explain or address that - it needs separate diagnostic info and is treated as a distinct, unverified issue. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Roland Krummenacher (RolandKrummenacher)
left a comment
There was a problem hiding this comment.
The Bicep change is correct and I would approve it as written — the reasoning in the PR description holds up under checking:
timeZones.bicep:63falls back to'UTC'viatimezoneobject[?loc] ?? 'UTC', andswedencentralis genuinely absent from the map, so the reported region does land on the fallback.- The ternary keeps the no-
Zform for all 36 mapped, non-UTC regions, so no currently-working region changes scheduling behavior. ARMequals()is case-sensitive and no map value is'UTC'in any casing, so the condition can only match the fallback. - All three
startTimeoccurrences undersrc/templates/are covered — there are no others. - Declining to unconditionally append
Z, and declining to grow the region map, are both the right calls for this PR.
I did not independently run bicep build, but the change is a plain ternary over two string literals in a property that already references timeZones.outputs.Timezone, so I'm not worried about the compiled output.
What blocks: the shipped deploy templates still reproduce #2157.
docs/deploy/*.json are regenerated only at release time, so on the flanakin/v15-prep base as it stands today:
| artifact | startTime |
swedencentral |
fallback |
|---|---|---|---|
finops-hub-latest.json |
no Z (3x) |
absent | 'UTC' |
finops-hub-14.0.json |
no Z (3x) |
absent | 'UTC' |
finops-hub-preview.json |
no Z (2x) |
absent | 'Universal Coordinated Time' |
Both latest and 14.0 already emit the 'UTC' fallback and have no swedencentral entry, and their startTime values have no Z — which is exactly the failing combination. So after this merges, anyone hitting the Deploy to Azure button in Sweden Central still gets InvalidWorkflowTriggerRecurrence, and the issue this PR closes remains reproducible through the primary deployment path until v15 ships.
That is the same situation as 91ce5a5e, which patched these artifacts surgically for this defect class in these same files, for the same triggers, on the grounds that they lag the src fixes. I would rather not close #2157 with the button still broken — either patch the three literals in latest and 14.0 here, or leave #2157 open with a note that the shipped-artifact half is outstanding.
finops-hub-preview.json has a second problem, pre-existing on the base and not caused by this PR: its fallback is still the display name 'Universal Coordinated Time', which ADF rejects outright — 91ce5a5e corrected the mapping values in that file but not the fallback. The Fallback context in HubsAdfTriggerTimeZones.Tests.ps1:139 only asserts against $bicepContent, so this passes CI. Since v15-prep users deploy from the preview artifact, and it is the same fallback path this PR is fixing, it seems in scope to fix here — your call.
Non-blocking:
- No changelog entry under
Unreleased > FinOps hubs > Fixed. The recent fix commits ondeveach add one. - No regression test pins the startTime/
Zinvariant — there are zerostartTimehits acrosssrc/powershell/Testsandsrc/scripts, so a template regeneration or refactor can silently drop this with CI green.91ce5a5eextendedHubsAdfTriggerTimeZones.Tests.ps1for exactly this reason; a case in itsFallbackcontext would cover it. See the inline comment.
On Norway East: your out-of-scope reasoning is right. norwayeast maps to 'W. Europe Standard Time' in the src Bicep, in finops-hub-latest.json, and in finops-hub-14.0.json, so this root cause does not explain the reporter's Norway East error, which named time zone 'UTC'. Agreed that needs separate diagnostics.
|
Hubs + ADX (managed) deployment failed. View logs. |
|
Hubs (manual) deployment failed. View logs. |
|
Hubs (manual) deployed to |
|
Hubs + ADX (managed) deployed to |
|
🤖 [AI][Claude Code] ✅ Implemented Addressed the review:
All 2283 PowerShell unit tests pass, and |
…erage Addresses PR #2291 review feedback from Roland Krummenacher: - Patch the 3 startTime literals in the compiled finops-hub-14.0.json deploy artifact with the same UTC-conditional Z suffix as the src fix, so the currently-shipped stable release also activates triggers correctly in regions not covered by timeZones.bicep's map. - Add a changelog entry under Unreleased > FinOps hubs > Fixed for #2157. - Extend HubsAdfTriggerTimeZones.Tests.ps1 with a startTime UTC suffix context pinning the Z/no-Z pairing in both src files and in the patched finops-hub-14.0.json, so the fix cannot silently regress. finops-hub-latest.json and finops-hub-preview.json are intentionally left untouched - both are regenerated wholesale at v15 release. Co-Authored-By: Roland Krummenacher <RolandKrummenacher@users.noreply.github.com> Co-Authored-By: Claude <noreply@anthropic.com>
|
🤖 [AI][Claude Code] PR Update Summary Addressed: 3 thread(s) + 1 review body
Key changes:
Full unit suite: 2283/2283 passing. |
Roland Krummenacher (RolandKrummenacher)
left a comment
There was a problem hiding this comment.
Approving — all three substantive items from my review landed, and I'm withdrawing the finops-hub-latest.json objection (reasoning inline on the 14.0.json patch).
Two things to carry forward, neither blocking:
- The branch conflicts with
devand isn't mergeable as-is. finops-hub-preview.json's'Universal Coordinated Time'fallback is still outstanding — pre-existing and correctly out of scope here, but nothing in CI catches it. Details inline on theFallbackcontext. I'll file it separately so it doesn't get lost in a resolved thread.
Manual validation in an unmapped region is still unchecked on the test plan. I don't think it needs to gate the merge — the change is a ternary over two string literals and the compiled ARM form is correct in all three places — but it's the one thing that would fully confirm #2157 is closed.
…ger-utc-starttime # Conflicts: # docs-mslearn/toolkit/changelog.md
|
Hubs + ADX (managed) deployed to |
|
Hubs (manual) deployment failed. View logs. |
|
Test environments cleaned up. |
Summary
Fixes #2157 — FinOps hub deployments fail in regions not covered by
timeZones.bicep's region→Windows-timezone map (e.g. Sweden Central) withInvalidWorkflowTriggerRecurrence.Root cause: Three ADF schedule triggers hardcode
startTimewithout a trailingZ(UTC zone designator):config_DailyScheduleandqueries_DailySchedule:'2023-01-01T01:01:00'config_MonthlySchedule:'2023-01-05T01:11:00'These triggers set
timeZonefromtimeZones.bicep's region lookup, which falls back to the literal'UTC'for any region not in its explicit map (confirmed: Sweden Central is one such region; likely also Qatar Central, Poland Central, Italy North, Israel Central, though the map should be checked directly rather than assuming this list is exhaustive). Azure Data Factory requiresstartTimeto end inZ(formatyyyy-MM-ddTHH:mm:ssZ) whenevertimeZoneresolves to'UTC'— otherwise trigger activation fails withInvalidWorkflowTriggerRecurrence, which surfaces during deployment asInit-DataFactory.ps1'sStart-AzDataFactoryV2Triggerretrying up toMAX_RETRIES = 20and then failing the whole deployment.Fix: Make the
Zsuffix conditional on the resolvedtimeZoneactually being'UTC':Applied to all three triggers:
src/templates/finops-hub/modules/Microsoft.CostManagement/ManagedExports/app.bicep—config_DailyScheduleandconfig_MonthlySchedulesrc/templates/finops-hub/modules/Microsoft.FinOpsHubs/IngestionQueries/app.bicep—queries_DailyScheduleThis preserves the existing local-wall-clock scheduling behavior for every region that is mapped (no
Z, non-UTCtimeZone), and only addsZfor the fallback case, fixing activation there.Explicitly not done, and why:
Zto all three literals — that would silently switch every mapped region from local-time scheduling to UTC wall-clock scheduling, a user-facing behavior change for currently-working regions.Out of scope: The issue reporter also mentioned a failure in Norway East. Norway East is present in
timeZones.bicep's map ('W. Europe Standard Time', non-UTC), so the root cause above does not explain a Norway East failure. This looks like a second, distinct issue that needs more diagnostic detail from the reporter — it is not addressed by this PR.Test plan
bicep buildon both changed files completes cleanly (only the expected@validate()experimental-feature warning, unrelated to this change)if(equals(...Timezone..., 'UTC'), '...Z', '...')expression for all threestartTimepropertiespwsh -Command "./src/scripts/Test-PowerShell.ps1 -Lint"— 3585/3585 tests passedInvalidWorkflowTriggerRecurrence🤖 Generated with Claude Code
📋 Checklist
🔬 How did you test this change?
📦 Deploy to test?
🙋♀️ Do any of the following that apply?
⚛️ [Catalyst] Added the release checklist section and opted into test deployments so the trigger activation can be verified before v15 ships.