|
1 | 1 | # Links for internal team members to find build definitions, etc. |
2 | 2 |
|
3 | | -Note that usually only the most recent link in each section is interesting. Older links are included for reference only. |
4 | | - |
5 | | -## PR Build Definition |
6 | | - |
7 | | -The PR build definition can be found [here](https://dev.azure.com/dnceng/internal/_build?definitionId=499&_a=summary) or by |
8 | | -navigating through an existing PR. |
9 | | - |
10 | | -There is also a duplicate scouting PR build that is identical to the normal PR build _except_ that it uses a different Windows |
11 | | -machine queue that always has the next preview build of Visual Studio installed. This is to hopefully get ahead of any breaking |
12 | | -API changes. That build definition is [here](https://dev.azure.com/dnceng/public/_build?definitionId=961). |
13 | | - |
14 | | -## Signed Build Definitions |
15 | | - |
16 | | -[VS 16.4 to current](https://dev.azure.com/dnceng/internal/_build?definitionId=499&_a=summary) |
17 | | - |
18 | | -[VS 15.7 to 16.3](https://dev.azure.com/devdiv/DevDiv/_build/index?definitionId=8978) |
19 | | - |
20 | | -[VS 15.6](https://dev.azure.com/devdiv/DevDiv/_build?definitionId=7239) |
21 | | - |
22 | | -[VS 15.0 to 15.5](https://dev.azure.com/devdiv/DevDiv/_build?definitionId=5037) |
23 | | - |
24 | | -## Branch auto-merge definitions |
25 | | - |
26 | | -Branch auto-merge definitions are specified [here](https://github.com/dotnet/roslyn-tools/blob/master/src/GitHubCreateMergePRs/config.xml). |
27 | | - |
28 | | -## VS Insertion Generators |
29 | | - |
30 | | -VS 16.4 to current - part of the build definition. [See below](#vs-insertions-as-part-of-the-build-definition). |
31 | | - |
32 | | -The following insertion generators are automatically invoked upon successful completion of a signed build in each of |
33 | | -their respective branches. |
34 | | - |
35 | | -[VS 16.3](https://dev.azure.com/devdiv/DevDiv/_release?definitionId=1839&_a=releases) |
36 | | - |
37 | | -[VS 16.2](https://dev.azure.com/devdiv/DevDiv/_release?definitionId=1699&_a=releases) |
38 | | - |
39 | | -[VS 16.1](https://dev.azure.com/devdiv/DevDiv/_release?definitionId=1669&_a=releases) |
40 | | - |
41 | | -VS 16.0 and prior were done manually. |
42 | | - |
43 | | -## VS Insertions as part of the build definition |
44 | | - |
45 | | -Starting with the 16.4 release and moving forwards, the VS insertion is generated as part of the build. The relevant |
46 | | -bits can be found near the bottom of [`azure-pipelines.yml`](azure-pipelines.yml) under the `VS Insertion` header. The |
47 | | -interesting parameters are `componentBranchName` and `insertTargetBranch`. In short, when an internal [signed build](https://dev.azure.com/dnceng/internal/_build?definitionId=499&_a=summary) |
48 | | -completes and the name of the branch built exactly equals the value in the `componentBranchName` parameter, a component |
49 | | -insertion into VS will be created into the `insertTargetBranch` branch. The link to the insertion PR will be found |
50 | | -near the bottom of the build under the title 'Insert into VS'. Examine the log for 'Insert VS Payload' and near the |
51 | | -bottom you'll see a line that looks like `Created request #xxxxxx at https://...`. |
52 | | - |
53 | | -Insertions generated to any `rel/*` branch will have to be manually verified and merged, and they'll be listed |
54 | | -[here](https://dev.azure.com/devdiv/DevDiv/_git/VS/pullrequests?createdBy=122d5278-3e55-4868-9d40-1e28c2515fc4&_a=active). |
55 | | -Note that insertions for other teams will also be listed. |
56 | | - |
57 | | -Insertions to any other VS branch (e.g., `main`) will have the auto-merge flag set and should handle themselves, but |
58 | | -it's a good idea to check the previous link for any old or stalled insertions into VS `main`. |
59 | | - |
60 | | -### What has to be done regularly |
61 | | - |
62 | | -1. Go to [signed builds](https://dev.azure.com/dnceng/internal/_build?definitionId=499&_a=summary) and make sure latest one for both main and release branches are passing. |
63 | | -2. Go to [insertion PRs](https://dev.azure.com/devdiv/DevDiv/_git/VS/pullrequests?createdBy=122d5278-3e55-4868-9d40-1e28c2515fc4&_a=active) and find the latest insertion PR for current release branch. (E.g. `Insert F# dev17.13 20241128.1 Payload into main`) |
64 | | -3. Check CI is passing and all comments are resolved. |
65 | | -4. Check that F# package version is not downgraded (unless that's intended for some reason) by the PR. |
66 | | -5. Approve it. |
67 | | -6. Abandon any older unmerged PRs that shouldn't be inserted. |
68 | | - |
69 | | -## Preparing for a new VS release branch |
70 | | - |
71 | | -### When a VS branch snaps from `main` to `rel/d*` and switches to ask mode: |
72 | | - |
73 | | -Update the `insertTargetBranch` value at the bottom of `azure-pipelines.yml` in the appropriate release branch. E.g., when VS 17.3 snapped and switched to ask mode, [this PR](https://github.com/dotnet/fsharp/pull/13456/files) correctly updates the insertion target so that future builds from that F# branch will get auto-inserted to VS. |
74 | | - |
75 | | -### When VS `main` is open for insertions for preview releases of VS: |
76 | | - |
77 | | -0. Disable auto-merges from `main` to **current** release branch, please make a change for the following file and create a pull request: |
78 | | -https://github.com/dotnet/roslyn-tools/blob/6d7c182c46f8319d7922561e2c1586c7aadce19e/src/GitHubCreateMergePRs/config.xml#L52-L74 |
79 | | -> You should comment out the `main -> release/devXX.X` flow until step #4 is completed (`<merge from="main" to="release/dev17.13" />`) |
80 | | -2. Create a new `release/dev*` branch (e.g., `release/dev17.4`) and initially set its HEAD commit to that of the previous release (e.g., `release/dev17.3` in this case). |
81 | | - ```console |
82 | | - git checkout -b release/dev17.4 |
83 | | - git reset --hard upstream/release/dev17.3 |
84 | | - git push --set-upstream upstream release/dev17.4 |
85 | | - ``` |
86 | | -3. Update versions in both `main` and new release branch **they need to match, so release notes bot knows which changelog file to check** |
87 | | -4. Update target insertion branches in the `azure-pipelines.yml`: |
88 | | - 1. F# release branch |
89 | | - ```yaml |
90 | | - # Release branch for F# |
91 | | - # Should be 'current' release branch name, i.e. 'release/dev17.10' in dotnet/fsharp/refs/heads/main, 'release/dev17.10' in dotnet/fsharp/refs/heads/release/dev17.10 and 'release/dev17.9' in dotnet/fsharp/refs/heads/release/dev17.9 |
92 | | - # Should **never** be 'main' in dotnet/fsharp/refs/heads/main, since it will start inserting to VS twice. |
93 | | - - name: FSharpReleaseBranchName |
94 | | - value: release/dev17.13 |
95 | | - ``` |
96 | | - 2. VS insertion branch |
97 | | - ```yaml |
98 | | - # VS Insertion branch name (NOT the same as F# branch) |
99 | | - # Should be previous release branch or 'main' in 'main' and 'main' in release branch |
100 | | - # (since for all *new* release branches we insert into VS main and for all *previous* releases we insert into corresponding VS release), |
101 | | - # i.e. 'rel/d17.9' *or* 'main' in dotnet/fsharp/refs/heads/main and 'main' in F# dotnet/fsharp/refs/heads/release/dev17.10 (latest release branch) |
102 | | - - name: VSInsertionTargetBranchName |
103 | | - value: main |
104 | | - ``` |
105 | | - > [!NOTE] Note |
106 | | - > For the **old** release branch `VSInsertionTargetBranchName` should point to corresponding VS release target branch (e.g. should be `rel/d17.13` in the F# repo branch `release/dev17.13`) |
107 | | - > For both `main` and **new** release branch `VSInsertionTargetBranchName` should be `main`. |
108 | | - > |
109 | | - > `FSharpReleaseBranchName` should **always** be the most recent in `main` and corresponding release branch name in release branches. |
110 | | - |
111 | | - 3. Oneloc branch: |
112 | | - ```yaml |
113 | | - # Localization: we only run it for specific release branches |
114 | | - - ${{ if eq(variables['Build.SourceBranch'], 'refs/heads/release/dev17.13') }}: |
115 | | - ``` |
116 | | -5. Set the new branch to receive auto-merges from `main`, and also set the old release branch to flow into the new one. [This PR](https://github.com/dotnet/roslyn-tools/pull/1245/files) is a good example of what to do when a new `release/dev17.4` branch is created that should receive merges from both `main` and the previous release branch, `release/dev17.3`. Old release branch should stop receiving updates from the `main`. |
117 | | - |
118 | | -6. Set the packages from the new branch to flow into the correct package feeds via the `darc` tool. To do this: |
119 | | - |
120 | | - 1. To use `darc` you need to be a member of the `dotnetes-maestro-users` entitlement. You can request access at [coreidentity.microsoft.com](https://coreidentity.microsoft.com/manage/Entitlement/entitlement/dotnetesmaes-z54r) |
121 | | - 2. Ensure the latest `darc` tool is installed by running `eng/common/darc-init.ps1`. |
122 | | - 3. (only needed once) Run the command `darc authenticate`. A text file will be opened with instructions on how to populate access tokens. |
123 | | - 4. Check the current package/channel subscriptions by running `darc get-default-channels --source-repo fsharp`. For this example, notice that the latest subscription shows the F# branch `release/dev17.3` is getting added to the `VS 17.3` channel. |
124 | | - 5. Get the list of `darc` channels and determine the appropriate one to use for the new branch via the command `darc get-channels`. For this example, notice that a channel named `VS 17.4` is listed. |
125 | | - 6. Add the new F# branch to the appropriate `darc` channel. In this example, run `darc add-default-channel --channel "VS 17.4" --branch release/dev17.4 --repo https://github.com/dotnet/fsharp` |
126 | | - 7. Ensure the subscription was added by repeating step 3 above. |
127 | | - 8. Note, the help in the `darc` tool is really good. E.g., you can simply run `darc` to see a list of all commands available, and if you run `darc <some-command>` with no arguments, you'll be given a list of arguments you can use. |
128 | | - 9. Ensure that version numbers are bumped for a new branch. |
129 | | - 10. Change needed subscriptions for arcade and SDK: |
130 | | - 1. `darc get-subscriptions --target-repo fsharp`, and then use `darc update-subscription --id <subscription id>` for corresponding channels (e.g. target new VS channel to specific SDK channel, or set up arcade auto-merges to release/* or main branch, depending on the timeline of release/upgrade cycle). |
131 | | - 2. If new subscription needs to be added, the following command should be used `darc add-subscription --source-repo https://github.com/dotnet/arcade --target-repo https://github.com/dotnet/fsharp --target-branch <target_branch> --channel "<target_channel>" --update-frequency everyDay --standard-automerge |
132 | | - 11. Update mibc and other dependencies if needed, refer to https://github.com/dotnet/arcade/blob/main/Documentation/Darc.md#updating-dependencies-in-your-local-repository for more information |
133 | | - |
134 | | -## Labeling issues on GitHub |
135 | | - |
136 | | -Assign appropriate `Area-*` label to bugs, feature improvements and feature requests issues alike. List of `Area` labels with descriptions can be found [here](https://github.com/dotnet/fsharp/labels?q=Area). These areas are laid out to follow the logical organization of the code. |
137 | | - |
138 | | -To find all existing open issues without assigned `Area` label, use [this query](https://github.com/dotnet/fsharp/issues?q=is%3Aissue+is%3Aopen+-label%3AArea-AOT+-label%3AArea-Async+-label%3AArea-Build+-label%3AArea-Compiler+-label%3AArea-Compiler-Checking+-label%3AArea-Compiler-CodeGen+-label%3AArea-Compiler-HashCompare+-label%3AArea-Compiler-ImportAndInterop+-label%3AArea-Compiler-Optimization+-label%3AArea-Compiler-Options+-label%3AArea-Compiler-PatternMatching+-label%3AArea-Compiler-Service+-label%3AArea-Compiler-SigFileGen+-label%3AArea-Compiler-SRTP+-label%3AArea-Compiler-StateMachines+-label%3AArea-Compiler-Syntax+-label%3AArea-ComputationExpressions+-label%3AArea-Debug+-label%3AArea-DependencyManager+-label%3AArea-Diagnostics+-label%3AArea-FCS+-label%3AArea-FSC+-label%3AArea-FSI+-label%3AArea-Infrastructure+-label%3AArea-LangService-API+-label%3AArea-LangService-AutoComplete+-label%3AArea-LangService-BlockStructure+-label%3AArea-LangService-CodeLens+-label%3AArea-LangService-Colorization+-label%3AArea-LangService-Diagnostics+-label%3AArea-LangService-FindAllReferences+-label%3AArea-LangService-Navigation+-label%3AArea-LangService-QuickFixes+-label%3AArea-LangService-RenameSymbol+-label%3AArea-LangService-ToolTips+-label%3AArea-LangService-UnusedDeclarations+-label%3AArea-LangService-UnusedOpens+-label%3AArea-Library+-label%3AArea-ProjectsAndBuild+-label%3AArea-Queries+-label%3AArea-Quotations+-label%3AArea-SetupAndDelivery+-label%3AArea-Testing+-label%3AArea-TypeProviders+-label%3AArea-UoM+-label%3AArea-VS+-label%3AArea-VS-Editor+-label%3AArea-VS-FSI+-label%3AArea-XmlDocs) |
139 | | - |
140 | | -Since github issue filtering is currently not flexible enough, that query was generated by pasting output of this PowerShell command to the search box (might need to be rerun if new kinds of `Area` labels are added): |
141 | | -```ps1 |
142 | | -Invoke-WebRequest -Uri "https://api.github.com/repos/dotnet/fsharp/labels?per_page=100" | ConvertFrom-Json | % { $_.name } | ? { $_.StartsWith("Area-") } | % { Write-Host -NoNewLine ('-label:"' + $_ + '" ') } |
143 | | -``` |
144 | | - |
145 | | -## Fix problems with the internal source mirror |
146 | | - |
147 | | -The repo is [here](https://dev.azure.com/dnceng/internal/_git/dotnet-fsharp), the CI is [here](https://dnceng.visualstudio.com/internal/_build?definitionId=499). |
148 | | - |
149 | | -If something breaks in the CI there and you want to experiment, the general workflow is the following: |
150 | | -1. Make a branch |
151 | | -2. Make a change |
152 | | -3. Run the build from your branch. If needed, set the "skipTests" variable to "true" - can save time at this stage. |
153 | | -4. Once the problem and the fix is identified, make a PR to THIS (dotnet/fsharp) repo - it will propagate to the internal mirror just afterwards. |
154 | | -5. Delete all your work in the internal repo. |
155 | | - |
156 | | -**DO NOT** try to push to the internal repo - this will mess up the flows. **DO NOT** create PRs to not confuse anyone. |
157 | | - |
158 | | -You need the following permissions to do the above investigations: |
159 | | -- "Generic contribute" |
160 | | -- "Create branch" |
161 | | -- "Queue builds" |
162 | | -- "Edit queue build configuration" |
163 | | - |
164 | | -If anything, reach out to the "First Responders" team. |
| 3 | +Moved [here](https://dev.azure.com/devdiv/DevDiv/_wiki/wikis/DevDiv.wiki/44702/FSharp) |
0 commit comments