Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run all steps in a container #44969

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Conversation

ellahathaway
Copy link
Member

@dotnet-issue-labeler dotnet-issue-labeler bot added Area-Infrastructure untriaged Request triage from a team member labels Nov 19, 2024
@ellahathaway
Copy link
Member Author

/azp run sdk-unified-build-full

Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@ellahathaway
Copy link
Member Author

Source-build isn't running all steps in containers: https://dev.azure.com/dnceng/internal/_build/results?buildId=2585278&view=results

The legs don't run the "initialize containers" step, so I'm working to determine why. This doesn't happen in PR checks.

./build.sh $buildArgs
fi
for envVar in $customEnvVars; do
customEnvVarsWithBashSyntax="$customEnvVarsWithBashSyntax export $envVar;"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One convenient thing we lost here is the easy way of simulating offline. We will have to now disable the network "manually"

@MichaelSimons
Copy link
Member

/azp run dotnet-source-build-lite

Copy link

No pipelines are associated with this pull request.

@ellahathaway
Copy link
Member Author

Source-build isn't running all steps in containers: https://dev.azure.com/dnceng/internal/_build/results?buildId=2585278&view=results

The legs don't run the "initialize containers" step, so I'm working to determine why. This doesn't happen in PR checks.

This is because the internal pipelines use 1ES PTs. I'm adjusting the templates so that the containers work in with these yamls.

- ${{ if ne(parameters.runOnline, 'True') }}:
- script: |
set -ex
sudo ip link set eth0 down
Copy link
Member Author

@ellahathaway ellahathaway Nov 21, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

iproute2 is not installed, so I can't run the above command. I can either adjust the Dockerfiles or try to install it here in the pipeline. Installing in the pipeline would likely involve trying to work around different distros' package managers.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mthalman or @lbussell - Do you have thoughts on the above?

Also related, I tested the above command out by installing iproute2 in a local docker container using the ubuntu 24.04 buildtools prereqs image. I found that I needed privileged access to run ip link set eth0 down. Given that the container is not manually configured, I worry about the fact that I may not be able to run the command in the pipelines even after installing iproute2. I don't think that the use of sudo fixes this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area-Infrastructure untriaged Request triage from a team member
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Run all VMR CI steps in containers
2 participants