Skip to content

Comments

[CICD] replace souce install with whl install#1121

Open
Darryl233 wants to merge 10 commits intoflagos-ai:mainfrom
Darryl233:cicd
Open

[CICD] replace souce install with whl install#1121
Darryl233 wants to merge 10 commits intoflagos-ai:mainfrom
Darryl233:cicd

Conversation

@Darryl233
Copy link
Collaborator

PR Category

CICD

PR Types

Improvements

PR Description

  • build.sh support --build-arg
  • Dockerfile precheck uv/conda/pip env before install dependency
  • Add megatron-fl and vllm-fl requirements into requirements.txt

@Darryl233 Darryl233 requested a review from aoyulong as a code owner February 24, 2026 06:29
else \
echo "[ENV] Found uv venv at ${FLAGSCALE_HOME}/venv"; \
fi; \
elif [ "$PKG_MGR" = "conda" ]; then \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the point to have conda or miniconda inside a container?
For miniconda, the base installation is approximately 250 MB to 900 MB, while for venv, the footprint is typically 5-10 MB.
Are we planning to install multiple Python versions in the same container image or something?

# Training-specific dependencies

-r ./base.txt
megatron_core @ https://resource.flagos.net/repository/flagos-pypi-hosted/packages/megatron-core/0.16.0rc0/megatron_core-0.16.0rc0-cp312-cp312-linux_x86_64.whl
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where does this megatron_core come from?
The official release or megatron core is 0.15.3.

ARG PYTORCH_INDEX
ARG PKG_MGR
ARG FLAGSCALE_HOME=/opt/flagscale
ARG PYTHON_VERSION=3.12
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually not configurable, because the packages we are installing later on are all about python3.12. Right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants