Repository navigation
gecko-dev full checkout takes 10m #818
Description
A shallow clone of https://github.com/mozilla/gecko-dev repo took 10m using this step (as of 2022-06-03)
- uses: actions/checkout@v3
with:
repository: mozilla/gecko-dev
path: gecko-dev
fetch-depth: 0
https://github.com/abitrolly/firefox-lang-stats/runs/6713143940?check_suite_focus=true
Is it possible to speed up it somehow? Like through https://docs.github.com/en/rest/repos/contents#download-a-repository-archive-zip
Activity
abitrolly commentedon Jun 3, 2022
Explicitly mentioning branch makes clone 1m slower.
But the clone commands are the same https://github.com/abitrolly/firefox-lang-stats/runs/6716850948?check_suite_focus=true
abitrolly commentedon Jun 3, 2022
These ZIP repository archives are missing
.gitdir.$ curl -L \ -H "Accept: application/vnd.github.v3+json" \ https://api.github.com/repos/abitrolly/firefox-lang-stats/zipball/main --output wow.zip % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 53643 0 53643 0 0 88864 0 --:--:-- --:--:-- --:--:-- 88864 /0.6s $ unzip wow.zip Archive: wow.zip eea523c6772f8b6342a9121a175be9bd8be16c87 creating: abitrolly-firefox-lang-stats-eea523c/ creating: abitrolly-firefox-lang-stats-eea523c/.github/ creating: abitrolly-firefox-lang-stats-eea523c/.github/workflows/ inflating: abitrolly-firefox-lang-stats-eea523c/.github/workflows/deploy.yml extracting: abitrolly-firefox-lang-stats-eea523c/.gitignore inflating: abitrolly-firefox-lang-stats-eea523c/01stats.sh inflating: abitrolly-firefox-lang-stats-eea523c/README.md creating: abitrolly-firefox-lang-stats-eea523c/dev/ inflating: abitrolly-firefox-lang-stats-eea523c/dev/build-data inflating: abitrolly-firefox-lang-stats-eea523c/dev/git-file-stats inflating: abitrolly-firefox-lang-stats-eea523c/index.mustache inflating: abitrolly-firefox-lang-stats-eea523c/rustacean-orig-noshadow.ico inflating: abitrolly-firefox-lang-stats-eea523c/rustacean-orig-noshadow.pngTry to clone Firefox without actions/checkout
abitrolly commentedon Jun 3, 2022
Maybe it is possible to cache repo clone? https://docs.github.com/en/actions/using-workflows/caching-dependencies-to-speed-up-workflows#usage-limits-and-eviction-policy
MartyIX commentedon Jun 30, 2025
Should the
fetch-depthbe1to download just shallow copy?0means to download full git history but I understand you just need the latest snapshot.https://git-scm.com/docs/git-clone explains
--depth(which is whatfetch-depthset, I hope):(I'm coming from 4e6/firefox-lang-stats#12)
abitrolly commentedon Jul 2, 2025
@MartyIX it is not evident, but I wanted to build a graph of language use in Firefox day by day, that's why a full clone is needed.
[-]`gecko-dev` checkout takes 10m[/-][+]`gecko-dev` full checkout takes 10m[/+]MartyIX commentedon Jul 2, 2025
Oh, I see. Given that the repo is big, I would guess that there is not really that much you can do. Even if you find a way to speed it up, I don't believe you should use Github Actions to download the complete repo every day. That feels quite wasteful resource-wise (even if it's somewhat free).
I thought you wanted to get shallow copy of the repo, do the stat for the day and write it somewhere. That's a bit better imho.
knowledgebreak commentedon Jul 5, 2025
No check out done
abitrolly commentedon Jul 10, 2025
@MartyIX the problem is to get checkout for the day.
MartyIX commentedon Jul 10, 2025
btw: The repo migrated from https://github.com/mozilla/gecko to https://github.com/mozilla/firefox
On my machine it took 5 minutes to get a shallow copy of the repo.
One way to achieve the daily stats would be to have a github repo with the following structure:
Now the
script.shwould run every day and it wouldfirefoxrepo,abitrolly commentedon Jul 10, 2025
What a coincidence.. :D