Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improved GPU utilization #2

Open
wants to merge 39 commits into
base: master
Choose a base branch
from
Open

Improved GPU utilization #2

wants to merge 39 commits into from

Commits on Nov 12, 2022

  1. reordered flow to only process full batches

    @wings-public
    wings-public committed Nov 12, 2022
    Configuration menu
    Copy the full SHA
    dfb20f7 View commit details
    Browse the repository at this point in the history

  2. sporadic missing predictions handling

    @wings-public
    wings-public committed Nov 12, 2022
    Configuration menu
    Copy the full SHA
    d72d9ee View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2022

  1. print overall performance when batching

    @wings-public
    wings-public committed Nov 13, 2022
    Configuration menu
    Copy the full SHA
    6f1d40e View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2022

  1. fix tensorflow batch size to actually use the provided size

    @wings-public
    wings-public committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    7662a76 View commit details
    Browse the repository at this point in the history

  2. revise logic to read parallel to prediction

    @wings-public
    wings-public committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    ecd71f6 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2022

  1. disabled performance output on predict in illumina implementation

    @wings-public
    wings-public committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    5e64b96 View commit details
    Browse the repository at this point in the history

  2. furhter optimization of gpu usage through offloading np-tensor conver… 

    …sion to cpu
    @wings-public
    wings-public committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    e20c586 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2022

  1. add gc collect to original code to prevent oom kills

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    ee16e00 View commit details
    Browse the repository at this point in the history

  2. add long variant for all arguments

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    3160793 View commit details
    Browse the repository at this point in the history

  3. add dockerfile

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    36a6659 View commit details
    Browse the repository at this point in the history

  4. moved docker directory

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    e6e06cc View commit details
    Browse the repository at this point in the history

  5. corrected long argument access

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    d223e4c View commit details
    Browse the repository at this point in the history

  6. updated benchmarks

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    580f5d5 View commit details
    Browse the repository at this point in the history

  7. added docker link

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    90a3f01 View commit details
    Browse the repository at this point in the history

  8. small fix to dockerfile

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    f7ec23c View commit details
    Browse the repository at this point in the history

  9. small fix to dockerfile

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    7255331 View commit details
    Browse the repository at this point in the history

  10. fixed typo

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    b1f28d2 View commit details
    Browse the repository at this point in the history

  11. fixed code layout

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    2c5d052 View commit details
    Browse the repository at this point in the history

  12. fixed code layout

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    1b28d31 View commit details
    Browse the repository at this point in the history

  13. fixed table layout

    @wings-public
    wings-public committed Nov 16, 2022
    Configuration menu
    Copy the full SHA
    2cf5ac5 View commit details
    Browse the repository at this point in the history

  14. Update README.md

    @geertvandeweyer
    geertvandeweyer authored Nov 16, 2022
    Configuration menu
    Copy the full SHA
    af2e7f8 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. revised code to scale to multiple gpus

    @geertvandeweyer
    geertvandeweyer committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    c7fd579 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2022

  1. relocate annotation loader in worker

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    cbc9679 View commit details
    Browse the repository at this point in the history

  2. fix arguments

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    0754a37 View commit details
    Browse the repository at this point in the history

  3. fix arguments

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    e2ec04b View commit details
    Browse the repository at this point in the history

  4. add small sleep investigating issues above 3 gpus

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    aad6bf9 View commit details
    Browse the repository at this point in the history

  5. looking into startup issues

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    fdbcf1d View commit details
    Browse the repository at this point in the history

  6. There is an issue when going above 2 GPUs

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    31a2ad0 View commit details
    Browse the repository at this point in the history

  7. hide physical devices in batch workers to evaluate memory issues

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    0e89d63 View commit details
    Browse the repository at this point in the history

  8. pass nonmasked device to worker for correct shelf names

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    18c6dac View commit details
    Browse the repository at this point in the history

  9. corrected arguments

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    a1ce6c5 View commit details
    Browse the repository at this point in the history

  10. final code cleanup

    @geertvandeweyer
    geertvandeweyer committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    d3cb462 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. Added custom port option

    @barneyhill
    barneyhill committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    bf00fb1 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2023

  1. Merge pull request #1 from barneyhill/master 

    Added custom port option
    @geertvandeweyer
    geertvandeweyer authored Mar 18, 2023
    Configuration menu
    Copy the full SHA
    6e61778 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Set default port

    @matthiasblum
    matthiasblum committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    c985bc1 View commit details
    Browse the repository at this point in the history

  2. Add -P option to README

    @matthiasblum
    matthiasblum committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    36d22d6 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2023

  1. Merge pull request #2 from matthiasblum/master 

    Add default port
    @geertvandeweyer
    geertvandeweyer authored Mar 23, 2023
    Configuration menu
    Copy the full SHA
    12c3079 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. working on error handling to shutdown on issues

    @geertvandeweyer
    geertvandeweyer committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    e09bca6 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. fix joining of workers

    @geertvandeweyer
    geertvandeweyer committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a354e38 View commit details
    Browse the repository at this point in the history