Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Experiment] Make resize block sizes tweakable via environment variables. #5301

Closed
wants to merge 2 commits into from

Conversation

mzient
Copy link
Contributor

@mzient mzient commented Feb 1, 2024

Category:

Other Performance tuning

Description:

The logical blocks seem to have been too large for resize and resulted in GPU underutilization.
This PR adds two environment variables that control the block sizes:
DALI_RESIZE_CUDA_BLOCK - for the CUDA block
DALI_RESIZE_MAX_ELEMENTS_PER_BLOCK - for the logical block

Previous defaults were:
For 2D: 768 and unlimited (32image_width for vertical pass and/ 32image_height for horizontal pass).
For 3D: 256 and 262,144

Additional information:

Affected modules and functionalities:

Key points relevant for the review:

Tests:

Resampling kernel tests and Python tests for Resize operator

  • Existing tests apply
  • New tests added
    • Python tests
    • GTests
    • Benchmark
    • Other
  • N/A

Checklist

Documentation

  • Existing documentation applies
  • Documentation updated
    • Docstring
    • Doxygen
    • RST
    • Jupyter
    • Other
  • N/A

DALI team only

Requirements

  • Implements new requirements
  • Affects existing requirements
  • N/A

REQ IDs: N/A

JIRA TASK: N/A

@mzient mzient changed the title Make resize block sizes tweakable via environment variables. [Experiment] Make resize block sizes tweakable via environment variables. Feb 1, 2024
@dali-automaton
Copy link
Collaborator

CI MESSAGE: [12516031]: BUILD STARTED

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [12516031]: BUILD PASSED

@stiepan
Copy link
Member

stiepan commented Feb 14, 2024

!build

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [12818339]: BUILD STARTED

@stiepan
Copy link
Member

stiepan commented Feb 14, 2024

!build

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [12818707]: BUILD STARTED

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [12818707]: BUILD FAILED

@stiepan
Copy link
Member

stiepan commented Feb 23, 2024

!build

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [13028849]: BUILD STARTED

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [13028849]: BUILD FAILED

@mzient mzient force-pushed the AdjustableResizeBlockSizes branch from 2002cc2 to cc95d44 Compare March 19, 2024 08:53
@mzient
Copy link
Contributor Author

mzient commented Mar 27, 2024

The tweaks have been used to establish optimum settings. The adjustment is merged as #5382 .

@mzient mzient closed this Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants