Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Core: Create config.testIds to expose all available test ids #1424

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Core: Create config.testIds to expose all available test ids #1424

wants to merge 1 commit into from

Commits on Jan 10, 2020

  1. Core: Create config.testIds to expose all available test ids 

    What this does

Currently each testId is calculated as each test is executed.
Config.testIds pre-hashes all the loaded tests on demand and returns all
testIds.

How is this helpful

Currently test runners can get access to test modules via config.modules
and partition the modules based on some distribution strategy for running
the tests in parallel. This is fine but it can lead to unbalanced
distribution as some modules have a lot of tests and some modules are
testing integration (longer running) test instead of unit test.

Partitioning the tests by modules caused some instance of test runners
to run way longer than others as some heavier running modules might be
clumped together in the same instance.

To mitigate and minimize the unbalanced test runs, the proposed solution
is to partition based on each individual test with testId. The test
runners can now access testIds beforehand and can distribute those ids
with the testId url param. This will minimize the test execution time
descrepencies between each individual instance of the test runners.
    @kltan
    kltan authored and Kean Tan committed Jan 10, 2020
    Configuration menu
    Copy the full SHA
    3c997f0 View commit details
    Browse the repository at this point in the history