Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance Internal CI reliability #42

Merged
merged 5 commits into from
Feb 6, 2024

Conversation

AhmedIsmail02
Copy link
Contributor

Description

This PR introduce two major improvements:

  • Enhance internal pipeline execution time and reliability.

  • Fix internal CI TPIP checker reported file URL.

Enhancing the internal pipeline execution time is done by the following:

  1. Fetch the submodules only for the jobs that needs the submodules files.
  2. Use AUDIO and INFERENCE configuration variants with ML applications only.
  3. Fix FVP VSI as part of the docker image rather than being done as part of every VSI test job.
  4. Test ML inference results as part of OTA update and use the other job for testing blinky app only as a smoke test.

Output metrics:

  • Totally 40 jobs have been eliminated (8 build jobs and 32 test jobs).

  • Totally around 50 minutes have been reduced.

Test Steps

Checklist:

  • I have tested my changes. No regression in existing tests.
  • I have modified and/or added unit-tests to cover the code changes in this Pull Request.

Related Issue

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

GaborAbonyi and others added 5 commits February 6, 2024 08:42
For non-ML applications there is no need to build and run for
AUDIO and INFERENCE variants as these configurations should
be relevant for ML applications only. Non-ML applications would
use the default values only. Thus, separating non-ML
applications pipeline configurations from the ML applications
pipeline configurations.

Signed-off-by: Ahmed Ismail <[email protected]>
Ensure the URL of the files reported in
the TPIP comment added to the Merge Request
contains the correct branch name.

Signed-off-by: Hugues Kamba-Mpiana <[email protected]>
FVP VSI python workaround shall be done as part
of the docker image generation rather than being
done for each VSI  test which should significantly
reduce CI execution time.

Signed-off-by: Ahmed Ismail <[email protected]>
This commit is meant to do the following:

* Modify test-application-output job to test blinky
application only as it can be used as a smoke test.

* Test ML inference output for both keyword-detection and
speech-recognition applications as part of the OTA test job
which is now renamed to test_applications as it is testing
OTA update and ML inference outputs as well.

Note:
* The mentioned changes would result in a better reliability
and better CI performance.

Signed-off-by: Ahmed Ismail <[email protected]>
@AhmedIsmail02 AhmedIsmail02 requested a review from a team as a code owner February 6, 2024 12:11
@urutva urutva merged commit 465e9e9 into FreeRTOS:main Feb 6, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants