Skip to content

Conversation

@XuehaoSun
Copy link
Collaborator

@XuehaoSun XuehaoSun commented Apr 17, 2025

Description

Add model test timeout
Refine accuracy report

Issues

n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

CI

Signed-off-by: Sun, Xuehao <[email protected]>
@XuehaoSun XuehaoSun requested a review from lkk12014402 as a code owner April 17, 2025 07:56
@XuehaoSun XuehaoSun requested review from Copilot and removed request for lkk12014402 April 17, 2025 07:56
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a timeout setting to model test workflows.

  • Added a 10-minute timeout configuration key for the HPU workflow.
  • Added a 10-minute timeout configuration key for the CPU workflow.

Reviewed Changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.

File Description
.github/workflows/model_test_hpu.yml Added a timeout setting to the HPU workflow configuration.
.github/workflows/model_test_cpu.yml Added a timeout setting to the CPU workflow configuration.
Files not reviewed (1)
  • .github/workflows/scripts/models/model_test.sh: Language not supported
Comments suppressed due to low confidence (2)

.github/workflows/model_test_hpu.yml:35

  • The 'timeout-minutes' key appears to be misaligned. It should be indented to match the other keys (e.g., 'runs-on') in the 'Evaluation-Workflow' block (likely 6 spaces) to ensure correct YAML parsing.
timeout-minutes: 10

.github/workflows/model_test_cpu.yml:35

  • The 'timeout-minutes' key appears to be misaligned. It should be indented to match the other keys (e.g., 'runs-on') in the 'Evaluation-Workflow' block (likely 6 spaces) to ensure correct YAML parsing.
timeout-minutes: 10

XuehaoSun and others added 5 commits April 17, 2025 16:03
Signed-off-by: Sun, Xuehao <[email protected]>
Signed-off-by: Sun, Xuehao <[email protected]>
Signed-off-by: Sun, Xuehao <[email protected]>
Signed-off-by: Sun, Xuehao <[email protected]>
@XuehaoSun XuehaoSun requested a review from Copilot April 17, 2025 08:35
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 2 out of 5 changed files in this pull request and generated no comments.

Files not reviewed (3)
  • .github/workflows/scripts/models/collect_log.sh: Language not supported
  • .github/workflows/scripts/models/generate_report.sh: Language not supported
  • .github/workflows/scripts/models/model_test.sh: Language not supported
Comments suppressed due to low confidence (4)

.github/workflows/model_test_hpu.yml:35

  • Please confirm that the chosen timeout of 10 minutes is sufficient for all tests. If some tests require more time, consider parameterizing this value.
+    timeout-minutes: 10

.github/workflows/model_test_hpu.yml:117

  • The removal of artifact download and report generation steps may affect downstream processes that depend on these outputs. Please confirm that their removal is intentional.
-      - name: Download Reference Artifact

.github/workflows/model_test_cpu.yml:35

  • Verify that the 10-minute timeout meets the execution requirements for CPU-based tests. Consider whether a dynamic timeout might be needed if test duration varies.
+    timeout-minutes: 10

.github/workflows/model_test_cpu.yml:117

  • The removal of artifact download and report generation steps may disrupt expected workflow outputs. Please confirm that this change aligns with the new testing approach.
-      - name: Download Reference Artifact

@XuehaoSun XuehaoSun requested review from ZePan110 and chensuyue April 17, 2025 08:40
@chensuyue chensuyue merged commit c823bfb into main Apr 17, 2025
11 checks passed
@chensuyue chensuyue deleted the xuehao/timeout branch April 17, 2025 14:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants