Skip to content
promptflow-release-testing-matrix

promptflow-release-testing-matrix #64

Sign in to view logs

promptflow-release-testing-matrix

promptflow-release-testing-matrix #64

Manually triggered November 8, 2023 08:03
@zhengfeiwangzhengfeiwang
⁠ 8924b43
release/promptflow/1.0.0
Status Cancelled
Total duration 20m 52s
Artifacts 12

promptflow-release-testing-matrix.yml

on: workflow_dispatch
Matrix: all_tests
id
0s
id
Publish Tests Results
26s
Publish Tests Results
Fit to window
Zoom out
Zoom in

Annotations

11 errors and 29 warnings
all_tests (windows-latest, executor, 3.11)
Process completed with exit code 1.
all_tests (windows-latest, sdk-cli, 3.8)
The run was canceled by @zhengfeiwang.
all_tests (windows-latest, sdk-cli, 3.8)
The operation was canceled.
all_tests (windows-latest, sdk-cli, 3.9)
The run was canceled by @zhengfeiwang.
all_tests (windows-latest, sdk-cli, 3.9)
The operation was canceled.
all_tests (windows-latest, sdk-cli, 3.11)
The run was canceled by @zhengfeiwang.
all_tests (windows-latest, sdk-cli, 3.11)
The operation was canceled.
all_tests (windows-latest, sdk-cli, 3.10)
The run was canceled by @zhengfeiwang.
all_tests (windows-latest, sdk-cli, 3.10)
The operation was canceled.
all_tests (macos-latest, sdk-cli, 3.8)
The run was canceled by @zhengfeiwang.
all_tests (macos-latest, sdk-cli, 3.8)
The operation was canceled.
all_tests (windows-latest, sdk-cli, 3.8)
No files were found with the provided path: D:\a\promptflow\promptflow/*.xml. No artifacts will be uploaded.
all_tests (windows-latest, sdk-cli, 3.9)
No files were found with the provided path: D:\a\promptflow\promptflow/*.xml. No artifacts will be uploaded.
all_tests (windows-latest, sdk-cli, 3.11)
No files were found with the provided path: D:\a\promptflow\promptflow/*.xml. No artifacts will be uploaded.
all_tests (windows-latest, sdk-cli, 3.10)
No files were found with the provided path: D:\a\promptflow\promptflow/*.xml. No artifacts will be uploaded.
all_tests (macos-latest, sdk-cli, 3.8)
No files were found with the provided path: /Users/runner/work/promptflow/promptflow/*.xml. No artifacts will be uploaded.
1 out of 12 runs failed: test_bulk_run_input_type_invalid[simple_flow_with_python_tool-batch_input1-The input for flow is incor…or adjust the input value in your input data.-InputTypeError] (tests.executor.e2etests.test_executor_validation.TestValidation): tests.executor.e2etests.test_executor_validation.TestValidation#L0
artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 3s]
3 out of 12 runs failed: test_single_node_input_type_invalid[path_root1-simple_flow_with_python_tool-divide_num-line_input1-Inp…is not type 'int'. Please review and rectify the input data.] (tests.executor.e2etests.test_executor_validation.TestValidation): tests.executor.e2etests.test_executor_validation.TestValidation#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
1 out of 12 runs failed: test_executor_batch_engine_with_image[python_tool_with_composite_image-input_dirs1-inputs_mapping1] (tests.executor.e2etests.test_executor_with_image.TestExecutorWithImage): tests.executor.e2etests.test_executor_with_image.TestExecutorWithImage#L0
artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results-executor.xml [took 1s]
3 out of 12 runs failed: test_gen_tool_by_source_error[tool_source2-custom_llm-NotSupported-The tool type custom_llm is current…. If you need further assistance, kindly contact support.] (tests.executor.unittests._core.test_tools_manager.TestToolsManager): tests.executor.unittests._core.test_tools_manager.TestToolsManager#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_get_user_execution_error_info[raise_tool_execution_error-ToolExecutionError] (tests.executor.unittests._utils.test_exception_utils.TestErrorResponse): tests.executor.unittests._utils.test_exception_utils.TestErrorResponse#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_tool_execution_error (tests.executor.unittests._utils.test_exception_utils.TestExceptions): tests.executor.unittests._utils.test_exception_utils.TestExceptions#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_additional_info (tests.executor.unittests._utils.test_exception_utils.TestExceptions): tests.executor.unittests._utils.test_exception_utils.TestExceptions#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_generate_tool_meta_dict_by_file_exception[MetaFileNotFound] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 2s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 3s]
3 out of 12 runs failed: test_generate_tool_meta_dict_by_file_exception[MetaFileReadError] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 2s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 3s]
3 out of 12 runs failed: test_generate_tool_meta_dict_by_file_exception[NotSupported] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 4s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 3s]
3 out of 12 runs failed: test_custom_llm_meta[JinjaParsingError_Code] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_custom_llm_meta[JinjaParsingError_File] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_custom_prompt_meta[JinjaParsingError_Code] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_custom_prompt_meta[JinjaParsingError_File] (tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils): tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_resolve_tool_error (tests.executor.unittests.executor.test_errors): tests.executor.unittests.executor.test_errors#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs0-None-InputParseErr…Please make sure your inputs are properly formatted.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs1-0-InputParseError-…Please make sure your inputs are properly formatted.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_resolve_aggregated_flow_inputs_type_error[inputs0-The input for flow is incorrect. The value for …t type or adjust the input value in your input data.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_parse_input_value_error[str-int-None-InputTypeError-The input for flow is incorrect. The value fo…t type or adjust the input value in your input data.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_parse_input_value_error[['1', '2']-list-None-InputParseError-Failed to parse the flow input. The …Please make sure your inputs are properly formatted.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_parse_input_value_error[str-int-10-InputTypeError-The input for flow is incorrect. The value for …t type or adjust the input value in your input data.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
3 out of 12 runs failed: test_parse_input_value_error[['1', '2']-list-10-InputParseError-Failed to parse the flow input. The va…Please make sure your inputs are properly formatted.] (tests.executor.unittests.executor.test_flow_validator.TestFlowValidator): tests.executor.unittests.executor.test_flow_validator.TestFlowValidator#L0
artifacts/Test Results (Python 3.11) (OS macos-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-executor.xml [took 0s] artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 0s]
1 out of 12 runs failed: test_unhealthy_process (tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess): tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess#L0
artifacts/Test Results (Python 3.11) (OS windows-latest)/test-results-executor.xml [took 30s]
3 out of 7 runs failed: test_flow_as_a_func_with_variant (tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc): tests.sdk_cli_test.e2etests.test_flow_as_func.TestFlowAsFunc#L0
artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results-sdk-cli.xml [took 0s] artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results-sdk-cli.xml [took 0s] artifacts/Test Results (Python 3.8) (OS ubuntu-latest)/test-results-sdk-cli.xml [took 0s]

Artifacts

Produced during runtime
Name Size
Test Results (Python 3.10) (OS macos-latest) Expired
150 KB
Test Results (Python 3.10) (OS ubuntu-latest) Expired
160 KB
Test Results (Python 3.10) (OS windows-latest) Expired
100 KB
Test Results (Python 3.11) (OS macos-latest) Expired
236 KB
Test Results (Python 3.11) (OS ubuntu-latest) Expired
246 KB
Test Results (Python 3.11) (OS windows-latest) Expired
241 KB
Test Results (Python 3.8) (OS macos-latest) Expired
101 KB
Test Results (Python 3.8) (OS ubuntu-latest) Expired
163 KB
Test Results (Python 3.8) (OS windows-latest) Expired
100 KB
Test Results (Python 3.9) (OS macos-latest) Expired
150 KB
Test Results (Python 3.9) (OS ubuntu-latest) Expired
150 KB
Test Results (Python 3.9) (OS windows-latest) Expired
100 KB