Skip to content

PF Recording/Replaying part for sdk_cli #1852

PF Recording/Replaying part for sdk_cli

PF Recording/Replaying part for sdk_cli #1852

GitHub Actions / Executor Unit Test Result [yigao/recording_draft](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:yigao/recording_draft++) succeeded Oct 23, 2023 in 0s

All 385 tests pass in 3m 13s

    2 files  ±0      2 suites  ±0   3m 13s ⏱️ + 1m 4s
385 tests ±0  385 ✔️ ±0  0 💤 ±0  0 ±0 
748 runs  ±0  747 ✔️ ±0  1 💤 ±0  0 ±0 

Results for commit c8cf75a. ± Comparison against earlier commit 79ff7b6.

Annotations

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Executor Unit Test Result [yigao/recording_draft](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:yigao/recording_draft++)

385 tests found

There are 385 tests, see "Raw output" for the full list of tests.
Raw output
tests.executor.unittests._core.test_api_injector ‑ test_aoai_call_inject
tests.executor.unittests._core.test_api_injector ‑ test_aoai_chat_tool_prompt
tests.executor.unittests._core.test_api_injector ‑ test_aoai_generator_proxy
tests.executor.unittests._core.test_api_injector ‑ test_aoai_tool_header
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[ChatCompletion-expected_apis1]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[Embedding-expected_apis2]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[None-expected_apis0]
tests.executor.unittests._core.test_api_injector ‑ test_get_aoai_telemetry_headers
tests.executor.unittests._core.test_api_injector ‑ test_inject_operation_headers
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_build_connections
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_get_secret_list
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_is_secret
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_serialize
tests.executor.unittests._core.test_generator_proxy ‑ test_generate_from_iterator_proxy
tests.executor.unittests._core.test_generator_proxy ‑ test_generate_from_proxy
tests.executor.unittests._core.test_generator_proxy ‑ test_generator_proxy_iter
tests.executor.unittests._core.test_generator_proxy ‑ test_generator_proxy_next
tests.executor.unittests._core.test_generator_proxy ‑ test_iterator_proxy_iter
tests.executor.unittests._core.test_generator_proxy ‑ test_iterator_proxy_next
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_datetime_prefix
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_exit_context_manager
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_get_logs
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_logging
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_clear_node_info
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_get_log
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_multi_thread
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_set_node_info
tests.executor.unittests._core.test_metric_logger.TestMetricLogger ‑ test_add_and_remove_metric_logger
tests.executor.unittests._core.test_metric_logger.TestMetricLogger ‑ test_log_metric
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_append_user_agent
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_context_dict
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_delattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_different_thread_have_different_instance
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_get_instance
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_get_user_agent
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_getattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_getattr_missing
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[Batch-Batch]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[SingleNode-SingleNode]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[Test-Test]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_setattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_setattr_non_primitive
tests.executor.unittests._core.test_run_tracker.TestRunTracker ‑ test_run_tracker
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_node_with_invalid_node
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_package_node
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_script_node
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_collect_package_tools_and_connections
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source0-None-PackageToolNotFoundError-Package tool 'fake_name' is not found in the current environment. Available package tools include: 'promptflow.tools.embedding.embedding,promptflow.tools.serpapi.SerpAPI.search,promptflow.tools.open_source_llm.OpenSourceLLM.call'. Please ensure that the required tool package is installed in current environment.]
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source0-None-PackageToolNotFoundError-Package tool 'fake_name' is not found in the current environment. Available package tools include: 'promptflow.tools.open_source_llm.OpenSourceLLM.call,promptflow.tools.serpapi.SerpAPI.search,promptflow.tools.embedding.embedding'. Please ensure that the required tool package is installed in current environment.]
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source1-python-NodeSourcePathEmpty-Invalid node definitions found in the flow graph. The node 'fake_name' is missing its source path. Please kindly add the source path for the node 'fake_name' in the YAML file and try the operation again.]
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source2-custom_llm-NotSupported-The tool type custom_llm is currently not supported for generating tools using source code. Please choose from the available types: python,prompt,llm. If you need further assistance, kindly contact support.]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_end_tracing
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_push_pop
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_push_tool
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_start_tracing
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[42]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj0]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj1]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj2]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_unserializable_obj_to_serializable
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionMissingParamComments-expected_str_in_template3]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionMissingTypeComments-expected_str_in_template2]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionWithInvalidComments-expected_str_in_template1]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionWithNoComments-expected_str_in_template0]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_default_value
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_regex
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_str
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_str_length_threshold
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_clear
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_normal_str_not_affected
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_scrub_key_in_connection_string
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_scrub_sigature_in_sasuri
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[1-1--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[1-2--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a0-b0-unittests/_utils/test_dataclass_serializer-True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a1-b1-unittests/_utils/test_dataclass_serializer-False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a2-b2--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a3-b3--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[string-string--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[string1-string2--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_dataclass
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[1-2-1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[2022-01-01T00:00:00-datetime-expected3]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[None-datetime-None]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[Status.Completed-Status-Status.Completed]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[NodeRunRecord-NodeRunRecord]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[int-int]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[str-str]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input1-List]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input1-expected1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input2-Dict]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input2-expected2]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_import_pydantic
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_import_pydantic_error
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_connection
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_dataclass
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_generator
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_remove_null
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[1-int-1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[Status.Completed-Status-Completed]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[a-str-a]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value0-datetime-2023-09-04T00:00:00Z]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value2-List-expected2]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value2-value_type2-expected2]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value3-Dict-expected3]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value3-value_type3-expected3]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_additional_info[error_dict0-expected_additional_info0]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_additional_info[error_dict1-expected_additional_info1]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict0-firstError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict1-firstError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict2-firstError/secondError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict3-]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict4-]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_from_error_dict
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_from_exception
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_get_user_execution_error_info[raise_general_exception-CustomizedException]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_get_user_execution_error_info[raise_tool_execution_error-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict0-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict1-UserError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict2-None]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_to_simplied_dict
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info_for_context_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info_for_general_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_general_exception-CustomizedException-expected_error_codes0]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_promptflow_exception-PromptflowException-expected_error_codes2]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_promptflow_exception_without_inner_exception-PromptflowException-expected_error_codes3]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_tool_execution_error-ToolExecutionError-expected_error_codes1]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_general_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_promptflow_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_promptflow_exception_without_inner_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_tool_execution_error
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_get_tb_next
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[SystemErrorException-SystemError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ToolExecutionError-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[UserErrorException-UserError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ValidationException-ValidationError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ValueError-ValueError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_last_frame_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info_for_empty_case
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info_for_empty_inner_error
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_code_hierarchy
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_debug_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_inner_exception[set_inner_exception_by_parameter]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_inner_exception[set_inner_exception_by_raise_from]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex0-message--expected_message_parameters0]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex1-message--expected_message_parameters1]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex10-Tool 'my tool' execution failed due to bug-Tool '{tool_name}' execution failed due to {error}-expected_message_parameters10]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex2-message--expected_message_parameters2]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex3-message--expected_message_parameters3]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex4-Hello world-Hello world-expected_message_parameters4]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex5-Hello world-Hello {name}-expected_message_parameters5]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex6-Hello world-Hello {name}-expected_message_parameters6]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex7-Hello world-Hello {name}-expected_message_parameters7]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex8-Hello world and world-Hello {name} and {name}-expected_message_parameters8]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex9-Hello world and world-Hello {name} and {name}-expected_message_parameters9]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_reference_code
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_target_and_message[ex0-message-Tool]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_target_and_message[ex1-message-Executor]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_for_JsonSerializedPromptflowException[False]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_for_JsonSerializedPromptflowException[True]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_object_parameter
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_turning_on_or_off_debug_info[False]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_turning_on_or_off_debug_info[True]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_tool_execution_error
tests.executor.unittests._utils.test_feature_utils ‑ test_get_feature_list
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestPythonLoadError ‑ test_additional_info
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestPythonLoadError ‑ test_additional_info_for_empty_inner_error
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[JinjaParsingError_Code]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[JinjaParsingError_File]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[ReservedVariableCannotBeUsed]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[JinjaParsingError_Code]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[JinjaParsingError_File]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[ReservedVariableCannotBeUsed]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[MultipleToolsDefined]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[NoToolDefined]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[PythonParsingError_NameError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[PythonParsingError_SyntaxError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[prompt_tools-summarize_text_content_prompt.jinja2-llm]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[prompt_tools-summarize_text_content_prompt.jinja2-prompt]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with___file__-script_with___file__.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with_import-dummy_utils/main.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with_special_character-script_with_special_character.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[BadFunctionInterface]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[MetaFileNotFound]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[MetaFileReadError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[NotSupported]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[PythonLoadError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[PythonLoaderNotFound]
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log_with_args
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log_with_exc_info
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_set_credential_list_thread_safe
tests.executor.unittests._utils.test_logger_utils.TestFileHandlerConcurrentWrapper ‑ test_clear
tests.executor.unittests._utils.test_logger_utils.TestFileHandlerConcurrentWrapper ‑ test_set_handler_thread_safe
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_context_manager
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_empty_file_path
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_scrub_credentials
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_update_log_path
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_update_single_log_path
tests.executor.unittests._utils.test_thread_utils.TestRepeatLogTimer ‑ test_context_manager
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_function_to_interface
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_function_to_interface_with_invalid_initialize_inputs
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_param_to_definition
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_input_names_for_node
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_input_names_for_node_with_variants
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names[flow_with_dict_input_with_variant-expected_connection_names1]
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names[web_classification-expected_connection_names0]
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names_with_package_tool
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_node_condition_conflict
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[5-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Any-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Callable-False0]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Callable-False1]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[MyConnection-True]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[MyType-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[None-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Optional-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[T-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Tuple-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[TypeVar-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[Union-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[dict-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[float-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[int-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[list-False0]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[list-False1]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[list-False2]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[some_function-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[str-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[tuple-False0]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[tuple-False1]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val0-True]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val11-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val14-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val16-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val17-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val19-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val22-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val23-False]
tests.executor.unittests.contracts.test_tool.TestToolContract ‑ test_is_custom_strong_type[val5-False]
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_complete_nodes
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_completed
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_get_bypassed_node_outputs
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_get_node_valid_inputs
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_pop_bypassed_nodes
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_pop_bypassed_nodes_with_exception
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_pop_ready_nodes
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error_with_no_PromptflowException_inner
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error_with_none_inner
tests.executor.unittests.executor.test_exceptions.TestExceptions ‑ test_exception_message
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[chat-True]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[completion-True]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[embedding-False]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_func_with_stream_parameter_should_be_wrapped
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_func_without_stream_parameter_should_not_be_wrapped
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_no_stream_param
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_with_mocked_should_stream
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_with_stream_param
tests.executor.unittests.executor.test_flow_executor.TestEnsureNodeResultIsSerializable ‑ test_non_streaming_tool_should_not_be_affected
tests.executor.unittests.executor.test_flow_executor.TestEnsureNodeResultIsSerializable ‑ test_streaming_tool_should_be_consumed_and_merged
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs0-aggregated_flow_inputs0-aggregation_inputs0-expected_inputs0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs1-aggregated_flow_inputs1-aggregation_inputs1-expected_inputs1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs2-aggregated_flow_inputs2-aggregation_inputs2-expected_inputs2]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs3-aggregated_flow_inputs3-aggregation_inputs3-expected_inputs3]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs4-aggregated_flow_inputs4-aggregation_inputs4-expected_inputs4]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs0-None-expected_inputs0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs1-inputs1-expected_inputs1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs2-inputs2-expected_inputs2]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs3-inputs3-expected_inputs3]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_inputs_mapping[inputs0-inputs_mapping0-expected0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_inputs_mapping[inputs1-inputs_mapping1-expected1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_inputs_mapping_error[inputs0-inputs_mapping0-InputMappingError-Couldn't find these mapping relations: ${baseline.output}, ${data.output}. Please make sure your input mapping keys and values match your YAML input section and input data.]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_complete_inputs_mapping_by_default_value[inputs_mapping0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_complete_inputs_mapping_by_default_value[inputs_mapping1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_inputs_mapping_for_all_lines_error[inputs0-None-UnexpectedError-The input for batch run is incorrect. Please make sure to set up a proper input mapping before proceeding. If you need additional help, feel free to contact support for further assistance.]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_merge_input_dicts_by_line[inputs0-expected0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_merge_input_dicts_by_line[inputs1-expected1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_merge_input_dicts_by_line_error[inputs0-InputMappingError-The input for batch run is incorrect. Input from key 'baseline' is an empty list, which means we cannot generate a single line input for the flow run. Please rectify the input and try again.]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_merge_input_dicts_by_line_error[inputs1-InputMappingError-The input for batch run is incorrect. Line numbers are not aligned. Some lists have dictionaries missing the 'line_number' key, and the lengths of these lists are different. List lengths are: {'data': 2, 'baseline': 1}. Please make sure these lists have the same length or add 'line_number' key to each dictionary.]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_validate_and_apply_inputs_mapping[inputs0-inputs_mapping0-expected0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_validate_and_apply_inputs_mapping[inputs1-inputs_mapping1-expected1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_validate_and_apply_inputs_mapping[inputs2-inputs_mapping2-expected2]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_validate_and_apply_inputs_mapping_empty_input
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_validate_and_apply_inputs_mapping_error[inputs_mapping0-InputMappingError]
tests.executor.unittests.executor.test_flow_executor.TestGetAvailableMaxWorkerCount ‑ test_get_available_max_worker_count[1024.0-128.0-64.0-1--3]
tests.executor.unittests.executor.test_flow_executor.TestGetAvailableMaxWorkerCount ‑ test_get_available_max_worker_count[1024.0-307.2-64.0-1-0]
tests.executor.unittests.executor.test_flow_executor.TestGetAvailableMaxWorkerCount ‑ test_get_available_max_worker_count[1024.0-768.0-64.0-7-7]
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_bypass_nodes
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_collect_outputs
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_execute_single_node
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_future_cancelled_for_exception
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_maximun_concurrency
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_no_nodes_to_run
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_submit_nodes
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_success_result
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes-expected_node_order0]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes_with_activate-expected_node_order2]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes_with_skip-expected_node_order1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[aggregation_activate_reference_non_aggregation-Invalid node definitions found in the flow graph. Non-aggregation node 'grade' cannot be referenced in the activate config of the aggregation node 'calculate_accuracy'. Please review and rectify the node reference.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[aggregation_skip_reference_non_aggregation-Invalid node definitions found in the flow graph. Non-aggregation nodes cannot be referenced in the skip config of the aggregation node 'calculate_accuracy'. Please review and rectify the node reference.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[nodes_cycle-Invalid node definitions found in the flow graph. Node circular dependency has been detected among the nodes in your flow. Kindly review the reference relationships for the nodes ['first_node', 'second_node'] and resolve the circular reference issue in the flow.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[nodes_cycle_with_activate-Invalid node definitions found in the flow graph. Node circular dependency has been detected among the nodes in your flow. Kindly review the reference relationships for the nodes ['first_node', 'second_node'] and resolve the circular reference issue in the flow.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[nodes_cycle_with_skip-Invalid node definitions found in the flow graph. Node circular dependency has been detected among the nodes in your flow. Kindly review the reference relationships for the nodes ['first_node', 'second_node'] and resolve the circular reference issue in the flow.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[non_aggregation_reference_aggregation-Invalid node definitions found in the flow graph. Non-aggregate node 'test_node' cannot reference aggregate nodes {'calculate_accuracy'}. Please review and rectify the node reference.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[wrong_node_reference-Invalid node definitions found in the flow graph. Node 'second_node' references a non-existent node 'third_node' in your flow. Please review your flow to ensure that the node name is accurately specified.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_outputs_valid_with_aggregation[simple_flow_with_python_tool_and_aggregate]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value[1-int-1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value[["1", "2"]-list-expected_result1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[['1', '2']-list-10-InputParseError-Failed to parse the flow input. The value for flow input 'my_input' in line 10 of input data was interpreted as JSON string since its type is 'list'. However, the value '['1', '2']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[['1', '2']-list-None-InputParseError-Failed to parse the flow input. The value for flow input 'my_input' was interpreted as JSON string since its type is 'list'. However, the value '['1', '2']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[str-int-10-InputTypeError-The input for flow is incorrect. The value for flow input 'my_input' in line 10 of input data does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[str-int-None-InputTypeError-The input for flow is incorrect. The value for flow input 'my_input' does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_aggregated_flow_inputs_type[inputs0-expected_result0]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_aggregated_flow_inputs_type_error[inputs0-The input for flow is incorrect. The value for flow input 'test_input' in line 1 of input data does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs0-None-InputParseError-Failed to parse the flow input. The value for flow input 'key' was interpreted as JSON string since its type is 'list'. However, the value '['hello']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs1-0-InputParseError-Failed to parse the flow input. The value for flow input 'key' in line 0 of input data was interpreted as JSON string since its type is 'list'. However, the value '['hello']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs0-aggregation_inputs0-The input for aggregation is incorrect. The value for aggregated reference input 'input1' should be a list, but received str. Please adjust the input value to match the expected format.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs1-aggregation_inputs1-The input for aggregation is incorrect. The value for aggregated flow input 'input1' should be a list, but received str. Please adjust the input value to match the expected format.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs2-aggregation_inputs2-The input for aggregation is incorrect. The length of all aggregated inputs should be the same. Current input lengths are: {'input1': 2, 'input_2': 1}. Please adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs3-aggregation_inputs3-The input for aggregation is incorrect. The input 'input1' appears in both aggregated flow input and aggregated reference input. Please remove one of them and try the operation again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val0-output-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val1-['output']-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val2-["output"]-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val3-["output"]["text"]-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val4-[1]-output2]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val5-value-dummy]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val0-output_str[2]-Invalid property 'output_str[2]' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val1-text-Invalid property 'text' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val2-value_type-Invalid property 'value_type' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[${inputs.text}-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[${node1.output}-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[hello promptflow-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${inputs.word}-InputNotFound-The input 'word' is not found from flow inputs 'text'. Please check the input name and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${node1.word}-UnsupportedReference-The section 'word' of reference is currently unsupported. Please specify the output part of the node 'node1'.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${node2.output}-InputNotFoundFromAncestorNodeOutput-The input 'node2' is not found from ancestor node outputs ['node1']. Please check the node name and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[input3-NotSupported-The type 'wrong_type' is currently unsupported. Please choose from available types: ['Literal', 'FlowInput', 'NodeReference'] and try again.]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_get_openai_metrics
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_get_status_summary
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call0]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call1]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call2]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call3]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call4]
tests.executor.unittests.executor.test_result.TestBulkResult ‑ test_invalid_api_calls[api_call5]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types0-MyFirstCSTConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types1-CustomConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types2-CustomConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types3-MyFirstCSTConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_ensure_node_inputs_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_integrate_prompt_in_package_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[None]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source1]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source2]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source3]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_llm_connection_to_inputs
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_llm_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_package_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_script_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_diff_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_duplicated_inputs
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_invalid_source_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_invalid_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_no_source
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_no_source_path
tests.executor.unittests.integrations.test_langchain.TestLangchain ‑ test_langchain_traces
tests.executor.unittests.integrations.test_langchain.TestLangchain ‑ test_langchain_traces_with_unpaired_events
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_format_completed_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_format_current_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_healthy_ensured_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_unhealthy_process
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_exec_line[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_exec_line_with_exception[simple_flow_with_python_tool-batch_input0-The value for flow input 'num' is not provided in line 0 of input data. Please review your input data or remove this input in your flow if it's no longer needed.-InputNotFound]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_line_execution_not_completed[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_line_execution_process_pool[web_classification_no_variants]
tests.executor.unittests.storage.test_azureml_run_storage_v2 ‑ test_line_record
tests.executor.unittests.storage.test_azureml_run_storage_v2 ‑ test_line_serialize
tests.executor.unittests.storage.test_azureml_run_storage_v2 ‑ test_node_record
tests.executor.unittests.storage.test_azureml_run_storage_v2 ‑ test_node_serialize
tests.executor.unittests.storage.test_queue_run_storage.TestLineExecutionProcessPool ‑ test_persist_flow_run
tests.executor.unittests.storage.test_queue_run_storage.TestLineExecutionProcessPool ‑ test_persist_node_run