Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PromptFlow] Optimize memory computation #1328

Merged
merged 32 commits into from
Dec 7, 2023

Redefine the calculation of factors

c1e228a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

[PromptFlow] Optimize memory computation #1328

Redefine the calculation of factors
c1e228a
Select commit
Loading
Failed to load commit list.
GitHub Actions / Executor Unit Test Result [luluzuo/optimize_memory_computation](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:luluzuo/optimize_memory_computation++) succeeded Dec 7, 2023 in 0s

All 590 tests pass, 5 skipped in 53s

595 tests  ±0   590 ✔️ ±0   53s ⏱️ +7s
    1 suites ±0       5 💤 ±0 
    1 files   ±0       0 ±0 

Results for commit c1e228a. ± Comparison against earlier commit 2c1a1b6.

Annotations

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Executor Unit Test Result [luluzuo/optimize_memory_computation](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:luluzuo/optimize_memory_computation++)

5 skipped tests found

There are 5 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[ChatCompletion-expected_apis1]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[Embedding-expected_apis2]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[None-expected_apis0]
tests.executor.unittests.processpool.test_line_execution_process_pool ‑ test_fork_mode_parallelism_in_subprocess
tests.executor.unittests.processpool.test_line_execution_process_pool ‑ test_spawn_mode_parallelism_in_subprocess

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Executor Unit Test Result [luluzuo/optimize_memory_computation](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:luluzuo/optimize_memory_computation++)

595 tests found (test 1 to 518)

There are 595 tests, see "Raw output" for the list of tests 1 to 518.
Raw output
tests.executor.unittests._core.test_api_injector ‑ test_aoai_call_inject
tests.executor.unittests._core.test_api_injector ‑ test_aoai_chat_tool_prompt
tests.executor.unittests._core.test_api_injector ‑ test_aoai_generator_proxy
tests.executor.unittests._core.test_api_injector ‑ test_aoai_tool_header
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[Embeddings-expected_apis2]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[None-expected_apis0]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis[chat.Completions-expected_apis1]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[ChatCompletion-expected_apis1]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[Embedding-expected_apis2]
tests.executor.unittests._core.test_api_injector ‑ test_availabe_openai_apis_for_legacy_openai[None-expected_apis0]
tests.executor.unittests._core.test_api_injector ‑ test_get_aoai_telemetry_headers
tests.executor.unittests._core.test_api_injector ‑ test_inject_operation_headers
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_build_connections
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_get_secret_list
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_is_secret
tests.executor.unittests._core.test_connection_manager.TestConnectionManager ‑ test_serialize
tests.executor.unittests._core.test_generator_proxy ‑ test_generate_from_iterator_proxy
tests.executor.unittests._core.test_generator_proxy ‑ test_generate_from_proxy
tests.executor.unittests._core.test_generator_proxy ‑ test_generator_proxy_iter
tests.executor.unittests._core.test_generator_proxy ‑ test_generator_proxy_next
tests.executor.unittests._core.test_generator_proxy ‑ test_iterator_proxy_iter
tests.executor.unittests._core.test_generator_proxy ‑ test_iterator_proxy_next
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_datetime_prefix
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_exit_context_manager
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_get_logs
tests.executor.unittests._core.test_log_manager.TestNodeLogManager ‑ test_logging
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_clear_node_info
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_get_log
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_multi_thread
tests.executor.unittests._core.test_log_manager.TestNodeLogWriter ‑ test_set_node_info
tests.executor.unittests._core.test_metric_logger.TestMetricLogger ‑ test_add_and_remove_metric_logger
tests.executor.unittests._core.test_metric_logger.TestMetricLogger ‑ test_log_metric
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_append_user_agent
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_context_dict
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_delattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_different_thread_have_different_instance
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_get_instance
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_get_user_agent
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_getattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_getattr_missing
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[Batch-Batch]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[SingleNode-SingleNode]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_run_mode[Test-Test]
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_set_batch_input_source_from_inputs_mapping_data
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_set_batch_input_source_from_inputs_mapping_empty
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_set_batch_input_source_from_inputs_mapping_none
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_set_batch_input_source_from_inputs_mapping_run
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_setattr
tests.executor.unittests._core.test_operation_context.TestOperationContext ‑ test_setattr_non_primitive
tests.executor.unittests._core.test_run_tracker.TestRunTracker ‑ test_run_tracker
tests.executor.unittests._core.test_tools_manager.TestBuiltinsManager ‑ test_load_tool_from_module
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_node_with_invalid_node
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_package_node
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_package_node_with_legacy_tool_id
tests.executor.unittests._core.test_tools_manager.TestToolLoader ‑ test_load_tool_for_script_node
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_collect_package_tools_and_connections
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_collect_package_tools_if_node_source_tool_is_legacy
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_dynamic_list
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source0-None-PackageToolNotFoundError-Package tool 'fake_name' is not found in the current environment. Available package tools include: 'promptflow.tools.openai_gpt4v.OpenAI.chat,promptflow.tools.serpapi.SerpAPI.search,promptflow.tools.open_source_llm.OpenSourceLLM.call,promptflow.tools.azure_content_safety.analyze_text,promptflow.tools.embedding.embedding'. Please ensure that the required tool package is installed in current environment.]
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source1-python-NodeSourcePathEmpty-Invalid node definitions found in the flow graph. The node 'fake_name' is missing its source path. Please kindly add the source path for the node 'fake_name' in the YAML file and try the operation again.]
tests.executor.unittests._core.test_tools_manager.TestToolsManager ‑ test_gen_tool_by_source_error[tool_source2-custom_llm-NotSupported-The tool type custom_llm is currently not supported for generating tools using source code. Please choose from the available types: python,prompt,llm. If you need further assistance, kindly contact support.]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_end_tracing
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_push_pop
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_push_tool
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_start_tracing
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[42]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj0]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj1]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_to_serializable[obj2]
tests.executor.unittests._core.test_tracer.TestTracer ‑ test_unserializable_obj_to_serializable
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionMissingParamComments-expected_str_in_template3]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionMissingTypeComments-expected_str_in_template2]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionWithInvalidComments-expected_str_in_template1]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_comments[MyCustomConnectionWithNoComments-expected_str_in_template0]
tests.executor.unittests._utils.test_connection_utils.TestConnectionUtils ‑ test_generate_custom_strong_type_connection_template_with_default_value
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_regex
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_str
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_add_str_length_threshold
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_clear
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_normal_str_not_affected
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_scrub_key_in_connection_string
tests.executor.unittests._utils.test_credential_scrubber.TestCredentialScrubber ‑ test_scrub_sigature_in_sasuri
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[1-1--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[1-2--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a0-b0-unittests/_utils/test_dataclass_serializer-True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a1-b1-unittests/_utils/test_dataclass_serializer-False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a2-b2--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[a3-b3--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[string-string--True]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_assertEqual[string1-string2--False]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_dataclass
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[1-2-1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[2022-01-01T00:00:00-datetime-expected3]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[None-datetime-None]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_deserialize_value[Status.Completed-Status-Status.Completed]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[NodeRunRecord-NodeRunRecord]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[int-int]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[str-str]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input1-expected1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_get_type[type_input2-expected2]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_import_pydantic
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_import_pydantic_error
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_connection
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_dataclass
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_generator
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_remove_null
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[1-int-1]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[Status.Completed-Status-Completed]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[a-str-a]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value0-datetime-2023-09-04T00:00:00Z]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value2-value_type2-expected2]
tests.executor.unittests._utils.test_dataclass_serializer ‑ test_serialize_value[value3-value_type3-expected3]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_additional_info[error_dict0-expected_additional_info0]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_additional_info[error_dict1-expected_additional_info1]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict0-firstError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict1-firstError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict2-firstError/secondError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict3-]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_error_code_hierarchy[input_dict4-]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_from_error_dict
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_from_exception
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_get_user_execution_error_info[raise_general_exception-CustomizedException]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_get_user_execution_error_info[raise_tool_execution_error-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict0-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict1-UserError]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_innermost_error_code_with_code[error_dict2-None]
tests.executor.unittests._utils.test_exception_utils.TestErrorResponse ‑ test_to_simplied_dict
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info_for_context_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_debug_info_for_general_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_general_exception-CustomizedException-expected_error_codes0]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_promptflow_exception-PromptflowException-expected_error_codes2]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_promptflow_exception_without_inner_exception-PromptflowException-expected_error_codes3]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_error_codes[raise_tool_execution_error-ToolExecutionError-expected_error_codes1]
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_general_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_promptflow_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_promptflow_exception_without_inner_exception
tests.executor.unittests._utils.test_exception_utils.TestExceptionPresenter ‑ test_to_dict_for_tool_execution_error
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_get_tb_next
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[SystemErrorException-SystemError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ToolExecutionError-ToolExecutionError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[UserErrorException-UserError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ValidationException-ValidationError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_infer_error_code_from_class[ValueError-ValueError]
tests.executor.unittests._utils.test_exception_utils.TestExceptionUtilsCommonMethod ‑ test_last_frame_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info_for_empty_case
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_additional_info_for_empty_inner_error
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_code_hierarchy
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_debug_info
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_inner_exception[set_inner_exception_by_parameter]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_inner_exception[set_inner_exception_by_raise_from]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex0-message--expected_message_parameters0]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex1-message--expected_message_parameters1]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex10-Tool 'my tool' execution failed due to bug-Tool '{tool_name}' execution failed due to {error}-expected_message_parameters10]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex2-message--expected_message_parameters2]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex3-message--expected_message_parameters3]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex4-Hello world-Hello world-expected_message_parameters4]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex5-Hello world-Hello {name}-expected_message_parameters5]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex6-Hello world-Hello {name}-expected_message_parameters6]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex7-Hello world-Hello {name}-expected_message_parameters7]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex8-Hello world and world-Hello {name} and {name}-expected_message_parameters8]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_message_and_format[ex9-Hello world and world-Hello {name} and {name}-expected_message_parameters9]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_reference_code
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_target_and_message[ex0-message-Tool]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_target_and_message[ex1-message-Executor]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_for_JsonSerializedPromptflowException[False]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_for_JsonSerializedPromptflowException[True]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_object_parameter
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_turning_on_or_off_debug_info[False]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_to_dict_turning_on_or_off_debug_info[True]
tests.executor.unittests._utils.test_exception_utils.TestExceptions ‑ test_tool_execution_error
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs0-None-expected_inputs0]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs1-inputs1-expected_inputs1]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs2-inputs2-expected_inputs2]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs3-inputs3-expected_inputs3]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs4-inputs4-expected_inputs4]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs5-inputs5-expected_inputs5]
tests.executor.unittests._utils.test_execution_utils.TestFlowExecutor ‑ test_apply_default_value_for_input[flow_inputs6-inputs6-expected_inputs6]
tests.executor.unittests._utils.test_feature_utils ‑ test_get_feature_list
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestPythonLoadError ‑ test_additional_info
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestPythonLoadError ‑ test_additional_info_for_empty_inner_error
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[JinjaParsingError_Code]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[JinjaParsingError_File]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_llm_meta[ReservedVariableCannotBeUsed]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[JinjaParsingError_Code]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[JinjaParsingError_File]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_prompt_meta[ReservedVariableCannotBeUsed]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[MultipleToolsDefined]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[NoToolDefined]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[PythonParsingError_NameError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_custom_python_meta[PythonParsingError_SyntaxError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[prompt_tools-summarize_text_content_prompt.jinja2-llm]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[prompt_tools-summarize_text_content_prompt.jinja2-prompt]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with___file__-script_with___file__.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with_import-dummy_utils/main.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file[script_with_special_character-script_with_special_character.py-python]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[BadFunctionInterface]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[MetaFileNotFound]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[MetaFileReadError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[NotSupported]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[PythonLoadError]
tests.executor.unittests._utils.test_generate_tool_meta_utils.TestToolMetaUtils ‑ test_generate_tool_meta_dict_by_file_exception[PythonLoaderNotFound]
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log_with_args
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_log_with_exc_info
tests.executor.unittests._utils.test_logger_utils.TestCredentialScrubberFormatter ‑ test_set_credential_list_thread_safe
tests.executor.unittests._utils.test_logger_utils.TestFileHandlerConcurrentWrapper ‑ test_clear
tests.executor.unittests._utils.test_logger_utils.TestFileHandlerConcurrentWrapper ‑ test_set_handler_thread_safe
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_context_manager
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_empty_file_path
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_scrub_credentials
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_update_log_path
tests.executor.unittests._utils.test_logger_utils.TestLogContext ‑ test_update_single_log_path
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_convert_multimedia_date_to_base64
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_base64[logo.gif]
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_base64[logo.jpg]
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_base64[logo.png]
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_base64[logo.webp]
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_url_failure
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_from_url_with_mime_type
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_with_dict
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_with_invalid_cases
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_create_image_with_string
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_load_multimedia_data
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_persist_multimedia_date
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_process_multimedia_dict_recursively
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_process_recursively
tests.executor.unittests._utils.test_multimedia_utils.TestMultimediaUtils ‑ test_resolve_multimedia_data_recursively
tests.executor.unittests._utils.test_thread_utils.TestRepeatLogTimer ‑ test_context_manager
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func1-None-False-expected_res0]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func2-func_input_params_dict1-False-expected_res1]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func3-func_input_params_dict2-False-expected_res2]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func3-func_input_params_dict3-False-expected_res3]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func3-func_input_params_dict4-True-expected_res4]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func4-func_input_params_dict5-True-expected_res5]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func5-func_input_params_dict6-True-expected_res6]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func5-func_input_params_dict7-True-expected_res7]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func6-func_input_params_dict8-True-expected_res8]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func6-func_input_params_dict9-True-expected_res9]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func7-func_input_params_dict10-True-expected_res10]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func7-func_input_params_dict11-True-expected_res11]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func8-func_input_params_dict12-True-expected_res12]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_append_workspace_triple_to_func_input_params[mock_dynamic_list_func8-func_input_params_dict13-True-expected_res13]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_find_deprecated_tools
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_function_to_interface
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_function_to_interface_with_invalid_initialize_inputs
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_function_to_interface_with_kwargs
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_load_function_from_function_path
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_load_function_from_function_path_with_error
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_param_to_definition
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res0]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res1]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res2]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res3]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res4]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type[res5]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[None-mock_func response can not be empty.]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[res1-mock_func response can not be empty.]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[res2-mock_func response must be a list of dict. a is not a dict.]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[res3-mock_func response must be a list.]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[res4-mock_func response dict must have 'value' key.]
tests.executor.unittests._utils.test_tool_utils.TestToolUtils ‑ test_validate_dynamic_list_func_response_type_with_error[res5-mock_func response dict value \\(1\\+2j\\) is not json serializable.]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var[TEST_VAR-10-5-10]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var[TEST_VAR-10-None-10]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var[TEST_VAR-None-5-5]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var[TEST_VAR-invalid-5-5]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var[TEST_VAR-invalid-None-None]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var_without_default_vaue[TEST_VAR-10-10]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var_without_default_vaue[TEST_VAR-None-None]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_get_int_env_var_without_default_vaue[TEST_VAR-invalid-None]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_is_json_serializable[-True]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_is_json_serializable[1-True]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_is_json_serializable[None-True]
tests.executor.unittests._utils.test_utils.TestUtils ‑ test_is_json_serializable[value3-False]
tests.executor.unittests.batch.test_batch_engine.TestBatchEngine ‑ test_batch_engine_error
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_apply_inputs_mapping[inputs0-inputs_mapping0-expected0]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_apply_inputs_mapping[inputs1-inputs_mapping1-expected1]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_apply_inputs_mapping_error[inputs0-inputs_mapping0-InputMappingError-Couldn't find these mapping relations: ${baseline.output}, ${data.output}. Please make sure your input mapping keys and values match your YAML input section and input data.]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_complete_inputs_mapping_by_default_value[inputs_mapping0]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_complete_inputs_mapping_by_default_value[inputs_mapping1]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_inputs_mapping_for_all_lines_error[inputs0-None-UnexpectedError-The input for batch run is incorrect. Please make sure to set up a proper input mapping before proceeding. If you need additional help, feel free to contact support for further assistance.]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_merge_input_dicts_by_line[inputs0-expected0]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_merge_input_dicts_by_line[inputs1-expected1]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_merge_input_dicts_by_line_error[inputs0-InputMappingError-The input for batch run is incorrect. Input from key 'baseline' is an empty list, which means we cannot generate a single line input for the flow run. Please rectify the input and try again.]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_merge_input_dicts_by_line_error[inputs1-InputMappingError-The input for batch run is incorrect. Line numbers are not aligned. Some lists have dictionaries missing the 'line_number' key, and the lengths of these lists are different. List lengths are: {'data': 2, 'baseline': 1}. Please make sure these lists have the same length or add 'line_number' key to each dictionary.]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_validate_and_apply_inputs_mapping[inputs0-inputs_mapping0-expected0]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_validate_and_apply_inputs_mapping[inputs1-inputs_mapping1-expected1]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_validate_and_apply_inputs_mapping[inputs2-inputs_mapping2-expected2]
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_validate_and_apply_inputs_mapping_empty_input
tests.executor.unittests.batch.test_batch_inputs_processor.TestBatchInputsProcessor ‑ test_validate_and_apply_inputs_mapping_error[inputs_mapping0-InputMappingError]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call0]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call1]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call2]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call3]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call4]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_invalid_api_calls[api_call5]
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_node_status
tests.executor.unittests.batch.test_result.TestBatchResult ‑ test_system_metrics
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_apply_default_node_variant[None]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_apply_default_node_variant[node_variants1]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_apply_default_node_variant[node_variants2]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_apply_default_node_variants
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_apply_node_overrides
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_flow_deserialize[data0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_flow_serialize[flow0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_flow_serialize[flow1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_get_chat_input_name
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_get_chat_output_name
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_get_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_get_tool
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_has_aggregation_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_import_requisites
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_chat_flow
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_llm_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_node_referenced_by
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_normal_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_reduce_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_referenced_by_flow_output
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_is_referenced_by_other_node
tests.executor.unittests.contracts.test_flow.TestFlow ‑ test_replace_with_variant
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_input_names_for_node
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_input_names_for_node_with_variants
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names[basic-with-connection-expected_connection_names1]
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names[flow_with_dict_input_with_variant-expected_connection_names2]
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names[web_classification-expected_connection_names0]
tests.executor.unittests.contracts.test_flow.TestFlowContract ‑ test_flow_get_connection_names_with_package_tool
tests.executor.unittests.contracts.test_flow.TestFlowInputAssignment ‑ test_deserialize
tests.executor.unittests.contracts.test_flow.TestFlowInputAssignment ‑ test_is_flow_input[-False]
tests.executor.unittests.contracts.test_flow.TestFlowInputAssignment ‑ test_is_flow_input[flow.section.property-True]
tests.executor.unittests.contracts.test_flow.TestFlowInputAssignment ‑ test_is_flow_input[inputs.section.property-True]
tests.executor.unittests.contracts.test_flow.TestFlowInputAssignment ‑ test_is_flow_input[section.property-False]
tests.executor.unittests.contracts.test_flow.TestFlowInputDefinition ‑ test_deserialize[data0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlowInputDefinition ‑ test_deserialize[data1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestFlowInputDefinition ‑ test_serialize[value0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlowInputDefinition ‑ test_serialize[value1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestFlowOutputDefinition ‑ test_deserialize[data0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlowOutputDefinition ‑ test_serialize[value0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestFlowOutputDefinition ‑ test_serialize[value1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize[$value-expected_value3]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize[${flow.section.property}-expected_value1]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize[${value.section.property}-expected_value0]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize[${value}-expected_value2]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize[value-expected_value4]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_node_reference[value-expected_value0]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_node_reference[value.section-expected_value1]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_node_reference[value.section.property-expected_value2]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_reference[flow.section-expected_value1]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_reference[flow.section.property-expected_value2]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_deserialize_reference[input-expected_value0]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_serialize[value0-value]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_serialize[value1-${flow.value}]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_serialize[value2-${value.section}]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_serialize[value3-${value.section.property}]
tests.executor.unittests.contracts.test_flow.TestInputAssignment ‑ test_serialize[value4-ABCMeta]
tests.executor.unittests.contracts.test_flow.TestNode ‑ test_deserialize[data0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestNode ‑ test_deserialize[data1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestNode ‑ test_serialize[node0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestNode ‑ test_serialize[node1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestToolSource ‑ test_deserialize[tool_source0-expected_value0]
tests.executor.unittests.contracts.test_flow.TestToolSource ‑ test_deserialize[tool_source1-expected_value1]
tests.executor.unittests.contracts.test_flow.TestToolSource ‑ test_deserialize[tool_source2-expected_value2]
tests.executor.unittests.contracts.test_multimedia.TestMultimediaContract ‑ test_constructors
tests.executor.unittests.contracts.test_run_info.TestFlowRunInfo ‑ test_creation
tests.executor.unittests.contracts.test_run_info.TestFlowRunInfo ‑ test_deserialize
tests.executor.unittests.contracts.test_run_info.TestRunInfo ‑ test_creation
tests.executor.unittests.contracts.test_run_info.TestRunInfo ‑ test_deserialize
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[123-False]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Bypassed-True]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.CancelRequested-False]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Canceled-True]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Completed-True]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Failed-True]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.NotStarted-False]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Preparing-False]
tests.executor.unittests.contracts.test_run_info.TestStatus ‑ test_status_is_terminated[Status.Running-False]
tests.executor.unittests.contracts.test_run_management ‑ test_visualization_render
tests.executor.unittests.contracts.test_run_mode ‑ test_parse[Batch-Batch]
tests.executor.unittests.contracts.test_run_mode ‑ test_parse[Default-Test]
tests.executor.unittests.contracts.test_run_mode ‑ test_parse[SingleNode-SingleNode]
tests.executor.unittests.contracts.test_run_mode ‑ test_parse[Test-Test]
tests.executor.unittests.contracts.test_run_mode ‑ test_parse_invalid
tests.executor.unittests.contracts.test_tool ‑ test_deserialize_enum[Status-FAILED-Status.Failed]
tests.executor.unittests.contracts.test_tool ‑ test_deserialize_enum[Status-Running-Status.Running]
tests.executor.unittests.contracts.test_tool ‑ test_deserialize_enum[Status-UNKNOWN-UNKNOWN]
tests.executor.unittests.contracts.test_tool ‑ test_deserialize_enum[Status-running-Status.Running]
tests.executor.unittests.contracts.test_tool ‑ test_deserialize_enum[TestStatus-Running-Running]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_get_connection_class[123-None]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_get_connection_class[AzureContentSafetyConnection-AzureContentSafetyConnection]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_get_connection_class[AzureOpenAIConnection-AzureOpenAIConnection]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_get_connection_class[_Connection-_Connection]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_get_connection_class[unknown-None]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_class_name[123-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_class_name[AzureContentSafetyConnection-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_class_name[AzureOpenAIConnection-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_class_name[_Connection-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_class_name[unknown-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_value[AzureContentSafetyConnection-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_value[False-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_value[Status-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_connection_value[value1-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[5-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[MyConnection-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[MyType-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[None-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[T-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[TypeVar-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[float-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[int-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[list-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[some_function-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[str-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[tuple-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val0-True]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val11-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val12-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val13-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val15-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val18-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val19-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val3-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_is_custom_strong_type[val9-False]
tests.executor.unittests.contracts.test_tool.TestConnectionType ‑ test_serialize_conn
tests.executor.unittests.contracts.test_tool.TestInputDefinition ‑ test_deserialize
tests.executor.unittests.contracts.test_tool.TestInputDefinition ‑ test_serialize
tests.executor.unittests.contracts.test_tool.TestOutDefinition ‑ test_deserialize[value0-expected0]
tests.executor.unittests.contracts.test_tool.TestOutDefinition ‑ test_deserialize[value1-expected1]
tests.executor.unittests.contracts.test_tool.TestOutDefinition ‑ test_serialize[value0-expected0]
tests.executor.unittests.contracts.test_tool.TestOutDefinition ‑ test_serialize[value1-expected1]
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_deserialize_tool
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_require_connection[action-None-False]
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_require_connection[action-connection_type1-True]
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_require_connection[llm-None-True]
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_serialize_tool[action-expected_keys0]
tests.executor.unittests.contracts.test_tool.TestTool ‑ test_serialize_tool[llm-expected_keys1]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[FilePath-file_path]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[Image-image]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[PromptTemplate-prompt_template]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[Secret-secret]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[bool-bool]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[dict-object]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[float-double]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[int-int]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[list-list]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_type[str-string]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[1-int]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[1.0-double]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[True-bool]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[file_path-file_path]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[prompt-prompt_template]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[secret-secret]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[string-string]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[value4-list]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_from_value[value5-object]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[1-int-1]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[1.0-double-1.0]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[123-string-123]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[True-bool-True]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[["a", "b", "c"]-list-expected6]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[[1, 2, 3]-object-expected8]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[false-bool-False]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[true-bool-True]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[value10-object-expected10]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[{"key": "value"}-object-expected7]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse[{-object-{]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse_error[1-bool]
tests.executor.unittests.contracts.test_tool.TestValueType ‑ test_parse_error[value1-list]
tests.executor.unittests.contracts.test_types ‑ test_file_path
tests.executor.unittests.contracts.test_types ‑ test_prompt_template
tests.executor.unittests.contracts.test_types ‑ test_secret
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_complete_nodes
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_completed
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_get_node_valid_inputs
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_pop_bypassed_nodes
tests.executor.unittests.executor.test_dag_manager.TestDAGManager ‑ test_pop_ready_nodes
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error_with_no_PromptflowException_inner
tests.executor.unittests.executor.test_errors ‑ test_resolve_tool_error_with_none_inner
tests.executor.unittests.executor.test_exceptions.TestExceptions ‑ test_exception_message
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[chat-True]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[completion-True]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_enable_stream_for_llm_tool[embedding-False]
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_func_with_stream_parameter_should_be_wrapped
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_func_without_stream_parameter_should_not_be_wrapped
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_no_stream_param
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_with_mocked_should_stream
tests.executor.unittests.executor.test_flow_executor.TestEnableStreamForLLMTool ‑ test_inject_stream_options_with_stream_param
tests.executor.unittests.executor.test_flow_executor.TestEnsureNodeResultIsSerializable ‑ test_non_streaming_tool_should_not_be_affected
tests.executor.unittests.executor.test_flow_executor.TestEnsureNodeResultIsSerializable ‑ test_streaming_tool_should_be_consumed_and_merged
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs0-aggregated_flow_inputs0-aggregation_inputs0-expected_inputs0]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs1-aggregated_flow_inputs1-aggregation_inputs1-expected_inputs1]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs2-aggregated_flow_inputs2-aggregation_inputs2-expected_inputs2]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs3-aggregated_flow_inputs3-aggregation_inputs3-expected_inputs3]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs4-aggregated_flow_inputs4-aggregation_inputs4-expected_inputs4]
tests.executor.unittests.executor.test_flow_executor.TestFlowExecutor ‑ test_apply_default_value_for_aggregation_input[flow_inputs5-aggregated_flow_inputs5-aggregation_inputs5-expected_inputs5]
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_bypass_nodes
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_collect_outputs
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_execute_single_node
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_future_cancelled_for_exception
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_maximun_concurrency
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_no_nodes_to_run
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_submit_nodes
tests.executor.unittests.executor.test_flow_nodes_scheduler.TestFlowNodesScheduler ‑ test_success_result
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes-expected_node_order0]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes_with_activate-expected_node_order2]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order[unordered_nodes_with_skip-expected_node_order1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[aggregation_activate_reference_non_aggregation-Invalid node definitions found in the flow graph. Non-aggregation node 'grade' cannot be referenced in the activate config of the aggregation node 'calculate_accuracy'. Please review and rectify the node reference.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[nodes_cycle-Invalid node definitions found in the flow graph. Node circular dependency has been detected among the nodes in your flow. Kindly review the reference relationships for the nodes ['first_node', 'second_node'] and resolve the circular reference issue in the flow.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[nodes_cycle_with_activate-Invalid node definitions found in the flow graph. Node circular dependency has been detected among the nodes in your flow. Kindly review the reference relationships for the nodes ['first_node', 'second_node'] and resolve the circular reference issue in the flow.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[non_aggregation_reference_aggregation-Invalid node definitions found in the flow graph. Non-aggregate node 'test_node' cannot reference aggregate nodes {'calculate_accuracy'}. Please review and rectify the node reference.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_nodes_order_with_exception[wrong_node_reference-Invalid node definitions found in the flow graph. Node 'second_node' references a non-existent node 'third_node' in your flow. Please review your flow to ensure that the node name is accurately specified.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_ensure_outputs_valid_with_aggregation[simple_flow_with_python_tool_and_aggregate]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value[1-int-1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value[["1", "2"]-list-expected_result1]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[['1', '2']-list-10-InputParseError-Failed to parse the flow input. The value for flow input 'my_input' in line 10 of input data was interpreted as JSON string since its type is 'list'. However, the value '['1', '2']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[['1', '2']-list-None-InputParseError-Failed to parse the flow input. The value for flow input 'my_input' was interpreted as JSON string since its type is 'list'. However, the value '['1', '2']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[str-int-10-InputTypeError-The input for flow is incorrect. The value for flow input 'my_input' in line 10 of input data does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Executor Unit Test Result [luluzuo/optimize_memory_computation](https://github.com/microsoft/promptflow/actions/workflows/promptflow-executor-unit-test.yml?query=branch:luluzuo/optimize_memory_computation++)

595 tests found (test 519 to 595)

There are 595 tests, see "Raw output" for the list of tests 519 to 595.
Raw output
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_parse_input_value_error[str-int-None-InputTypeError-The input for flow is incorrect. The value for flow input 'my_input' does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_aggregated_flow_inputs_type[inputs0-expected_result0]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_aggregated_flow_inputs_type_error[inputs0-The input for flow is incorrect. The value for flow input 'test_input' in line 1 of input data does not match the expected type 'int'. Please change flow input type or adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs0-None-InputParseError-Failed to parse the flow input. The value for flow input 'key' was interpreted as JSON string since its type is 'list'. However, the value '['hello']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_resolve_flow_inputs_type_json_error_for_list_type[flow_with_list_input-inputs1-0-InputParseError-Failed to parse the flow input. The value for flow input 'key' in line 0 of input data was interpreted as JSON string since its type is 'list'. However, the value '['hello']' is invalid for JSON parsing. Error details: (JSONDecodeError) Expecting value: line 1 column 2 (char 1). Please make sure your inputs are properly formatted.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs0-aggregation_inputs0-The input for aggregation is incorrect. The value for aggregated reference input 'input1' should be a list, but received str. Please adjust the input value to match the expected format.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs1-aggregation_inputs1-The input for aggregation is incorrect. The value for aggregated flow input 'input1' should be a list, but received str. Please adjust the input value to match the expected format.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs2-aggregation_inputs2-The input for aggregation is incorrect. The length of all aggregated inputs should be the same. Current input lengths are: {'input1': 2, 'input_2': 1}. Please adjust the input value in your input data.]
tests.executor.unittests.executor.test_flow_validator.TestFlowValidator ‑ test_validate_aggregation_inputs_error[aggregated_flow_inputs3-aggregation_inputs3-The input for aggregation is incorrect. The input 'input1' appears in both aggregated flow input and aggregated reference input. Please remove one of them and try the operation again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val0-output-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val1-['output']-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val2-["output"]-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val3-["output"]["text"]-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val4-[1]-output2]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property[node_val5-value-dummy]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val0-output_str[2]-Invalid property 'output_str[2]' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val1-text-Invalid property 'text' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_node_property_with_exception[node_val2-value_type-Invalid property 'value_type' when accessing the node 'node1'. Please check the property and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[${inputs.text}-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[${node1.output}-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value[hello promptflow-hello promptflow]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${inputs.word}-InputNotFound-The input 'word' is not found from flow inputs 'text'. Please check the input name and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${node1.word}-UnsupportedReference-The section 'word' of reference is currently unsupported. Please specify the output part of the node 'node1'.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[${node2.output}-InputNotFoundFromAncestorNodeOutput-The input 'node2' is not found from ancestor node outputs ['node1']. Please check the node name and try again.]
tests.executor.unittests.executor.test_input_assignment_parser.TestInputAssignmentParser ‑ test_parse_value_with_exception[input3-NotSupported-The type 'wrong_type' is currently unsupported. Please choose from available types: ['Literal', 'FlowInput', 'NodeReference'] and try again.]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types0-MyFirstCSTConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types1-CustomConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types2-CustomConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_convert_to_custom_strong_type_connection_value[conn_types3-MyFirstCSTConnection]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_ensure_node_inputs_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_integrate_prompt_in_package_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[None]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source1]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source2]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_load_source_error[source3]
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_llm_connection_to_inputs
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_llm_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_package_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_script_node
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_diff_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_duplicated_inputs
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_invalid_source_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_invalid_template
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_invalid_type
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_no_source
tests.executor.unittests.executor.test_tool_resolver.TestToolResolver ‑ test_resolve_tool_by_node_with_no_source_path
tests.executor.unittests.integrations.test_langchain.TestLangchain ‑ test_langchain_traces
tests.executor.unittests.integrations.test_langchain.TestLangchain ‑ test_langchain_traces_with_unpaired_events
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_format_completed_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_format_current_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_healthy_ensured_process
tests.executor.unittests.processpool.test_healthy_ensured_process.TestHealthyEnsuredProcess ‑ test_unhealthy_process
tests.executor.unittests.processpool.test_line_execution_process_pool ‑ test_fork_mode_parallelism_in_subprocess
tests.executor.unittests.processpool.test_line_execution_process_pool ‑ test_spawn_mode_parallelism_in_subprocess
tests.executor.unittests.processpool.test_line_execution_process_pool.TestGetAvailableMaxWorkerCount ‑ test_get_available_max_worker_count[128.0-64.0-2-2]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestGetAvailableMaxWorkerCount ‑ test_get_available_max_worker_count[63.0-64.0-1-0]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_exec_line[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_exec_line_failed_when_line_execution_not_start[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_get_multiprocessing_context
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_line_execution_not_completed[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_line_execution_process_pool[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_not_set_environment_variable
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_parallelism_in_fork_mode[web_classification_no_variants-False-None-4]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_parallelism_in_fork_mode[web_classification_no_variants-True-3-3]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_parallelism_in_non_spawn_mode[web_classification_no_variants-False-True-None-2-2]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_parallelism_in_non_spawn_mode[web_classification_no_variants-True-False-2-4-2]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_parallelism_in_non_spawn_mode[web_classification_no_variants-True-True-6-2-6]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_pool_run_with_exception[web_classification_no_variants]
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_set_environment_variable_failed
tests.executor.unittests.processpool.test_line_execution_process_pool.TestLineExecutionProcessPool ‑ test_process_set_environment_variable_successed
tests.executor.unittests.storage.test_queue_run_storage.TestLineExecutionProcessPool ‑ test_persist_flow_run
tests.executor.unittests.storage.test_queue_run_storage.TestLineExecutionProcessPool ‑ test_persist_node_run
tests.executor.unittests.storage.test_run_records ‑ test_line_record
tests.executor.unittests.storage.test_run_records ‑ test_line_serialize
tests.executor.unittests.storage.test_run_records ‑ test_node_record
tests.executor.unittests.storage.test_run_records ‑ test_node_serialize