[Bug]: the session was hung for 15 minutes every 5 minutes during choas test (kill one dn pod continously interval 10 minutes)

[aressu1985]

Is there an existing issue for the same bug?

• I have checked the existing issues.

Branch Name

2.0-dev

Commit ID

29838b5

Other Environment Information

- Hardware parameters:
3*CN: 7C 28G
1*DN: 7C 28G
3*PROXY: 2C 5G
3*LOG: 1C 7G
- OS type:
- Others:

Actual Behavior

[test load]
run tpcc 10-10
insert data to a table with 2 thread
and during the test, the chaos tool were continuously kill one log pod by interval 10 mins

[issue]
the session was hung for 15 minutes every 5 minutes during this test, such as inserting data:
1、session was hung at 2024-12-24 02:09:57

2、session recovery at 2024-12-24 02:25:27

3、session was hung again at 2024-12-24 02:30:07

mo-log:
https://shanghai.idc.matrixorigin.cn:30001/explore?panes=%7B%22yZZ%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-chaos-29838b5-202412232305%5C%22,%20matrixorigin_io_component%3D%5C%22DNSet%5C%22%7D%20%7C%3D%20%60%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221734969900000%22,%22to%22:%221734978659000%22%7D%7D%7D&schemaVersion=1&orgId=1

Expected Behavior

No response

Steps to Reproduce

[test load]
run tpcc 10-10
insert data to a table with 2 thread
and during the test, the chaos tool were continuously kill one log pod by interval 10 mins

Additional information

No response