[Bug]: Handling Errors in RemoteBulkWriter.commit() – Try-Except Not Catching Errors

[Basir-mahmood]

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

I am using RemoteBulkWriter.commit() in Milvus, but when an error occurs, it is not getting caught in the try-except block. However, the internal bulk_writer._throw() method logs the error.
How can I catch this error inside my own code? Is there a callback method available to handle errors from writer.commit()?

writer = RemoteBulkWriter(
    schema=schema, 
    remote_path=bulk_writer_pth,
    connect_param=conn, 
    chunk_size=2*1024*1024*1024,
    file_type=BulkFileType.PARQUET
)

try:
    for df_record in df_records: 
        writer.append_row(df_record) 
    writer.commit()
except Exception as e:
    logger.error(f"Some error occurred. Error: {e}")

The code executes successfully, but when an error occurs inside writer.commit(), it does not get caught in the try-except block.
The error is instead logged by Milvus via bulk_writer._throw().
I want to ask that How can I catch error in my routine with writer.commit() within my try-except block? Is there a callback method available for handling errors during commit()?

Expected Behavior

No response

Steps/Code To Reproduce behavior

Environment details

Anything else?

No response