[SPARK-48722][K8S] Patch executor pod without optimistic locking

[dcoliversun]

What changes were proposed in this pull request?

This PR aims to support apache spark patch executor pod without optimistic locking when using version 6.5 or later of fabric8 kubernetes-client, to avoid error 409 conflicts when other components attempts to patch requests to the same executor pod.

Why are the changes needed?

Before fabric8 kubernetes-client#6.5, edit action without optimistic locking by default. Request is following:

{
    "requestObject":[
        {
            "op":"add",
            "path":"/metadata/labels",
            "value":{
                "spark-exec-inactive": "true"
            }
        }
    ]
}

After fabric8 kubernetes-client#6.5, edit action with optimistic locking. Request is following:

{
    "requestObject":[
        {
            "op":"add",
            "path":"/metadata/labels",
            "value":{
                "spark-exec-inactive":"true"
            }
        },
        {
            "op":"add",
            "path":"/metadata/resourceVersion",
            "value":"xxxx"
        }
    ]
}

More info: fabric8io/kubernetes-client#4896

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manual test with k8s auditing log.

Was this patch authored or co-authored using generative AI tooling?

No.

[dcoliversun]

cc @dongjoon-hyun Could you please review this PR if you have time :)