Fix resource modifiers e2e case

[qiuming-best]

Thank you for contributing to Velero!

Please add a summary of your change

Does your change fix a particular issue?

Fixes #(issue)

Please indicate you've done the following:

• Accepted the DCO. Commits without the DCO will delay acceptance.
• Created a changelog file or added /kind changelog-not-required as a comment on this pull request.
• Updated the corresponding documentation in site/content/docs/main.

[qiuming-best]

Test still failed with an error, I'll figure it out

time="2023-08-16T03:42:17Z" level=error msg="error restoring resource-modifiers-90576967: Deployment in version \"v1\" cannot be handled as a Deployment: json: cannot unmarshal string into Go struct field DeploymentSpec.spec.replicas of type int32" logSource="pkg/restore/restore.go:1516" restore=velero/restore-resource-modifiers-90576967

when I using the latest code to build the velero container image, the error has gone

[codecov]

Codecov Report

Merging #6659 (3f05a7d) into main (e753a08) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #6659   +/-   ##
=======================================
  Coverage   60.36%   60.36%           
=======================================
  Files         242      242           
  Lines       25968    25968           
=======================================
  Hits        15676    15676           
  Misses       9190     9190           
  Partials     1102     1102