[Feedback] docs/components/spark-operator/user-guide/gcp.md

[nrawal47]

The specified image does not exist.

[andreyvelich]

/assign @ChenYi015 @yuchaoran2011 @vara-bonthu @jacobsalway

[jacobsalway]

This is referring to gcr.io/ynli-k8s/spark:v2.3.0-gcs right?

[ChenYi015]

The GCP related documentation have not been updated for years, I have no idea whether it is still applicable now.

[andreyvelich]

I would suggest to remove this documentation page if that doesn't work now.

[nrawal47]

To be clear, this is the jar that works for us:

jars:
        - "local:///opt/spark/jobs/lib/gcs-connector-3.0.2-shaded.jar"

relevant hadoopConf:

fs.AbstractFileSystem.gs.impl: "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS"
fs.gs.impl: "com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem" # testing
fs.gs.auth.service.account.enable: "false"
fs.gs.auth.type: "UNAUTHENTICATED"

[varodrig]

@nrawal47 would you like to contribute to this page?

[nrawal47]

@nrawal47 would you like to contribute to this page?

Yes but it's been several months so I'm assuming there may be some changes for me to catch up on. I'm actually not using Kubeflow at the moment and working on other things, so my response may be delayed.

[varodrig]

/help

[google-oss-prow]

@varodrig:
This request has been marked as needing help from a contributor.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.