Update all connectors to latest sdk

[raulb]

⚠️ We need to make sure those connectors are also released once upgraded.

Important

After updating the SDK run this script to fix 95% of the code automatically: ConduitIO/conduit#1433 (comment)

• https://github.com/ConduitIO/conduit-connector-file @ v0.10.0
• https://github.com/ConduitIO/conduit-connector-generator @ v0.10.0
• https://github.com/ConduitIO/conduit-connector-kafka @ v0.10.0
• https://github.com/ConduitIO/conduit-connector-log @ v0.10.0
• https://github.com/ConduitIO/conduit-connector-postgres @ v0.10.0
• https://github.com/ConduitIO/conduit-connector-s3 @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-activemq-artemis @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-activemq-classic @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-azure-storage @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-clickhouse @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-dynamodb @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-http @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-kinesis @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-mongo @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-mysql @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-pinecone @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-pulsar @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-rabbitmq @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-salesforce @ v0.10.0
• https://github.com/conduitio-labs/conduit-connector-sqs @ v0.10.0
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-airtable#10
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-algolia#7
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-azure-event-hub#22
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-benthos#7
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-bigquery#50
• https://github.com/conduitio-labs/conduit-connector-cassandra @ v0.9.1
• https://github.com/conduitio-labs/conduit-connector-chaos @ v0.7.2
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-cosmos-nosql#55
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.10.1 conduitio-labs/conduit-connector-databricks#70
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.10.0 conduitio-labs/conduit-connector-db2#119
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.10.1 to 0.11.0 conduitio-labs/conduit-connector-elasticsearch#94
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.7.2 to 0.11.0 conduitio-labs/conduit-connector-firebolt#103
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.10.1 to 0.11.0 conduitio-labs/conduit-connector-gcp-pubsub#262
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.10.1 conduitio-labs/conduit-connector-google-cloudstorage#42
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-google-sheets#196
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-grpc-client#98
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-grpc-server#46
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-hubspot#103
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-marketo#39
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-materialize#101
• https://github.com/conduitio-labs/conduit-connector-nats-jetstream @ v0.9.1 @hariso
• https://github.com/conduitio-labs/conduit-connector-nats-pubsub @ v0.9.1 @lovromazgon
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-neo4j#89
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.7.2 to 0.11.0 conduitio-labs/conduit-connector-notion#79
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.10.0 conduitio-labs/conduit-connector-oracle#155
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-redis#116
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-redpanda#19
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.8.0 to 0.11.0 conduitio-labs/conduit-connector-redshift#98
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-sap-hana#207
• https://github.com/conduitio-labs/conduit-connector-snowflake @ v0.9.1
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-sql-server#104
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.8.0 to 0.11.0 conduitio-labs/conduit-connector-stripe#32
• chore: upgrade version of conduit-connector-sdk to ≥ v0.10.0 conduitio-labs/conduit-connector-vitess#139
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-weather#43
• https://github.com/conduitio-labs/conduit-connector-weaviate @ v0.7.2
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.9.1 to 0.11.0 conduitio-labs/conduit-connector-zendesk#63
• go.mod: bump github.com/conduitio/conduit-connector-sdk from 0.8.0 to 0.10.0 conduitio-labs/conduit-connector-zeromq#13

[hariso]

For NATS JetStream, the work is done here: conduitio-labs/conduit-connector-nats-jetstream#137.

[raulb]

Generated by using this script

#!/bin/bash

# Check that a tag was provided as an argument
if [ -z "$1" ]; then
  echo "Usage: $0 <tag>"
  exit 1
fi

connectors=$(curl -s https://conduit.io/connectors.json | jq -c '.[].url')
connectors_outdated=()
connectors_without_sdk=()
contributor_connectors_outdated=()

for url in $(echo "$connectors"); do
  github_url=${url#*github.com/}
  github_url=${github_url%%\"*}
  raw_url="https://raw.githubusercontent.com/$github_url/main/go.mod"

  if ! curl -sL "$raw_url" >/dev/null 2>&1; then
    connectors_without_sdk+=("https://github.com/$github_url")
    continue
  fi

  go_mod=$(curl -s "$raw_url")

  commit=$(awk -F' ' '/github.com\/conduitio\/conduit-connector-sdk/{print $NF}' <<< "$go_mod")

  if [ "$commit" = "github.com/conduitio/conduit-connector-sdk" ]; then
    commit=$(awk -F' ' '/require github.com\/conduitio\/conduit-connector-sdk/{print $3}' <<< "$go_mod")
  fi

  if ! grep -q "github.com/conduitio/conduit-connector-sdk $1" <<< "$go_mod"; then
    if [ -z "$commit" ]; then
      connectors_without_sdk+=("https://github.com/$github_url")
    else
      if ! grep -q "conduitio-labs" <<< "$github_url" && ! grep -q "ConduitIO" <<< "$github_url"; then
        contributor_connectors_outdated+=("https://github.com/$github_url @ $commit")
      else
        connectors_outdated+=("https://github.com/$github_url @ $commit")
      fi
    fi
  else
    echo "- [x] https://github.com/$github_url @ $commit"
  fi
done

if [ "${#connectors_outdated[@]}" -gt 0 ]; then
  for connector in "${connectors_outdated[@]}"; do
    echo "- [ ] $connector"
  done
fi

if [ "${#contributor_connectors_outdated[@]}" -gt 0 ]; then
  echo "
### Connectors owned by contributors:
"
  for connector in "${contributor_connectors_outdated[@]}"; do
    echo "- [ ] $connector"
  done
fi

if [ "${#connectors_without_sdk[@]}" -gt 0 ]; then
  echo "
### Connectors without conduit-connector-sdk:
"
  for connector in "${connectors_without_sdk[@]}"; do
    echo "- [ ] $connector"
  done
fi
exit 0

[alarbada]

@raulb do you mind if I help you out with some of my connectors?

Specifically with these:

• pinecone
• activemq artemis & classic
• pulsar
• rabbitmq

Also, I took a look at some of these:

• Pinecone needs the {{ secrets.API_KEY }} set, for some reason it is not there anymore.
• activemq artemis has many dependabot prs blocked, might be misconfigured.
• activemq classic got a failed to create review: GraphQL: GitHub Actions is not permitted to approve pull requests. (addPullRequestReview), might also be misconfigured.

[raulb]

@alarbada please do so!!! thank you!

[raulb]

Closing this one since we'll address the upgrade to the latest SDK for each connector independently.