Skip to content

Commit

Permalink
tinybird
Browse files Browse the repository at this point in the history
  • Loading branch information
hdulay committed Aug 11, 2022
1 parent ca2e1a0 commit 10b678e
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 10 deletions.
2 changes: 1 addition & 1 deletion tinybird/datasources/decodable_wikipedia.datasource
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ ENGINE "MergeTree"
ENGINE_PARTITION_KEY "toYYYYMM(timestamp)"
ENGINE_SORTING_KEY "timestamp"

KAFKA_CONNECTION_NAME 'pkc-4r087.us-west2.gcp.confluent.cloud:9092'
KAFKA_CONNECTION_NAME 'xxxxxxxxxxx.confluent.cloud:9092'
KAFKA_TOPIC 'wiki'
KAFKA_GROUP_ID 'tinybird_wikipedia'
KAFKA_AUTO_OFFSET_RESET 'latest'
Expand Down
8 changes: 0 additions & 8 deletions tinybird/datasources/events_example.datasource

This file was deleted.

2 changes: 1 addition & 1 deletion tinybird/wiki.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ def kinesis():
return boto3.client('kinesis',region_name=os.getenv("REGION"))

def poll():
feed=feedparser.parse('https://en.wikipedia.org/w/api.php?action=feedrecentchanges&format=json')
feed=feedparser.parse('https://en.wikipedia.org/w/api.php?action=feedrecentchanges')
entries = feed['entries']
stream = os.getenv("KINESIS_STREAM")
k = kinesis()
Expand Down

0 comments on commit 10b678e

Please sign in to comment.