Skip to content

Update metadata for collection releases #316

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 91 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
91 commits
Select commit Hold shift + click to select a range
b4f68ba
Add `prefect-slack` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
da73129
Add `prefect-slack` `v0.2.1` to block records
marvin-robot Nov 14, 2023
a2478e7
Update aggregate block metadata with `prefect-slack` `v0.2.1`
marvin-robot Nov 14, 2023
5b28449
Add `prefect-slack` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
a30e777
Add `prefect-census` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
b5a4dd1
Add `prefect-twitter` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
c38564e
Add `prefect-hightouch` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
1c0c5e1
Add `prefect-census` `v0.2.1` to block records
marvin-robot Nov 14, 2023
70fecbe
Add `prefect-hightouch` `v0.2.1` to block records
marvin-robot Nov 14, 2023
96d4cd0
Update aggregate block metadata with `prefect-census` `v0.2.1`
marvin-robot Nov 14, 2023
81b6509
Add `prefect-census` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
ad7be74
Add `prefect-email` `v0.3.1` to flow records
marvin-robot Nov 14, 2023
2b281a3
Add `prefect-monday` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
13dc2b7
Add `prefect-email` `v0.3.1` to block records
marvin-robot Nov 14, 2023
5ee1ad5
Update aggregate block metadata with `prefect-email` `v0.3.1`
marvin-robot Nov 14, 2023
466d7b9
Add `prefect-shell` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
5c1779f
Add `prefect-monday` `v0.2.1` to block records
marvin-robot Nov 14, 2023
7fa3992
Update aggregate block metadata with `prefect-monday` `v0.2.1`
marvin-robot Nov 14, 2023
6a66f81
Add `prefect-bitbucket` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
9a83417
Add `prefect-shell` `v0.2.1` to block records
marvin-robot Nov 14, 2023
a34b7da
Add `prefect-email` `v0.3.1` to worker records
marvin-robot Nov 14, 2023
7626ae2
Update aggregate block metadata with `prefect-shell` `v0.2.1`
marvin-robot Nov 14, 2023
c18bf94
Add `prefect-bitbucket` `v0.2.1` to block records
marvin-robot Nov 14, 2023
8870d03
Update aggregate block metadata with `prefect-bitbucket` `v0.2.1`
marvin-robot Nov 14, 2023
f938a51
Add `prefect-hex` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
a32d3ee
Add `prefect-shell` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
0ca97fc
Add `prefect-hex` `v0.2.1` to block records
marvin-robot Nov 14, 2023
5fc2045
Add `prefect-bitbucket` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
b9dd8ce
Update aggregate block metadata with `prefect-hex` `v0.2.1`
marvin-robot Nov 14, 2023
e99d6be
Add `prefect-docker` `v0.4.1` to flow records
marvin-robot Nov 14, 2023
61640ba
Add `prefect-snowflake` `v0.27.1` to flow records
marvin-robot Nov 14, 2023
a32ac46
Add `prefect-monte-carlo` `v0.3.1` to flow records
marvin-robot Nov 14, 2023
86ae8d8
Add `prefect-docker` `v0.4.1` to block records
marvin-robot Nov 14, 2023
dd5a6e4
Add `prefect-hex` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
f9941df
Add `prefect-snowflake` `v0.27.1` to block records
marvin-robot Nov 14, 2023
58817b9
Update aggregate block metadata with `prefect-snowflake` `v0.27.1`
marvin-robot Nov 14, 2023
9274f75
Add `prefect-monte-carlo` `v0.3.1` to block records
marvin-robot Nov 14, 2023
ffb91b2
Update aggregate block metadata with `prefect-monte-carlo` `v0.3.1`
marvin-robot Nov 14, 2023
7ceca05
Add `prefect-dask` `v0.2.6` to flow records
marvin-robot Nov 14, 2023
ee38958
Add `prefect-snowflake` `v0.27.1` to worker records
marvin-robot Nov 14, 2023
74ae190
Add `prefect-dask` `v0.2.6` to block records
marvin-robot Nov 14, 2023
e4906dc
Add `prefect-monte-carlo` `v0.3.1` to worker records
marvin-robot Nov 14, 2023
0170cfb
Add `prefect-dask` `v0.2.6` to worker records
marvin-robot Nov 14, 2023
b767ac2
Add `prefect-aws` `v0.4.3` to flow records
marvin-robot Nov 14, 2023
91bb856
Add `prefect-aws` `v0.4.3` to block records
marvin-robot Nov 14, 2023
4bca66d
Update aggregate block metadata with `prefect-aws` `v0.4.3`
marvin-robot Nov 14, 2023
0ba24a8
Add `prefect-jupyter` `v0.3.1` to flow records
marvin-robot Nov 14, 2023
3c5ab4c
Add `prefect-jupyter` `v0.3.1` to block records
marvin-robot Nov 14, 2023
af35224
Add `prefect-jupyter` `v0.3.1` to worker records
marvin-robot Nov 14, 2023
a01cf1c
Add `prefect-dbt` `v0.4.1` to flow records
marvin-robot Nov 14, 2023
7aa343d
Add `prefect-dbt` `v0.4.1` to block records
marvin-robot Nov 14, 2023
9d44637
Update aggregate block metadata with `prefect-dbt` `v0.4.1`
marvin-robot Nov 14, 2023
c74a079
Add `prefect-azure` `v0.3.2` to flow records
marvin-robot Nov 14, 2023
585b3df
Add `prefect-dbt` `v0.4.1` to worker records
marvin-robot Nov 14, 2023
a83968f
Add `prefect-azure` `v0.3.2` to block records
marvin-robot Nov 14, 2023
0619ad1
Update aggregate block metadata with `prefect-azure` `v0.3.2`
marvin-robot Nov 14, 2023
333f614
Add `prefect-azure` `v0.3.2` to worker records
marvin-robot Nov 14, 2023
f796773
Update aggregate worker metadata with `prefect-azure` `v0.3.2`
marvin-robot Nov 14, 2023
e57a277
Add `prefect-docker` `v0.4.1` to worker records
marvin-robot Nov 14, 2023
fa4ed0e
Update aggregate worker metadata with `prefect-docker` `v0.4.1`
marvin-robot Nov 14, 2023
de103c3
Add `prefect-hightouch` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
006f8ca
Add `prefect-github` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
05e7804
Add `prefect-firebolt` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
3cafca5
Add `prefect-github` `v0.2.1` to block records
marvin-robot Nov 14, 2023
2c455ba
Update aggregate block metadata with `prefect-github` `v0.2.1`
marvin-robot Nov 14, 2023
0bfe1af
Add `prefect-firebolt` `v0.2.1` to block records
marvin-robot Nov 14, 2023
7def382
Add `prefect-github` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
988717c
Add `prefect-great-expectations` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
b943b79
Add `prefect-great-expectations` `v0.2.1` to block records
marvin-robot Nov 14, 2023
727250a
Add `prefect-airbyte` `v0.3.1` to flow records
marvin-robot Nov 14, 2023
1d1ec2d
Add `prefect-databricks` `v0.2.2` to flow records
marvin-robot Nov 14, 2023
50fc170
Add `prefect-airbyte` `v0.3.1` to block records
marvin-robot Nov 14, 2023
139f97b
Add `prefect-great-expectations` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
8c402a8
Update aggregate block metadata with `prefect-airbyte` `v0.3.1`
marvin-robot Nov 14, 2023
44412ef
Add `prefect-databricks` `v0.2.2` to block records
marvin-robot Nov 14, 2023
05476fb
Update aggregate block metadata with `prefect-databricks` `v0.2.2`
marvin-robot Nov 14, 2023
e85fdaf
Add `prefect-gitlab` `v0.2.1` to flow records
marvin-robot Nov 14, 2023
e74fbee
Add `prefect-airbyte` `v0.3.1` to worker records
marvin-robot Nov 14, 2023
ad007f0
Add `prefect-gitlab` `v0.2.1` to block records
marvin-robot Nov 14, 2023
a6eaae1
Add `prefect-databricks` `v0.2.2` to worker records
marvin-robot Nov 14, 2023
7b7e949
Add `prefect-aws` `v0.4.3` to worker records
marvin-robot Nov 14, 2023
05431bd
Add `prefect-gcp` `v0.5.2` to flow records
marvin-robot Nov 14, 2023
edab8be
Add `prefect-gcp` `v0.5.2` to block records
marvin-robot Nov 14, 2023
b270704
Update aggregate block metadata with `prefect-gcp` `v0.5.2`
marvin-robot Nov 14, 2023
e5bb209
Add `prefect-gcp` `v0.5.2` to worker records
marvin-robot Nov 14, 2023
3bce460
Add `prefect-monday` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
408fc8c
Add `prefect-twitter` `v0.2.1` to block records
marvin-robot Nov 14, 2023
5d4497d
Update aggregate block metadata with `prefect-twitter` `v0.2.1`
marvin-robot Nov 14, 2023
1831c2a
Add `prefect-twitter` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
783b66b
Add `prefect-gitlab` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
1400665
Add `prefect-firebolt` `v0.2.1` to worker records
marvin-robot Nov 14, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
190 changes: 190 additions & 0 deletions collections/prefect-airbyte/blocks/v0.3.1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,190 @@
{
"prefect-airbyte": {
"block_types": {
"airbyte-connection": {
"name": "Airbyte Connection",
"slug": "airbyte-connection",
"logo_url": "https://images.ctfassets.net/zscdif0zqppk/6gm7wsC7ANnKYQsm7oiSYz/aac1ad5e054d35d9e24af8d6ed3aed5f/59758427?h=250",
"documentation_url": "https://prefecthq.github.io/prefect-airbyte/connections/#prefect_airbyte.connections.AirbyteConnection",
"description": "A block representing an existing Airbyte connection. This block is part of the prefect-airbyte collection. Install prefect-airbyte with `pip install prefect-airbyte` to use this block.",
"code_example": "Load an existing `AirbyteConnection` block:\n```python\nfrom prefect_airbyte import AirbyteConnection\n\nairbyte_connection = AirbyteConnection.load(\"BLOCK_NAME\")\n```\n\nRun an Airbyte connection sync as a flow:\n```python\nfrom prefect import flow\nfrom prefect_airbyte import AirbyteConnection\nfrom prefect_airbyte.flows import run_connection_sync # this is a flow\n\nairbyte_connection = AirbyteConnection.load(\"BLOCK_NAME\")\n\n@flow\ndef airbyte_orchestrator():\n run_connection_sync(airbyte_connection) # now it's a subflow\n```",
"block_schema": {
"checksum": "sha256:b0d1479644a23659067536d89a7254ec7ab05101e225db74de165b90cd3a1d73",
"fields": {
"title": "AirbyteConnection",
"description": "A block representing an existing Airbyte connection.",
"type": "object",
"properties": {
"airbyte_server": {
"title": "Airbyte Server",
"description": "AirbyteServer block representing the Airbyte instance where the Airbyte connection is defined.",
"allOf": [
{
"$ref": "#/definitions/AirbyteServer"
}
]
},
"connection_id": {
"title": "Connection Id",
"description": "UUID of the Airbyte Connection to trigger.",
"type": "string",
"format": "uuid"
},
"poll_interval_s": {
"title": "Poll Interval S",
"description": "Time in seconds between status checks of the Airbyte sync job.",
"default": 15,
"type": "integer"
},
"status_updates": {
"title": "Status Updates",
"description": "Whether to log job status on each poll of the Airbyte sync job.",
"default": false,
"type": "boolean"
},
"timeout": {
"title": "Timeout",
"description": "Timeout in seconds for requests made by httpx.AsyncClient.",
"default": 5,
"type": "integer"
}
},
"required": [
"airbyte_server",
"connection_id"
],
"block_type_slug": "airbyte-connection",
"secret_fields": [
"airbyte_server.password"
],
"block_schema_references": {
"airbyte_server": {
"block_type_slug": "airbyte-server",
"block_schema_checksum": "sha256:f0bc49c549405ef3e753b3cc0a81e0e13b1b036acfab571c76f4d198c4bb842a"
}
},
"definitions": {
"AirbyteServer": {
"title": "AirbyteServer",
"description": "A block representing an Airbyte server for generating `AirbyteClient` instances.",
"type": "object",
"properties": {
"username": {
"title": "Username",
"description": "Username to authenticate with Airbyte API.",
"default": "airbyte",
"type": "string"
},
"password": {
"title": "Password",
"description": "Password to authenticate with Airbyte API.",
"default": "**********",
"type": "string",
"writeOnly": true,
"format": "password"
},
"server_host": {
"title": "Server Host",
"description": "Host address of Airbyte server.",
"default": "localhost",
"example": "127.0.0.1",
"type": "string"
},
"server_port": {
"title": "Server Port",
"description": "Port number of Airbyte server.",
"default": 8000,
"type": "integer"
},
"api_version": {
"title": "API Version",
"description": "Airbyte API version to use.",
"default": "v1",
"type": "string"
},
"use_ssl": {
"title": "Use SSL",
"description": "Whether to use SSL when connecting to Airbyte server.",
"default": false,
"type": "boolean"
}
},
"block_type_slug": "airbyte-server",
"secret_fields": [
"password"
],
"block_schema_references": {}
}
}
},
"capabilities": [],
"version": "0.3.1"
}
},
"airbyte-server": {
"name": "Airbyte Server",
"slug": "airbyte-server",
"logo_url": "https://images.ctfassets.net/zscdif0zqppk/6gm7wsC7ANnKYQsm7oiSYz/aac1ad5e054d35d9e24af8d6ed3aed5f/59758427?h=250",
"documentation_url": "https://prefecthq.github.io/prefect-airbyte/server/#prefect_airbyte.server.AirbyteServer",
"description": "A block representing an Airbyte server for generating `AirbyteClient` instances. This block is part of the prefect-airbyte collection. Install prefect-airbyte with `pip install prefect-airbyte` to use this block.",
"code_example": "```python\nfrom prefect_airbyte.server import AirbyteServer\n\nserver = AirbyteServer.load(\"BLOCK_NAME\")\n```",
"block_schema": {
"checksum": "sha256:f0bc49c549405ef3e753b3cc0a81e0e13b1b036acfab571c76f4d198c4bb842a",
"fields": {
"title": "AirbyteServer",
"description": "A block representing an Airbyte server for generating `AirbyteClient` instances.",
"type": "object",
"properties": {
"username": {
"title": "Username",
"description": "Username to authenticate with Airbyte API.",
"default": "airbyte",
"type": "string"
},
"password": {
"title": "Password",
"description": "Password to authenticate with Airbyte API.",
"default": "**********",
"type": "string",
"writeOnly": true,
"format": "password"
},
"server_host": {
"title": "Server Host",
"description": "Host address of Airbyte server.",
"default": "localhost",
"example": "127.0.0.1",
"type": "string"
},
"server_port": {
"title": "Server Port",
"description": "Port number of Airbyte server.",
"default": 8000,
"type": "integer"
},
"api_version": {
"title": "API Version",
"description": "Airbyte API version to use.",
"default": "v1",
"type": "string"
},
"use_ssl": {
"title": "Use SSL",
"description": "Whether to use SSL when connecting to Airbyte server.",
"default": false,
"type": "boolean"
}
},
"block_type_slug": "airbyte-server",
"secret_fields": [
"password"
],
"block_schema_references": {}
},
"capabilities": [],
"version": "0.3.1"
}
}
}
}
}
147 changes: 147 additions & 0 deletions collections/prefect-airbyte/flows/v0.3.1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,147 @@
{
"prefect-airbyte": {
"run_connection_sync": {
"description": {
"summary": "A flow that triggers a sync of an Airbyte connection and waits for it to complete.",
"returns": "`AirbyteSyncResult`: Model containing metadata for the `AirbyteSync`.",
"examples": [
"Define a flow that runs an Airbyte connection sync:\n```python\nfrom prefect import flow\nfrom prefect_airbyte.server import AirbyteServer\nfrom prefect_airbyte.connections import AirbyteConnection\nfrom prefect_airbyte.flows import run_connection_sync\n\nairbyte_server = AirbyteServer(\n server_host=\"localhost\",\n server_port=8000\n)\n\nconnection = AirbyteConnection(\n airbyte_server=airbyte_server,\n connection_id=\"<YOUR-AIRBYTE-CONNECTION-UUID>\"\n)\n\n@flow\ndef airbyte_sync_flow():\n # do some things\n\n airbyte_sync_result = run_connection_sync(\n airbyte_connection=connection\n )\n print(airbyte_sync_result.records_synced)\n\n # do some other things, like trigger DBT based on number of new raw records\n```"
]
},
"documentation_url": "https://prefecthq.github.io/prefect-airbyte/flows/#prefect_airbyte.flows.run_connection_sync",
"entrypoint": "prefect_airbyte/flows.py:run_connection_sync",
"install_command": "pip install prefect-airbyte",
"logo_url": "https://cdn.sanity.io/images/3ugk85nk/production/7f50097d1915fe75b0ee84c951c742a83d3c53cb-250x250.png",
"name": "run-connection-sync",
"parameters": {
"title": "Parameters",
"type": "object",
"properties": {
"airbyte_connection": {
"title": "airbyte_connection",
"description": "`AirbyteConnection` representing the Airbyte connection to\ntrigger and wait for completion of.",
"position": 0,
"allOf": [
{
"$ref": "#/definitions/AirbyteConnection"
}
]
}
},
"required": [
"airbyte_connection"
],
"definitions": {
"AirbyteServer": {
"title": "AirbyteServer",
"description": "A block representing an Airbyte server for generating `AirbyteClient` instances.",
"type": "object",
"properties": {
"username": {
"title": "Username",
"description": "Username to authenticate with Airbyte API.",
"default": "airbyte",
"type": "string"
},
"password": {
"title": "Password",
"description": "Password to authenticate with Airbyte API.",
"default": "**********",
"type": "string",
"writeOnly": true,
"format": "password"
},
"server_host": {
"title": "Server Host",
"description": "Host address of Airbyte server.",
"default": "localhost",
"example": "127.0.0.1",
"type": "string"
},
"server_port": {
"title": "Server Port",
"description": "Port number of Airbyte server.",
"default": 8000,
"type": "integer"
},
"api_version": {
"title": "API Version",
"description": "Airbyte API version to use.",
"default": "v1",
"type": "string"
},
"use_ssl": {
"title": "Use SSL",
"description": "Whether to use SSL when connecting to Airbyte server.",
"default": false,
"type": "boolean"
}
},
"block_type_slug": "airbyte-server",
"secret_fields": [
"password"
],
"block_schema_references": {}
},
"AirbyteConnection": {
"title": "AirbyteConnection",
"description": "A block representing an existing Airbyte connection.",
"type": "object",
"properties": {
"airbyte_server": {
"title": "Airbyte Server",
"description": "AirbyteServer block representing the Airbyte instance where the Airbyte connection is defined.",
"allOf": [
{
"$ref": "#/definitions/AirbyteServer"
}
]
},
"connection_id": {
"title": "Connection Id",
"description": "UUID of the Airbyte Connection to trigger.",
"type": "string",
"format": "uuid"
},
"poll_interval_s": {
"title": "Poll Interval S",
"description": "Time in seconds between status checks of the Airbyte sync job.",
"default": 15,
"type": "integer"
},
"status_updates": {
"title": "Status Updates",
"description": "Whether to log job status on each poll of the Airbyte sync job.",
"default": false,
"type": "boolean"
},
"timeout": {
"title": "Timeout",
"description": "Timeout in seconds for requests made by httpx.AsyncClient.",
"default": 5,
"type": "integer"
}
},
"required": [
"airbyte_server",
"connection_id"
],
"block_type_slug": "airbyte-connection",
"secret_fields": [
"airbyte_server.password"
],
"block_schema_references": {
"airbyte_server": {
"block_type_slug": "airbyte-server",
"block_schema_checksum": "sha256:f0bc49c549405ef3e753b3cc0a81e0e13b1b036acfab571c76f4d198c4bb842a"
}
}
}
}
},
"path_containing_flow": "prefect_airbyte/flows.py",
"repo_url": "https://github.com/PrefectHQ/prefect-airbyte",
"slug": "run_connection_sync"
}
}
}
3 changes: 3 additions & 0 deletions collections/prefect-airbyte/workers/v0.3.1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{
"prefect-airbyte": {}
}
Loading