Update examples for deployed pipelines #3960

safoinme · 2025-09-15T19:27:34Z

Describe changes

I implemented/fixed _ to achieve _.

Pre-requisites

Please ensure you have done the following:

I have read the CONTRIBUTING.md document.
I have added tests to cover my changes.
I have based my new branch on develop and the open PR is targeting develop. If your branch wasn't based on develop read Contribution guide on rebasing branch to develop.
IMPORTANT: I made sure that my changes are reflected properly in the following resources:
- ZenML Docs
- Dashboard: Needs to be communicated to the frontend team.
- Templates: Might need adjustments (that are not reflected in the template tests) in case of non-breaking changes and deprecations.
- Projects: Depending on the version dependencies, different projects might get affected.

Types of changes

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds functionality)
Breaking change (fix or feature that would cause existing functionality to change)
Other (add details above)

…loyed-pipelines

coderabbitai · 2025-09-15T19:27:41Z

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests

Create PR with unit tests
Post copyable unit tests in a comment
Commit unit tests in branch misc/update-examples-deployed-pipelines

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

github-actions · 2025-09-15T19:28:00Z

🔍 Broken Links Report

Summary

📁 Files with broken links: 1
🔗 Total broken links: 1
📄 Broken markdown links: 1
🖼️ Broken image links: 0
⚠️ Broken reference placeholders: 0

Details

File	Link Type	Link Text	Broken Path
`book/toc.md`	📄	"Pipeline Serving Capture Policies"	`how-to/serving/capture-policies.md`

📂 Full file paths

/home/runner/work/zenml/zenml/scripts/../docs/book/toc.md

github-actions · 2025-09-15T19:29:32Z

Documentation Link Check Results

❌ Absolute links check failed
There are broken absolute links in the documentation. See workflow logs for details
❌ Relative links check failed
There are broken relative links in the documentation. See workflow logs for details
_{Last checked: 2025-09-20 19:46:50 UTC}

github-actions · 2025-09-15T19:30:06Z

Classification template updates in examples/mlops_starter have been pushed.

…loyed-pipelines

…for OpenAI in agent.yaml.- Integrate LLM responses and classifier upgrades in agent pipeline.- Log metadata for training and response generation

…isc/update-examples-deployed-pipelines

…te-quickstart

…Rename agent_serving_pipeline to support_agent

review-notebook-app · 2025-09-19T13:11:00Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

htahir1 · 2025-09-19T13:12:24Z

examples/quickstart/configs/agent.yaml

+settings:
+  docker:
+    requirements: requirements.txt
+    parent_image: zenmldocker/zenml:0.85.0-py3.12


htahir1 · 2025-09-19T13:12:37Z

examples/quickstart/pipelines/evaluation_pipeline.py

+    settings={
+        "docker": DockerSettings(
+            requirements="requirements.txt",
+            parent_image="zenmldocker/zenml:0.85.0-py3.12",


remember to remove

htahir1 · 2025-09-19T13:12:46Z

examples/quickstart/pipelines/intent_training_pipeline.py

+    settings={
+        "docker": DockerSettings(
+            requirements="requirements.txt",
+            parent_image="zenmldocker/zenml:0.85.0-py3.12",


remember to remove

strickvl

Getting there. Bunch of small suggestions, but yeah almost there!

(Thanks for adding the eval pipeline too!)

strickvl · 2025-09-19T15:27:32Z

examples/quickstart/run.py

+Usage:
+  python run.py --train    # Train classifier and tag as production


add the rest of the options here as well?

(or delete)

strickvl · 2025-09-19T15:28:19Z

examples/quickstart/run.py

-# limitations under the License.
-#
-from typing import Optional
+#!/usr/bin/env python3


Does this file (and others) need the ZenML license at the top?

strickvl · 2025-09-19T15:36:40Z

examples/quickstart/steps/data.py

+    ("good morning", "general"),
+    ("i have a question about my account", "general"),
+    ("what services do you offer", "general"),
+    ("i need assistance with banking", "general"),


Suggested change

("i need assistance with banking", "general"),

("i need assistance with banking", "general"),

# More Card Lost (6 examples)

("please freeze my card i cant find it", "card_lost"),

("how do i report my card stolen", "card_lost"),

("need a new card mine went missing", "card_lost"),

("lost debit card cancel it now", "card_lost"),

("misplaced my credit card can you disable it", "card_lost"),

("i lost my atm card what now", "card_lost"),

# More Payments (6 examples)

("set up autopay for my account", "payments"),

("why was my payment declined", "payments"),

("make a one time payment today", "payments"),

("can i change my payment date", "payments"),

("payment is pending how long will it take", "payments"),

("set a recurring monthly payment", "payments"),

# More Account Balance (6 examples)

("whats my available credit right now", "account_balance"),

("show balance for my checking account", "account_balance"),

("how much can i spend before reaching my limit", "account_balance"),

("tell me my statement balance", "account_balance"),

("balance inquiry please", "account_balance"),

("how much do i have available to spend", "account_balance"),

# More Dispute (6 examples)

("i want to file a chargeback", "dispute"),

("merchant charged me twice", "dispute"),

("charged the wrong amount", "dispute"),

("i didnt receive the service i paid for", "dispute"),

("how do i dispute a fraudulent transaction", "dispute"),

("there is an unauthorized withdrawal on my card", "dispute"),

# More Credit Limit (6 examples)

("lower my credit limit please", "credit_limit"),

("temporary limit increase for travel", "credit_limit"),

("why was my credit limit reduced", "credit_limit"),

("can you review my credit line", "credit_limit"),

("whats my current credit limit", "credit_limit"),

("reduce my credit line for safety", "credit_limit"),

# More General (6 examples)

("good afternoon", "general"),

("thanks for your help", "general"),

("i need support with my account", "general"),

("can i talk to an agent", "general"),

("help please", "general"),

("can you assist me with something", "general"),

Added some more examples

strickvl · 2025-09-19T15:43:00Z

examples/quickstart/steps/data.py

+
+logger = get_logger(__name__)
+
+# Expanded dataset for intent classification with more diverse examples


Suggested change

# Expanded dataset for intent classification with more diverse examples

strickvl · 2025-09-19T15:45:05Z

examples/quickstart/visualizations/__init__.py

@@ -0,0 +1,106 @@
+"""Visualization utilities for the ZenML quickstart."""


Small thing, but not sure all this logic should be in an init file

This is fine i think

strickvl · 2025-09-19T16:28:52Z

examples/quickstart/README.md

+This quickstart demonstrates the evolution from generic LLM responses to structured, intent-driven customer support. You'll see how adding a simple intent classifier dramatically improves response quality and user experience. We will:

-Unlike traditional MLOps tools, ZenML offers unparalleled flexibility and control. It integrates seamlessly with your infrastructure, allowing both ML and Ops teams to collaborate effectively without compromising on their specific requirements.
+- Deploy a generic LLM agent that gives general banking advice


Suggested change

- Deploy a generic LLM agent that gives general banking advice

- Deploy a generic LLM agent that gives generic banking advice

strickvl · 2025-09-19T16:29:54Z

examples/quickstart/README.md

-Unlike traditional MLOps tools, ZenML offers unparalleled flexibility and control. It integrates seamlessly with your infrastructure, allowing both ML and Ops teams to collaborate effectively without compromising on their specific requirements.
+- Deploy a generic LLM agent that gives general banking advice
+- Train an intent classifier and tag it as "production"
+- Compare generic responses vs. structured, targeted responses


Are we missing the part where we deploy the intent classifier and/or use it in a
newly deployed agent or something? At least in this story, I somehow assume that
when I run an eval, I'm comparing against two deployments.

strickvl · 2025-09-19T16:30:28Z

examples/quickstart/README.md

+def my_pipeline():
+    data = load_data()        # Step 1: Load data
+    model = train_model(data) # Step 2: Train model using data from step 1
+    do_agentic_loop(model)    # Step 3: Evaluate the model with an agent (toy example)


the comments are out of step with the names of the steps..

strickvl · 2025-09-19T16:31:42Z

examples/quickstart/README.md

 ```

-You can edit `configs/training_aws.yaml` to adjust the settings for running your pipeline in aws.
+This generates:


Include screenshots of the visualizations?

strickvl · 2025-09-19T16:32:00Z

examples/quickstart/README.md


-zenml stack set <INSERT_YOUR_STACK_NAME_HERE>
-python run.py --model_type=t5-small
+The magic happens in the init hook:


link to our docs on hooks?

…layout

socket-security · 2025-09-20T18:15:48Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	matplotlib@3.10.6

View full report

safoinme added 5 commits September 15, 2025 15:33

add mlops starter and readme

7a95671

update minimal_agent

0b4d13f

Merge branch 'feature/served-pipelines' into misc/update-examples-dep…

a7b81d0

…loyed-pipelines

quickstart

2900fb0

format

c3a2ee2

github-actions bot added the internal To filter out internal PRs and issues label Sep 15, 2025

Auto-update of Starter template

519b863

htahir1 self-requested a review September 18, 2025 12:59

htahir1 and others added 15 commits September 18, 2025 15:05

Merge branch 'feature/served-pipelines' into misc/update-examples-dep…

2228616

…loyed-pipelines

New quickstart

2e8ec66

Update deployer and stack registration for Docker

943ee9c

Update agent serving pipeline to remove confidence threshold

1aa886a

Add missing comma in classify_intent function parameters

767d8aa

Add ZenML Quickstart example notebook

71003ae

Update README with ZenML pipeline modes and OpenAI key.- Add support …

bad2293

…for OpenAI in agent.yaml.- Integrate LLM responses and classifier upgrades in agent pipeline.- Log metadata for training and response generation

Update quickstart README with key ZenML features

b3ad594

Upgrade to structured, targeted agent responses

09ab2ec

lint and docstring

a5b5235

Update pipeline docstrings with Args and Returns

f1b9349

Refactor typing to remove Optional for boolean inputs

89edb8d

Merge remote-tracking branch 'origin/feature/served-pipelines' into m…

1b7e329

…isc/update-examples-deployed-pipelines

Merge branch 'misc/update-examples-deployed-pipelines' into misc/upda…

400a6d6

…te-quickstart

Rename agent_serving_pipeline.py to support_agent.py<commit message> …

d0e5a65

…Rename agent_serving_pipeline to support_agent

htahir1 reviewed Sep 19, 2025

View reviewed changes

htahir1 added 3 commits September 19, 2025 15:18

Update import statement in visualization module

4c5a0ea

Update quickstart README with additional details

9e51a47

lint and docstring

5e094ef

strickvl self-requested a review September 19, 2025 15:24

strickvl requested changes Sep 19, 2025

View reviewed changes

htahir1 added 2 commits September 19, 2025 22:45

Update payload structure for ZenML deployment API

0162cd8

Remove unnecessary code and display analysis results in a structured …

fca7b99

…layout

htahir1 added 4 commits September 20, 2025 20:26

Add DocumentAnalysis to pipelines/__init__.py & refactor code

f620165

Remove unused static files and associated styles

8c0030f

New quickstart

e4388f7

Code review

e85c4df

		Usage:
		python run.py --train # Train classifier and tag as production

-    ("i need assistance with banking", "general"),
+    ("i need assistance with banking", "general"),
+    # More Card Lost (6 examples)
+    ("please freeze my card i cant find it", "card_lost"),
+    ("how do i report my card stolen", "card_lost"),
+    ("need a new card mine went missing", "card_lost"),
+    ("lost debit card cancel it now", "card_lost"),
+    ("misplaced my credit card can you disable it", "card_lost"),
+    ("i lost my atm card what now", "card_lost"),
+    # More Payments (6 examples)
+    ("set up autopay for my account", "payments"),
+    ("why was my payment declined", "payments"),
+    ("make a one time payment today", "payments"),
+    ("can i change my payment date", "payments"),
+    ("payment is pending how long will it take", "payments"),
+    ("set a recurring monthly payment", "payments"),
+    # More Account Balance (6 examples)
+    ("whats my available credit right now", "account_balance"),
+    ("show balance for my checking account", "account_balance"),
+    ("how much can i spend before reaching my limit", "account_balance"),
+    ("tell me my statement balance", "account_balance"),
+    ("balance inquiry please", "account_balance"),
+    ("how much do i have available to spend", "account_balance"),
+    # More Dispute (6 examples)
+    ("i want to file a chargeback", "dispute"),
+    ("merchant charged me twice", "dispute"),
+    ("charged the wrong amount", "dispute"),
+    ("i didnt receive the service i paid for", "dispute"),
+    ("how do i dispute a fraudulent transaction", "dispute"),
+    ("there is an unauthorized withdrawal on my card", "dispute"),
+    # More Credit Limit (6 examples)
+    ("lower my credit limit please", "credit_limit"),
+    ("temporary limit increase for travel", "credit_limit"),
+    ("why was my credit limit reduced", "credit_limit"),
+    ("can you review my credit line", "credit_limit"),
+    ("whats my current credit limit", "credit_limit"),
+    ("reduce my credit line for safety", "credit_limit"),
+    # More General (6 examples)
+    ("good afternoon", "general"),
+    ("thanks for your help", "general"),
+    ("i need support with my account", "general"),
+    ("can i talk to an agent", "general"),
+    ("help please", "general"),
+    ("can you assist me with something", "general"),


		logger = get_logger(__name__)

		# Expanded dataset for intent classification with more diverse examples

		@@ -0,0 +1,106 @@
		"""Visualization utilities for the ZenML quickstart."""

	- Deploy a generic LLM agent that gives general banking advice
	- Deploy a generic LLM agent that gives generic banking advice

Update examples for deployed pipelines #3960

Are you sure you want to change the base?

Update examples for deployed pipelines #3960

Uh oh!

Conversation

safoinme commented Sep 15, 2025

Describe changes

Pre-requisites

Types of changes

Uh oh!

coderabbitai bot commented Sep 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review skipped

Uh oh!

github-actions bot commented Sep 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔍 Broken Links Report

Summary

Details

Uh oh!

github-actions bot commented Sep 15, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Documentation Link Check Results

Uh oh!

github-actions bot commented Sep 15, 2025

Uh oh!

review-notebook-app bot commented Sep 19, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

strickvl left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

socket-security bot commented Sep 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

coderabbitai bot commented Sep 15, 2025 •

edited

Loading

github-actions bot commented Sep 15, 2025 •

edited

Loading

github-actions bot commented Sep 15, 2025 •

edited

Loading

socket-security bot commented Sep 20, 2025 •

edited

Loading