Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improvement: add 'auto' as an option for auto_discovery #4043

Merged
merged 3 commits into from
Mar 9, 2025

Conversation

mscolnick
Copy link
Contributor

@mscolnick mscolnick commented Mar 9, 2025

This adds 'auto' as an option for auto_discovery, which is nice for things like sqlite so these can be discovered while Snowflake or Bigquery don't need to be.

Should we also do this for columns?

cc @Light2Dark

Cons:

  • this could add confusion with the double auto

Copy link

vercel bot commented Mar 9, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
marimo-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 9, 2025 9:35pm
marimo-storybook ✅ Ready (Inspect) Visit Preview 💬 Add feedback Mar 9, 2025 9:35pm

@Light2Dark
Copy link
Collaborator

Light2Dark commented Mar 9, 2025

Nice!

Is the value of this option mainly for LLM and code completion? Because the latency to discover tables for sqlite, postgres is pretty low.

But yeah, we should make auto discovery smarter for the future, eg. check number of schemas, tables b4 discovering. Async discovery. All of these optimizations fit under "auto".

maybe leave it as false for columns for now 🤔, mysql and postgres can have a lot of tables. We should work to make it async I think.

Light2Dark
Light2Dark previously approved these changes Mar 9, 2025
Copy link
Collaborator

@Light2Dark Light2Dark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let me know if you'd like me to test. but lgtm

Copy link

github-actions bot commented Mar 9, 2025

Breaking changes detected in the OpenAPI specification!

@mscolnick mscolnick merged commit 9c940f3 into main Mar 9, 2025
37 of 38 checks passed
@mscolnick mscolnick deleted the ms/auto-discover branch March 9, 2025 21:41
Copy link

github-actions bot commented Mar 9, 2025

🚀 Development release published. You may be able to view the changes at https://marimo.app?v=0.11.18-dev25

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants