Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Major Feature: Tool Support #99

Merged
merged 219 commits into from
Jun 24, 2024
Merged

Major Feature: Tool Support #99

Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
219 commits
Select commit Hold shift + click to select a range
d18b2ae
created flowise page and flow dropdown for chat
Maxwell-Lindsey Dec 23, 2023
5de43d1
added flow in navbar; improved flow page
Maxwell-Lindsey Dec 24, 2023
ffe1c55
renamed flowise items to n8n
Maxwell-Lindsey Jan 22, 2024
e93686a
Merge branch 'main' into n8n-ui
Maxwell-Lindsey Jan 22, 2024
d96e993
Altered Navbar to include n8n flow
Maxwell-Lindsey Jan 22, 2024
dd79691
initial working set up of n8n hosted on flowise
Maxwell-Lindsey Jan 22, 2024
6ff0a90
Added explanation text, placeholder table made
KastanDay Feb 13, 2024
771a77e
Add trunk to PR branch
KastanDay Feb 13, 2024
426894e
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Feb 13, 2024
c0b068e
merge main into branch
KastanDay Feb 13, 2024
a5cb526
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Feb 13, 2024
b1b8585
Major progress on getWorkflows datatable. Table not quite rendering p…
KastanDay Feb 13, 2024
2b7097b
Fix the api formatting to make the table render
KastanDay Feb 13, 2024
8152ad4
Fix tiny build error
KastanDay Feb 14, 2024
2aef64f
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Feb 14, 2024
73e5baa
added tags column in materials page table
Maxwell-Lindsey Feb 14, 2024
2786a75
added new packages
Maxwell-Lindsey Feb 14, 2024
7e57f10
Inital commit for arbitrary tool invocations
rohan-uiuc Feb 15, 2024
be909cd
Bugfix to render correct images after pest detection api output is re…
rohan-uiuc Feb 15, 2024
395b20b
Added docstring ONLY
rohan-uiuc Feb 15, 2024
a49b946
reverted changes to packages
Maxwell-Lindsey Feb 16, 2024
07860cb
Merge branch 'advanced-document-controls-ui' of github.com:KastanDay/…
Maxwell-Lindsey Feb 16, 2024
1d02ca6
Format ONLY
rohan-uiuc Feb 16, 2024
5d48074
Commenting some debug logs
rohan-uiuc Feb 16, 2024
dd1227c
reverted changes to package files
Maxwell-Lindsey Feb 16, 2024
461c587
Prompt change for generting image description
rohan-uiuc Feb 16, 2024
734b9ea
Updates:
rohan-uiuc Feb 19, 2024
aa4623a
Build fix ONLY
rohan-uiuc Feb 19, 2024
1592f46
Updates:
rohan-uiuc Feb 21, 2024
7e34e23
cleaned up the feel and look of n8n page and also removed iframe for now
jkmin3 Feb 21, 2024
0c72498
added document groups table; needs to be connected to backend
Maxwell-Lindsey Feb 25, 2024
f3a3702
ui changes to doc group table
Maxwell-Lindsey Feb 25, 2024
4a770d8
changed naming convention of CourseDocument inferface
Maxwell-Lindsey Feb 25, 2024
f774669
commented out unused function; switched to backend branch from main b…
Maxwell-Lindsey Feb 26, 2024
c07b4be
document_group_set naming
Maxwell-Lindsey Feb 26, 2024
be7d518
fixed doc_group naming; fixed onChange error from multiselect
Maxwell-Lindsey Feb 26, 2024
948a2f8
fixed documentGroups naming
Maxwell-Lindsey Feb 26, 2024
7260e87
added supabase, made table cleaner
jkmin3 Feb 26, 2024
7b28347
Document groups now working being updated correctly on frontend and b…
Maxwell-Lindsey Feb 26, 2024
4ae4b32
removed description column
Maxwell-Lindsey Feb 26, 2024
de8f05d
corrected document id logic; Documents table fully functional
Maxwell-Lindsey Feb 27, 2024
00a3c11
added queues for fetches and state updates to prevent race conditions
Maxwell-Lindsey Feb 27, 2024
07a8030
added default group to document group table
Maxwell-Lindsey Feb 27, 2024
f421b1a
Fixed counting number of docs for doc group table
Maxwell-Lindsey Feb 27, 2024
1b7c4b4
updated logic to properly retrieve whether or not a group is enabled
Maxwell-Lindsey Feb 27, 2024
a85f8a3
made supabase to a list, cleaned up table and feel
jkmin3 Mar 4, 2024
4c1ce7d
cleaned up the table and corrected when the popup should show up for …
jkmin3 Mar 5, 2024
cd1ce1e
better fetching for different format of workflow records
jkmin3 Mar 5, 2024
7247c06
now calling frontend api which directly interacts with tables for doc…
Maxwell-Lindsey Mar 11, 2024
7884c2b
cleaned up comments
Maxwell-Lindsey Mar 11, 2024
33f03be
reverted to production backend; correctly retrieving state from new t…
Maxwell-Lindsey Mar 12, 2024
f3316c9
fixed adding new document group functionality
Maxwell-Lindsey Mar 13, 2024
e606ac0
fixed frontend handling of adding document groups
Maxwell-Lindsey Mar 13, 2024
a41b669
Merge branch 'main' into advanced-document-controls-ui
Maxwell-Lindsey Mar 13, 2024
a4292c4
fixed error with removing doc groups
Maxwell-Lindsey Mar 13, 2024
aa08c86
fixed functionality for adding and removing multiple document groups …
Maxwell-Lindsey Mar 13, 2024
fcc5779
Merging. Double check onChange for the data table
KastanDay Mar 14, 2024
42ceb47
fixed issue with displaying multiple document groups in frontend (sti…
Maxwell-Lindsey Mar 14, 2024
4582af2
made interfaces more consistent between ui and api; fixed issue with …
Maxwell-Lindsey Mar 15, 2024
abb3a66
implemented functionality for enabling and disabling document groups
Maxwell-Lindsey Mar 15, 2024
ba1d692
commented out default group handling
Maxwell-Lindsey Mar 16, 2024
09c9e6d
fixed npm build error
Maxwell-Lindsey Mar 16, 2024
5c7c1a1
added pagination functionality to documents table
Maxwell-Lindsey Mar 17, 2024
6820e9a
removed top corner curving of search bar for document groups table
Maxwell-Lindsey Mar 17, 2024
543888b
Merge branch 'main' into advanced-document-controls-ui
Maxwell-Lindsey Mar 17, 2024
a87f50a
minor wording improvement
Maxwell-Lindsey Mar 18, 2024
e0aae41
Introducing react query with optimistic updates and mutations to regu…
rohan-uiuc Mar 18, 2024
0e04eeb
Remove unused imports
rohan-uiuc Mar 18, 2024
f30ddb3
fixed document table width consistency issue
Maxwell-Lindsey Mar 19, 2024
d51804b
fix for isssue oif old documents not being cleared when changing pages
Maxwell-Lindsey Mar 19, 2024
b09bc4b
changed where materials are being cleared for pagination
Maxwell-Lindsey Mar 19, 2024
c575778
removed redundant clearing of materials and unnecessary initializing …
Maxwell-Lindsey Mar 20, 2024
864818d
removed unused CourseDocument commented out code
Maxwell-Lindsey Mar 20, 2024
aa865b4
corrected issue with multiselect options
Maxwell-Lindsey Mar 20, 2024
0d0f7ce
data fetching fixes
Maxwell-Lindsey Mar 20, 2024
b824862
Merge branch 'advanced-document-controls-ui' into react_query
rohan-uiuc Mar 20, 2024
73662ee
Merge pull request #131 from KastanDay/react_query
rohan-uiuc Mar 20, 2024
e304ad6
changed * to id in count
Maxwell-Lindsey Mar 20, 2024
e5bf363
changed table component in MakeOldCoursePage
Maxwell-Lindsey Mar 20, 2024
ae6e9cc
added page to fetch query to fix stale behavior
Maxwell-Lindsey Mar 20, 2024
c82d455
removed extra dependencies for fetcing to avoid extra calls other tha…
Maxwell-Lindsey Mar 20, 2024
944ae05
added back 'documents' query name to fetch
Maxwell-Lindsey Mar 20, 2024
fd4212e
Major bugfix. Project Table works great, has loading and error states…
KastanDay Mar 21, 2024
95a0252
minor clean up ProjectTable
KastanDay Mar 21, 2024
eaf0b91
DocGroups table is back. Last up: connect it to the ProjectFiles table
KastanDay Mar 21, 2024
1b96975
EVERYTHING WORKS, AND the code is CLEANNNN. Deleting doc groups does …
KastanDay Mar 21, 2024
47034a7
added switches to frontend
jkmin3 Mar 21, 2024
2393aa6
changed key to id in tools.ts
jkmin3 Mar 21, 2024
e4a134b
Move n8n api key logging to edge function
KastanDay Mar 21, 2024
015a802
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
beb3bb3
Full error management for API key saving
KastanDay Mar 21, 2024
85b9828
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
bf2b461
Major cleanup of N8N page. Big improvement to upsert API key
KastanDay Mar 21, 2024
35592d7
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
217b1ae
Bugfixes: All mutations work now, correct usage of useQueryClient and…
rohan-uiuc Mar 21, 2024
1d3103e
we get n8n api keys if they are in supabase
jkmin3 Mar 21, 2024
65e7cf0
Major improvement to copy and layout
KastanDay Mar 21, 2024
acb8771
Placeholder for llmFunctionCalling
KastanDay Mar 21, 2024
913bb05
Fix tiny build error
KastanDay Mar 21, 2024
2079b12
added better error messages for workflows
jkmin3 Mar 21, 2024
46d1031
added better error messages for workflows
jkmin3 Mar 21, 2024
dbe4837
Making parameters optional in getN8nWorkflows
KastanDay Mar 21, 2024
18b69f0
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
ad14987
Finalize getN8nWorkflows endpoint for apikey or course_name
KastanDay Mar 21, 2024
301ab71
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
4576f45
Fix up getn8nworkflows endpoint
KastanDay Mar 21, 2024
04fec9e
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 Mar 21, 2024
b078886
Update styles and hooks related to document groups
rohan-uiuc Mar 21, 2024
a87307b
Fix tiny build error
KastanDay Mar 22, 2024
e266cd7
Improvements:
rohan-uiuc Mar 22, 2024
7241633
Build fix ONLY
rohan-uiuc Mar 22, 2024
34a4d0d
Fixed optimistic updates of documents table
rohan-uiuc Mar 23, 2024
95a76b3
Add spotlight search functionality to Chat component
rohan-uiuc Mar 25, 2024
50fa4c3
Add fetchEnabledDocGroups function to dbUtils.ts and implement fetchE…
rohan-uiuc Mar 25, 2024
9cfb720
Add Vercel AI SDK for tool use
KastanDay Mar 27, 2024
345bc65
Merged Pest Detection PR into this branch
KastanDay Mar 27, 2024
a510323
Add app router, function calling basics work. Need to make fully dynamic
KastanDay Mar 28, 2024
b2945a6
Tiny build fix
KastanDay Mar 28, 2024
0961ac7
Refactor OpenAI Key handling for simplicity. Add placeholder callN8nF…
KastanDay Mar 28, 2024
5ebb852
Add doc_groups parameter in fetchMQRContexts and fetchContexts
rohan-uiuc Mar 28, 2024
3df13d5
Using link and button conditionally to retain the ctrl + click openin…
rohan-uiuc Mar 28, 2024
d19d8f2
Clean up n8n tool parsing
KastanDay Mar 29, 2024
6d7b566
Minor cleanup
KastanDay Mar 29, 2024
40e826c
Merge Spotlight branch into here
KastanDay Mar 29, 2024
0907e94
Remove TRPC, upgrade ReactQuery to v5. Merge Spotlight
KastanDay Mar 29, 2024
4a31f04
Remove many dependencies, like nextAuth, styling, etc
KastanDay Mar 29, 2024
03e5fff
Fix up N8nWorkflowsTable w/ react query. In progress: Adding tools to…
KastanDay Mar 29, 2024
fffb02d
Working tools in Spotlight
KastanDay Mar 29, 2024
3a8dcd0
Mostly working. Need to make use of image description and URLs in fin…
KastanDay Mar 30, 2024
2c545e7
Image description & URLs are injected into tool call
KastanDay Apr 1, 2024
76cb1d5
Working end-to-end tool use! Need to cleanup, add status messages
KastanDay Apr 2, 2024
3a859bf
Add basic UI for showing tool usage
KastanDay Apr 2, 2024
d8e3879
Remove 'only ansler if it's related to the course materials' promptga .
KastanDay Apr 3, 2024
bceffdf
In progress on handing API key deletion
KastanDay May 7, 2024
0464b0c
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 7, 2024
df6e432
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 7, 2024
986589f
working fetching workflows
jkmin3 May 7, 2024
83992d9
Clean up workflows table formatting
KastanDay May 7, 2024
b3bb7ce
Move endpoints from localhost to RAILWAY_URL env var
KastanDay May 7, 2024
fc85692
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 7, 2024
ce15ca8
Minor cleanup
KastanDay May 7, 2024
decb5c3
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 8, 2024
76a5bf7
Fix 'clear N8n api key' functionality
KastanDay May 10, 2024
6bcb787
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 10, 2024
dd8f5a6
Fix set & clear N8N key. Working SMOOTH now
KastanDay May 10, 2024
9658752
checked boxes in real time for activating workflows
jkmin3 May 10, 2024
aa9dfd8
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 10, 2024
5dcaec4
pagination is fixed
jkmin3 May 13, 2024
59069fc
Fix n8n output parsing, works w/ gmail tool now
KastanDay May 13, 2024
b9f18e1
CAUTION: Resolve ALL Merge conflicts, needs testing
KastanDay May 13, 2024
400917d
Merge branch 'n8n-ui' of https://github.com/KastanDay/ai-ta-frontend …
jkmin3 May 13, 2024
9e0ca00
ordered the table by the created at date
jkmin3 May 13, 2024
08c4dab
Working tool use, proper types for Rohan's settings page
KastanDay May 13, 2024
9571e79
Major improvements to saving tool outputs, chatMessage types. Finally…
KastanDay May 14, 2024
f1fc0ba
build fix
KastanDay May 14, 2024
a137443
Huge improvement, making progress on buildPrompt. Major cleanup to ty…
KastanDay May 14, 2024
669e108
Working tool use w/ new 'buildPrompt()' prompt formatting!
KastanDay May 14, 2024
4489d97
Improve formatting on chatmessage tools otput
KastanDay May 14, 2024
243bb95
build fix
KastanDay May 14, 2024
db9f530
Minor improvements to ChatMessage, display tool names
KastanDay May 15, 2024
b203591
build fix
KastanDay May 17, 2024
6c1463c
build fix
KastanDay May 17, 2024
ee50d0e
Messy push -- new tools endpoint, moving results values into routingR…
KastanDay May 21, 2024
425319b
Multiple accordions for showing parallel tool calls loading and outpu…
rohan-uiuc May 21, 2024
cc6e896
Cleanup of types
rohan-uiuc May 21, 2024
39d7bb4
Working tool use w/ new types, adding to Conversation object
KastanDay May 21, 2024
1a85b50
Fix tool.output type to string
KastanDay May 21, 2024
2d472df
Error handling when calling tool, add errors to tool output
KastanDay May 21, 2024
2ef6f5d
Updated fields in accordions to use new types from selectedConversati…
rohan-uiuc May 21, 2024
e2e2d47
pretty fantastic tools usage, errors are shown to user
KastanDay May 22, 2024
548ead6
Minor prompting improvement to keep last 2 messages (broken-ish), and…
KastanDay May 22, 2024
7724e75
Add loading state for generating final response
rohan-uiuc May 22, 2024
fb91bfd
Adding available tools to user settings
rohan-uiuc May 22, 2024
86bfdce
Docgroups -> tools typos
rohan-uiuc May 22, 2024
f7f4f30
Add langsmith monitoring
KastanDay May 23, 2024
e7bf327
Auto-clear local storage when full
KastanDay May 23, 2024
a77d30a
Fix build errors, in progress log to LangSmith
KastanDay May 28, 2024
a08cc96
Fix build error on tool type
KastanDay May 28, 2024
4805839
Multimodality in tool outputs
rohan-uiuc May 30, 2024
7fd54e3
Handling multimodal tool outputs for final message
rohan-uiuc May 31, 2024
2078e6f
Add isImage check for context search and add log to time n8n run_flow
rohan-uiuc May 31, 2024
3f31e34
Clearing tools on regenerate
rohan-uiuc May 31, 2024
c7d4e61
Working convo logging to LangSmith, prompt engineering needs work
KastanDay May 31, 2024
1638ec8
Create a new OpenAI API invocation for image description
rohan-uiuc Jun 4, 2024
0f35b45
Add tool-routing to LangSmith
KastanDay Jun 4, 2024
ed133e2
Build fix
rohan-uiuc Jun 4, 2024
baadbfa
Fix multiple tool output formats (data / response)
KastanDay Jun 4, 2024
4a523f1
No cache on tool runs. log toos to LangSmith
KastanDay Jun 4, 2024
8b4e1f0
Parsing fix, error message for empty tool response, better spacing fo…
rohan-uiuc Jun 4, 2024
c2562ff
Beautiful image previews for tool inputs and outputs
rohan-uiuc Jun 5, 2024
d6c798e
Simplify models. Point to rolling latest models, don't offer specific…
KastanDay Jun 10, 2024
5e55a25
Send Json outputs to tooloutput.data
KastanDay Jun 11, 2024
649a51c
Fix build error
KastanDay Jun 12, 2024
eed2c15
Major buildPrompt() improvements... lesson: put all 'factual' info in…
KastanDay Jun 12, 2024
c28df28
Major cleanup of UI on Chat page
rohan-uiuc Jun 14, 2024
506c99d
Chat page will use appropriate N8N key per project (instead of hard c…
KastanDay Jun 15, 2024
369cdc4
Major UI improvement to /tools page, added instructions and button to…
rohan-uiuc Jun 15, 2024
a3205c3
Merge remote-tracking branch 'refs/remotes/origin/n8n-ui' into n8n-ui
rohan-uiuc Jun 15, 2024
6dca9ca
Fix workflow 'enabled' status, add tags to workflows table
KastanDay Jun 15, 2024
d73dd62
Fix tool names in Settings modal on /chat
KastanDay Jun 15, 2024
8de00ee
Merge branch 'main' into n8n-ui
rohan-uiuc Jun 16, 2024
c54f68c
Build fix
rohan-uiuc Jun 16, 2024
498ba0d
trunk fmt
rohan-uiuc Jun 16, 2024
a3781ed
Fix chat request by stripping extra fields
rohan-uiuc Jun 21, 2024
68e5a46
Merge branch 'main' into n8n-ui
rohan-uiuc Jun 21, 2024
d47c4bf
Build fix
rohan-uiuc Jun 21, 2024
ea727e6
Minor prompt engineering, much more helpful final responses now!
rohan-uiuc Jun 21, 2024
97b85d5
Minor UI fix
rohan-uiuc Jun 21, 2024
df0abc8
merge:
KastanDay Jun 21, 2024
76f171e
Improve tool output parsing, log to posthog, beta image outputs support
KastanDay Jun 21, 2024
1f633ea
Update Langsmith project to 'uiuc-chat-production'
KastanDay Jun 21, 2024
b38200a
Re-enable full context search, remove dummy contexts
KastanDay Jun 21, 2024
a4487aa
Feat: allow image outputs to be used in combination with all other to…
KastanDay Jun 21, 2024
ef8907b
Update Posthog names, use tool_error and tool_error_empty_response as…
KastanDay Jun 21, 2024
2b68193
Fix buggy accordions, their display order, font sizes, responsive des…
rohan-uiuc Jun 24, 2024
0634a66
Remove contexts from last message on regenerate, fix states in multi-…
rohan-uiuc Jun 24, 2024
73fbe23
save conversation history, delete oldest convos if necssary... todo: …
KastanDay Jun 24, 2024
7a2c667
Add proper titles and metadata to Chat and Materials page. Show Proje…
KastanDay Jun 24, 2024
2d731bf
build fix in convo saving code
KastanDay Jun 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading