Skip to content

Conversation

@prinskumar-tigergraph
Copy link
Collaborator

@prinskumar-tigergraph prinskumar-tigergraph commented Dec 3, 2025

PR Type

Enhancement, Bug fix


Description

  • Add real-time server config UI endpoints

  • Implement temp-file ingestion review workflow

  • Switch PDF extraction to pymupdf4llm

  • Improve thread-safety and image handling


Diagram Walkthrough

flowchart LR
  ui["Setup page (new flows)"]
  cfg["Server config endpoints (/ui/config)"]
  tempAPI["Temp ingestion endpoints (/ingestion_temp/*)"]
  create["create_ingest (server/S3)"]
  extractor["TextExtractor: save to temp + lock pymupdf4llm"]
  temp["uploads/ingestion_temp/<graph>/<session>"]
  review["UI review or direct ingest"]
  ingest["/ingest reads temp JSON -> TigerGraph"]
  s3["S3 (JSON or multi via Bedrock BDA)"]

  ui -- "configure LLM/GraphRAG" --> cfg
  ui -- "upload/download triggers" --> create
  create -- "server: process with temp_folder" --> extractor
  extractor -- "writes JSON docs" --> temp
  ui -- "list/delete temp files" --> tempAPI
  tempAPI -- "serves file metadata" --> ui
  ui -- "review or direct" --> review
  review -- "run ingest" --> ingest
  ui -- "S3 ingest (json/multi)" --> s3
  s3 -- "create_ingest + ingest" --> ingest
Loading

File Walkthrough

Relevant files
Enhancement
5 files
text_extractors.py
Temp-folder saving, PDF via pymupdf4llm, image handling   
+266/-138
supportai.py
Use temp session storage; load from saved JSON                     
+63/-16 
ui.py
Add temp ingestion and server config REST endpoints           
+207/-1 
image_data_extractor.py
Describe images from file path; remove legacy saver           
+31/-132
Setup.tsx
UI: temp review flow, S3 ingest, server config                     
+964/-205
Configuration changes
1 files
config.py
Add in-memory config update with file persistence               
+56/-0   
Dependencies
1 files
requirements.txt
Replace PyMuPDF with pymupdf4llm; enable pathtools             
+3/-2     
Documentation
1 files
pymupdf4llm-AGPL-3.0.txt
Add license for pymupdf4llm dependency                                     
+661/-0 

<TabsTrigger value="AmazonBDA" disabled={isIngesting}>
<CloudLightning className="h-4 w-4 mr-2" />
Use Amazon BDA
<TabsTrigger value="s3">
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@prinskumar-tigergraph is it on the latest main branch?

</Dialog>

{/* Server Configuration Dialog */}
<Dialog
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@prinskumar-tigergraph as discussed, let's put the config dialogs in a separate admin page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants