You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I am using the create_by_text API to upload my documents (around 22,000). The documents have been uploaded, but the vectors are still queued for computation (very slow, seems to be calculated one by one rather than in parallel).
Last time, I uploaded about 40,000 documents, which resulted in filling up my hard drive space (using over 100GB, while my original files were only around 200MB).
This time, I conducted further observations and found that the dataset_keyword_tables table occupies a very high amount of space, which can be said to be largely occupied by this table.
I suspect that this table is used to store the keywords corresponding to each document, but I only use vector search. How can I disable keywords? Or is there any way to reduce this table's hard drive usage?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I am using the
create_by_text
API to upload my documents (around 22,000). The documents have been uploaded, but the vectors are still queued for computation (very slow, seems to be calculated one by one rather than in parallel).Last time, I uploaded about 40,000 documents, which resulted in filling up my hard drive space (using over 100GB, while my original files were only around 200MB).
This time, I conducted further observations and found that the
dataset_keyword_tables
table occupies a very high amount of space, which can be said to be largely occupied by this table.I suspect that this table is used to store the keywords corresponding to each document, but I only use vector search. How can I disable keywords? Or is there any way to reduce this table's hard drive usage?
2. Additional context or comments
Related issue: #6269
Beta Was this translation helpful? Give feedback.
All reactions