🐛 Bug Report: Self-hosting localy reports that llama-cpp-python is not installed

[irmoktran]

📜 Description

Self-hosting localy reports that llama-cpp-python is not installed on the console logs.

When I ask a question on CHAT the following message appear on the console logs:

backend_1 | err Please install llama_cpp using pip install llama-cpp-python

I'm using the default script provided on the project.

👟 Reproduction steps

git clone https://github.com/arc53/DocsGPT.git

cd DocsGPT

python -m pip install all_requirements

./run-with-docker-compose.sh

Go to browser: http://localhost:5173/

Ask a question

👍 Expected behavior

I expect to receive any answer, instead the message bellow appear:

Please try again later. We apologize for any inconvenience.

👎 Actual Behavior with Screenshots

💻 Operating system

Linux

What browsers are you seeing the problem on?

Firefox, Chrome, Microsoft Edge

🤖 What development environment are you experiencing this bug on?

Docker

🔒 Did you set the correct environment variables in the right path? List the environment variable names (not values please!)

Yes, followed the instructions on https://docs.docsgpt.cloud/Deploying/Quickstart

📃 Provide any additional context for the Bug.

No response

📖 Relevant log output

acoelho@zenduox:~/Git/DocsGPT$ sudo -E bash -i -c ./run-with-docker-compose.sh
Running Plain Configuration
WARNING: The API_KEY variable is not set. Defaulting to a blank string.
redis uses an image, skipping
mongo uses an image, skipping
Building worker
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  331.3kB
Step 1/24 : FROM ubuntu:24.04 as builder
 ---> 59ab366372d5
Step 2/24 : ENV DEBIAN_FRONTEND=noninteractive
 ---> Using cache
 ---> 1f3a50573902
Step 3/24 : RUN apt-get update &&     apt-get install -y software-properties-common &&     add-apt-repository ppa:deadsnakes/ppa &&     apt-get update &&     apt-get install -y --no-install-recommends gcc wget unzip libc6-dev python3.11 python3.11-distutils python3.11-venv &&     rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> 7a6395833fb3
Step 4/24 : RUN if [ -f /usr/bin/python3.11 ]; then         ln -s /usr/bin/python3.11 /usr/bin/python;     else         echo "Python 3.11 not found"; exit 1;     fi
 ---> Using cache
 ---> 5be52b29da5c
Step 5/24 : RUN wget https://d3dg1063dc54p9.cloudfront.net/models/embeddings/mpnet-base-v2.zip &&     unzip mpnet-base-v2.zip -d model &&     rm mpnet-base-v2.zip
 ---> Using cache
 ---> b6512cc7bcb6
Step 6/24 : RUN wget -q -O - https://sh.rustup.rs | sh -s -- -y
 ---> Using cache
 ---> 03923db068a7
Step 7/24 : RUN apt-get remove --purge -y wget unzip && apt-get autoremove -y && rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> 11155429ed74
Step 8/24 : COPY requirements.txt .
 ---> Using cache
 ---> 04b07eb2862a
Step 9/24 : RUN python3.11 -m venv /venv
 ---> Using cache
 ---> ab1c42366a7d
Step 10/24 : ENV PATH="/venv/bin:$PATH"
 ---> Using cache
 ---> aceec49c0fae
Step 11/24 : RUN pip install --no-cache-dir --upgrade pip &&     pip install --no-cache-dir tiktoken &&     pip install --no-cache-dir -r requirements.txt
 ---> Using cache
 ---> b2e4f5a6b4ac
Step 12/24 : FROM ubuntu:24.04 as final
 ---> 59ab366372d5
Step 13/24 : RUN apt-get update &&     apt-get install -y software-properties-common &&     add-apt-repository ppa:deadsnakes/ppa &&     apt-get update && apt-get install -y --no-install-recommends python3.11 &&     ln -s /usr/bin/python3.11 /usr/bin/python &&     rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> cf7cdcb4aba8
Step 14/24 : WORKDIR /app
 ---> Using cache
 ---> ae376f13d8d6
Step 15/24 : RUN groupadd -r appuser &&     useradd -r -g appuser -d /app -s /sbin/nologin -c "Docker image user" appuser
 ---> Using cache
 ---> f5fefdbea95c
Step 16/24 : COPY --from=builder /venv /venv
 ---> Using cache
 ---> 746c03745eea
Step 17/24 : COPY --from=builder /model /app/model
 ---> Using cache
 ---> 7ed03b62aaa9
Step 18/24 : COPY . /app/application
 ---> Using cache
 ---> 360278205d2c
Step 19/24 : RUN mkdir -p /app/application/inputs/local
 ---> Using cache
 ---> cf17dd5709a7
Step 20/24 : RUN chown -R appuser:appuser /app
 ---> Using cache
 ---> fc6c392f2cb1
Step 21/24 : ENV FLASK_APP=app.py     FLASK_DEBUG=true     PATH="/venv/bin:$PATH"
 ---> Using cache
 ---> 56ec8a9fb4a6
Step 22/24 : EXPOSE 7091
 ---> Using cache
 ---> 6ac6cba8b490
Step 23/24 : USER appuser
 ---> Using cache
 ---> 459200219891
Step 24/24 : CMD ["gunicorn", "-w", "2", "--timeout", "120", "--bind", "0.0.0.0:7091", "application.wsgi:app"]
 ---> Using cache
 ---> b78d53f273a0
Successfully built b78d53f273a0
Successfully tagged docsgpt_worker:latest
Building backend
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  331.3kB
Step 1/24 : FROM ubuntu:24.04 as builder
 ---> 59ab366372d5
Step 2/24 : ENV DEBIAN_FRONTEND=noninteractive
 ---> Using cache
 ---> 1f3a50573902
Step 3/24 : RUN apt-get update &&     apt-get install -y software-properties-common &&     add-apt-repository ppa:deadsnakes/ppa &&     apt-get update &&     apt-get install -y --no-install-recommends gcc wget unzip libc6-dev python3.11 python3.11-distutils python3.11-venv &&     rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> 7a6395833fb3
Step 4/24 : RUN if [ -f /usr/bin/python3.11 ]; then         ln -s /usr/bin/python3.11 /usr/bin/python;     else         echo "Python 3.11 not found"; exit 1;     fi
 ---> Using cache
 ---> 5be52b29da5c
Step 5/24 : RUN wget https://d3dg1063dc54p9.cloudfront.net/models/embeddings/mpnet-base-v2.zip &&     unzip mpnet-base-v2.zip -d model &&     rm mpnet-base-v2.zip
 ---> Using cache
 ---> b6512cc7bcb6
Step 6/24 : RUN wget -q -O - https://sh.rustup.rs | sh -s -- -y
 ---> Using cache
 ---> 03923db068a7
Step 7/24 : RUN apt-get remove --purge -y wget unzip && apt-get autoremove -y && rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> 11155429ed74
Step 8/24 : COPY requirements.txt .
 ---> Using cache
 ---> 04b07eb2862a
Step 9/24 : RUN python3.11 -m venv /venv
 ---> Using cache
 ---> ab1c42366a7d
Step 10/24 : ENV PATH="/venv/bin:$PATH"
 ---> Using cache
 ---> aceec49c0fae
Step 11/24 : RUN pip install --no-cache-dir --upgrade pip &&     pip install --no-cache-dir tiktoken &&     pip install --no-cache-dir -r requirements.txt
 ---> Using cache
 ---> b2e4f5a6b4ac
Step 12/24 : FROM ubuntu:24.04 as final
 ---> 59ab366372d5
Step 13/24 : RUN apt-get update &&     apt-get install -y software-properties-common &&     add-apt-repository ppa:deadsnakes/ppa &&     apt-get update && apt-get install -y --no-install-recommends python3.11 &&     ln -s /usr/bin/python3.11 /usr/bin/python &&     rm -rf /var/lib/apt/lists/*
 ---> Using cache
 ---> cf7cdcb4aba8
Step 14/24 : WORKDIR /app
 ---> Using cache
 ---> ae376f13d8d6
Step 15/24 : RUN groupadd -r appuser &&     useradd -r -g appuser -d /app -s /sbin/nologin -c "Docker image user" appuser
 ---> Using cache
 ---> f5fefdbea95c
Step 16/24 : COPY --from=builder /venv /venv
 ---> Using cache
 ---> 746c03745eea
Step 17/24 : COPY --from=builder /model /app/model
 ---> Using cache
 ---> 7ed03b62aaa9
Step 18/24 : COPY . /app/application
 ---> Using cache
 ---> 360278205d2c
Step 19/24 : RUN mkdir -p /app/application/inputs/local
 ---> Using cache
 ---> cf17dd5709a7
Step 20/24 : RUN chown -R appuser:appuser /app
 ---> Using cache
 ---> fc6c392f2cb1
Step 21/24 : ENV FLASK_APP=app.py     FLASK_DEBUG=true     PATH="/venv/bin:$PATH"
 ---> Using cache
 ---> 56ec8a9fb4a6
Step 22/24 : EXPOSE 7091
 ---> Using cache
 ---> 6ac6cba8b490
Step 23/24 : USER appuser
 ---> Using cache
 ---> 459200219891
Step 24/24 : CMD ["gunicorn", "-w", "2", "--timeout", "120", "--bind", "0.0.0.0:7091", "application.wsgi:app"]
 ---> Using cache
 ---> b78d53f273a0
Successfully built b78d53f273a0
Successfully tagged docsgpt_backend:latest
Building frontend
DEPRECATED: The legacy builder is deprecated and will be removed in a future release.
            Install the buildx component to build images with BuildKit:
            https://docs.docker.com/go/buildx/

Sending build context to Docker daemon  2.047MB
Step 1/7 : FROM node:20.6.1-bullseye-slim
 ---> 7fd43d8ade4c
Step 2/7 : WORKDIR /app
 ---> Using cache
 ---> 28f0fc0ddd84
Step 3/7 : COPY package*.json ./
 ---> Using cache
 ---> 904a5059c1ff
Step 4/7 : RUN npm install
 ---> Using cache
 ---> 4d11a1f918ab
Step 5/7 : COPY . .
 ---> Using cache
 ---> 18734cbb39a1
Step 6/7 : EXPOSE 5173
 ---> Using cache
 ---> 81207546b988
Step 7/7 : CMD [ "npm", "run", "dev", "--" , "--host"]
 ---> Using cache
 ---> d38ffd56e9d0
Successfully built d38ffd56e9d0
Successfully tagged docsgpt_frontend:latest
WARNING: The API_KEY variable is not set. Defaulting to a blank string.
Starting docsgpt_redis_1 ... done
Starting docsgpt_mongo_1 ... done
Starting docsgpt_backend_1 ... done
Starting docsgpt_worker_1   ... done
Starting docsgpt_frontend_1 ... done
Attaching to docsgpt_redis_1, docsgpt_mongo_1, docsgpt_backend_1, docsgpt_worker_1, docsgpt_frontend_1
backend_1   | [2024-10-30 02:08:24 +0000] [1] [INFO] Starting gunicorn 23.0.0
backend_1   | [2024-10-30 02:08:24 +0000] [1] [INFO] Listening at: http://0.0.0.0:7091 (1)
backend_1   | [2024-10-30 02:08:24 +0000] [1] [INFO] Using worker: sync
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.674+00:00"},"s":"I",  "c":"NETWORK",  "id":4915701, "ctx":"-","msg":"Initialized wire specification","attr":{"spec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true}}}
backend_1   | [2024-10-30 02:08:24 +0000] [7] [INFO] Booting worker with pid: 7
backend_1   | [2024-10-30 02:08:24 +0000] [8] [INFO] Booting worker with pid: 8
redis_1     | 1:C 30 Oct 2024 02:08:24.593 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
redis_1     | 1:C 30 Oct 2024 02:08:24.593 # Redis version=6.2.16, bits=64, commit=00000000, modified=0, pid=1, just started
redis_1     | 1:C 30 Oct 2024 02:08:24.593 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
redis_1     | 1:M 30 Oct 2024 02:08:24.593 # You requested maxclients of 10000 requiring at least 10032 max file descriptors.
redis_1     | 1:M 30 Oct 2024 02:08:24.593 # Server can't set maximum open files to 10032 because of OS error: Operation not permitted.
redis_1     | 1:M 30 Oct 2024 02:08:24.593 # Current maximum open files is 1024. maxclients has been reduced to 992 to compensate for low ulimit. If you need higher maxclients increase 'ulimit -n'.
redis_1     | 1:M 30 Oct 2024 02:08:24.593 * monotonic clock: POSIX clock_gettime
redis_1     | 1:M 30 Oct 2024 02:08:24.593 * Running mode=standalone, port=6379.
redis_1     | 1:M 30 Oct 2024 02:08:24.593 # Server initialized
redis_1     | 1:M 30 Oct 2024 02:08:24.593 # WARNING Memory overcommit must be enabled! Without it, a background save or replication may fail under low memory condition. Being disabled, it can can also cause failures without low memory condition, see https://github.com/jemalloc/jemalloc/issues/1328. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.676+00:00"},"s":"I",  "c":"CONTROL",  "id":23285,   "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.676+00:00"},"s":"I",  "c":"NETWORK",  "id":4648601, "ctx":"main","msg":"Implicit TCP FastOpen unavailable. If TCP FastOpen is required, set tcpFastOpenServer, tcpFastOpenClient, and tcpFastOpenQueueSize."}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.677+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationDonorService","namespace":"config.tenantMigrationDonors"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.677+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"TenantMigrationRecipientService","namespace":"config.tenantMigrationRecipients"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.677+00:00"},"s":"I",  "c":"REPL",     "id":5123008, "ctx":"main","msg":"Successfully registered PrimaryOnlyService","attr":{"service":"ShardSplitDonorService","namespace":"config.tenantSplitDonors"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.677+00:00"},"s":"I",  "c":"CONTROL",  "id":5945603, "ctx":"main","msg":"Multi threading initialized"}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.678+00:00"},"s":"I",  "c":"CONTROL",  "id":4615611, "ctx":"initandlisten","msg":"MongoDB starting","attr":{"pid":1,"port":27017,"dbPath":"/data/db","architecture":"64-bit","host":"ff66d8a27eb9"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.678+00:00"},"s":"I",  "c":"CONTROL",  "id":23403,   "ctx":"initandlisten","msg":"Build Info","attr":{"buildInfo":{"version":"6.0.19","gitVersion":"a7ada5ff3a4d8a1e2ed88f86bd6b3d1d16cb43c6","openSSLVersion":"OpenSSL 3.0.2 15 Mar 2022","modules":[],"allocator":"tcmalloc","environment":{"distmod":"ubuntu2204","distarch":"x86_64","target_arch":"x86_64"}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.678+00:00"},"s":"I",  "c":"CONTROL",  "id":51765,   "ctx":"initandlisten","msg":"Operating System","attr":{"os":{"name":"Ubuntu","version":"22.04"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.678+00:00"},"s":"I",  "c":"CONTROL",  "id":21951,   "ctx":"initandlisten","msg":"Options set by command line","attr":{"options":{"net":{"bindIp":"*"}}}}
redis_1     | 1:M 30 Oct 2024 02:08:24.594 * Loading RDB produced by version 6.2.16
redis_1     | 1:M 30 Oct 2024 02:08:24.594 * RDB age 134 seconds
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.679+00:00"},"s":"I",  "c":"STORAGE",  "id":22270,   "ctx":"initandlisten","msg":"Storage engine to use detected by data files","attr":{"dbpath":"/data/db","storageEngine":"wiredTiger"}}
redis_1     | 1:M 30 Oct 2024 02:08:24.594 * RDB memory usage when created 0.32 Mb
redis_1     | 1:M 30 Oct 2024 02:08:24.594 # Done loading RDB, keys loaded: 1, keys expired: 0.
redis_1     | 1:M 30 Oct 2024 02:08:24.594 * DB loaded from disk: 0.000 seconds
redis_1     | 1:M 30 Oct 2024 02:08:24.594 * Ready to accept connections
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.679+00:00"},"s":"I",  "c":"STORAGE",  "id":22315,   "ctx":"initandlisten","msg":"Opening WiredTiger","attr":{"config":"create,cache_size=15210M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,remove=true,path=journal,compressor=snappy),builtin_extension_config=(zstd=(compression_level=6)),file_manager=(close_idle_time=600,close_scan_interval=10,close_handle_minimum=2000),statistics_log=(wait=0),json_output=(error,message),verbose=[recovery_progress:1,checkpoint_progress:1,compact_progress:1,backup:0,checkpoint:0,compact:0,evict:0,history_store:0,recovery:0,rts:0,salvage:0,tiered:0,timestamp:0,transaction:0,verify:0,log:0],"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.767+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254104,"ts_usec":766960,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Recovering log 3 through 4"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.800+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254104,"ts_usec":800403,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Recovering log 4 through 4"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.861+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254104,"ts_usec":861542,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Main recovery loop: starting at 3/5376 to 4/256"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.929+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254104,"ts_usec":929002,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Recovering log 3 through 4"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:24.976+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254104,"ts_usec":976157,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Recovering log 4 through 4"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.011+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":11614,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"recovery log replay has successfully finished and ran for 244 milliseconds"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.011+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":11704,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Set global recovery timestamp: (0, 0)"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.011+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":11714,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"Set global oldest timestamp: (0, 0)"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.011+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":11878,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"recovery rollback to stable has successfully finished and ran for 0 milliseconds"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.013+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":13279,"thread":"1:0x7f031b61bcc0","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 1, snapshot max: 1 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1313"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.020+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":20303,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"recovery checkpoint has successfully finished and ran for 8 milliseconds"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.020+00:00"},"s":"I",  "c":"WTRECOV",  "id":22430,   "ctx":"initandlisten","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254105,"ts_usec":20379,"thread":"1:0x7f031b61bcc0","session_name":"txn-recover","category":"WT_VERB_RECOVERY_PROGRESS","category_id":30,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"recovery was completed successfully and took 253ms, including 244ms for the log replay, 0ms for the rollback to stable, and 8ms for the checkpoint."}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.021+00:00"},"s":"I",  "c":"STORAGE",  "id":4795906, "ctx":"initandlisten","msg":"WiredTiger opened","attr":{"durationMillis":342}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.021+00:00"},"s":"I",  "c":"RECOVERY", "id":23987,   "ctx":"initandlisten","msg":"WiredTiger recoveryTimestamp","attr":{"recoveryTimestamp":{"$timestamp":{"t":0,"i":0}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.025+00:00"},"s":"W",  "c":"CONTROL",  "id":22120,   "ctx":"initandlisten","msg":"Access control is not enabled for the database. Read and write access to data and configuration is unrestricted","tags":["startupWarnings"]}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.025+00:00"},"s":"W",  "c":"CONTROL",  "id":22184,   "ctx":"initandlisten","msg":"Soft rlimits for open file descriptors too low","attr":{"currentValue":1024,"recommendedMinimum":64000},"tags":["startupWarnings"]}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.027+00:00"},"s":"I",  "c":"NETWORK",  "id":4915702, "ctx":"initandlisten","msg":"Updated wire specification","attr":{"oldSpec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":0,"maxWireVersion":17},"outgoing":{"minWireVersion":6,"maxWireVersion":17},"isInternalClient":true},"newSpec":{"incomingExternalClient":{"minWireVersion":0,"maxWireVersion":17},"incomingInternalClient":{"minWireVersion":17,"maxWireVersion":17},"outgoing":{"minWireVersion":17,"maxWireVersion":17},"isInternalClient":true}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.027+00:00"},"s":"I",  "c":"REPL",     "id":5853300, "ctx":"initandlisten","msg":"current featureCompatibilityVersion value","attr":{"featureCompatibilityVersion":"6.0","context":"startup"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.027+00:00"},"s":"I",  "c":"STORAGE",  "id":5071100, "ctx":"initandlisten","msg":"Clearing temp directory"}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.028+00:00"},"s":"I",  "c":"CONTROL",  "id":20536,   "ctx":"initandlisten","msg":"Flow Control is enabled on this deployment"}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.028+00:00"},"s":"I",  "c":"FTDC",     "id":20625,   "ctx":"initandlisten","msg":"Initializing full-time diagnostic data capture","attr":{"dataDirectory":"/data/db/diagnostic.data"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.031+00:00"},"s":"I",  "c":"REPL",     "id":6015317, "ctx":"initandlisten","msg":"Setting new configuration state","attr":{"newState":"ConfigReplicationDisabled","oldState":"ConfigPreStart"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.031+00:00"},"s":"I",  "c":"STORAGE",  "id":22262,   "ctx":"initandlisten","msg":"Timestamp monitor starting"}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.032+00:00"},"s":"I",  "c":"NETWORK",  "id":23015,   "ctx":"listener","msg":"Listening on","attr":{"address":"/tmp/mongodb-27017.sock"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.032+00:00"},"s":"I",  "c":"NETWORK",  "id":23015,   "ctx":"listener","msg":"Listening on","attr":{"address":"0.0.0.0"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.032+00:00"},"s":"I",  "c":"NETWORK",  "id":23016,   "ctx":"listener","msg":"Waiting for connections","attr":{"port":27017,"ssl":"off"}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.032+00:00"},"s":"I",  "c":"CONTROL",  "id":8423403, "ctx":"initandlisten","msg":"mongod startup complete","attr":{"Summary of time elapsed":{"Startup from clean shutdown?":true,"Statistics":{"Transport layer setup":"0 ms","Run initial syncer crash recovery":"0 ms","Create storage engine lock file in the data directory":"0 ms","Create storage engine lock file in the data directory":"0 ms","Get metadata describing storage engine":"0 ms","Get metadata describing storage engine":"0 ms","Validate options in metadata against current startup options":"0 ms","Validate options in metadata against current startup options":"0 ms","Create storage engine":"0 ms","Create storage engine":"343 ms","Write current PID to file":"0 ms","Write current PID to file":"0 ms","Initialize FCV before rebuilding indexes":"0 ms","Initialize FCV before rebuilding indexes":"2 ms","Drop abandoned idents and get back indexes that need to be rebuilt or builds that need to be restarted":"0 ms","Drop abandoned idents and get back indexes that need to be rebuilt or builds that need to be restarted":"0 ms","Rebuild indexes for collections":"0 ms","Rebuild indexes for collections":"0 ms","Build user and roles graph":"0 ms","Set up the background thread pool responsible for waiting for opTimes to be majority committed":"0 ms","Start up the replication coordinator":"2 ms","Start transport layer":"1 ms","_initAndListen total elapsed time":"354 ms"}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.068+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.4:56928","uuid":"4a7dfd99-a953-4d82-bf1d-f3ca4f03addb","connectionId":1,"connectionCount":1}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.068+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn1","msg":"client metadata","attr":{"remote":"172.18.0.4:56928","client":"conn1","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.070+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.4:56936","uuid":"5524a1fe-1587-4aaa-b456-8ec433ac7c35","connectionId":2,"connectionCount":2}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.070+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn2","msg":"client metadata","attr":{"remote":"172.18.0.4:56936","client":"conn2","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.115+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.4:56938","uuid":"9462e2fa-3a74-4f5d-8cac-bfa19dbf2ad3","connectionId":3,"connectionCount":3}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.115+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn3","msg":"client metadata","attr":{"remote":"172.18.0.4:56938","client":"conn3","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.116+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.4:56948","uuid":"07fbe5b7-b2a3-4e2f-a611-9d04d02d2490","connectionId":4,"connectionCount":4}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.117+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn4","msg":"client metadata","attr":{"remote":"172.18.0.4:56948","client":"conn4","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.129+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.5:43462","uuid":"bdb3d46f-c8b3-4271-bc43-067259a9dc08","connectionId":5,"connectionCount":5}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.130+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn5","msg":"client metadata","attr":{"remote":"172.18.0.5:43462","client":"conn5","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.132+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.5:43474","uuid":"18791631-41cb-455d-8388-3d3eb1585fdc","connectionId":6,"connectionCount":6}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:25.133+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn6","msg":"client metadata","attr":{"remote":"172.18.0.5:43474","client":"conn6","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
frontend_1  | 
frontend_1  | > [email protected] dev
frontend_1  | > vite --host
frontend_1  | 
frontend_1  | 
frontend_1  |   VITE v5.4.6  ready in 122 ms
frontend_1  | 
frontend_1  |   ➜  Local:   http://localhost:5173/
frontend_1  |   ➜  Network: http://172.18.0.6:5173/
mongo_1     | {"t":{"$date":"2024-10-30T02:08:28.397+00:00"},"s":"I",  "c":"NETWORK",  "id":22943,   "ctx":"listener","msg":"Connection accepted","attr":{"remote":"172.18.0.5:43490","uuid":"87c99211-7cd6-4b90-93e3-a823192da147","connectionId":7,"connectionCount":7}}
.
.
.
.
.
mongo_1     | {"t":{"$date":"2024-10-30T02:08:28.463+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn22","msg":"client metadata","attr":{"remote":"172.18.0.5:43554","client":"conn22","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
worker_1    |  
worker_1    |  -------------- celery@013e064787f3 v5.3.6 (emerald-rush)
worker_1    | --- ***** ----- 
worker_1    | -- ******* ---- Linux-6.11.3-200.fc40.x86_64-x86_64-with-glibc2.39 2024-10-30 02:08:28
worker_1    | - *** --- * --- 
worker_1    | - ** ---------- [config]
worker_1    | - ** ---------- .> app:         application.celery_init:0x7f009e2ac050
worker_1    | - ** ---------- .> transport:   redis://redis:6379/0
worker_1    | - ** ---------- .> results:     redis://redis:6379/1
worker_1    | - *** --- * --- .> concurrency: 22 (prefork)
worker_1    | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
worker_1    | --- ***** ----- 
worker_1    |  -------------- [queues]
worker_1    |                 .> celery           exchange=celery(direct) key=celery
worker_1    |                 
worker_1    | 
worker_1    | [tasks]
worker_1    |   . application.api.user.tasks.ingest
worker_1    |   . application.api.user.tasks.ingest_remote
worker_1    |   . application.api.user.tasks.schedule_syncs
worker_1    | 
backend_1   | USER_AGENT environment variable not set, consider setting it to identify your requests.
.
.
.
.
.
mongo_1     | {"t":{"$date":"2024-10-30T02:08:28.528+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn30","msg":"client metadata","attr":{"remote":"172.18.0.4:57094","client":"conn30","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:08:28.528+00:00"},"s":"I",  "c":"NETWORK",  "id":51800,   "ctx":"conn31","msg":"client metadata","attr":{"remote":"172.18.0.4:57110","client":"conn31","negotiatedCompressors":[],"doc":{"driver":{"name":"PyMongo","version":"4.8.0"},"os":{"type":"Linux","name":"Linux","architecture":"x86_64","version":"6.11.3-200.fc40.x86_64"},"platform":"CPython 3.11.10.final.0","env":{"container":{"runtime":"docker"}}}}}
worker_1    | [2024-10-30 02:08:32,088] WARNING in warnings: /venv/lib/python3.11/site-packages/celery/worker/consumer/consumer.py:507: CPendingDeprecationWarning: The broker_connection_retry configuration setting will no longer determine
worker_1    | whether broker connection retries are made during startup in Celery 6.0 and above.
worker_1    | If you wish to retain the existing behavior for retrying connections on startup,
worker_1    | you should set broker_connection_retry_on_startup to True.
worker_1    |   warnings.warn(
worker_1    | 
worker_1    | [2024-10-30 02:08:32,092] INFO in beat: beat: Starting...
worker_1    | [2024-10-30 02:08:32,093] INFO in connection: Connected to redis://redis:6379/0
worker_1    | [2024-10-30 02:08:32,094] WARNING in warnings: /venv/lib/python3.11/site-packages/celery/worker/consumer/consumer.py:507: CPendingDeprecationWarning: The broker_connection_retry configuration setting will no longer determine
worker_1    | whether broker connection retries are made during startup in Celery 6.0 and above.
worker_1    | If you wish to retain the existing behavior for retrying connections on startup,
worker_1    | you should set broker_connection_retry_on_startup to True.
worker_1    |   warnings.warn(
worker_1    | 
worker_1    | [2024-10-30 02:08:32,096] INFO in mingle: mingle: searching for neighbors
worker_1    | [2024-10-30 02:08:33,101] INFO in mingle: mingle: all alone
mongo_1     | {"t":{"$date":"2024-10-30T02:09:25.027+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254165,"ts_usec":27145,"thread":"1:0x7f0311600640","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 3, snapshot max: 3 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1313"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:10:25.034+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254225,"ts_usec":34506,"thread":"1:0x7f0311600640","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 6, snapshot max: 6 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1313"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:11:25.043+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254285,"ts_usec":43177,"thread":"1:0x7f0311600640","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 8, snapshot max: 8 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1313"}}}
mongo_1     | {"t":{"$date":"2024-10-30T02:12:25.053+00:00"},"s":"I",  "c":"WTCHKPT",  "id":22430,   "ctx":"Checkpointer","msg":"WiredTiger message","attr":{"message":{"ts_sec":1730254345,"ts_usec":53108,"thread":"1:0x7f0311600640","session_name":"WT_SESSION.checkpoint","category":"WT_VERB_CHECKPOINT_PROGRESS","category_id":6,"verbose_level":"DEBUG","verbose_level_id":1,"msg":"saving checkpoint snapshot min: 10, snapshot max: 10 snapshot count: 0, oldest timestamp: (0, 0) , meta checkpoint timestamp: (0, 0) base write gen: 1313"}}}
backend_1   | [2024-10-30 02:13:13,524] INFO in routes: /stream - request_data: {'question': 'Hi', 'history': '[{"prompt":"Hi"}]', 'conversation_id': None, 'prompt_id': 'default', 'chunks': '2', 'token_limit': 2000, 'isNoneDoc': False, 'retriever': 'classic'}, source: {}
backend_1   | /venv/lib/python3.11/site-packages/transformers/tokenization_utils_base.py:1601: FutureWarning: `clean_up_tokenization_spaces` was not set. It will be set to `True` by default. This behavior will be depracted in transformers v4.45, and will be then set to `False` by default. For more details check this issue: https://github.com/huggingface/transformers/issues/31884
backend_1   |   warnings.warn(
backend_1   | [2024-10-30 02:13:13,635] INFO in loader: Loading faiss with AVX2 support.
backend_1   | [2024-10-30 02:13:13,646] INFO in loader: Successfully loaded faiss with AVX2 support.
Batches: 100%|██████████| 1/1 [00:00<00:00, 19.65it/s]
Batches:   0%|          | 0/1 [00:00<?, ?it/s][Document(page_content='\n\nContributor Covenant Code of Conduct\n\n \n\nOur Pledge\n\nWe as members, contributors and leaders pledge to make participation in our\ncommunity, a harassment-free experience for everyone, regardless of age, body\nsize, visible or invisible disability, ethnicity, sex characteristics, gender\nidentity and expression, level of experience, education, socio-economic status,\nnationality, personal appearance, race, religion or sexual identity\nand orientation.\n\nWe pledge to act and interact in ways that contribute to an open, welcoming,\ndiverse, inclusive and a healthy community.\n\n \n\nOur Standards\n\nExamples of behavior that contribute to a positive environment for our\ncommunity include:\n\n', metadata={'title': 'inputs/local/DocsGPT-main.zip/DocsGPT-main/CODE_OF_CONDUCT.md', 'store': 'local/DocsGPT-main.zip'}), Document(page_content='\n\n🌐 If you are looking to contribute to frontend (⚛React, Vite):\n\n- The current frontend is being migrated from `/application` to `/frontend` with a new design, so please contribute to the new one.\n- Check out this milestone and its issues.\n- The updated Figma design can be found here.\n\nPlease try to follow the guidelines.\n\n', metadata={'title': 'inputs/local/DocsGPT-main.zip/DocsGPT-main/extensions/web-widget/README.md', 'store': 'local/DocsGPT-main.zip'})]
Batches: 100%|██████████| 1/1 [00:00<00:00, 63.44it/s]
backend_1   | err Please install llama_cpp using pip install llama-cpp-python

👀 Have you spent some time to check if this bug has been raised before?

• I checked and didn't find similar issue

🔗 Are you willing to submit PR?

Yes, I am willing to submit a PR!

🧑‍⚖️ Code of Conduct

• I agree to follow this project's Code of Conduct

[dartpain]

Lets create a message or a warning to a user that they need to install this dependency, im not sure if this dependency needs to be installed by default

[irmoktran]

Looking around on requirements.txt I noticed that python-llama-cpp is not being installed, so I made two changes:

1. Added the build-essentials package be installed by APT to ./application/Dockerfile

Builder Stage

.
.
apt-get install -y software-properties-common build-essential && \

2. Added llama_cpp_python to the ./application/requirements.txt at the end of the file
   llama_cpp_python==0.3.1

This causes the application to find the Llama package, however now the application complains that the model does not exist. Should I report this here or open another issue?

[dartpain]

Yeah, I would suggest we have an error message instead of adding it as a dependency to our requirements.txt file.
Otherwise we will have too many dependencies. As per my previous message

[dartpain]

Issue with your model not existing is because you dont have it in your model/ directory.
Check out setup.sh script