Skip to content

Latest commit

 

History

History
54 lines (36 loc) · 2.17 KB

DEPLOY.md

File metadata and controls

54 lines (36 loc) · 2.17 KB
Raw

How to deploy a private AnythingLLM instance on GCP

With a GCP account you can easily deploy a private AnythingLLM instance on GCP. This will create a url that you can access from any browser over HTTP (HTTPS not supported). This single instance will run on your own keys and they will not be exposed - however if you want your instance to be protected it is highly recommend that you set a password one setup is complete.

The output of this cloudformation stack will be:

  • 1 GCP VM
  • 1 Security Group with 0.0.0.0/0 access on Ports 22 & 3001
  • 1 GCP VM Volume gb2 of 10Gib minimum

Requirements

  • An GCP account with billing information.

How to deploy on GCP

Open your terminal

  1. Log in to your GCP account using the following command:

    gcloud auth login

  2. After successful login, Run the following command to create a deployment using the Deployment Manager CLI:


gcloud deployment-manager deployments create anything-llm-deployment --config gcp/deployment/gcp_deploy_anything_llm.yaml

Once you execute these steps, the CLI will initiate the deployment process on GCP based on your configuration file. You can monitor the deployment status and view the outputs using the Google Cloud Console or the Deployment Manager CLI commands.

gcloud compute instances get-serial-port-output anything-llm-instance

ssh into the instance

gcloud compute ssh anything-llm-instance

Delete the deployment

gcloud deployment-manager deployments delete anything-llm-deployment

Please read this notice before submitting issues about your deployment

Note: Your instance will not be available instantly. Depending on the instance size you launched with it can take anywhere from 5-10 minutes to fully boot up.

If you want to check the instances progress, navigate to your deployed instances and connect to your instance via SSH in browser.

Once connected run sudo tail -f /var/log/cloud-init-output.log and wait for the file to conclude deployment of the docker image.

Additionally, your use of this deployment process means you are responsible for any costs of these GCP resources fully.