Skip to content

Latest commit

 

History

History
81 lines (59 loc) · 2.3 KB

TERRAFORM-README.md

File metadata and controls

81 lines (59 loc) · 2.3 KB
Raw

Terraform template

Get the BTC-USD realtime multi exchange observer running in less than 10 minutes

Architectural overview

Terraform version used in this tutorial: v0.11.13

Providers used:

  • provider.google v2.2.0
  • provider.template v2.1.0

Setup:

  • Open the Terraform Shell and clone the project
git clone https://github.com/GoogleCloudPlatform/professional-services
cd professional-services/examples/cryptorealtime/terraform-setup/
 vim terraform.tfvars
  • Check that everything is working
terraform init
terraform apply

(ignore api enablement errors and/or rerun)

  • Wait 5-10 minutes until the VM startup script is booted

  • Note: Your public IP address will be displayed here or in console

  • SSH into the VM that was created

sudo -s 
cd ~/professional-services/examples/cryptorealtime/
  • Verify the variables from terraform are in place:
echo "PROJECT_ID" $PROJECT_ID  "REGION" $REGION "ZONE" $ZONE "BUCKET_NAME" $BUCKET_NAME "BUCKET_FOLDER" $BUCKET_FOLDER "BIGTABLE_INSTANCE_NAME" $BIGTABLE_INSTANCE_NAME "BIGTABLE_TABLE_NAME" $BIGTABLE_TABLE_NAME "BIGTABLE_FAMILY_NAME" $BIGTABLE_FAMILY_NAME
  • Run the Dataflow job to connect to exchanges
./run.sh ${PROJECT_ID} ${BIGTABLE_INSTANCE_NAME} ${BUCKET_NAME}${BUCKET_FOLDER} ${BIGTABLE_TABLE_NAME} $BIGTABLE_FAMILY_NAME

  • Ignore any java.lang.IllegalThreadStateException

  • Go to frontend script and run the frontend flask server and data visualisation

cd frontend/
python app.py ${PROJECT_ID} ${BIGTABLE_INSTANCE_NAME} ${BIGTABLE_TABLE_NAME} ${BIGTABLE_FAMILY_NAME}
  • Open the VM IP on port 5000 in your browser to see the chart

Cleanup:

  • Delete the Dataflow jobs
gcloud dataflow jobs cancel \
$(gcloud dataflow jobs list \
  --format='value(id)' \
  --filter="name:runthepipeline*")
  • Take down the infrastructure
terraform destroy

Read the post for addtional information:

Terraform