Skip to content

Latest commit

 

History

History
35 lines (18 loc) · 1.51 KB

README.md

File metadata and controls

35 lines (18 loc) · 1.51 KB

DBT with BigQuery

In this lightning project I challenge myself to create a pipeline using DBT to learn about the tool and use it for the first time. I tried to complete this exercise within the 4 hour period.

Data source

My dataset is a small sample of Walmart sales, very possibly fictitious obtained from the internet.

The Pipeline

image

DBT

I used DBT to connect directly to BigQuery, perform validation of column types and null values. Then, using SQL, I created some views to help me in the final elaboration of the dashboard. The hardest part was following the DBT documentation and making the connection in BigQuery, however the documentation is very well prepared. So it was a quick activity.

image

BigQuery

In the big query I uploaded my data source, created a table, configured my user and obtained my keyfile that was used at DBT profile.yml. In addition, there I was able to visualize my data source in a tabular way and validate my views quickly and simply.

image

Final Dashboard

As final product I delivered this simples dashboard bellow made in just a few minutes.

image