In this lightning project I challenge myself to create a pipeline using DBT to learn about the tool and use it for the first time. I tried to complete this exercise within the 4 hour period.
My dataset is a small sample of Walmart sales, very possibly fictitious obtained from the internet.
I used DBT to connect directly to BigQuery, perform validation of column types and null values. Then, using SQL, I created some views to help me in the final elaboration of the dashboard. The hardest part was following the DBT documentation and making the connection in BigQuery, however the documentation is very well prepared. So it was a quick activity.
In the big query I uploaded my data source, created a table, configured my user and obtained my keyfile that was used at DBT profile.yml. In addition, there I was able to visualize my data source in a tabular way and validate my views quickly and simply.
As final product I delivered this simples dashboard bellow made in just a few minutes.
