Hi all,
This is my first community post into the forum and I just wanted to share a side-project I’ve been working on.
It’s part of a larger piece of work involving building a data engineering pipeline using the chess.com API.
And I needed to figure out my BigQuery usage patterns to determine my BQ compute cost.
So I’ve created a simple Dash BigQuery application to monitor and forecast data processing trends.
Perhaps you may find the concept useful to incorporate into your own data projects.
Here is the video detailing how I’ve structured the application for any curious folk:
1 Like
pretty useful, @Filpill . Thank you.
So what’s the best way to work with this? Should we clone the repo?
People are free to clone the repo at: https://github.com/Filpill/chess_analysis
The repo has a lot of other stuff going on though besides this BigQuery monitoring tool which may make it more cumbersome to navigate around if only looking for the Dash App.
However, Dash setups are inside in the following directories:
- ./chess_analysis/dash/bq_monitor: Dash script + assets
- ./chess_analysis/docker/bq_monitor: Dockerfile for Dash Application
I have plans to visualize the chess data as well, but its currently still a work in progress.
If you want to try this application on your own BigQuery project:
The application only queries the INFORMATION SCHEMA, so it should be a simple as swapping out the project_id and region inside the FROM clause.
Additionally, you would need to be suitably permission-ed to read your BigQuery metadata into the Dash App.
1 Like
