Tagged etl

Google Analytics Raw Data: Wrangling

Zero to Hero: From raw data to business-ready assets.

At the nascency of this digital radio product, I focused on establishing big data pipelines to meet business needs for reporting, visualisation, and machine learning applications.

data-modellinganalytics-engineeringetlsnowflakesql

3-Step ETL Reporting Tool

Integrate 5 Brand Data Sources programmatically to populate reporting records.

Management makes use of spend, revenue, and eCommerce metrics to make marketing decisions. The stakeholders had a preference for tables that could be explored by date range and broken down by date.

reportingetlpythonapis

Youtube API Data Extraction

Extract video and channel data from search queries, and store them to a database.

For my first Python project, I wanted to understand popular video topics in a certain niche, and explore Youtube as a data source. One of the largest limitations to the project is the rate limit, which compelled me to consider an ETL process to avoid redundant extraction.

data-engineeringetlpythonpandassqliteapi