Projects

Selected data science and analytics work, from raw data to production models.

Recommender systems

Building and evaluating recommendation models.

Rebuilding evaluation calculations for recommendation systems

A lot of models work. Evaluation metrics tell us which ones work well.

Evaluation metrics describe how well a model predicts on unseen data, and are used in fine-tuning. In the Python package "implicit", the evaluation module returned errors for common metrics, such as Normalised Discounted Cumulative Gain (NDCG).

recommender-systemsmachine-learninglinear-algebrapythonpandasnumpyscipy

User churn model

Predicting inactivity using activity, and the lack thereof

Digital media rely on user activity to determine marketable audiences. Being able to predict churning users allow for retention efforts to be put in place. In this project, I defined churn as a 30-day streak of a logged-out state, or 30-day streak of non-listenership.

machine-learningpythonlightgbmoptuna

Google Analytics Raw Data: Wrangling

Zero to Hero: From raw data to business-ready assets.

At the nascency of this digital radio product, I focused on establishing big data pipelines to meet business needs for reporting, visualisation, and machine learning applications.

data-modellinganalytics-engineeringetlsnowflakesql

Ad Request Optimisation

Increased profit margins by limiting ad requests to profitable observations.

Supply-Side Platforms manage ad space by deciding which instances of web traffic would be good to show ads to; however, not all traffic is profitable, and sending these instances to the auction (real-time bidding) can be costly.

machine-learningpythonlightgbmairflowdockerawsoptuna

3-Step ETL Reporting Tool

Integrate 5 Brand Data Sources programmatically to populate reporting records.

Management makes use of spend, revenue, and eCommerce metrics to make marketing decisions. The stakeholders had a preference for tables that could be explored by date range and broken down by date.

reportingetlpythonapis

Exploring mental health incidents in New Zealand Police Data

Explore trends in mental health report misclassifications to the police as indicators of supplementary social services.

In 2021, the New Zealand Police expressed a need to approach call-outs related to mental health issues. To free up the workload of the police force in that regard, it would be good to explore existing trends on mental health-related issues.

exploratory-analysisreportingr

Youtube API Data Extraction

Extract video and channel data from search queries, and store them to a database.

For my first Python project, I wanted to understand popular video topics in a certain niche, and explore Youtube as a data source. One of the largest limitations to the project is the rate limit, which compelled me to consider an ETL process to avoid redundant extraction.

data-engineeringetlpythonpandassqliteapi