Adventures with pre-commit

Posted on Wed 30 September 2020 in docs

I started using the pre-commit framework a while back on my projects but only with a very basic setup on pretty simple codebases. Common uses are apply code formatters like black or to run static type checking with mypy. I tried to create a rough framework for my Python projects.


Continue reading

TM1 and Apache Airflow

Posted on Thu 23 July 2020 in tm1

I've seen numerous solutions for handling data integration where data needs to be extracted form TM1. Most end up involving multiple tasks triggered and managed in different tools by different teams. None of the moving parts are particularly complicated but the end to end process can be difficult to debug and it never seems to result in a particularly reusable solution. The introduction of the REST API and development of TM1py have increased the options. I thought it might be interesting to see how Airflow might be used to manage pipelines need data from TM1.


Continue reading

Using pytest to test TM1 models

Posted on Tue 24 March 2020 in tm1

I wanted an excuse to explore TM1py in more depth and had been thinking for a while about the possibilities offered by using a test framework like pytest to run automate tests of a TM1 model. This is really a quick proof of concept to gauge how feasible it might prove.


Continue reading

Cricket Data Sources and Python

Posted on Sat 28 September 2019 in docs

Inspired by an enthralling Ashes series, I wanted to play around with cricket data available from various free and commercial sources out there.. Despite a bit of trawling, I couldn't really find a single document detailing what was available. I've tried to make a start.


Continue reading

Anaconda and Jupyter Cheatsheet

Posted on Mon 26 August 2019 in docs

A bit annoyed at finding myself having to re-learn a good workflow for setting up dev environments for Jupyter projects, I thought I'd try to list my workflow as is and update as I improve so I can refer back after a hiatus.


Continue reading