How data gets cleaned – an example

Image courtesy of flickr https://www.flickr.com/photos/compacflt/34496068126/ Anyone interested in data analysis or the broader field of data science may have heard that about 80% of the work entails cleaning data. About a year ago I did some basic analysis on South African Schools data, and I happened to document the cleaning …

How to avoid being disappointed by your Data

The value of data has grown exponentially in the last few years. As people realise that good data and analysis leads to good decisions, there’s a virtuous cycle that calls for more and more data. In digital technology (e.g. cellphones or websites), it’s pretty easy to collect data at every …

A Software Development Guide for Non Profits

Download the much prettier PDF here. Who this guide is for. If you are a Non-Profit, this guide is for you.You might be in an NGO, NPO, NPC, Profit not-for-distribution company, charity, or funding a good cause from your own pocket.   Why specifically these organisations? In many cases, nonprofits …

Lies, Damned Lies & Beautiful Statistics

Lies, Damned Lies & Beautiful Statistics There’s a bit of a worrying trend developing around the world, and that is for people to dismiss data and statistics unless the information is “100% accurate”.  Data and the resulting statistics are too easily cast aside when we don’t trust the source or its …