Why I love Excel

It feels a bit weird to write a post about MS Excel, but I feel compelled to and I think it’s because I am a feeling a bit defensive of it lately. People love to hate Excel. From software developers to data analysts and many other professionals, there’s usually a …

How data gets cleaned – an example

Image courtesy of flickr https://www.flickr.com/photos/compacflt/34496068126/ Anyone interested in data analysis or the broader field of data science may have heard that about 80% of the work entails cleaning data. About a year ago I did some basic analysis on South African Schools data, and I happened to document the cleaning …

How to avoid being disappointed by your Data

The value of data has grown exponentially in the last few years. As people realise that good data and analysis leads to good decisions, there’s a virtuous cycle that calls for more and more data. In digital technology (e.g. cellphones or websites), it’s pretty easy to collect data at every …

Lies, Damned Lies & Beautiful Statistics

Lies, Damned Lies & Beautiful Statistics There’s a bit of a worrying trend developing around the world, and that is for people to dismiss data and statistics unless the information is “100% accurate”.  Data and the resulting statistics are too easily cast aside when we don’t trust the source or its …