AB Test Bloody Everything/ Unlocking the Benefits of AB Testing

Matt Heaney

⏱ 60 minute session
09:30-10:30, Friday, 24th May 2024
I have a golden rule: AB test everything.

When working on an app, you'll find yourself making decisions about nearly everything. Questions like, 'Which wording works best here?' or 'Which design should I use for this screen' are common. Every choice, no matter how small, can have a significant impact on your app's performance and overall quality. Making the right decisions is critical.

However, even with extensive research, making the right decisions can be extremely challenging.

That's where AB testing comes into play. AB testing allows you to run experiments within your app to try out different variants and measure their impact. Building up this system successfully will let you AB test as much as possible in a quick and safe way, which leads to better results.

This talk provides everything you need to get started with an AB testing system. We'll cover:

  • What are AB tests?
  • Why are AB Tests important?
  • Tools for running AB Tests
  • Key tips for maximizing the benefits of AB Tests
  • Code architectures for implementing AB Tests
  • Running unit tests and UI tests on AB Tests

Oh, and when I say 'AB test everything’, I mean everything. So, let's treat this talk as an AB test itself! The presentation is divided into 2 halves, each approaching AB testing from a different angle and style.

Which half will you prefer?

🏷 AB Tests
🏷 iOS
🏷 Architecture
🏷 Results
🏷 Experiment
🏷 Experimental
🏷 System

Matt Heaney

My name is Matt Heaney, and I am a senior iOS engineer. I currently work as a contract engineer while also running my own company called Hacked Reality Studio. I've been coding for over 10 years after teaching myself to code using online resources.

I enjoy giving back to the community in any way I can and teaching code online. Previously, I focused on teaching through my YouTube channel called 'Matt Heaney Apps,' which had over 19,000 subscribers. I continue to teach iOS app development and Swift through LinkedIn, where I have over 3,000 followers.

While my main focus is currently on contracting, I aim to get back into creating my own apps for the App Store. In 2014, I developed a Christmas app that received over 700,000 downloads and topped the entertainment charts in the UK.

My primary goals are to continue growing my skills as an iOS engineer to become a world-class developer. In 2024, I plan to work towards this by traveling to conferences all over the world and pursuing my ultimate goal of delivering talks at these conferences