YOW! Brisbane 2022

Monday Dec 5
11:35 –
Blue Room

A Kafkaesque series of events

You may have heard that Rust eliminates concurrency bugs, and this is largely true. This talk will be a deep-dive into the investigation of a concurrency bug that could not be caught by the Rust type system. We'll walk through the background on the asynchronous messaging systems at OneSignal that process billions of events per day, and discuss how a massive series of unfortunate coincidences caused almost a total stoppage of work.