How WebSockets cost us $1M on our AWS bill
Inter-process communication (IPC) can result in enormous AWS bills if done inefficiently. Recall.ai discovered that its Python WebSocket client and Chromium's WebSocket implementations were calling two functions that were taking up a majority of its CPU time. This article looks at how the company discovered the issue, why it chose to use WebSockets in the first place, and how it fixed the issue and reduced the CPU usage of its bots by up to 50%. This exercise in optimizing IPC for CPU efficiency reduced Recall.ai's AWS bill by over a million dollars per year.