ML Battle Stories

Alaa shares their experiences in working on ML projects. In one example, their team attempted to introduce a new deep neural net architecture for predicting ad clicks but encountered challenges in revamping the entire ecosystem around the model. After overcoming these challenges, the team faced a new issue where the model suddenly stopped working. They discovered that the issue was caused by applying a log transform to a feature with a parallel distribution, resulting in NAND predictions when the feature became zero.