You get alerts when a service experiences undesirable behaviour that needs to be immediately remedied.
After getting an alert, you need to figure out why it was triggered and fix it (which can include rolling back changes).
Use Root Cause Analysis, or past Incident Reports.