Good Outcomes

  • Test fails and finds a fault (TP)
  • Test passes and there is no fault (TN)

Flaky Outcomes

  • A test fails but no fault is found in software (FP)
  • A test passes but a fauly slips through to production (FN)