Beat 1 · The problem
Thousands of failing E2E tests a day, and new ones written slowly, all by hand.
I lead a team that investigates 5,000+ E2E test failures a day for about 200 customers.5 Every failure meant someone reading its logs, its trace and the live page to find the cause, then deciding: is the E2E test wrong, or is the product broken? New E2E tests were slow too: the company expected about 10 a week.3 And every E2E test, new or a teammate's, needed a person to check that it does what its steps say.