There is one AI metric that we keep a really close eye on:

How many actions can a system take at 99% reliability before a human must intervene?

We call this the 99% step-length: the number of sequential actions an AI can execute with at least 99% reliability without human help

Go to Source