So the better these systems get, the less actual driving the driver does. Which means, when it does fail back to the driver, who is likely doing something else, their skills have degraded / atrophied and they'll be less capable of dealing with the situation.
If you worked from home for months...