Discussion about this post

User's avatar
Lane Boland's avatar

Agree that asking people to be continuously vigilant is unreasonable and likely impossible. Another aspect is fatigue… staying highly vigilant for extended periods is taxing and likely counterproductive if able to be done at all.

One option would be to only require an immediate reaction at certain times when the automation is closer to ODD limits and/or the consequences are more severe. Outside those times the reaction time could extend, allowing a slightly lower level of vigilance. Aviation offers one way to consider this: automation generally gives pilots a few seconds of reaction time before anything truly dangerous develops. And during the phases where that buffer shrinks (automated landings, for example) crews shift to more active monitoring, with procedures and redundancy that support immediate intervention if necessary.

ODD has measurable dimensions, so where boundaries are measurable warnings should activate before they’re crossed. These warnings could allow more reaction time for the supervisor to take over as needed.

4 more comments...

No posts

Ready for more?