INCOMPREHENSIBLE SYSTEMS. “There is concern that a dormant “gene” in a medical system or flight control program might express itself without warning, sending the mutant software on an unpredictable rampage. Similarly, poorly defined criteria might allow a self-adapting system to explore dangerous options in its single-minded thrust towards efficiency, placing human lives in peril.”
https://lnkd.in/e5p4fXs