“Even seeing part of how a decision was made can give you a lot of insight into the possible ways it can fail,” said Christopher Olah, a Google researcher.
A growing number of A.I. researchers are now developing ways to better understand neural networks. Jeff Clune, a professor at University of Wyoming who now works in the A.I. lab at the ride-hailing company Uber, called this “artificial neuroscience.”