But... Do the machines know when they know nothing?
Today will be the recommendation of educational material — very good series of lectures about Uncertainty Estimation.
From basics, terminology and motivation to methods of estimation for different tasks.
Here. At least, give a chance to the intro.