A comprehensive and consistent theory of estimation, including a description of a powerful new tool, the generalized maximum capacity estimator.