Maximum Entropy

BayesianMachineLearningInformationTheoryMachineLearningPhysicsStatistics The Maximum Entropy principle for Density Estimation is to find a distribution that is closest to the uniform distribution . More formally, a maximum entropy distribution solves the optimization problem the dual problem is