BayesianMachineLearningMachineLearningStatistics One approach to nonparametric regression is to define the optimal regression function using Bayes rule which suggests using the kernel density estimator of the joint density for i.i.d. data which yields the Nadaraya-Watson estimator with weights given by and when is -Lipschitz has expected error is bound using the Bias-Variance Decomposition