Can all three criteria ML, MMSE, and LS be called regressor, estimator, and predictor ?

If not, an intuitive explanation of why they can't be, would be good.


1 Answer 1


Let's see:

  • Maximum Likelihood (ML) - A Method to estimate parameters (MLE - Maximum Likelihood Estimator). Given a PDF of samples, what is the parameter value which maximizes the probability of the observations.
  • Least Squares (LS) - Least Squares model for estimating parameters. Sometime coincides with the MLE (Usually in the case of Gaussian Noise).
  • Minimum Means Square Error (MMSE) - Bayesian Estimator based on Loss Function which is the second moment of the error.

All of them are estimators in a model (PDF of Parameters in the ML, Numeric Model in the LS or Bayesian Model for the MMSE).

Predictor is a term for predicting future data based on given data. Any of the method above can do that with different assumption of the model.
Regressor is a term for predicting model parameters from a given data. Again any of the above can be used to do so.

So you need to separate the means you use (Type of estimator and model) for the object you try to achieve (Predict, Regress, Smooth, etc...).

  • $\begingroup$ I can't understand this sentence: "separate the means from the end." $\endgroup$ Commented Jul 7, 2017 at 11:15
  • $\begingroup$ I rephrased it. $\endgroup$
    – Royi
    Commented Jul 7, 2017 at 12:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.