What is a hyperparameter?
  • A hyperparameter is a parameter of a distribution which models our belief in some unknown parameter.
  • For example, suppose we observe data points from a Bernoulli(θ) distribution. If the parameter θ is unknown, we might model it as a random variable: &theta ~ Beta(α, β). Here, the constants α and β are hyperparameters.

Valid HTML 4.0 Transitional