A hyperparameter is a parameter of a distribution which models our belief in some unknown parameter.
For example, suppose we observe data points from a Bernoulli(θ) distribution. If the parameter θ is unknown, we might model it as a random variable: &theta ~ Beta(α, β). Here, the constants α and β are hyperparameters.