Mixture models

集成思想主要有四类

• committees

• boosting

• space split

• mixture models，例：mixtures of Linear regression，mixtures of logistic models 和mixtures of experts

Mixture models###

通过公式：$p(t|x) = \sum_{k=1}^K \pi_k(x) p_k(t|x)$ 比如：$f(x) = \sum_{k=1}^K \frac {e^{v_k x}}{\sum_{j=1}^K e^{v_j x}} \frac {1}{1+e^{w_k x}}$, 然后用EM求解。