Statistical physics of independent component analysis
Institut für theoretische Physik, Universität Würzburg
Am Hubland, D-97074 Würzburg, Germany
Accepted: 1 September 2003
Statistical physics is used to investigate independent component analysis with polynomial contrast functions. While the replica method fails, an adapted cavity approach yields valid results. The learning curves, obtained in a suitable thermodynamic limit, display a first-order phase transition from poor to perfect generalization.
PACS: 89.75.Fb – Structures and organization in complex systems / 84.35.+i – Neural networks / 64.60.Cn – Order-disorder transformations; statistical mechanics of model systems
© EDP Sciences, 2003