Unsupervised learning of distributions
Universität Augsburg, Memminger Str. 6, 86135 Augsburg, Germany
Accepted: 16 September 1997
We study unsupervised learning from non-uniformly distributed examples with a single symmetry-breaking orientation when both the distribution and the preferential direction are otherwise completely unknown. For asymptotically high dimensions N of the pattern space the distribution can be inferred exactly from p=O(N) examples up to a well-known remaining uncertainty in the preferential direction. We further discuss implications for supervised learning of a teacher perceptron with unknown transfer function, unsupervised learning with several preferential directions, and architecture optimization.
PACS: 07.05.Kf – Data analysis: algorithms and implementation; data management / 02.50.-r – Probability theory, stochastic processes, and statistics / 05.20.-y – Statistical mechanics
© EDP Sciences, 1997