I need to use a Multi Layer Perceptron Network in order to perform some non-linear regression. Any ideas if it's possible to perform a task like that and how? Which activation function should be used for that purpose?
thanks!
Theoretical Computer Science Stack Exchange is a question and answer site for theoretical computer scientists and researchers in related fields. It only takes a minute to sign up.
Sign up to join this communityI need to use a Multi Layer Perceptron Network in order to perform some non-linear regression. Any ideas if it's possible to perform a task like that and how? Which activation function should be used for that purpose?
thanks!
Any normal activation function should do. Multi-layer perceptrons are universal approximators, so you should have no problems.
You can find this even on wikipedia. The limitation for perceptrons is linear separability. Intuitively, each new layer allows to classify inputs according to as many parameters as neurons in the the previous layer obtaining a classification in as many dimensions as neurons in the next layer. In short, for one layer you have to keep linear separability, but according to that linear separability you are kind of "bending" (non isomorphic transformation) that hyperspace into a different one, where linear separability may be possible, or at least one layer closer.