MACHINE LEARNING TECHNIQUES - LASA
MACHINE LEARNING TECHNIQUES - LASA
MACHINE LEARNING TECHNIQUES - LASA
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
158<br />
Figure 6-17: To determine the convergence of a leaky-integrator neuron with a self-connection, one must<br />
find numerically the value m* for which the derivative of the membrane potential m is zero. Here we have a<br />
*<br />
single stable point<br />
m = 10 for a steady input S=30 with a negative self-connection w 11<br />
=− 20 .<br />
The zeros of the derivative correspond to equilibrium points. These may however be stable or<br />
unstable. A stable point is such that if it slightly pushed away from the stable point, it will<br />
eventually come back to its equilibrium. In contrast, an unstable point is such that a small<br />
perturbation in the input may send the system away from its equilibrium. In Leak-Integrator<br />
Neurons, this is easily achieved and depends on the value of the different parameters, but<br />
especially that of the self-connection. Figure 6-17 and Figure 6-18 illustrate these two cases.<br />
Figure 6-18: Example of a leaky-integrator neuron for a steady input S=30 with a positive selfconnection<br />
w 11<br />
= 20. The system has three equilibrium points at m=0, m=-10 and m=10. m=0 is an<br />
unstable point, whereas m=-10 and m=10 are two stable points. This can be seen by observing that the<br />
slope of m(s) around m=0 is positive, whereas it is negative for m=-10 and m=10 (see left figure).<br />
Stability of the equilibrium points can be determined by looking at the direction of the slope of the<br />
derivative of the membrane potential around the equilibrium point, i.e.:<br />
dm 1<br />
f( m) = ( m S w11x)<br />
dt<br />
= τ<br />
− + + (6.80)<br />
© A.G.Billard 2004 – Last Update March 2011