(simple neural network with 2 input and 5 hidden layers)
Take the value from the input, multiply by specific weight and output the result.
Their job is to act together the output from other synapse and apply the activation function
(sigmoid activation function)
And the apply the activation function to every neuron
By vinfinit