Reading questions

If you are unsure about any of these concepts, post a question on the discussion forum!

  • What is a hidden unit?
  • What is the difference between a hidden unit and an output unit?
  • What is a neuron weight?
  • What is a neuron bias?
  • What is an activation function?
  • What is the sigmoid function?
  • What is the hyperbolic tangent (tanh) function?
  • What is the softmax function?
  • What is the advantage of a hidden layer neural network over a linear classifier?
  • What are synapses, axons and dendrites in a biological neuron?
  • What is an action potential?
  • What is the firing rate of a neuron?