Which of the following statements are correct? (a) The application of gradient descent requires…
Which of the following statements are correct?
(a) The application of gradient descent requires the use of a cost function that is differentiable.
(b) Training a neural network requires the use of both forward propagation and backward propagation. Testing a neural network only requires the use of forward propagation.
(c) The use of the logistic function (that is, the sigmoid function) as the activation function makes an artificial neuron non-linear in nature.
(d) Given is a fully connected neural network that consists of
(i) an input layer with four inputs and one bias unit,
(ii) an output layer with three neurons, and
(iii) a single hidden layer with five neurons and one bias unit. This neural network comes with 42 weights (parameters) that need to be trained.