edited by
7,394 views
3 3 votes

Assume we have the following neural network and all activation functions are $f(z)=z$. If the weights are initialized with the values you see in table below, what will be new updated weights after one step if learning rate, $\alpha = 0.05$?

Assume the input values are [$i_1$,$i_2$] = [2,3] and target value $out = 1$.

Hint:
$w_{new} = w_{old} - \alpha \frac{\partial E}{\partial w}$

$E_{\text {total}}=\sum \frac{1}{2}(\text {target}-\text {output})^{2}$

Updating weights in backpropagation algorithm
Weights Initialization New weights after one step
$w1$ 0.11 ?
$w2$ 0.21 ?
$w3$ 0.12 ?
$w4$ 0.08 ?
$w5$ 0.14 ?
$w6$ 0.15 ?

50% Accept Rate Accepted 31 answers out of 62 questions

1 Answer

Best answer
1 1 vote

A detailed solution is provided in this URL.

The updated weights are as follows:

Related questions

3 3 votes
1 answers 1 answer
6.0k
6.0k views
tofighi asked Aug 10, 2020
6,007 views
The goal of backpropagation is to optimize the weights so that the neural network can learn how to correctly map arbitrary inputs to outputs.Assume for the following neur...
2 2 votes
1 answers 1 answer
6.6k
6.6k views
tofighi asked Mar 28, 2019
6,628 views
For the below neural network, imagine we are going to use the backpropagation algorithm to update weights. If the Bias (b) in this problem is always 0 (ignore bias when y...
3 3 votes
1 answers 1 answer
9.4k
9.4k views
tofighi asked Apr 4, 2019
9,400 views
In the figure below, a neural network is shown. Calculate the following:1) How many neurons do we have in the input layer and the output layer?2) How many hidden layers d...
3 3 votes
2 answers 2 answers
8.4k
8.4k views
tofighi asked Apr 4, 2019
8,401 views
The scatter plot of Iris Dataset is shown in the figure below. Assume Softmax Regression is used to classify Iris to Setosa, Versicolor, or Viriginica using just petal le...
5 5 votes
1 answers 1 answer
9.1k
9.1k views
tofighi asked Jun 26, 2019
9,103 views
Assume we have a $5\times5$ px RGB image with 3 channels respectively for R, G, and B. IfR2000012001201021210101020G0212211100002202002002111B0100111201102021011012112 We...