Derivative Hadamard Product
I am looking for the solution of this derivative of the Hadamard Product.
a and b are vectors of dimension |V|, W is a Matrix with dimension |V|×|d|
-
What do you mean with the derivative wrt W?
-
I did d some research and it seems to me that there is no commonly accepted definition. Please provide one.
-
The term is part of the backpropagation of my neural network. I need to calculate this derivative to update my weights in the neural network. Hope this helps.
-
The hadamard product is the elemt-wise product of two matrices of the same dimensionality https://en.m.wikipedia.org/wiki/Hadamard_product_(matrices)
-
One can view the product as a function from R^(|V|\times |d|) to R^(|d|). So the derivative may mean just the matrix of partial derivatives. Do you expect the result to be a a |d| by ( |V|\times |d| ) matrix?
-
a and b must be row vectors for this product to make sense.
-
Ideally the result would be in the dimenson of |V|
-
The preferred notation for a vector is as a column vector, so ideally aW would be written as a^t W , meaning a transpose times W. will keep with the notation you used, so that aW is a row vector times a matrix, but this is not a very common notation.
-
I will keep with the notation you used, so that aW is a row vector times a matrix, but this is not a very common notation*
-
I am sorry for any inconvenience with the notation. Of course, a and b would be transposed.
Answer
- The questioner was satisfied and accepted the answer, or
- The answer was disputed, but the judge evaluated it as 100% correct.
1 Attachment
- answered
- 294 views
- $58.00
Related Questions
- Linear Algebra - matrices and vectors
- Explain what the problem means in laymens terms.
- Prove that $\int _0^{\infty} \frac{1}{1+x^{2n}}dx=\frac{\pi}{2n}\csc (\frac{\pi}{2n})$
- Matrices Linear transformation
- Find eigenvalues and eigenvectors of $\begin{pmatrix} -3 & 0 & 2 \\ 1 &-1 &0\\ -2 & -1& 0 \end{pmatrix} $
- Prove that $\int_{-\infty}^{\infty}\frac{\cos ax}{x^4+1}dx=\frac{\pi}{2}e^{-\frac{a}{\sqrt{2}}}(\cos \frac{a}{\sqrt{2}}+\sin \frac{a}{\sqrt{2}} )$
- Elementary row reduction for an $n\times n$ matrix
- Evluate $\int_{|z|=3}\frac{1}{z^5(z^2+z+1)}\ dz$
