Matrix Calculus (Matrix-vector derivatives)
How to find derivatives of functions consisting of matrices and vectors? For example:
$$f(x) =x^TA^TAx$$
As I understand $$A^TA$$ can be treated as constant? How to treat $$x^T$$
My intuition tells me that somehow derivative should be taken in terms of product, but not sure product of what?
$$x^T(A^TAx)?$$
Babaduras
Answer
- The questioner was satisfied with and accepted the answer, or
- The answer was evaluated as being 100% correct by the judge.
1 Attachment
Mathe
-
@Mathe wow, that's great. I will tip you a coffee next time when I will top up my balance. Thanks.
-
@Mathe Hi, I like your way of explanations. Could you take a look into this thread and let me know if you could work on explanation? I will pay you separately(by creating separate thread), just let me know if you can https://matchmaticians.com/questions/setkfa
-
Yes, I can. I would be happy to.
-
@Mathe ok, I will create a separate free question, when you answer I will pay 10$, is it good? (Free so no one will answer it xD)
-
I think we can do that, I can answer it and you can tip me $10 (buy me coffee).
-
@Mathe posted it here https://matchmaticians.com/questions/oy7msa
-
-
@Mathe would you like to explain how backpropagation works? I want to see some example of it for simple MPL(1 input, 1 hidden and 1 output layers). Particularly interested in how Chain Rule is used there
-
I can, but I would need some time to prepare it. When do you want this?
-
today by the end of the day, how much would you like to get?
-
CEST time btw
-
I would have to rush some things, but I could have it in about 5 hours. Because you want such an specific example, I would charge you $70
-
@Mathe oh, that’s too much for me. Sorry for bothering you…
-
No problem. If you are interested I could give you a discount that I have more free time.
-
- answered
- 1402 views
- $5.00
Related Questions
- Compute $\lim _{n \rightarrow \infty} \frac{1}{n}\ln \frac{(2n)!}{n^n n!}$
- Show that the line integral $ \oint_C y z d x + x z d y + x y d z$ is zero along any closed contour C .
- Is $\sum_{i=1}^{\infty}\arctan (\frac{n+1}{n^2+5})$ convergent or divergent?
- Please solve the attached problem from my worksheet
- Calculate the inverse of a triangular matrix
- Find $lim_{x \rightarrow 0^+} x^{\ln x}$
- Exercise on Ito's rule for two correlated stocks.
- Find the area bounded by the graphs of two functions
