Matrix Calculus (Matrix-vector derivatives)
How to find derivatives of functions consisting of matrices and vectors? For example:
$$f(x) =x^TA^TAx$$
As I understand $$A^TA$$ can be treated as constant? How to treat $$x^T$$
My intuition tells me that somehow derivative should be taken in terms of product, but not sure product of what?
$$x^T(A^TAx)?$$
Babaduras
Answer
- The questioner was satisfied and accepted the answer, or
- The answer was disputed, but the judge evaluated it as 100% correct.
1 Attachment
Mathe
-
@Mathe wow, that's great. I will tip you a coffee next time when I will top up my balance. Thanks.
-
@Mathe Hi, I like your way of explanations. Could you take a look into this thread and let me know if you could work on explanation? I will pay you separately(by creating separate thread), just let me know if you can https://matchmaticians.com/questions/setkfa
-
Yes, I can. I would be happy to.
-
@Mathe ok, I will create a separate free question, when you answer I will pay 10$, is it good? (Free so no one will answer it xD)
-
I think we can do that, I can answer it and you can tip me $10 (buy me coffee).
-
@Mathe posted it here https://matchmaticians.com/questions/oy7msa
-
-
@Mathe would you like to explain how backpropagation works? I want to see some example of it for simple MPL(1 input, 1 hidden and 1 output layers). Particularly interested in how Chain Rule is used there
-
I can, but I would need some time to prepare it. When do you want this?
-
today by the end of the day, how much would you like to get?
-
CEST time btw
-
I would have to rush some things, but I could have it in about 5 hours. Because you want such an specific example, I would charge you $70
-
@Mathe oh, that’s too much for me. Sorry for bothering you…
-
- answered
- 230 views
- $5.00
Related Questions
- Epsilon-delta definitoon of continuity for $f : x → x^3$
- Exponentil bacteria growth
- Show that the $5\times 5$ matrix is not invertable
- Calculus and Vector
- Evaluate $\int_C (2x^3-y^3)dx+(x^3+y^3)dy$, where $C$ is the unit circle.
- Calculus - Differentiation
- Differentiate $f(x)=\int_{\tan x}^{0} \frac{\cos t}{1+e^t}dt$
- Integrate $\int \frac{1}{x^2+x+1}dx$
