Matrix Calculus (Matrix-vector derivatives)
How to find derivatives of functions consisting of matrices and vectors? For example:
$$f(x) =x^TA^TAx$$
As I understand $$A^TA$$ can be treated as constant? How to treat $$x^T$$
My intuition tells me that somehow derivative should be taken in terms of product, but not sure product of what?
$$x^T(A^TAx)?$$

Answer
- The questioner was satisfied with and accepted the answer, or
- The answer was evaluated as being 100% correct by the judge.
1 Attachment
-
@Mathe wow, that's great. I will tip you a coffee next time when I will top up my balance. Thanks.
-
@Mathe Hi, I like your way of explanations. Could you take a look into this thread and let me know if you could work on explanation? I will pay you separately(by creating separate thread), just let me know if you can https://matchmaticians.com/questions/setkfa
-
Yes, I can. I would be happy to.
-
@Mathe ok, I will create a separate free question, when you answer I will pay 10$, is it good? (Free so no one will answer it xD)
-
I think we can do that, I can answer it and you can tip me $10 (buy me coffee).
-
@Mathe posted it here https://matchmaticians.com/questions/oy7msa
-
-
@Mathe would you like to explain how backpropagation works? I want to see some example of it for simple MPL(1 input, 1 hidden and 1 output layers). Particularly interested in how Chain Rule is used there
-
I can, but I would need some time to prepare it. When do you want this?
-
today by the end of the day, how much would you like to get?
-
CEST time btw
-
I would have to rush some things, but I could have it in about 5 hours. Because you want such an specific example, I would charge you $70
-
@Mathe oh, that’s too much for me. Sorry for bothering you…
-
No problem. If you are interested I could give you a discount that I have more free time.
-
- answered
- 770 views
- $5.00
Related Questions
- Explain in detail how you use triple integrals to find the volume of the solid.
- Linear Algebra - matrices and vectors
- Calculus Help
- Is $\int_0^1 \frac{\cos x}{x \sin^2 x}dx$ divergent or convergent?
- Help with Business calculus. Finding derivative for X of given function.
- Basic calc help
- Compute the curl of $F=(x^2-\sin (xy), z-cox(y), e^{xy} )$
- Show that $\int_0^{\frac{\pi}{2}}\frac{ x}{ \tan x}dx=\frac{\pi}{2} \ln 2$