Matrix Calculus (Matrix-vector derivatives)

How to find derivatives of functions consisting of matrices and vectors? For example:
$$f(x) =x^TA^TAx$$
As I understand $$A^TA$$ can be treated as constant? How to treat $$x^T$$
My intuition tells me that somehow derivative should be taken in terms of product, but not sure product of what?
$$x^T(A^TAx)?$$

Calculus Matrices
Babaduras Babaduras
106
Report

Answer

Answers can only be viewed under the following conditions:
  1. The questioner was satisfied with and accepted the answer, or
  2. The answer was evaluated as being 100% correct by the judge.
View the answer

1 Attachment

Mathe Mathe
3.7K
  • Babaduras Babaduras
    +1

    @Mathe wow, that's great. I will tip you a coffee next time when I will top up my balance. Thanks.

  • Babaduras Babaduras
    0

    @Mathe Hi, I like your way of explanations. Could you take a look into this thread and let me know if you could work on explanation? I will pay you separately(by creating separate thread), just let me know if you can https://matchmaticians.com/questions/setkfa

    • Mathe Mathe
      0

      Yes, I can. I would be happy to.

    • Babaduras Babaduras
      0

      @Mathe ok, I will create a separate free question, when you answer I will pay 10$, is it good? (Free so no one will answer it xD)

    • Mathe Mathe
      0

      I think we can do that, I can answer it and you can tip me $10 (buy me coffee).

    • Babaduras Babaduras
      0

      @Mathe posted it here https://matchmaticians.com/questions/oy7msa

  • Babaduras Babaduras
    0

    @Mathe would you like to explain how backpropagation works? I want to see some example of it for simple MPL(1 input, 1 hidden and 1 output layers). Particularly interested in how Chain Rule is used there

    • Mathe Mathe
      0

      I can, but I would need some time to prepare it. When do you want this?

    • Babaduras Babaduras
      0

      today by the end of the day, how much would you like to get?

    • Babaduras Babaduras
      0

      CEST time btw

    • Mathe Mathe
      0

      I would have to rush some things, but I could have it in about 5 hours. Because you want such an specific example, I would charge you $70

    • Babaduras Babaduras
      0

      @Mathe oh, that’s too much for me. Sorry for bothering you…

    • Mathe Mathe
      0

      No problem. If you are interested I could give you a discount that I have more free time.

The answer is accepted.
Join Matchmaticians Affiliate Marketing Program to earn up to a 50% commission on every question that your affiliated users ask or answer.