Pergunta de entrevista da empresa AMD

Explain the differences between MQA, MHA and GQA. Why is GQA particularly interesting for LLMs and Multi-Modal models?