Pergunta de entrevista da empresa Baidu

If the gradient descent doesn't converge, what might be the problem?

Respostas da entrevista

Sigiloso

5 de mai. de 2016

Step size

Sigiloso

11 de jul. de 2018

If learning rate is too high gradient descent will never converge

Sigiloso

31 de mai. de 2022

Low learning rate with early stopping High learning rate diverges