Large MAPE gap between LSTM Optimizers

I used MAPE measurement to compare Adam, Adagrad and SGD. There is a large gap between the results, in stacked LSTM with network size 256, as following: MAPE Adam: 4.43 MAPE Adagrad: 86.30 MAPE SGD: 70.07

Is it normal to have such large difference?