learning rate calculating use adagrad algorithm
Created by: PseudoProgrammer
how to calculate the learning rate in first pass use adagrad algorithm?In first pass, the penalty item is gt, i ,and the gradient be gt,i too,so learning rate for all paramters is the same-base learning rate? Can you tell me?@yuyang