Created by: DogHeadMoon

Add save/load state dict to make optimizers to save/load their states Add learning_rate() to access learning rate value without waiting Add a unit test file to test save/load the optimizers' states