Support RMSProp in Caffe2.

Summary:
Add `RmsPropOptimizer` to `optimizer.py` so RMSProp can be used as an optimizer.

`RmpsPropOptimizer` uses `RmpPropOp` to update the gradient and `MomentumSGDUpdateOp` to update the model parameters.

Differential Revision: D6118279

fbshipit-source-id: e38b8380ff74c1d1bb1e87fc300b6b55e32cd2e0
2 files changed
tree: 37b26aec7cdcff1470967b1f7b72c1f97770c683
  1. .jenkins/
  2. .travis/
  3. caffe/
  4. caffe2/
  5. cmake/
  6. conda/
  7. docker/
  8. docs/
  9. modules/
  10. scripts/
  11. third_party/
  12. .Doxyfile
  13. .Doxyfile-c
  14. .Doxyfile-python
  15. .gitattributes
  16. .gitignore
  17. .gitmodules
  18. .travis.yml
  19. appveyor.yml
  20. CMakeLists.txt
  21. LICENSE
  22. Makefile
  23. NOTICE
  24. README.md
  25. release-notes.md
README.md

Caffe2

License TravisCI Build Status Appveyor Build Status

Caffe2 is a lightweight, modular, and scalable deep learning framework. Building on the original Caffe, Caffe2 is designed with expression, speed, and modularity in mind.

News and Events

Caffe2 research award competition request for proposals

Questions and Feedback

Please use Github issues (https://github.com/caffe2/caffe2/issues) to ask questions, report bugs, and request new features.

Please participate in our survey (https://www.surveymonkey.com/r/caffe2). We will send you information about new releases and special developer events/webinars.

License

Caffe2 is released under the Apache 2.0 license. See the NOTICE file for details.

Further Resources on Caffe2.ai