| commit | 995c83f945a1ba74e649345a975264dff72ea7ac | [log] [tgz] |
|---|---|---|
| author | James Reed <jamesreed@fb.com> | Wed Oct 04 17:11:51 2017 -0700 |
| committer | Facebook Github Bot <facebook-github-bot@users.noreply.github.com> | Wed Oct 04 17:24:09 2017 -0700 |
| tree | 8bcd138b9df72e0a037ab52a391669ae82a69c5e | |
| parent | 6a71cfa31edb26c40c0dd8bc90c09084cb3b14ad [diff] |
Disable cudnn dropout Summary: The cudnn version of the DropoutOp was taking a significant (and unwarranted) amount of time in our RNN training. Further investigation showed that setting the cudnn dropout descriptors was an extremely expensive operation (https://pxl.cl/99nT), much more so than the dropout operation itself. This diff adds to the DropoutCell the option to disable cudnn. The non-cudnn version uses a raw curand call that elides all of the expensive descriptor setting. Reviewed By: jmp84, akyrola Differential Revision: D5972022 fbshipit-source-id: 6325ec5d6569f8b94d776cbb2554cc8ddb28f699
Caffe2 is a lightweight, modular, and scalable deep learning framework. Building on the original Caffe, Caffe2 is designed with expression, speed, and modularity in mind.
Caffe2 research award competition request for proposals
Please use Github issues (https://github.com/caffe2/caffe2/issues) to ask questions, report bugs, and request new features.
Please participate in our survey (https://www.surveymonkey.com/r/caffe2). We will send you information about new releases and special developer events/webinars.
Caffe2 is released under the Apache 2.0 license. See the NOTICE file for details.