| commit | 2caca70a37de32bc7e0e9eb2c51240641579c754 | [log] [tgz] |
|---|---|---|
| author | Aapo Kyrola <akyrola@fb.com> | Wed Nov 29 21:13:30 2017 -0800 |
| committer | Facebook Github Bot <facebook-github-bot@users.noreply.github.com> | Wed Nov 29 21:17:00 2017 -0800 |
| tree | d889649985477840e9e87fbe78de0ea24c63d870 | |
| parent | 0e21cd2eaeac2e95751ad89ccbf524dbc05e1345 [diff] |
Allow shifting of activations / ops to other GPUs in data parallel model Summary: (Work in progress). This diff will allow shifting of activations to other GPUs, in case the model does not fit into memory. To see the API, check the code in data_parallel_model_test, which tests shifting two activations from 0 and 1 to gpu 4, and from gpu 2 and 3 to gpu 5. I will need to further test on ResNets, and probablly add copy operations to handle device change points. Reviewed By: asaadaldien Differential Revision: D5591674 fbshipit-source-id: eb12d23651a56d64fa4db91090c6474218705270
Caffe2 is a lightweight, modular, and scalable deep learning framework. Building on the original Caffe, Caffe2 is designed with expression, speed, and modularity in mind.
Caffe2 research award competition request for proposals
Please use Github issues (https://github.com/caffe2/caffe2/issues) to ask questions, report bugs, and request new features.
Please participate in our survey (https://www.surveymonkey.com/r/caffe2). We will send you information about new releases and special developer events/webinars.
Caffe2 is released under the Apache 2.0 license. See the NOTICE file for details.