Snapdragon NPE Support

Build

Use the typical build_android script, but include a couple Cmake options to enable Snapdragon NPE:

NPE_HEADERS=/path/to/snpe-1.2.2/include/
NPE_LOCATION=/path/to/snpe-1.2.2/lib/arm-android-gcc4.9/libSNPE.so
./scripts/build_android.sh -DUSE_SNPE=ON -DSNPE_LOCATION=$NPE_LOCATION -DSNPE_HEADERS=$NPE_HEADERS

this will enable the Snapdragon NPE Operator, which is a Caffe2 operator that can execute NPE dlc files.

Usage

Follow Qualcomm's instructions to convert a model into dlc format. You can then use the dlc as a Caffe2 operator in Python:

with open('submodel.dlc', 'rb') as f:
    dlc = f.read()

op = core.CreateOperator('SNPE', ['data_in'], ['data_out'],
         arg=[
             utils.MakeArgument("model_buffer", dlc),
             utils.MakeArgument("input_name", "data") # Assuming DLC's first layer takes in 'data'
         ]
     )

and adding the operator to your model as you would normally.

Debug

libSNPE.so is a shared library that is loaded at runtime. You may need to specify the location of the library on your Android device when running standalone binaries. The runtime assumes it will be able to dlopen() a file named libSNPE.so at the location specified by gSNPELocation(). Either change this value at runtime or use an environment variable such as LD_LIBRARY_PATH.

You also need libgnustl_shared.so from Android NDK to be loaded in order to run standalone binaries.