With Artificial intelligence and neural networks becoming prominent features in the mobile, Qualcomm has released its Neural Processing Engine (NPE) SDK that allows developers to accelerate the deep neural network or AI workloads on mobile or other edge devices that are powered by Snapdragon processors.
The Snapdragon NPE is a deep learning software framework designed for Snapdragon Mobile Platforms. It offers developers in multiple industries, including mobile, automotive, healthcare, security and imaging, the tools they need to deliver on-device neural network-driven user experiences.
Developers can choose the optimal Snapdragon core for the desired user experience – Qualcomm Kryo CPU, Qualcomm Adreno GPU or Qualcomm Hexagon DSP.
In the announcement, the firm stated that the capabilities of Snapdragon NPE include style transfers and filters (augmented reality), scene detection, facial recognition, natural language understanding, object tracking and avoidance, gesturing, and text recognition to name a few.
The Snapdragon NPE is currently used by developers to improve their mobile app experiences. For example, Facebook has integrated the Snapdragon NPE into the camera of the Facebook app to accelerate Caffe2-powered AR features.
Qualcomm asserted that with NPE, Facebook acheived 5x better performance on the Adreno GPU, compared to a generic CPU implementation. This resulted in a better application of AR features when capturing photos and live videos.
“We developed the Snapdragon NPE SDK to help meet the increasing demand for running deep neural networks efficiently on mobile and other edge devices powered by Snapdragon,” said Gary Brotman, director, product management, Qualcomm Technologies, Inc. “The Snapdragon NPE was created to give developers the tools to easily migrate intelligence from the cloud to edge devices, and affords them the flexibility to target the appropriate Snapdragon core with the power and performance profile for a given user experience.”
The Snapdragon NPE is compatible with Snapdragon 600 and 800 Series Mobile Platforms. It supports common deep learning frameworks such as Caffe, Caffe2 and Tensorflow, and also offers support for custom layers.
The SDK includes runtime software, libraries, APIs, offline model conversion tools, sample code, documentation, and debugging and benchmarking tools.
The Snapdragon NPE is now available at Qualcomm Developer Network, found at https://developer.qualcomm.com/ai.
To view the full Press release, click here.