Amazon Web Services has released SageMaker Neo, an open source Neo-AI project under the Apache Software License. This is seen as a boost to edge computing since the machine learning feature of SageMaker Neo can be run by computers with limited power and storage capabilities.
More on this effort to drive innovation in edge computing in this report from T-HQ:
This will allow processor vendors, device makers, and deep learning developers to bring new and independent innovations in machine learning to a variety of hardware platforms.
In most cases, optimizing a machine learning model for multiple hardware platforms can be difficult as developers need to tune models manually for each platform’s hardware and software configuration.
This is especially challenging for edge devices, which tend to be constrained in compute power and storage. These constraints limit the size and complexity of the models that they can run.
[…]
At its core, Neo-AI reduces the time and effort needed to tune machine learning models for deployment on multiple platforms by automatically optimizing these models with no loss of accuracy.
The models are converted into efficient common formats that reduce software compatibility problems too. This software solution allows modes to run on resource-constrained devices too.Unlocking innovation in areas such as autonomous vehicles, home security, and anomaly detection is also on the horizon. Neo-AI currently supports platforms from Intel, NVIDIA, and ARM, with support for Xilinx, Cadence and Qualcomm coming soon.
