Qualcomm Technologies has announced the Qualcomm Vision Intelligence Platform, featuring the company’s first family of system-on-chips (SoCs) purpose-built for IoT using advanced 10nm FinFET process technology.
The SoCs integrate Qualcomm Technologies’ most advanced image signal processor (ISP) to date and the Qualcomm Artificial Intelligence (AI) Engine, along with a heterogeneous compute architecture including a cutting-edge ARM-based multicore CPU, vector processor and GPU. The Vision Intelligence Platform also includes Qualcomm Technologies’ advanced camera processing software, machine learning and computer vision software development kits (SDKs), as well as proven Qualcomm Technologies’ connectivity and security technologies.
The platform is optimised to support exciting new possibilities for industrial and consumer smart security cameras, sports cameras, wearable cameras, virtual reality (VR) 360 and 180 cameras, robotics, smart displays, and more. KEDACOM and Ricoh THETA are planning to develop products based on the Qualcomm Vision Intelligence Platform.
“Our goal is to make IoT devices significantly smarter as we help customers bring powerful on-device intelligence, camera processing and security. AI is already enabling cameras with object detection, tracking, classification and facial recognition, robots that avoid obstacles autonomously, and action cameras that learn and generate a video summary of your latest adventure, but this is really just the beginning,” said Joseph Bousaba, vice president, product management, Qualcomm Technologies.
“The Qualcomm Vision Intelligence Platform is the culmination of years of advanced research and development that brings together breakthrough advancements in camera, on-device AI and heterogeneous computing. The platform is a premier launchpad for manufacturers and developers to create a new world of intelligent IoT devices.”
The Vision Intelligence Platform supports up to 2x2 802.11ac Wi-Fi with MU-MIMO and dual band simultaneous transmission, Bluetooth 5.1, Qualcomm 3D Audio Suite, Qualcomm Aqstic Audio Technologies and Qualcomm aptX™ Audio. The platform also features Qualcomm Noise and Echo Cancellation, as well as advanced on-device audio analytics and processing features to support natural language processing, audio speech recognition, and “barge-in” capability for a reliable voice interface even in loud or noisy environments or when users are far from the device.
The Qualcomm QCS605 and QCS603 are sampling now, with multiple SKUs designed to meet a variety of technical and cost effectiveness requirements. QCS605-based VR 360 camera reference designs from Qualcomm Technologies and Altek Corporation, a leading original design manufacturer for cameras, are available today, and QCS603-based industrial security camera reference designs are expected to be available in the second half of 2018.
In a blog on Qualcomm official website, Jim Merrick, marketing director, IoT explains the platform in an interesting way:
"Think of it this way: A home surveillance camera that notifies you every time your Great Dane jumps up on the sofa might be entertaining, but how useful is it, really? Now imagine that camera is positioned at your front door and able to differentiate between your child who’s been locked out and a burglar. In the case of the former, it could connect with the door’s smart lock to allow entry, and if the latter, sound an alarm that notifies the local police.
This level of home security is possible, but it won’t happen overnight. For that camera to be truly effective, it needs to be connected and intelligent enough to be able to process and analyze data in real time locally on the device, so it can recognize the things that matter and take immediate action. That’s where the just-announced Qualcomm Vision Intelligence Platform, which includes Qualcomm Technologies’ first family of system-on-chips (SoCs) for the development of smart devices for the IoT, comes in."