Augmented Reality
COMPUTER VISION AND AUGMENTED REALITY
Computer Vision (CV) and Augmented Reality (AR) are cutting edge technologies that are rapidly becoming a game changer in many domains since they are enabling transformation of human machine interactions. This is ultimately bringing new possibilities that were unachievable before. For example, AR technology allows diagnoses of faults and maintenance of industrial machinery by integrating the physical shape of the device with a digital model in real-time. This approach significantly reduces human error and process time. Other applications are infotainment, people flow management, navigation, quality control, etc. Being profound experts in embedded systems we offer efficient CNN/DNN portation to constrained devices. We know how to achieve best performance with technology stacks like TensorFlow and OpenVINO while reducing complexity of CNN/DNN. Moreover, we have a track record of combining edge data processing with cloud management in order to create a self-learning IoT system with optimized data traffic.
RTSoft has vast experience in implementing СV and AR algorithms for its customers.
our services
Machine learning algorithm development for object recognition in real-time
Algorithm development using Deep Neural Networks
Algorithm development for Computer Graphics (real-time OpenGL transformations)
Algorithm Optimization
Computer Vision system turn-key build
Technologies
• Deep Neural Networks
• SLAM
• Computer Vision
• OpenCV, OpenCI, CUDA
• Augmented Reality
• Unity, Unreal Engine
Information
Smart Assistant to FAE
Having many facilities with complex industrial equipment require a large workforce well trained enough to handle many troublesome situations. However, training this large workforce might not be financially viable and reading a volume of manuals is not efficient anymore for many troublesome situations. This leads to an unintentional misuse of devices and significant damage or loss in production environments.
AR allows overcoming this situation by offering FAEs remote assistance in the field. For example, displaying corresponding manuals, AR guided smart instructions, displaying maintenance check lists, etc. This can reduce errors, and increase efficiency and control over your workforce.
Functionality:
- AR-based live support video calling
- Remote AR
Application in Automotive
Algorithms from Machine Learning, Computer Vision, and Augmented Reality can be implemented in HMI together with Advanced Driver-Assistance Systems (ADAS) to increase car safety and more generally road safety.
Functionality:
- Object detection (pedestrians, vehicles, traffic signs, traffic lights, Points of Interest)
- Gesture control for HMI
- Driver monitoring
- Safety alerts, navigation elements, infotainment features on Heads-Up Display
- Integration with WMS platform.
Warehouse Assistant
Modern warehouses represent highly sophisticated facilities resembling busy downtowns of large cities. The efficiency of a warehouse’s loader in finding the fastest routes to shelves with products, avoiding errors, and traffic jams may increase operational productivity. Real-time tracking of the current status of all operations, heat-maps of all routes in the warehouse, and real-time notification of low stock levels – all of these comprise a smart warehouse. Functionality:
- Usage with smart glasses (ex., EPSON-BT300);
- Real-time navigation with just a monocular camera (no additional dongles, QR codes, etc.);
People flow analysis
Through pairing CV, DNN, and IoT technologies we can build a system capable of counting people indoors and outdoors, analyze people flow and foot traffic, and recognize people for access management purposes. The software system and recognition algorithms can be flexibly distributed among onsite server and cloud while being configured and update totally remotely.
Functionality:
- People counting
- Queue counting
- Crowd counting
- Visitor counting
- Foot traffic analysis
- Facial recognition
Our recent projects
IoT for banknote processing devices
RTSoft enhanced a complex IoT solution for G+D, a banknote processing systems manufacturer, by integrating an industrial LWM2M protocol.
RTSReality for tourism business
RTSReality: Onboard infotainment for tourism with real-time attraction recognition, streaming, and 3D urban reconstruction.
Unified Embedded Device Management Platform
RTSoft’s Unified Embedded Device Management Platform for IoT: Enhanced security, OTA updates, and cloud-based solutions.
Remote Software Updates for Banknote Security
RTSoft enhances banknote security with cross-platform, automated software updates and data exchange for G+D systems.
Empathic Cockpit: Next-Gen Digital Auto Interface
RTSoft and Motherson innovate ‘The Empathic Cockpit’, blending AR, Gesture Control for advanced automotive comfort.”
STM32MP1: Smart Robotics Firmware
RTSoft’s STM32MP1 firmware boosts smart robotics with cloud connectivity, real-time control, and OTA updates.
Smart Energy OTA: Efficient Firmware Updates
RTSoft’s cloud-based OTA update system enhances smart energy controllers with secure, efficient firmware management.
Metro Crowd Control: AI-Powered CCTV
RTSoft’s AI solution for metro CCTV systems enhances passenger flow management with accurate people counting.