Qaprosoft

Learning management system with multiplayer VR and AR

Situation TriPointLab, the team within the Stanford School of Medicine, was looking for an innovation partner to create Learning Management System with VR/AR capabilities. The project is of high complexity: real-time multiplayer education in the virtual space means complex network logic, as well as the subject field requires most medically accurate 3D modelling, largely derived from the real human data. Solution Our team built a product from initial idea to live enterprise solution on the fresh top-industry tech stack. Pushed by the deadlines dedicated to Apple ARKit release, our team had to iterate under short cycle delivering portions of working product to dynamically adapt product vision and requirements. We had to take risks and build the solution on the super-fresh technology stack, however it paid off with reduced budget and increased feature capabilities. Besides general AR/VR tech, we also used computer vision AI for object detection on the live video to identify which students participate in surgery practice more. Result Stanford University got an ultimate product corresponding all the value from the initial vision. The resulting solution contains: VR clients for desktop (Oculus) and mobile (IOS, Android), Mobile AR clients (IOS, Android), Complex backend, Regular 3d-viewers (WEB, standalone desktop and mobile), Admin tool for professors (models, scenes and tour management) which provides faculty with the ability to curate the content and directly correlate to daily or weekly topical learning objectives. Solution for recognizing activities taken in surgery practice room. Solution for exhibitions and museums (3d desktop / VR desktop).