vConnect: perceive and interact with real world from CAVE

详细信息    查看全文

• 作者：Yifeng He ; Ziyang Zhang ; Xiaoming Nan ; Ning Zhang…
• 关键词：Cave Automatic Virtual Environment (CAVE) ; Virtual reality ; Human ; Computer Interaction (HCI) ; Cloud computing ; Wireless sensor networks ; Optimal resource allocation ; Quality of Service (QoS)
• 刊名：Multimedia Tools and Applications
• 出版年：2017
• 出版时间：January 2017
• 年：2017
• 卷：76
• 期：1
• 页码：1479-1508
• 全文大小：
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems; Computer Communication Networks; Data Structures, Cryptology and Information Theory; Special Purpose and Application-Based Systems;
• 出版者：Springer US
• ISSN：1573-7721
• 卷排序：76

文摘

The Cave Automatic Virtual Environment (CAVE) is a fully immersive Virtual Reality (VR) system. CAVE systems have been widely used in many applications, such as architectural and industrial design, medical training and surgery plan, museums and education. However, one limitation for most of the current CAVE systems is that they are separated from the real world. The user in the CAVE is not able to sense the real world around him or her. In this paper, we propose a vConnect architecture, which aims to establish real-time bidirectional information exchange between the virtual world and the real world by utilizing the advanced technologies in cloud computing, mobile communications, wireless sensor networks, and computer vision. Specifically, we address three technical challenges in the proposed vConnect architecture. First, we propose an optimal allocation scheme for the wireless sensor networks to ensure that the data streams captured by the sensors can be delivered to the cloud servers in a reliable and prompt way. Second, we optimize the allocation of the cloud resources to ensure that the data streams sent from the clients can be processed promptly by the cloud servers at a minimal resource cost. Third, we propose to use marker-based finger interactions such that the user in the CAVE can manipulate the information in a natural and intuitive way. Fourth, we implemented a vHealth prototype, a CAVE-based real-time health monitoring system, to validate the proposed vConnect architecture. We demonstrated in the vHealth prototype that the user in the CAVE can visualize and manipulate the real-time physiological data of the patient who is being monitored, and interact with the patient.