基于混合现实的矿用设备维修指导系统
|
摘要
针对矿用设备现场维修知识和专业指导不足导致维修效率低、周期长,虚拟现实和增强现实技术实现平台一般为头戴式设备、手机等,设备的移动性很好,但用户只能依赖交互手柄、触摸屏进行交互,视觉体验缺乏真实性,设计了一种基于混合现实的矿用设备维修指导系统。该系统基于Unity3D虚拟现实平台,采用混合现实设备HoloLens实时显示维修指导方案,实现了矿用设备原理虚拟仿真、基于二维码的设备管理、设备维修指导和远程专家协作等功能。HoloLens通过虚拟文字、虚拟设备模型、动画及语音提示等方式将维修指导信息直观地呈现给维修人员,维修人员可通过视线跟踪、语音交互、手势识别等方式与HoloLens交互。采煤机齿轮磨损故障维修指导应用实例验证了该系统的实用性和有效性。
In view of low maintenance efficiency and long cycle caused by insufficient on-site maintenance knowledge and professional guidance for mine-used equipments,and virtual reality and augmented reality technologies are generally realized on head mounted device,mobile phones or tablet computers with good mobility,but users can only rely on interactive handle and touch screen to interact,and visual experience lacks authenticity,a maintenance guidance system of mine-used equipments based on mixed reality was designed.Based on Unity3D virtual reality platform,the system adopts mixed reality device HoloLens to real-timely display maintenance instruction schemes,which realizes functions of virtual simulation of mine-used equipments principle,equipments management based on QR code,equipments maintenance guidance and remote expert collaboration. HoloLens visually presents maintenance instructions to maintenance personnel through virtual text,virtual device models,animations and voice prompts.Maintenance personnel can interact with HoloLens through line-of-sight tracking,voice interaction and gesture recognition.Application example of shearer gear wear fault maintenance guidance verifies practicality and effectiveness of the system.
In view of low maintenance efficiency and long cycle caused by insufficient on-site maintenance knowledge and professional guidance for mine-used equipments,and virtual reality and augmented reality technologies are generally realized on head mounted device,mobile phones or tablet computers with good mobility,but users can only rely on interactive handle and touch screen to interact,and visual experience lacks authenticity,a maintenance guidance system of mine-used equipments based on mixed reality was designed.Based on Unity3D virtual reality platform,the system adopts mixed reality device HoloLens to real-timely display maintenance instruction schemes,which realizes functions of virtual simulation of mine-used equipments principle,equipments management based on QR code,equipments maintenance guidance and remote expert collaboration. HoloLens visually presents maintenance instructions to maintenance personnel through virtual text,virtual device models,animations and voice prompts.Maintenance personnel can interact with HoloLens through line-of-sight tracking,voice interaction and gesture recognition.Application example of shearer gear wear fault maintenance guidance verifies practicality and effectiveness of the system.
引文
[1]张红岩.基于虚拟现实技术的煤矿安全培训系统[J].工矿自动化,2014,40(2):88-92.ZHANG Hongyan.Coal mine safety training system based on virtual reality technology[J].Industry and Mine Automation,2014,40(2):88-92.
[2]田子建.虚拟现实教学手段在煤矿特种工培训中的应用[J].工矿自动化,2013,39(3):40-42.TIAN Zijian.Application of virtual reality teaching means in special operators training of coal mines[J].Industry and Mine Automation,2013,39(3):40-42.
[3]张旭辉,王妙云,张雨萌,等.数据驱动下的工业设备虚拟仿真与远程操控技术研究[J].重型机械,2018(5):14-17.ZHANG Xuhui,WANG Miaoyun,ZHANG Yumeng,et al.Virtual simulation and remote control technology with data-driven for industrial equipment[J].Heavy Machinery,2018(5):14-17.
[4]NEUMA U,MAJORS A.Cognitive,performance,and systems issues for augmented reality applications in manufacturing and maintenance[C]//IEEE 1998Virtual Reality Annual International Symposium,Atlanta,GA,1998.
[5]FIORENTINO M,UVA A E,GATTULLO M,et al.Augmented reality on large screen for interactive maintenance instructions[J].Computers in Industry,2014,65(2):270-278.
[6]HAVARD V,BAUDRY D,LOUIS A,et al.Augmented reality maintenance demonstrator and associated modelling[C]//2015 IEEE Virtual Reality,Arles,France,2015.
[7]李喆,陈佳宁,张林鍹.核电站设备维修中混合现实技术的应用研究[J].计算机仿真,2018,35(5):340-345.LI Zhe,CHEN Jianing,ZHANG Linxuan.Application of mixed reality technology in maintenance of nuclear power stations[J].Computer Simulation,2018,35(5):340-345.
[8]杨晓,杨家轩,余枫,等.基于混合现实眼镜的船舶远程故障诊断及维修保养辅助系统和方法:CN106707810A[P].2017-05-24.
[9]马思群,王开顺,李健,等.基于Unity3D的动车转向架虚拟拆装培训系统研究[J].铁路计算机应用,2017,26(8):33-37.MA Siqun,WANG Kaishun,LI Jian,et al.Virtual disassembly and assembly training system of EMUbogie based on Unity3D[J].Railway Computer Application,2017,26(8):33-37.
[10]帅朝林,陈雪梅,邱世广.虚拟现实技术在航空智能制造中的应用思考与展望[J].航空制造技术,2016(16):26-33.SHUAI Chaolin,CHEN Xuemei,QIU Shiguang.Thinking and prospect of virtual reality application in aerospace intelligent manufacturing[J].Aeronautical Manufacturing Technology,2016(16):26-33.
[11]杨壹斌,李敏,解鸿文.基于Unity3D的桌面式虚拟维修训练系统[J].计算机应用,2016,36(增刊2):125-128.YANG Yibin,LI Min,XIE Hongwen.Desktop virtual maintenance training system based on Unity3D[J].Journal of Computer Applications,2016,36(S2):125-128.
[12]曾华荣,黄良,陈沛龙.基于混合现实技术的电力协同仿真设计方法[J].中国农村水利水电,2016(1):158-160.
[2]田子建.虚拟现实教学手段在煤矿特种工培训中的应用[J].工矿自动化,2013,39(3):40-42.TIAN Zijian.Application of virtual reality teaching means in special operators training of coal mines[J].Industry and Mine Automation,2013,39(3):40-42.
[3]张旭辉,王妙云,张雨萌,等.数据驱动下的工业设备虚拟仿真与远程操控技术研究[J].重型机械,2018(5):14-17.ZHANG Xuhui,WANG Miaoyun,ZHANG Yumeng,et al.Virtual simulation and remote control technology with data-driven for industrial equipment[J].Heavy Machinery,2018(5):14-17.
[4]NEUMA U,MAJORS A.Cognitive,performance,and systems issues for augmented reality applications in manufacturing and maintenance[C]//IEEE 1998Virtual Reality Annual International Symposium,Atlanta,GA,1998.
[5]FIORENTINO M,UVA A E,GATTULLO M,et al.Augmented reality on large screen for interactive maintenance instructions[J].Computers in Industry,2014,65(2):270-278.
[6]HAVARD V,BAUDRY D,LOUIS A,et al.Augmented reality maintenance demonstrator and associated modelling[C]//2015 IEEE Virtual Reality,Arles,France,2015.
[7]李喆,陈佳宁,张林鍹.核电站设备维修中混合现实技术的应用研究[J].计算机仿真,2018,35(5):340-345.LI Zhe,CHEN Jianing,ZHANG Linxuan.Application of mixed reality technology in maintenance of nuclear power stations[J].Computer Simulation,2018,35(5):340-345.
[8]杨晓,杨家轩,余枫,等.基于混合现实眼镜的船舶远程故障诊断及维修保养辅助系统和方法:CN106707810A[P].2017-05-24.
[9]马思群,王开顺,李健,等.基于Unity3D的动车转向架虚拟拆装培训系统研究[J].铁路计算机应用,2017,26(8):33-37.MA Siqun,WANG Kaishun,LI Jian,et al.Virtual disassembly and assembly training system of EMUbogie based on Unity3D[J].Railway Computer Application,2017,26(8):33-37.
[10]帅朝林,陈雪梅,邱世广.虚拟现实技术在航空智能制造中的应用思考与展望[J].航空制造技术,2016(16):26-33.SHUAI Chaolin,CHEN Xuemei,QIU Shiguang.Thinking and prospect of virtual reality application in aerospace intelligent manufacturing[J].Aeronautical Manufacturing Technology,2016(16):26-33.
[11]杨壹斌,李敏,解鸿文.基于Unity3D的桌面式虚拟维修训练系统[J].计算机应用,2016,36(增刊2):125-128.YANG Yibin,LI Min,XIE Hongwen.Desktop virtual maintenance training system based on Unity3D[J].Journal of Computer Applications,2016,36(S2):125-128.
[12]曾华荣,黄良,陈沛龙.基于混合现实技术的电力协同仿真设计方法[J].中国农村水利水电,2016(1):158-160.
© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号 地址：北京市海淀区学院路29号 邮编：100083 电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700 |