Towards Medical Cyber-Physical Systems: Multimodal Augmented Reality for Doctors and Knowledge Discovery about Patients

详细信息    查看全文

• 作者：Daniel Sonntag (17)
  Sonja Zillner (18)
  Christian Schulz (17)
  Markus Weber (17)
  Takumi Toyama (17)
  
• 刊名：Lecture Notes in Computer Science
• 出版年：2013
• 出版时间：2013
• 年：2013
• 卷：8014
• 期：1
• 页码：411-418
• 全文大小：1231KB
• 参考文献：1. Hall, F.M.: The radiology report of the future. Radiology聽251(2), 313鈥?16 (2009) CrossRef
  2. Havukumpu, J., V盲h盲kangas, P., Gr枚nroos, E., H盲kkinen, J.: Midwives experiences of using hmd in ultrasound scan. In: M酶rch, A.I., Morgan, K., Bratteteig, T., Ghosh, G., Svanaes, D. (eds.) NordiCHI, pp. 369鈥?72. ACM (2006)
  3. Indyk, P., Motwani, R.: Approximate nearest neighbors: Towards removing the curse of dimensionality. In: Proceedings of the Thirtieth Annual ACM Symposium on the Theory of Computing, Dallas, Texas, USA, pp. 604鈥?13 (1998)
  4. Keller, K., State, A., Fuchs, H.: Head mounted displays for medical use. J. Display Technol.聽4(4), 468鈥?72 (2008) CrossRef
  5. Lee, E.A.: Cyber physical systems: Design challenges. Technical Report UCB/EECS-2008-8, EECS Department, University of California, Berkeley (January 2008)
  6. Oviatt, S.: Ten myths of multimodal interaction. Communications of the ACM聽42(11), 74鈥?1 (1999) CrossRef
  7. Pieraccini, R., Huerta, J.: Where do we go from here? Research and commercial spoken dialog systems. In: Proceedings of the 6th SIGDdial Workshop on Discourse and Dialogue, pp. 1鈥?0 (September 2005)
  8. Reithinger, N., Fedeler, D., Kumar, A., Lauer, C., Pecourt, E., Romary, L.: MIAMM - A Multimodal Dialogue System Using Haptics. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N.O. (eds.) Advances in Natural Multimodal Dialogue Systems. Springer (2005)
  9. Reithinger, N., Sonntag, D.: An integration framework for a mobile multimodal dialogue system accessing the Semantic Web. In: Proceedings of INTERSPEECH, Lisbon, Portugal, pp. 841鈥?44 (2005)
  10. Sonntag, D.: Ontologies and Adaptivity in Dialogue for Question Answering. AKA and IOS Press, Heidelberg (2010)
  11. Sonntag, D., Liwicki, M., Weber, M.: Digital pen in mammography patient forms. In: Proceedings of the 13th International Conference on Multimodal Interfaces, pp. 303鈥?06. ACM (November 2011)
  12. Sonntag, D., Schulz, C., Reuschling, C., Galarraga, L.: Radspeech鈥檚 mobile dialogue system for radiologists. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, IUI 2012, pp. 317鈥?18. ACM, New York (2012) CrossRef
  13. Sonntag, D., Sonnenberg, G., Nesselrath, R., Herzog, G.: Supporting a rapid dialogue engineering process. In: Proceedings of the First International Workshop On Spoken Dialogue Systems Technology, IWSDS (2009)
  14. Sonntag, D., Wennerberg, P., Buitelaar, P., Zillner, S.: Pillars of Ontology Treatment in the Medical Domain. In: Cases on Semantic Interoperability for Information Systems Integration: Practices and Applications, pp. 162鈥?86. Information Science Reference (2010)
  15. Traub, J., Sielhorst, T.: Advanced display and visualization concepts for image guided surgery. Display Technology, .... (2008)
  16. Wahlster, W.: SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In: Krahl, R., G眉nther, D. (eds.) Proceedings of the Human Computer Interaction Status Conference 2003, pp. 47鈥?2. DLR, Berlin (2003)
  17. Weiss, D.L., Langlotz, C.: Structured reporting: Patient care enhancement or productivity nightmare? Radiology聽249(3), 739鈥?47 (2008) CrossRef
  
• 作者单位：Daniel Sonntag (17)
  Sonja Zillner (18)
  Christian Schulz (17)
  Markus Weber (17)
  Takumi Toyama (17)
  
  17. German Research Center for AI (DFKI), Stuhlsatzenhausweg 3, 66123, Saarbruecken, Germany
  18. Siemens AG, Corporate Technology, Otto-Hahn-Ring 6, 81739, Munich, Germany
  

文摘

In the medical domain, which becomes more and more digital, every improvement in efficiency and effectiveness really counts. Doctors must be able to retrieve data easily and provide their input in the most convenient way. With new technologies towards medical cyber-physical systems, such as networked head-mounted displays (HMDs) and eye trackers, new interaction opportunities arise. With our medical demo in the context of a cancer screening programme, we are combining active speech based input, passive/active eye tracker user input, and HMD output (all devices are on-body and hands-free) in a convenient way for both the patient and the doctor.