Efficient Model to Query and Visualize the System States Extracted from Trace Data

详细信息    查看全文

• 作者：Alexandre Montplaisir (18)
  Naser Ezzati-Jivan (18)
  Florian Wininger (18)
  Michel Dagenais (18)
  
• 刊名：Lecture Notes in Computer Science
• 出版年：2013
• 出版时间：2013
• 年：2013
• 卷：8174
• 期：1
• 页码：235-250
• 全文大小：570KB
• 参考文献：1. Cohen, I., Goldszmidt, M., Kelly, T., Symons, J., Chase, J.S.: Correlating instrumentation data to system states: A building block for automated diagnosis and control. In: Proceedings of the 6th Conference on Symposium on Operating Systems Design Implementation, vol.聽6, p. 16. USENIX Association, Berkeley (2004)
  2. Chan, A., Gropp, W., Lusk, E.: An efficient format for nearly constant-time access to arbitrary time intervals in large trace files. Scientific Programming聽16(2), 155鈥?65 (2008)
  3. Cohen, I., Zhang, S., Goldszmidt, M., Symons, J., Kelly, T., Fox, A.: Capturing, indexing, clustering, and retrieving system history. SIGOPS Operating Systems Review聽39(5), 105鈥?18 (2005) CrossRef
  4. Desnoyers, M., Dagenais, M.R.: The LTTng tracer: A low impact performance and behavior monitor for GNU/Linux. In: Proceedings of the Ottawa Linux Symposium (2006)
  5. Desnoyers, M., Dagenais, M.: LTTng: Tracing across execution layers, from the hypervisor to user-space. In: Proceedings of the Ottawa Linux Symposium (2008)
  6. Ezzati-Jivan, N., Dagenais, M.R.: A stateful approach to generate synthetic events from kernel traces. In: Advances in Software Engineering (April 2012)
  7. Ezzati-Jivan, N., Dagenais, M.R.: A framework to compute statistics of system parameters from very large trace files. SIGOPS Oper. Syst. Rev.聽47(1), 43鈥?4 (2013) CrossRef
  8. Giraldeau, F., Desfossez, J., Goulet, D., Dagenais, M., Desnoyers, M.: Recovering system metrics from kernel trace. In: Linux Symposium, p. 109 (June 2011)
  9. Gaede, V., Gunther, O.: Multidimensional access methods. ACM Computing Surveys聽30(2), 170鈥?31 (1998) CrossRef
  10. Montplaisir, A.: Stockage sur disque pour acce茅s rapide d鈥?attributs avec intervalles de temps. Master鈥檚 thesis, Ecole polytechnique de Montreal (2011)
  11. Schnorr, L.M., Huard, G., Navaux, P.O.A.: Towards visualization scalability through time intervals and hierarchical organization of monitoring data. In: Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009, pp. 428鈥?35. IEEE Computer Society, Washington, DC (2009)
  12. Zaki, O., Lusk, E., Gropp, W., Swider, D.: Toward scalable performance visualization with jumpshot. International Journal of High Performance Computing Applications聽13(3), 277鈥?88 (1999) CrossRef
  
• 作者单位：Alexandre Montplaisir (18)
  Naser Ezzati-Jivan (18)
  Florian Wininger (18)
  Michel Dagenais (18)
  
  18. Ecole Polytechnique de Montreal, Canada
  
• ISSN：1611-3349

文摘

Any application, database server, telephony server, or operating system maintains different states for their internal elements and resources. When tracing is enabled on such systems, the corresponding events in the trace logs can be used to extract and model the different state values of the traced modules to analyze their runtime behavior. In this paper, a generic method and corresponding data structures are proposed to model and manage the system state values, allowing efficient storage and access. The proposed state organization mechanism generates state intervals from trace events and stores them in a tree-based state history database. The state history database can then be used to extract the state of any system resources (i.e. cpu, process, memory, file, etc.) at any timestamp. The extracted state values can be used to track system problems (e.g. performance degradation). The proposed system is usable in both the offline tracing mode, when there is a set of trace files, and online tracing mode, when there is a stream of trace events. The proposed system has been implemented and used to display and analyze interactively various information extracted from very large traces in the magnitude order of 1 TB.