航天型号软件测试的计划技术研究
|
摘要
对于航天型号软件测试来说，量化测试过程、改进测试管理水平、提高测试自动化程度是保证测试质量进而保证产品质量和可靠性的重要途径。测试计划是测试过程的指导方针，测试计划水平对测试过程质量起着决定性的作用。
本文从航天型号软件的特点入手，重点研究航天型号软件测试计划技术；在参考现有成熟度量技术的基础上，提出了适合我国航天型号软件的单元测试度量模型、集成测试度量模型以及系统测试度量模型；并且在这些模型的基础上，提出了测试工作量估计模型TEEM（Test Effort Estimation Model），并利用最小二乘原理进行参数估计。另外，我们还开发了单元测试度量原型工具、集成测试度量原型工具和测试计划编制原型工具。
本课题的研究成果主要体现在创造性的提出了用于航天型号软件测试的软件度量理论以及软件工作量估计模型。本文通过对已有的软件度量和工作量估计模型进行选取和改进扩展，从而提出专门针对测试（特别是航天型号软件测试）的度量和工作量估计模型，并为后续研究提供了研究思路和参考依据。
本课题研究成果可供我国航天型号软件研制和测试组织用来进行测试计划安排以及测试过程控制。
In order to improve the quality and maturity of avionics software test ,we must measure software test processes, increase software test management and introduce more available software test automation tools .In this paper ,we study the technology and methodology of avionics software test planning, which is indispensable to improving the quality of avionics software test and thus to improving the quality of avionics software itself.
The key problem is : How to make a software test plan? Or ,What should be taken as the real foundation to make a software test plan? This paper solves this problem by developing a software Test Effort Estimation Model(TEEM) which is based on three software test metric models - unit test metric model ,integration test metric model and system test metric model. These metric models are more accurate and more particular than other existing metric models using KLOC or FPs. The parameters of TEEM have been estimated by the method of least squares .In addition ,we develop a productivity factor model which reflects the productivity of a software test organization and can be used to adjust test efforts calculated by TEEM.
In order to apply and validate those models given by this paper, We developed unit test metric tool, integration test metric tool and software test plan making tool, whose introduction and implementation are shown in the last of this paper.
本文从航天型号软件的特点入手，重点研究航天型号软件测试计划技术；在参考现有成熟度量技术的基础上，提出了适合我国航天型号软件的单元测试度量模型、集成测试度量模型以及系统测试度量模型；并且在这些模型的基础上，提出了测试工作量估计模型TEEM（Test Effort Estimation Model），并利用最小二乘原理进行参数估计。另外，我们还开发了单元测试度量原型工具、集成测试度量原型工具和测试计划编制原型工具。
本课题的研究成果主要体现在创造性的提出了用于航天型号软件测试的软件度量理论以及软件工作量估计模型。本文通过对已有的软件度量和工作量估计模型进行选取和改进扩展，从而提出专门针对测试（特别是航天型号软件测试）的度量和工作量估计模型，并为后续研究提供了研究思路和参考依据。
本课题研究成果可供我国航天型号软件研制和测试组织用来进行测试计划安排以及测试过程控制。
In order to improve the quality and maturity of avionics software test ,we must measure software test processes, increase software test management and introduce more available software test automation tools .In this paper ,we study the technology and methodology of avionics software test planning, which is indispensable to improving the quality of avionics software test and thus to improving the quality of avionics software itself.
The key problem is : How to make a software test plan? Or ,What should be taken as the real foundation to make a software test plan? This paper solves this problem by developing a software Test Effort Estimation Model(TEEM) which is based on three software test metric models - unit test metric model ,integration test metric model and system test metric model. These metric models are more accurate and more particular than other existing metric models using KLOC or FPs. The parameters of TEEM have been estimated by the method of least squares .In addition ,we develop a productivity factor model which reflects the productivity of a software test organization and can be used to adjust test efforts calculated by TEEM.
In order to apply and validate those models given by this paper, We developed unit test metric tool, integration test metric tool and software test plan making tool, whose introduction and implementation are shown in the last of this paper.
引文
1 McCabe,T.J.,"A Software Complexity Measure," IEEE Trans. Software Engineering,vol SE-2,December 1976
2 McCabe,T.J. and C.W. Butler , "Design Complexity Measurement and Testing," CACM,vol 32,no.12,December 1989
3 Halstead,M., Element of Software Science,North-Holland,1977
4 Dhama,H., "Quantitative Models of Cohesion and Coupling in Software,"Journal of Systems and Software,vol 29,no.4,April 1995
5 Henry,S. and D.Kafura,"Software Structure Metrics Based on Information Flow,"IEEE Trans. Software Engineering,vol.SE-7,no.5,September 1981
6 Roche,J.M.,"Software Metrics and Measurement Principles",Software Engineering Notes,ACM,vol.19,no.1,Janurary 1994
7 Putnam,L. and W.Myers, "How Solved Is the Cost Estimation Problem",IEEE Software,November 1997
8 Matson,J.,B.Barrett,and J.Mellichamp,"Software Develepoment Cost Estimation Using Function Points," IEEE Trans. Software Engineering,vol SE-20,no.4,April 1994
9 Whitmire,S.A.,"An Introduction to 3D Function Points",Software Development,April 1995
10 Albrecht,A.J. and J.E. Gaffney,"Software Function,Source Lines of Code and Development Effort Prediction:A Software Science Validation," IEEE Trans. Software Engineering,November 1983
11 White,L.J. and E.I. Cohen,"A Domain Strategy for Program Testing," IEEE Trans. Software Engineering,vol.SE-6,no.5,May 1980
12 Tai,K.C.,"What to Do Beyond Branch Testing,"ACM Software Engineering Notes,vol.14,no.2,April 1989
13 Frankl,P.G. and S.Weiss,"An Experimental Comparison of the Effectivness of
Branch Testing and Data Flow," IEEE Trans. Software Engineering,vol.SE-19,no.8,August 1993.
14 Ntafos,S.C.,"A Comparison of Some Structural Testing Strategies," IEEE Trans. Software Engineering,vol.SE-14,no.6,June 1988
15 Foster,K.A.,"Sensitive Test Data for Boolean Expressions," ACM Software Engineering Notes,vol.9,no.2,April 1984
16 Braid, D.M.; Johnson, C.W.; Schillinger, G.D, "An integrated test approach for avionics system development" Digital Avionics Systems, 2001. DASC. The 20th Conference , Volume: 2 , Oct 2001 Page(s): 9B2/1 -9B2/9 vol.2
17 Gokhale, S.S.; Trivedi, K.S.; "Log-logistic software reliability growth model" High-Assurance Systems Engineering Symposium, 1998. Proceedings. Third IEEE International , 13-14 Nov 1998 Page(s): 34 -41
18 Kapur, P.K.; Min Xie; Garg, R.B.; Jha, A.K.; "A discrete software reliability growth model with testing effort" Software Testing, Reliability and Quality Assurance, 1994. Conference Proceedings., First International Conference on , 21-22 Dec 1994 Page(s): 16 -20
19 Yamada, S.; Hishitani, J.; Osaki, S.; "A software reliability growth model for test-effort management" Computer Software and Applications Conference, 1991. COMPSAC '91., Proceedings of the Fifteenth Annual International , 11-13 Sep 1991
Page(s): 585 -590
20 Lo, R.; Webby, R.; Jeffery, R.; "Sizing and estimating the coding and unit testing effort for GUI systems" Software Metrics Symposium, 1996., Proceedings of the 3rd International , 25-26 Mar 1996 Page(s): 166 -173
21 Chin-Yu Huang; Sy-Yen Kuo; Ing-Yi Chen; "Analysis of a software reliability growth model with logistic testing-effort function" PROCEEDINGS The Eighth International Symposium On Software Reliability Engineering , 2-5 Nov1997 Page(s): 378 -388
22 Mizuno, O.; Shigematsu, E.; Takagi, Y.; Kikuno, T.; "On estimating testing effort needed to assure field quality in software development" Software Reliability Engineering, 2002. Proceedings. 13th International Symposium on , 2002 Page(s): 139 -146
23 Crowe, D.; Griffin, W.; Matysek, G.; "Standardized test resource models vs. UUT signal oriented models for test system control" AUTOTESTCON '91. IEEE Systems Readiness Technology Conference. Improving Systems Effectiveness in the Changing Environment of the '90s, Conference Record. , 24-26 Sep 1991 Page(s): 153 -166
24 Lyu, M.R.; Rangarajan, S.; van Moorsel, A.P.A.; "Optimal allocation of test resources for software reliability growth modeling in software development" Reliability, IEEE Transactions on , Volume: 51 Issue: 2 , Jun 2002 Page(s): 183 -192
25 Chin-Yu Huang; Jung-Hua Lo; Sy-Yen Kuo; Lyu, M.R.; "Optimal allocation of testing resources for modular software systems" Software Reliability Engineering, 2002. Proceedings. 13th International Symposium on , 2002 Page(s): 129 -138
26 Bo Yang; Min Xie; "Testing-resource allocation for redundant software systems" Dependable Computing, 1999. Proceedings. 1999 Pacific Rim International Symposium on , 1999 Page(s): 78 -83
27 Emergy, K.O.; Mitchell, B.K.; "Multi-level software testing based on cyclomatic complexity" Aerospace and Electronics Conference, 1989. NAECON 1989., Proceedings of the IEEE 1989 National , 22-26 May 1989 Page(s): 500 -507 vol.2
28 Leung, H.K.N.; White, L.; "A cost model to compare regression test strategies" Software Maintenance, 1991., Proceedings. Conference on , 15-17 Oct 1991 Page(s): 201 -208
29 Kane, P.T.; Leuci, N.D.; Reifer, D.J.; "A cost model for estimating the cost of developing software in the Ada programming language" System Sciences, 1988. Vol.II. Software Track, Proceedings of the Twenty-First Annual Hawaii International Conference on , Volume: 2 , 5-8 Jan 1988 Page(s): 782 -790
30 Boehm, B.; "Safe and simple software cost analysis"IEEE Software , Volume: 17 Issue: 5 , Sep/Oct 2000 Page(s): 14 -17
31 Moore, T.J.; "A test process optimization and cost modeling tool" Test Conference, 1994. Proceedings., International , 2-6 Oct1994 Page(s): 103 -110
32 Pillai, K.; Sukumaran Nair, V.S.; "A model for software development effort and cost estimation" Software Engineering, IEEE Transactions on , Volume: 23 Issue: 8 , Aug 1997
Page(s): 485 -497
33 Kansala, K.; "Integrating risk assessment with cost estimation"IEEE Software , Volume: 14 Issue: 3 , May/Jun 1997 Page(s): 61 -67
34 Yu, W.D.; "A modeling approach to software cost estimation"Selected Areas in Communications, IEEE Journal on , Volume: 8 Issue: 2 , Feb 1990 Page(s): 309 -314
35 Madachy, R.; "Knowledge-based risk assessment and cost estimation" Knowledge-Based Software Engineering Conference, 1994. Proceedings., Ninth , 20-23 Sep 1994 Page(s): 172 -178
36 Wang, S.; Kountanis, D.; "IASCE: an intelligent assistant to software cost estimation" Tools with Artificial Intelligence, 1992. TAI '92, Proceedings., Fourth International Conference on , 10-13 Nov 1992 Page(s): 114 -117
37 Heemstra, F.J.; "Software cost estimation models" Information Technology, 1990. 'Next Decade in Information Technology', Proceedings of the 5th Jerusalem Conference on (Cat. No.90TH0326-9) , 22-25 Oct 1990 Page(s): 286 -297
38 Clark, B.K.; "Cost modeling process maturity-COCOMO 2.0" Aerospace Applications Conference, 1996. Proceedings., 1996 IEEE , Volume: 3 , 3-10 Feb 1996 Page(s): 347 -369 vol.3
39 Birgisson, R.; Mellin, J.; Andler, S.F.; "Bounds on test effort for event-triggered real-time systems" Real-Time Computing Systems and Applications, 1999. RTCSA '99. Sixth International Conference on , 1999 Page(s): 212 -215
40 Chin-Yu Huang; Jung-Hua Lo; Sy-Yen Kuo; Lyu, M.R.; "Software reliability modeling and cost estimation incorporating testing-effort and efficiency" Software Reliability Engineering, 1999. Proceedings. 10th International Symposium on , 1999 Page(s): 62 -72
41 Hoang Pham; Xuemei Zhang; "A software cost model with warranty and risk costs" Computers, IEEE Transactions on , Volume: 48 Issue: 1 , Jan 1999
Page(s): 71 -75
42 Ohtera, H.; Yamada, S.; "Optimal allocation and control problems for software-testing resources" Reliability, IEEE Transactions on , Volume: 39 Issue: 2 , Jun 1990 Page(s): 171 -176
43 Kapsu Kim; Chisu Wu; "A software reliability model in the embedded system" Software Testing, Reliability and Quality Assurance, 1994. Conference Proceedings., First International Conference on , 21-22 Dec 1994
Page(s): 59 -63
44 Shimeall, T.J.; Kelly, T.J.; "Examination of a software-test cost model" Reliability and Maintainability Symposium, 1994. Proceedings., Annual , 24-27Jan 1994 Page(s): 26 -30
45 Tsai, J.J.P.; Fang, K.-Y.; Bi, Y.-D.; "On real-time software testing and debugging" Computer Software and Applications Conference, 1990. COMPSAC 90. Proceedings., Fourteenth Annual International , 31 Oct-2 Nov 1990 Page(s): 512 -518
46 Coulter, A.C.; "Graybox software testing methodology: embedded software testing technique" Digital Avionics Systems Conference, 1999. Proceedings. 18th , Volume: 2 , 1999 Page(s): 10.A.5-1 -10.A.5-8 vol.2
47 Rajgopal, J.; Mazumdar, M.; "Modular operational test plans for inferences on software reliability based on a Markov model" Software Engineering, IEEE Transactions on , Volume: 28 Issue: 4 , Apr 2002 Page(s): 358 -363
48 Sang Hun Oh; Jong Yeon Lee; Yoon Joon Lee; Myoung Ho Kim; "Software Quality Manager: a knowledge-based management tool of software metrics" TENCON '94. IEEE Region 10's Ninth Annual International Conference. Theme: 'Frontiers of Computer Technology'. Proceedings of 1994 , 22-26 Aug 1994 Page(s): 796 -800 vol.2
49 Takahashi, M.; Miyake, T.; Hanata, S.; "Statistically-based program size estimation" Computer Software and Applications Conference, 1989. COMPSAC 89., Proceedings of the 13th Annual International , 20-22 Sep 1989 Page(s): 574 -579
50 Tso, K.S.; Hecht, M.; Littlejohn, K.; "Complexity metrics for avionics software" Aerospace and Electronics Conference, 1992. NAECON 1992., Proceedings of the IEEE 1992 National , 18-22 May 1992 Page(s): 603 -609 vol.2
51 Offutt, A.J.; Abdurazik, A.; Alexander, R.T.; "An analysis tool for coupling-based integration testing" Engineering of Complex Computer Systems, 2000. ICECCS 2000. Proceedings. Sixth IEEE International Conference on , 2000
Page(s): 172 -178
52 Kam Sing Tao,Myron Hecht,Kenneth Littlejohn,"Complexity Metrics for Avionics Software"
53 Zhenyi Jin ,A.Jefferson Offutt,"Coupling-based Criteria for Integration Testing"
54 A.Jefferson Offutt,Mary Jean Harrold,Priyadarshan Kolte,"A Software Metric System for Module Coupling"
55 周涛 航天型号软件测试 宇航出版社1999年
56Roger S.Pressman，软件工程实践者的研究方法，梅宏，第5版，机械工业出版社，2002年
2 McCabe,T.J. and C.W. Butler , "Design Complexity Measurement and Testing," CACM,vol 32,no.12,December 1989
3 Halstead,M., Element of Software Science,North-Holland,1977
4 Dhama,H., "Quantitative Models of Cohesion and Coupling in Software,"Journal of Systems and Software,vol 29,no.4,April 1995
5 Henry,S. and D.Kafura,"Software Structure Metrics Based on Information Flow,"IEEE Trans. Software Engineering,vol.SE-7,no.5,September 1981
6 Roche,J.M.,"Software Metrics and Measurement Principles",Software Engineering Notes,ACM,vol.19,no.1,Janurary 1994
7 Putnam,L. and W.Myers, "How Solved Is the Cost Estimation Problem",IEEE Software,November 1997
8 Matson,J.,B.Barrett,and J.Mellichamp,"Software Develepoment Cost Estimation Using Function Points," IEEE Trans. Software Engineering,vol SE-20,no.4,April 1994
9 Whitmire,S.A.,"An Introduction to 3D Function Points",Software Development,April 1995
10 Albrecht,A.J. and J.E. Gaffney,"Software Function,Source Lines of Code and Development Effort Prediction:A Software Science Validation," IEEE Trans. Software Engineering,November 1983
11 White,L.J. and E.I. Cohen,"A Domain Strategy for Program Testing," IEEE Trans. Software Engineering,vol.SE-6,no.5,May 1980
12 Tai,K.C.,"What to Do Beyond Branch Testing,"ACM Software Engineering Notes,vol.14,no.2,April 1989
13 Frankl,P.G. and S.Weiss,"An Experimental Comparison of the Effectivness of
Branch Testing and Data Flow," IEEE Trans. Software Engineering,vol.SE-19,no.8,August 1993.
14 Ntafos,S.C.,"A Comparison of Some Structural Testing Strategies," IEEE Trans. Software Engineering,vol.SE-14,no.6,June 1988
15 Foster,K.A.,"Sensitive Test Data for Boolean Expressions," ACM Software Engineering Notes,vol.9,no.2,April 1984
16 Braid, D.M.; Johnson, C.W.; Schillinger, G.D, "An integrated test approach for avionics system development" Digital Avionics Systems, 2001. DASC. The 20th Conference , Volume: 2 , Oct 2001 Page(s): 9B2/1 -9B2/9 vol.2
17 Gokhale, S.S.; Trivedi, K.S.; "Log-logistic software reliability growth model" High-Assurance Systems Engineering Symposium, 1998. Proceedings. Third IEEE International , 13-14 Nov 1998 Page(s): 34 -41
18 Kapur, P.K.; Min Xie; Garg, R.B.; Jha, A.K.; "A discrete software reliability growth model with testing effort" Software Testing, Reliability and Quality Assurance, 1994. Conference Proceedings., First International Conference on , 21-22 Dec 1994 Page(s): 16 -20
19 Yamada, S.; Hishitani, J.; Osaki, S.; "A software reliability growth model for test-effort management" Computer Software and Applications Conference, 1991. COMPSAC '91., Proceedings of the Fifteenth Annual International , 11-13 Sep 1991
Page(s): 585 -590
20 Lo, R.; Webby, R.; Jeffery, R.; "Sizing and estimating the coding and unit testing effort for GUI systems" Software Metrics Symposium, 1996., Proceedings of the 3rd International , 25-26 Mar 1996 Page(s): 166 -173
21 Chin-Yu Huang; Sy-Yen Kuo; Ing-Yi Chen; "Analysis of a software reliability growth model with logistic testing-effort function" PROCEEDINGS The Eighth International Symposium On Software Reliability Engineering , 2-5 Nov1997 Page(s): 378 -388
22 Mizuno, O.; Shigematsu, E.; Takagi, Y.; Kikuno, T.; "On estimating testing effort needed to assure field quality in software development" Software Reliability Engineering, 2002. Proceedings. 13th International Symposium on , 2002 Page(s): 139 -146
23 Crowe, D.; Griffin, W.; Matysek, G.; "Standardized test resource models vs. UUT signal oriented models for test system control" AUTOTESTCON '91. IEEE Systems Readiness Technology Conference. Improving Systems Effectiveness in the Changing Environment of the '90s, Conference Record. , 24-26 Sep 1991 Page(s): 153 -166
24 Lyu, M.R.; Rangarajan, S.; van Moorsel, A.P.A.; "Optimal allocation of test resources for software reliability growth modeling in software development" Reliability, IEEE Transactions on , Volume: 51 Issue: 2 , Jun 2002 Page(s): 183 -192
25 Chin-Yu Huang; Jung-Hua Lo; Sy-Yen Kuo; Lyu, M.R.; "Optimal allocation of testing resources for modular software systems" Software Reliability Engineering, 2002. Proceedings. 13th International Symposium on , 2002 Page(s): 129 -138
26 Bo Yang; Min Xie; "Testing-resource allocation for redundant software systems" Dependable Computing, 1999. Proceedings. 1999 Pacific Rim International Symposium on , 1999 Page(s): 78 -83
27 Emergy, K.O.; Mitchell, B.K.; "Multi-level software testing based on cyclomatic complexity" Aerospace and Electronics Conference, 1989. NAECON 1989., Proceedings of the IEEE 1989 National , 22-26 May 1989 Page(s): 500 -507 vol.2
28 Leung, H.K.N.; White, L.; "A cost model to compare regression test strategies" Software Maintenance, 1991., Proceedings. Conference on , 15-17 Oct 1991 Page(s): 201 -208
29 Kane, P.T.; Leuci, N.D.; Reifer, D.J.; "A cost model for estimating the cost of developing software in the Ada programming language" System Sciences, 1988. Vol.II. Software Track, Proceedings of the Twenty-First Annual Hawaii International Conference on , Volume: 2 , 5-8 Jan 1988 Page(s): 782 -790
30 Boehm, B.; "Safe and simple software cost analysis"IEEE Software , Volume: 17 Issue: 5 , Sep/Oct 2000 Page(s): 14 -17
31 Moore, T.J.; "A test process optimization and cost modeling tool" Test Conference, 1994. Proceedings., International , 2-6 Oct1994 Page(s): 103 -110
32 Pillai, K.; Sukumaran Nair, V.S.; "A model for software development effort and cost estimation" Software Engineering, IEEE Transactions on , Volume: 23 Issue: 8 , Aug 1997
Page(s): 485 -497
33 Kansala, K.; "Integrating risk assessment with cost estimation"IEEE Software , Volume: 14 Issue: 3 , May/Jun 1997 Page(s): 61 -67
34 Yu, W.D.; "A modeling approach to software cost estimation"Selected Areas in Communications, IEEE Journal on , Volume: 8 Issue: 2 , Feb 1990 Page(s): 309 -314
35 Madachy, R.; "Knowledge-based risk assessment and cost estimation" Knowledge-Based Software Engineering Conference, 1994. Proceedings., Ninth , 20-23 Sep 1994 Page(s): 172 -178
36 Wang, S.; Kountanis, D.; "IASCE: an intelligent assistant to software cost estimation" Tools with Artificial Intelligence, 1992. TAI '92, Proceedings., Fourth International Conference on , 10-13 Nov 1992 Page(s): 114 -117
37 Heemstra, F.J.; "Software cost estimation models" Information Technology, 1990. 'Next Decade in Information Technology', Proceedings of the 5th Jerusalem Conference on (Cat. No.90TH0326-9) , 22-25 Oct 1990 Page(s): 286 -297
38 Clark, B.K.; "Cost modeling process maturity-COCOMO 2.0" Aerospace Applications Conference, 1996. Proceedings., 1996 IEEE , Volume: 3 , 3-10 Feb 1996 Page(s): 347 -369 vol.3
39 Birgisson, R.; Mellin, J.; Andler, S.F.; "Bounds on test effort for event-triggered real-time systems" Real-Time Computing Systems and Applications, 1999. RTCSA '99. Sixth International Conference on , 1999 Page(s): 212 -215
40 Chin-Yu Huang; Jung-Hua Lo; Sy-Yen Kuo; Lyu, M.R.; "Software reliability modeling and cost estimation incorporating testing-effort and efficiency" Software Reliability Engineering, 1999. Proceedings. 10th International Symposium on , 1999 Page(s): 62 -72
41 Hoang Pham; Xuemei Zhang; "A software cost model with warranty and risk costs" Computers, IEEE Transactions on , Volume: 48 Issue: 1 , Jan 1999
Page(s): 71 -75
42 Ohtera, H.; Yamada, S.; "Optimal allocation and control problems for software-testing resources" Reliability, IEEE Transactions on , Volume: 39 Issue: 2 , Jun 1990 Page(s): 171 -176
43 Kapsu Kim; Chisu Wu; "A software reliability model in the embedded system" Software Testing, Reliability and Quality Assurance, 1994. Conference Proceedings., First International Conference on , 21-22 Dec 1994
Page(s): 59 -63
44 Shimeall, T.J.; Kelly, T.J.; "Examination of a software-test cost model" Reliability and Maintainability Symposium, 1994. Proceedings., Annual , 24-27Jan 1994 Page(s): 26 -30
45 Tsai, J.J.P.; Fang, K.-Y.; Bi, Y.-D.; "On real-time software testing and debugging" Computer Software and Applications Conference, 1990. COMPSAC 90. Proceedings., Fourteenth Annual International , 31 Oct-2 Nov 1990 Page(s): 512 -518
46 Coulter, A.C.; "Graybox software testing methodology: embedded software testing technique" Digital Avionics Systems Conference, 1999. Proceedings. 18th , Volume: 2 , 1999 Page(s): 10.A.5-1 -10.A.5-8 vol.2
47 Rajgopal, J.; Mazumdar, M.; "Modular operational test plans for inferences on software reliability based on a Markov model" Software Engineering, IEEE Transactions on , Volume: 28 Issue: 4 , Apr 2002 Page(s): 358 -363
48 Sang Hun Oh; Jong Yeon Lee; Yoon Joon Lee; Myoung Ho Kim; "Software Quality Manager: a knowledge-based management tool of software metrics" TENCON '94. IEEE Region 10's Ninth Annual International Conference. Theme: 'Frontiers of Computer Technology'. Proceedings of 1994 , 22-26 Aug 1994 Page(s): 796 -800 vol.2
49 Takahashi, M.; Miyake, T.; Hanata, S.; "Statistically-based program size estimation" Computer Software and Applications Conference, 1989. COMPSAC 89., Proceedings of the 13th Annual International , 20-22 Sep 1989 Page(s): 574 -579
50 Tso, K.S.; Hecht, M.; Littlejohn, K.; "Complexity metrics for avionics software" Aerospace and Electronics Conference, 1992. NAECON 1992., Proceedings of the IEEE 1992 National , 18-22 May 1992 Page(s): 603 -609 vol.2
51 Offutt, A.J.; Abdurazik, A.; Alexander, R.T.; "An analysis tool for coupling-based integration testing" Engineering of Complex Computer Systems, 2000. ICECCS 2000. Proceedings. Sixth IEEE International Conference on , 2000
Page(s): 172 -178
52 Kam Sing Tao,Myron Hecht,Kenneth Littlejohn,"Complexity Metrics for Avionics Software"
53 Zhenyi Jin ,A.Jefferson Offutt,"Coupling-based Criteria for Integration Testing"
54 A.Jefferson Offutt,Mary Jean Harrold,Priyadarshan Kolte,"A Software Metric System for Module Coupling"
55 周涛 航天型号软件测试 宇航出版社1999年
56Roger S.Pressman，软件工程实践者的研究方法，梅宏，第5版，机械工业出版社，2002年