用户名: 密码: 验证码:
基于形式化的软件测试复用若干关键技术的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
软件测试作为直接获取软件基本度量和发现软件缺陷的最重要手段之一,日益受到人们的重视。在软件的发展过程中,测试逐步从软件研发过程中分离,成为独立的业务和社会分工。在整个软件生命周期内,软件测试成本已经占到软件研发总成本的40%,在安全关键领域甚至占到60%,由于缺乏充分测试而导致的软件质量问题成为制约我国软件产业发展的重要因素。测试用例的复用在提高软件测试质量,缩短测试周期,提高软件测试的覆盖率,均起着十分重要的作用,对软件测试复用的研究已成为软件测试工程化研究的趋势之一。课题的研究对于提高企业测试水平和过程能力,促进我国软件产业的发展具有极其重要的指导意义。
     目前国内外在软件测试用例复用方面的研究,往往集中在某特定环节的复用技术,缺乏能够综合测试用例的来源、组织和存储、检索、复用的完整复用体系。测试能力成熟度模型提供了良好的软件测试过程的指导,但缺少有效的建模和仿真手段,过程改进成本高,测试用例的描述缺少语义关联,来源缺乏系统化,严重地制约了测试用例的复用,因此开展测试用例的复用研究具有重要的理论价值和广阔的应用前景。基于上述原因,本文在测试流程建模和仿真,测试用例的生成,测试用例的描述、组织和检索,测试用例复用的支撑环境等方面进行了深入的研究。所做的工作和成果主要体现在以下几个方面:
     I提出了基于层次赋时着色Petri网的测试流程模型,实现了软件流程的仿真与复用。利用经典Petri网对测试计划、测试设计、测试执行、修故缺陷、测试评估、测试结束等环节构成的测试流程进行仿真和分析。在此基础上,根据测试流程的基本要素,进一步采用HTCPN工具,依照自顶向下的模式,开展软件过程的复杂建模和流程的动态仿真,实现了事前高效的软件测试过程优化和资源调度,避免了传统软件测试过程在事后实施改进周期长、成本高的缺点。
     I提出了基于Z语言的Web页面序列及浏览器交互测试覆盖准则。Web系统的无状态、多入口、流程不确定等特点给Web软件的测试带来了新的挑战,本文依据Web应用的页面关系提出了Web应用的页面序列覆盖准则,分析了准则之间的包含关系,根据Web应用和浏览器按钮之间的交互提出了交互状态覆盖和迁移覆盖准则。解决了目前Web应用存在覆盖准则复杂、应用不直观的现状,提高了Web应用测试的可复用程度。
     I提出并实现了可复用的基于遗传算法的两两组合测试用例的自动生成算法GACT。求解满足两两组合覆盖的最小测试用例集是NP完全问题,该算法能够生成满足两两组合的测试用例集的满意解,和国外相似算法相比,在组合数目较大时,GACT测试用例数量减少的优势比较明显。
     I提出了面向复用的测试用例描述模型。引入测试本体和软件测试用例分类本体,讨论了测试用例本体的匹配的相似度计算方法和测试用例的检索过程。采用形式化方法描述了固定属性字段测试、状态分解、和测试模板框架等可复用测试用例的来源,提高了软件测试用例的复用能力。
     I在调查软件测试质量情况和企业软件配置情况的基础上,分析了软件测试质量和软件测试配置之间的联系。结合本文研究成果,实现了基于本文研究成果的测试用例复用支撑环境-软件测试管理平台STMP,并应用于实际的第三方测试组织,取得了较为明显的效果,根据过去2年约1000个软件测试项目的统计,测试效率平均提高了20%,项目的部分研究应用成果获得上海市科技进步三等奖。
With the rapid growth of the application of information technology, computer soft-ware system has been penetrated into all fields of social life. The losses caused by soft-ware defects extend from the military, aviation, medical and other fields gradually toeveryday life. Software testing, as one of the most important means to acquire the qual-ity metric and to find software defects, constantly catches people’s attention. Softwaretesting gradually becomes an independent business and social division of labor,alongwith the rapid development of software engineering. Software testing accounts for morethan forty percent of the entire cost in software life cycle,even sixty percent of theentire cost in the Safety-critical field. The poor software product quality caused by inad-equate testing of the software has become one of the important factors which constrainChina’s software industry development. Reuse of test cases plays a very important role inimproving software quality, shortening the testing cycle,improving the testing coverage.The research on software testing reuse has become a vital branch of testing engineeringresearch.The research project in this paper has significance in improving the testing skilland process capability maturity, promoting the development of China’s software industry.
     Software testing cases reuse research at home and abroad, tends to focus on specificstage of the reuse process, either on the generation of test cases or on the organization andstorage of test cases. The Testing Capability Maturity provides a guidance for the soft-ware testing process, but the process improvement cost is very high because of the lack ofeffective means of modeling and simulation before the practice. The lack of semantic de-scription of test cases and systemize research impact testing cases reuse. The research onreuse of test cases has great theoretical value and broad application prospects. In this pa-per,we will carry out deep research on the test process modeling and simulation, reusabletest cases generation, the description of test case based on ontology. The achievementsand main works in this dissertation are listed as following:
     I The testing process model based on Hierarchical Timed Colored PetriNets(HTCPN) was presented in this paper, and the simulation and reuse was im-plemented. According to the basic elements of the testing process, we used classicpetri net to simulate and analyze all the stages of testing process including test plan,test design, test execution, defect repair, testing result evaluation and other aspects.On this basis,software process modeling and the dynamic simulation process was implemented by HTCPN tools in accordance with the model of top-down. Thetesting process optimization and resource schedule was achieved by adjusting thevarious process parameters, avoiding the time and economic loss caused by lowtesting process.
     I The web browser page sequence testing coverage criteria and interaction testingcoverage criteria was proposed and described in Z Notation. The web applicationhas a non-status, multi-entrance uncertain ?ow characteristics,which has broughtnew challenges for web application testing. The web sequence coverage criteriawas proposed based on the sequence of different web page according to applica-tion logic. This paper also discuss interaction coverage between web applicationand browser in Z Notation. The subsumption of these coverage criteria was ana-lyzed. These coverage criteria is very usable to reduce complication, to improvethe accuracy of criteria description and reusability.
     I Anewautomatictestcasegenerationalgorithmbasedongeneticalgorithmforpair-wise testing was put forward. The algorithm is called GACT. To find the smallestset of testing cases which satisfies the pairwise combination is non-deterministicpolynomial complete problem. The tool based on GACT can generate satisfactorytest case set. Compared to the similar algorithm abroad, GACT can decrease thenumber of test cases when the number of combination is very large.
     I Thedescriptionmodel,usedforreuseoftestcase,wasproposed. Thetestingontol-ogy and software classification ontology were introduced to describe the semanticrelationship between the test cases. Test cases ontology similarity matching calcu-lation methods and retrieval process of test cases were discussed after building testcases ontology. Formal method was used to describe three sources of the reusablesoftware test case to increase the reuse capacity of test cases. These source are thefixed properties field test, the state decomposition and state comparison, and thetest template framework of reusable test cases.
     I Aftersurveyingofthequalityofsoftwaretestingandenterprisesoftwareconfigura-tion, the causal relation between testing software quality and the test configurationwas analyzed. On this basis, a test case reuse support environment - SoftwareTesting Management Platform(STMP) was implemented according to the achieve-ment of this paper. This support environment was applied in a actual third-party testing organization, according to statistics over the past year,the testing efficiencyincreased by 20% on average. Part of the research results of this paper won thethird prize for Progress of Science and Technology of Shanghai.
引文
[1] Tassey G. The economic impacts of inadequate infrastructure for software testing. Technicalreport, National Institute of Standards and Technology, 2002.
    [2] Bennett T. L, Wennberg P. W. Eliminating Embedded Software Defects Prior to IntegrationTest. The Journal of Defense Software Engineering, 2005.
    [3]朱少民.软件测试方法和技术.清华大学出版社, 2005: 14–17.
    [4] Leveson N. Safeware : System Safety and Computers. Addison-Wesley Professional, April,1995.
    [5] Leveson N. Role of Software in Spacecraft Accidents. Journal of Spacecraft and Rockets,2004, 41(4):564–575.
    [6] Gelperin D, Hetzel B. The growth of software testing. Communications of the Association ofComputing Machinery, 1988, 31(6):687–695.
    [7] Hetzel W. C, Hetzel B. The Complete Guide to Software Testing. New York, NY, USA: JohnWiley & Sons, Inc., 1991.
    [8] Myers G. J. Art of Software Testing. New York, NY, USA: John Wiley & Sons, Inc., 1979.
    [9] Patton R. Software Testing (2nd Edition). Sams, 2005.
    [10] Boehm B. W. Software Engineering. Transactions on Computers, 1976, 25(12):1226–1241.
    [11] Marciniak J. J. Encyclopedia of Software Engineering. New York, NY, USA: John Wiley &Sons, Inc., 2002.
    [12]崔小乐,王轶辰,阮镰.一种软件测试过程的博弈模型.北京航空航天大学学报, 2004,30(8):797–802.
    [13] Kuvaja P. BOOTSTRAP 3.0-A SPICE1 Conformant Software Process Assessment Method-ology. Software Quality Control, 1999, 8(1):7–19.
    [14] Dorling A. SPICE: Software Process Improvement and Capability Determination. SoftwareQuality Journal, 1993, 2(4):209–224.
    [15] SEI . CMMI for Development, Version 1.2-Improving Processes for Better Products. SEI,CMU, 2006.
    [16] Burnstein I, Suwannasart T, Carlson C, et al. The Development of a Testing MaturityModel.Proceedings of Proceedings of the Ninth International Quality Week Conference, San Fran-cisco, 1996.
    [17]戴晔,张培培.测试成熟度模型的研究.信息技术与标准化, 2007, (9).
    [18]杨根兴,蔡立志,陈昊鹏, et al.软件质量保证、测试与评价.清华大学出版社, 2007.
    [19] Joa W. Cangussu I. R. A. D. F. I, Mathur A. P. A Formal Model of the Software Test Process.IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2002, 28(8).
    [20]杨磊,钟金宏,李兴国.动态模型在软件系统测试过程中的应用研究.计算机测量与控制,2007, 25(12):1680–1682.
    [21]张锡芳,黄上腾.软件工程中的测试流程模型与管理.计算机应用与软件, 2005,22(8):28–29,136.
    [22]崔小乐,周豪.软件测试过程中的参与方关系分析.微电子学与计算机, 2008, 25(8):52–55.
    [23]谢冰,王亚沙,李戈, et al.面向复用的软件资产与过程管理.清华大学出版社, 2008.
    [24]王渊峰,张涌,任洪敏.基于刻面描述的构件检索.软件学报, 2002, 13(8):1546–1551.
    [25]马亮,谢冰,杨芙清.多构件系统刻面检索机制.电子学报, 2002, 30(z1).
    [26]王明兰,叶东升.测试用例描述语言研究.计算机工程与设计, 2006, 22(7):4281–4284.
    [27] Mayrhauser A, Mraz R. T, Walls J, et al. Domain Based Testing: Increasing Test Case Reuse.Proceedings of International Conference on Computer Design, 1994. 484-491.
    [28] Mraz R. T. Domain Based Testing: A Reuse Oriented Test Method. Technical report, coloradostate university, 1993.
    [29] Folkerts M, Lamey T, Evans J. Common Test Patterns and Reuse of Test Designs, June, 2008.Available at http://msdn.microsoft.com/en-us/library/cc514239.aspx.
    [30] Vouffo-Feudjio A, Schieferdecker I. Test Patterns with TTCN-3. Proceedings of FATES, 2004.170-179.
    [31] Hornstein H. E. Test reuse in CBSE using built-in tests. Proceedings of Proc of the Work-shop on Component-Based Software Engineering,Composing Systems from Components, LosAlamitos,CA: IEEE Computer Society Press,, 2002.
    [32] Kulkarni . Reusable Test Cases How Can It Facilitate Web Testing. Proceedings of 3rd AnnualInternational Software Testing 2001 Conference in India, 2001.
    [33] lin G. S. On Testing Case Class Library and Its Application in Software Engneering(In Chinse.Journal of Anyang Normal chollege, 2006. 32–34.
    [34] Luxiao Li H. G. Designing a Test Case Library System of Supporting Sharing and Reusing(inchinese). Journal of computer science, 2006, 33(5):290–291.
    [35] Zhenyu Liu G. Y. An Anomate Test Case Generation Approach:Using Match Technique.Proceedings of The fifth International Conference on Computer and Information Technology,Shanghai China, 2005. 922-926.
    [36] Zhenyu Liu T. L. N. G. A component-based Reuse Technique of Software Test Cases. Pro-ceedings of The 2rd word Congress for software Quality, Munich,Germany, 2005. 129-138.
    [37] Kung D. C, Liu C.-H, Hsia P. An Object-Oriented Web Test Model for Testing Web Applica-tions. Proceedings of APAQS’00: Proceedings of the The First Asia-Pacific Conference onQuality Software (APAQS’00), Washington, DC, USA: IEEE Computer Society, 2000. 111.
    [38] Liu C.-H, Kung D. C, Hsia P, et al. Structural Testing of Web Applications. Proceedings ofISSRE’00: Proceedings of the 11th International Symposium on Software Reliability Engi-neering, Washington, DC, USA: IEEE Computer Society, 2000. 84.
    [39] Lucca G. D, Fasolino A, Faralli F. Testing Web Applications. Proceedings of ICSM’02: Pro-ceedings of the International Conference on Software Maintenance (ICSM’02), Washington,DC, USA: IEEE Computer Society, 2002. 310.
    [40] Ricca F, Tonella P. Analysis and testing of Web applications. Proceedings of ICSE’01:Proceedings of the 23rd International Conference on Software Engineering, Washington, DC,USA: IEEE Computer Society, 2001. 25–34.
    [41]许蕾,徐宝文,陈振强. Web测试综述.计算机科学, 2003, 30(3):100–104.
    [42] Roper M. I. B. A. M. J. W. M. Genetic Algorithms and the Automatic Generation of Test Data.Working Paper, 1991.
    [43] Pargas H. M. P. R. Test Data Generation Using Genetic Algorithms. Software Testing, Verifi-cation And Reliability, 1999, 9(263-282).
    [44] Wegener B. A. S. H. Evolutionary Test Environment for Automatic Structural Testing. Infor-mation & Software Technology, 2001.
    [45] Lin J.-C, Yeh P.-L. Automatic test data generation for path testing using GAs. Inf. Sci., 2001,131(1-4):47–64.
    [46]潘英敏.基于遗传算法的测试用例自动生成.中国科技信息, 2005.
    [47] Watkins A. The Automatic Generation of Software Test Data using Genetic Algorithms. Pro-ceedings of the Fourth Software Quality Conference, Dundee, Scotland, 1995. 300-309.
    [48] Borgelt K. Software Test Data Generation From A Genetic Algorithm. Proceedings of Indus-trial Applications Of Genetic Algorithms. CRC Press, 1998.
    [49] Tracey C. J. M. K. Automated Program Flaw Finding Using Simulated Annealing. Proceed-ings of ISSTA-98, Florida, USA, 1998.
    [50]薛云志.一种基于Messy GA的结构测试数据自动生成方法.软件学报, 2006,17(8):1688.1697.
    [51]赵明等.基于遗传算法的测试用例生成工具研究.计算机工程, 2005, 31(13):151–153.
    [52] Khor S, Grogono P. Using a Genetic Algorithm and Formal Concept Analysis to GenerateBranch Coverage Test Data Automatically. Proceedings of ASE’04: Proceedings of the 19thIEEE international conference on Automated software engineering, Washington, DC, USA:IEEE Computer Society, 2004. 346–349.
    [53] Berndt DJ W. A. Investigating the performance of genetic algorithm-based software test casegeneration. In: CV R, editor, Proceedings of Proc. of the Int’l Symp. on High AssuranceSystems Engineering, Tampa Florida: IEEE Computer Society Press, 2004. 261-262.
    [54] McGraw G, Michael C, Schatz M. Generating software test data by evolution. Tech-nical report, Reliable Software Technologies, Sterling, VA, 1997. citeseer.ist.psu.edu/mcgraw97generating.html. Submitted to IEEE Transactions on Software Engineering.
    [55] Patton R. M, Wu A. S, Walton G. H. A Genetic Algorithm Approach to Focused SoftwareUsage Testing. citeseer.ist.psu.edu/580006.html.
    [56] Mandl R. Orthogonal Latin squares: an application of experiment design to compiler testing.Commun. ACM, 1985, 28(10):1054–1058.
    [57] Grindal M, Offutt J, Andler S. F. Combination testing strategies: a survey. Software Testing,Verification and Reliability, 2005, 15(3):167–199.
    [58] Cohen D. M, Dalal S. R, Fredman M. L, et al. The Automatic Efficient Test Generator (AETG)system. Proceedings of the Fifth International Symposium on Software Reliability Engineer-ing, California, 1994. 303-309.
    [59] Cohen D. M, Dalal S. R, Fredman M. L, et al. The AETG system: An approach to testing basedon combinatorial design. IEEE Transactions on Software Engineering, 1997, 23(7):437~444.
    [60] Lei Y, Tai K. C. Ip-Parameter-Order:A Test Generation Strategy for Pairwise Testing. IEEETrans. Softw. Eng., 2002, 28(1):109–111.
    [61]牛为华,孟建良,张素文.成对测试中的测试生成策略研究.计算机仿真, 2003, 20(7):111–113.
    [62] CHUNG T. K, YU L. A Test Generation Strategy for Pairwise Testing. IEEE Trans. Softw.Eng., 2002, 28(1):109–111.
    [63]朱小骏,高建华.正交拉丁方在参数组合测试中的应用与分析. Proceedings of第十届全国容错计算机学术会议,北京:中国计算机学会, 2003.中国计算机学会. 170-176.
    [64]高建华,朱小骏.配对覆盖测试集的估计与实用策略分析.上海师范大学学报(自然科学版), 2004, 33(3):39–42.
    [65] Barroca L. M, Mcdermid J. A. Formal methods: Use and relevance for the development ofsafety critical systems. The Computer Journal, 1992, 35:579–599.
    [66] ISO/IEC . Information Technology - Z Formal Specification Notation - Syntax, Type Systemand Semantics. ISO/IEC 13568:2002, 2002.
    [67] J.M.Spivey . Understanding Z: A specification language and its formal semantics. CambridgeUniversity Press, 1988.
    [68]缪淮扣,李刚,朱关铭.软件工程语言―Z.上海科学技术出版社, 1999.
    [69] G.Smith . The Object-Z Specification Language. Advances in Formal Methods series. KluwerAcademic Publishers, 2000.
    [70] Jones C. B. Systematic Software Development using VDM. Upper Saddle River, NJ 07458,USA: Prentice-Hall, 1990.
    [71] Hoare C. A. R. Communicating sequential processes. Commun. ACM, 1978, 21(8):666–677.
    [72] Milner R. A Calculus of Communicating Systems, volume 92. Springer Verlag, 1980.
    [73] A.Galton . Logic as a Formal Method. The Computer Journal, 1992, 35(5).
    [74]陈小勇,尹刚,史殿习.软件测试模型分析与研究.现代计算机(专业版), 2008, (5):22–25.
    [75]张华龙,袁兆山.软件测试过程模型的研究与应用.计算机时代, 2008, (8):41–43.
    [76]刘超,金茂忠.软件测试过程的基本模型POCERM.北京航空航天大学学报, 1997,23(1):56–60.
    [77]王玉娟,吴国华.基于并发反馈修正的软件测试过程模型.杭州电子工业学院学报, 2003,23(3):58–61.
    [78]曹德胜,王燕兴.一种新的软件测试过程模型.华北科技学院学报, 2006, 3(2):72–74.
    [79] Osterweil L. Software processes are software too. Proceedings of ICSE’87: Proceedingsof the 9th international conference on Software Engineering, Los Alamitos, CA, USA: IEEEComputer Society Press, 1987. 2-13.
    [80] Ja¨ger D, Schleicher A, Westfechtel B. Using UML for software process modeling. Proceed-ings of ESEC/FSE-7: Proceedings of the 7th European software engineering conference heldjointly with the 7th ACM SIGSOFT international symposium on Foundations of software en-gineering, London, UK: Springer-Verlag, 1999. 91–108.
    [81] Marlon Dumas A. H. M. t. H. Process Modeling Using UML. Proceedings of Process-AwareInformation Systems. Wiley, 2005. 85–117.
    [82]袁崇义. Petri网原理与应用.电子工业出版社, 2005.
    [83]林闯.随机Petri网和性能评价.清华大学出版社, 2000.
    [84]吴琼,邵志清,刘刚, et al.基于着色时间Petri网的实时系统的形式验证.计算机科学,2008, 35.
    [85]赵熙临,周建中,刘辉.基于概率Petri网的故障诊断模型研究.计算机工程与应用, 2008,44(24):224–227.
    [86]吴圣义,吕永建,逯囯亮.基于Petri网航空电器抢修系统建模.微计算机信息, 2008,24(8-3):210–211,226.
    [87] Iv R. G. P, Gomaa H. Validation of Dynamic Behavior in UML Using Colored Petri Nets. Pro-ceedings of Proc. of UML′2000 Workshop - Dynamic Behaviour in UML Models: SemanticQuestions, volume 1939 in LNCS. Springer Verlag, 2000.
    [88] Adam N. R, Atluri V, Huang W.-K. Modeling and Analysis of Work?ows Using Petri Nets. J.Intell. Inf. Syst., 1998, 10(2):131–158.
    [89] Ha S, Suh H.-W. A timed colored Petri nets modeling for dynamic work?ow in productdevelopment process. Comput. Ind., 2008, 59(2-3):193–209.
    [90] Gottschalk F, Aalst W. M. P, Jansen-Vullers M. H, et al. Protos2CPN: using colored Petri netsfor configuring and testing business processes. Int. J. Softw. Tools Technol. Transf., 2007,10(1):95–110.
    [91] Pankratius V, Stucky W. A formal foundation for work?ow composition, work?ow view def-inition, and work?ow normalization based on petri nets. Proceedings of APCCM’05: Pro-ceedings of the 2nd Asia-Pacific conference on Conceptual modelling, Darlinghurst, Australia,Australia: Australian Computer Society, Inc., 2005. 79-88.
    [92] López-grao J. P, Merseguer J, Campos J. From UML Activity Diagrams To Stochastic PetriNets: Application To Software Performance Engineering. Proceedings of In Proceedings ofthe Seventeenth International Symposium on Computer and Information Sciences. CRC Press,2004. 25-36.
    [93]杨玉梅,刁永锋.基于UML顺序图的Petri网建模.计算机技术与发展, 2007, 17(10):130–133.
    [94]张彦欲.结合UML和Petri Net技术的工作流建模的研究.徽型电脑应用, 2008, 24(2):47–49,64.
    [95]郭峰,姚淑珍.基于Petri网的UML状态图的形式化模型.北京航空航天大学学报, 2007,33(2):248–252.
    [96] Murata T. Petri Nets: Properties, Analysis and Applications. Proceedings of Proceedings ofthe IEEE. 541–580.
    [97] Aalst W. V. Three good reasons for using a Petri-net-based work?ow management system.Proceedings of International Working Conference on Information and Process Integration inEnterprises (IPIC’96), Cambridge,Massachusetts, 1996. 179-201.
    [98]葛季栋,顾庆,胡昊, et al.一种基于对象网的多视角软件过程模型.软件学报, 2008,19(6):1363–1378.
    [99]潘秋菱,刘宗田,张立群, et al. PETRI网在软件过程建模及过程实施中的应用.小型微型计算机系统, 2002, 23(5):570–573.
    [100]张友生,陈松乔.基于体系结构的软件过程Petri模型.小型微型计算机系统, 2004,26(1):79–83.
    [101] Jensen K. An Introduction to the Theoretical Aspects of Coloured Petri Nets. Proceedings ofA Decade of Concurrency, Re?ections and Perspectives, REX School/Symposium, London,UK: Springer-Verlag, 1994. 230–272.
    [102] Jensen K. An Introduction to the Practical Use of Coloured Petri Nets. Proceedings of Lectureson Petri Nets II: Applications, Advances in Petri Nets, the volumes are based on the AdvancedCourse on Petri Nets, London, UK: Springer-Verlag, 1998. 237-292.
    [103] Ratzer A. V, Wells L, Lassen H. M, et al. CPN Tools for Editing Simulating and AnalysingColoured Petri Nets. Proceedings of the 24th International Conference on Applications andTheory of Petri Nets (ICATPN 2003), Eindhoven, The Netherlands: Springer-Verlag, 2003.450-462.
    [104] Memon A. M, Soffa M. L, Pollack M. E. Coverage criteria for GUI testing. SIGSOFT Softw.Eng. Notes, 2001, 26(5):256–267.
    [105] Vilkomir S. A, Bowen J. P. Formalization of software testing criteria using the Z notation.Proceedings of Computer Software and Applications Conference, 2001. 351-356.
    [106] Zhu H, Hall P. A. V, May J. H. R. Software unit test coverage and adequacy. ACM Comput.Surv., 1997, 29(4):366–427.
    [107]刘玲,缪淮扣.对逻辑覆盖软件测试准则的公理化评估.软件学报, 2004, 15(9):1301–1310.
    [108] Sampath S, Gibson E, Sprenkle S, et al. Coverage Criteria for Testing Web Applications.Technical report, Computer and Information Sciences, University of Delaware, 2005.
    [109] Davies J, Woodcock J. Using Z :Specification,Refinement and Proof. Prentice Hall Interna-tional, 1996.
    [110] Robert M. Hierons S. S, Singh H. Testing a system specified using Statecharts and Z. Infor-mation & Software Technology, 2001, 43(2):137–149.
    [111] Burton S, Clark J, McDermid J. Testing, Proof and Automation. An Integrated Approach.Proceedings of the 1st International Workshop of Automated Program Analysis, Testing andVerification. June 2000. ACMSIGSOFT IEEE Computer Science, 2000.
    [112] Singh H, Conrad M, Sadeghipour S. Test Case Design Based on Z and the Classification-TreeMethod. Proceedings of ICFEM, 1997. 81-90.
    [113] Stocks P, Carrington D. A. Test Templates: A Specification-based Testing Framework. Pro-ceedings of Proc. 15th International Conference on Software Engineering, 1993. 405-414.
    [114] Abdallah A. E, Khayat E. J. Formal Z Specifications of Several Flat Role-Based AccessControl Models. Proceedings of SEW’06: Proceedings of the 30th Annual IEEE/NASASoftware Engineering Workshop, Washington, DC, USA: IEEE Computer Society, 2006. 282–292.
    [115] Lucca G. A. D, Penta M. D. Considering Browser Interaction in Web Application Testing.wse, 2003, 00:74.
    [116] Gruber T. R. A translation approach to portable ontology specifications. Knowl. Acquis.,1993, 5(2):199–220.
    [117] Neches R, Fikes R, Finin T, et al. Enabling technology for knowledge sharing. AI Mag., 1991,12(3):36–56.
    [118] Studer R, Benjamins V. R, Fensel D. Knowledge engineering: principles and methods. DataKnowl. Eng., 1998, 25(1-2):161–197.
    [119] Perez A, Benjamins V. Overview of Knowledge Sharing and Reuse Components: Ontologiesand Problem-Solving Methods. Proceedings of Proceedings of the IJCAI99 workshop onOntologies and Problem-Solving Methods(KRR5), 1999. 1-15.
    [120]邓志鸿,唐世渭,张铭, et al. Ontology研究综述.北京大学(自然科学版), 2002, 28(5):730–737.
    [121] Berners-Lee T, Hendler J, Lassila O. The semantic web. Scientific American, 2001,284(5):34–43.
    [122] Cristani M, Cuel R. A Survey on Ontology Creation Methodologies. International Journal onSemantic Web and Information Systems, 2005, 1(2):49–69.
    [123] M Fernández L. Overview of methodologies for building ontologies. Proceedings of TheIJCAI-99 Workshop on Ontologies and Problem-Solving Methods, Stockholm,Sweden, 1999.
    [124] Prieto-Díaz R. A Faceted Approach to Building Ontologies. Proceedings of InformationReuse and Integration, 2003. IRI 2003. IEEE International Conference on. IEEE Systems,Man, and Cybernetics Society, 2003. 458-465.
    [125] Abran A, Moore J. W, Bourque P, et al. Guide to the Software Engineering Body of Knowledge(SWEBOK). IEEE, 2004.
    [126] Resnik P. Using Information Content to Evaluate Semantic Similarity in a Taxonomy. Pro-ceedings of The 14th International Joint Conference on Artificial Intelligence, 1995. 448–453.
    [127]张德海,朱耀.不同本体中概念语义距离的一种度量方法.计算机科学, 2008, 35(9):144–148.
    [128] Guarino N, Masolo C, Vetere G. OntoSeek: Content-Based Access to the Web. IEEE Intelli-gent Systems, 1999, 14(3):70–80.
    [129] Binder R. V. Testing Object-Orient System:Models, Patterns, and Tools. Addison-Wesley,1999.
    [130] Pressman R. S. Software engineering: a practitioner’s approach (6th ed.). New York, NY,USA: McGraw-Hill, Inc., 2005.
    [131] Poonawala M. REUSABLE STRATEGIES FOR TESTING SAFETY-CRITICAL SYSTEMS.Tech Rep 99-032, Department of Computer Science, University of Minnesota, 1999.
    [132] Renzuo Xu B. C. M. W. Z. X. Investigation on the pattern for construction of reuable testcases in object-oriented software. Journal of Wuhan University(Natural Science Edition),2003, 49(5):295–296.
    [133] Ling Liu h. M. A specification-based case study from test class framework. Journal of shanghaiunversity(english edition), 2001, 5(3):205–210.
    [134] Cohen D. M, Dalal S. R, Parelius J, et al. The Combinatorial Design Approach to AutomaticTest Generation. IEEE Softw., 1996, 13(5):83–88.
    [135] Williams A. W, Probert R. L. A practical strategy for testing pair-wise coverage of networkinterfaces. Proceedings of ISSRE’96: Proceedings of The Seventh International Symposiumon Software Reliability Engineering (ISSRE’96), Washington, DC, USA: IEEE ComputerSociety, 1996. 246.
    [136] Holland J. H. Adaptation in natural and artificial systems. Ann Arbor, MI: University ofMichigan Press, 1975.
    [137]朱海燕.关于两两测试的研究.计算机工程与设计, 2006, 27(15):2802–2804.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700