基于MSC的TTCN测试套自动生成方法研究
摘要
随着网络技术和测试技术的发展,协议测试技术越来越受到人们的重视。协议测试是用来保证协议实现的正确性和有效性的重要手段。作为协议测试的一种形式,协议一致性测试用于测试被测实现与协议规范要求的一致性,也是协议测试的基础。TTCN-3(测试和测试控制表示法第三版)是近年来备受业界关注的一种全新的测试描述语言,是协议一致性测试规范的基础构成要素之一,可以实现对网络协议的全方位测试。
本课题深入研究了TTCN-3的图形表示格式GFT,提出了一种基于形式化语言MSC的TTCN-3测试套生成方法。课题研究的目的是在测试套图形化表示形式的基础上进行测试套的开发,从而增强了测试套编写过程的可视性和可理解性,这在很大程度上减少了测试人员编写测试用例的工作量,提高了开发效率。课题在对TTCN-3核心语言和图形表示格式深入学习的基础上,实现了一个从TTCN-3的图形表示格式到核心语言的转换工具。通过这个工具,测试开发人员在测试例的开发过程中可以结合形式化描述语言,方便地实现对使用GFT图形格式表示的测试套的编辑操作,并在这个图形的基础上生成相应的测试例代码。
在课题研究的后期工作中,选用了诺基亚公司开发的一个手机游戏软件为例进行测试分析。通过测试可以得到结论:测试人员在测试过程中只需要了解测试工作的需求和简单的基于形式化描述语言消息序列图的GFT符号就可以得到测试例的基本流程。在测试流程代码生成之后,用户再添加相应的测试套定义部分就可以在测试平台上运行测试套,从而在一定程度上解决了测试套开发的繁琐和不直观,使测试套的编写工作更加方便快捷。
With the development of testing technology and internet technology, protocol testing is gaining increasingly acceptance because protocol testing is the most effective method to achieve the correctness and validity of the protocol implementation. And protocol conformance testing verifies the conformance between protocol implementation and protocol standard and it is the foundation of protocol testing. TTCN-3 (Testing and Test Control Notation version 3) is a new implementation of testing description language. It is one of the base elements of protocol conformance testing standards and it could test protocols with all levels.
It is mainly studied the TTCN-3 standard and its graphical format (GFT) in this paper, and it introduced a method of test suite generation which based on Message Sequence Charts (MSC). The main purpose of the study is to generate a test suite based on the graphical format and then enhance the intelligibility of the test suite generation process and improve the test efficiency. Besides that, a tool of transfer between TTCN-3 core language and GFT diagram is carried out. It can edit a GFT diagram with formalization language, thereby, the user could edit a test case in the process of test implementation and generate the test code based on the diagram.
At last, a mobile game software is used to analyzing the test process of this tool. It can concluded that the tester could get the flows of test cases if only he understands the requirements of a test work and knows the graphical symbol of GFT. After that, the test suite could be run as long as the definition part of the test suite appended. So it can improve test efficiency to make the development of test suite become more convenient and easier.
本课题深入研究了TTCN-3的图形表示格式GFT,提出了一种基于形式化语言MSC的TTCN-3测试套生成方法。课题研究的目的是在测试套图形化表示形式的基础上进行测试套的开发,从而增强了测试套编写过程的可视性和可理解性,这在很大程度上减少了测试人员编写测试用例的工作量,提高了开发效率。课题在对TTCN-3核心语言和图形表示格式深入学习的基础上,实现了一个从TTCN-3的图形表示格式到核心语言的转换工具。通过这个工具,测试开发人员在测试例的开发过程中可以结合形式化描述语言,方便地实现对使用GFT图形格式表示的测试套的编辑操作,并在这个图形的基础上生成相应的测试例代码。
在课题研究的后期工作中,选用了诺基亚公司开发的一个手机游戏软件为例进行测试分析。通过测试可以得到结论:测试人员在测试过程中只需要了解测试工作的需求和简单的基于形式化描述语言消息序列图的GFT符号就可以得到测试例的基本流程。在测试流程代码生成之后,用户再添加相应的测试套定义部分就可以在测试平台上运行测试套,从而在一定程度上解决了测试套开发的繁琐和不直观,使测试套的编写工作更加方便快捷。
With the development of testing technology and internet technology, protocol testing is gaining increasingly acceptance because protocol testing is the most effective method to achieve the correctness and validity of the protocol implementation. And protocol conformance testing verifies the conformance between protocol implementation and protocol standard and it is the foundation of protocol testing. TTCN-3 (Testing and Test Control Notation version 3) is a new implementation of testing description language. It is one of the base elements of protocol conformance testing standards and it could test protocols with all levels.
It is mainly studied the TTCN-3 standard and its graphical format (GFT) in this paper, and it introduced a method of test suite generation which based on Message Sequence Charts (MSC). The main purpose of the study is to generate a test suite based on the graphical format and then enhance the intelligibility of the test suite generation process and improve the test efficiency. Besides that, a tool of transfer between TTCN-3 core language and GFT diagram is carried out. It can edit a GFT diagram with formalization language, thereby, the user could edit a test case in the process of test implementation and generate the test code based on the diagram.
At last, a mobile game software is used to analyzing the test process of this tool. It can concluded that the tester could get the flows of test cases if only he understands the requirements of a test work and knows the graphical symbol of GFT. After that, the test suite could be run as long as the definition part of the test suite appended. So it can improve test efficiency to make the development of test suite become more convenient and easier.
引文
[1]ISO/IEC9646.OSI conformance testing methodology and framework.1993,32-48
[2]毕军,史美林.计算机网络协议测试及其发展.电信科学,1996.7:51-54
[3]TTCN-3-A new Test Specification Language.for Black-Box Testing of Distributed Systems[C],Jens Grabowski,Germany.In:Proceedings of the 17th International Conference and Exposition on Testing Computer Software(TCS'2000),Theme:Testing Technology vs.Testers' Requirements,Washington D.C.,2000-02
[4]张云勇.下一代网络义务开发技术.电子工业出版社,2004:173-192
[5]ISO/IEC 9646-1(1994):"Information technology-Open Systems Interconnection-Conformance testing methodology and framework-Part 1:General concepts"
[6]ISO/IEC 9646-1.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 1:General concepts.1991
[7]ISO/IEC 9646-2.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 2:Abstract test suite specification.1991
[8]ISO/IEC 9646-3.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 3:The tree and tabular combined notation.1991
[9]ISO/IEC 9646-4.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 4:Test realization.1991
[10]ISO/IEC 9646-5.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 5:Requirements and guidance for test laboratories and their clients for the conformance assessment process.1991
[11]ISO/IEC 9646-6.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 6:Profile test specification.1994
[12]ISO/IEC 9646-7.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 7:Implement conformation statements.1994
[13]ETS 300 406.Methods for Testing and Specification(MTS);Protocol and profile conformance testing specifications.Standardization methodology.April 1995:45-61
[14]ETSI ES 201 873-1 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 1:TTCN-3 Core Language
[15]郝丹丹,付晓宇译.测试描述方法(MTS);测试和测试控制表示法第三版;第一部分:TTCN-3核心语言ETSI ES 201 873-1 V2.2.1(2003-02)
[16]ETSI ES 201 873-2 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 2:TTCN-3 Tabular presentation Format(TFT)
[17]ETSI ES 201 873-3 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 3:TTCN-3 Graphical presentation Format(GFT)
[18]ETSI ES 201 873-4 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 4:TTCN-3 Operational Semantics
[19]TTCN-3-A new Test Specification Language for Black-Box Testing of Distributed Systems,Jens Grabowski,Germany
[20]丁鹏,沈小玲.TTCN-3及其图形格式的应用.南京邮电学院学报,2002.6:71-74.
[21]ITU-T Recommendation Z.120(2004):"Message sequence chart(MSC)"
[22]丁静,吴辰文.一致性测试中的TTCN和MSC.甘肃科技,2005.2:52-53
[23]Paul Baker.Test Generation towards TTCN-3,TTCN-3 User Conference.May 3-52004
[24]宋茂强,等.通信软件设计基础.北京邮电大学出版社,2001:38-39
[25]Jeckle,M.,Rupp,C.,Hahn,J.,Zengler,B.,Queins,S.:UML 2 glasklar.1 edn.Hanser (2004)
[26]http://www.eclipse.org/
[27]Yunfeng Ma,Huiqun Zhao.Design and Implementation of TTCN-3 IDE based on Eclipse.2005:245-250
[25]Bill Moore,David Dean.Eclipse development using the Graphical Editing Framework and the Eclipse Modeling Framework.ibm.com/redbooks:43-62
[29]阎宏.Java与模式.电子工业出版社,2002:632-657
[30]甘树满,王秀明.Eclipse插件开发方法与实战.电子工业出版社,2006:305-306
[2]毕军,史美林.计算机网络协议测试及其发展.电信科学,1996.7:51-54
[3]TTCN-3-A new Test Specification Language.for Black-Box Testing of Distributed Systems[C],Jens Grabowski,Germany.In:Proceedings of the 17th International Conference and Exposition on Testing Computer Software(TCS'2000),Theme:Testing Technology vs.Testers' Requirements,Washington D.C.,2000-02
[4]张云勇.下一代网络义务开发技术.电子工业出版社,2004:173-192
[5]ISO/IEC 9646-1(1994):"Information technology-Open Systems Interconnection-Conformance testing methodology and framework-Part 1:General concepts"
[6]ISO/IEC 9646-1.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 1:General concepts.1991
[7]ISO/IEC 9646-2.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 2:Abstract test suite specification.1991
[8]ISO/IEC 9646-3.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 3:The tree and tabular combined notation.1991
[9]ISO/IEC 9646-4.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 4:Test realization.1991
[10]ISO/IEC 9646-5.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 5:Requirements and guidance for test laboratories and their clients for the conformance assessment process.1991
[11]ISO/IEC 9646-6.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 6:Profile test specification.1994
[12]ISO/IEC 9646-7.Information Processing Systems,Open System Interconnection,OSI Conformance Testing Methodology and Framework.Part 7:Implement conformation statements.1994
[13]ETS 300 406.Methods for Testing and Specification(MTS);Protocol and profile conformance testing specifications.Standardization methodology.April 1995:45-61
[14]ETSI ES 201 873-1 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 1:TTCN-3 Core Language
[15]郝丹丹,付晓宇译.测试描述方法(MTS);测试和测试控制表示法第三版;第一部分:TTCN-3核心语言ETSI ES 201 873-1 V2.2.1(2003-02)
[16]ETSI ES 201 873-2 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 2:TTCN-3 Tabular presentation Format(TFT)
[17]ETSI ES 201 873-3 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 3:TTCN-3 Graphical presentation Format(GFT)
[18]ETSI ES 201 873-4 V3.1.1(2005-06),Methods for Testing and Specification(MTS);The Testing and Test Control Notation version 3;Part 4:TTCN-3 Operational Semantics
[19]TTCN-3-A new Test Specification Language for Black-Box Testing of Distributed Systems,Jens Grabowski,Germany
[20]丁鹏,沈小玲.TTCN-3及其图形格式的应用.南京邮电学院学报,2002.6:71-74.
[21]ITU-T Recommendation Z.120(2004):"Message sequence chart(MSC)"
[22]丁静,吴辰文.一致性测试中的TTCN和MSC.甘肃科技,2005.2:52-53
[23]Paul Baker.Test Generation towards TTCN-3,TTCN-3 User Conference.May 3-52004
[24]宋茂强,等.通信软件设计基础.北京邮电大学出版社,2001:38-39
[25]Jeckle,M.,Rupp,C.,Hahn,J.,Zengler,B.,Queins,S.:UML 2 glasklar.1 edn.Hanser (2004)
[26]http://www.eclipse.org/
[27]Yunfeng Ma,Huiqun Zhao.Design and Implementation of TTCN-3 IDE based on Eclipse.2005:245-250
[25]Bill Moore,David Dean.Eclipse development using the Graphical Editing Framework and the Eclipse Modeling Framework.ibm.com/redbooks:43-62
[29]阎宏.Java与模式.电子工业出版社,2002:632-657
[30]甘树满,王秀明.Eclipse插件开发方法与实战.电子工业出版社,2006:305-306