Штучний інтелект

Анотація: The survey includes description of prevailing coverage types and modern methods of code-based tests generation for imperative programs. Special emphasis is made for methods, which are based on symbolic execution technique. Advantages of different approaches and disadvantages of the automatic tests generation as a whole are discussed.

Ключові слова: testing, coverage, state-space search reduction.

Посилання:

1. Myers G.J. The Art Of Software Testing. N.Y. John Wiley & Sons, Inc. –2004. – 254 p.
2. King J. Symbolic execution and program testing // In Comm. of the ACM. –1976. –Vol.19. –P. 385–394.
3. Su T., Wu K., Miao W., Pu G., and oth. A Survey on Data-Flow Testing // ACM Comput. Survey. –2017. –Vol. 50(1). –35 p.
4. Ramler R., Wetzlmaier T., Klammer C. An empirical study on the application of mutation testing for asafety-critical industrial software system // Proc. of Symp. on Applied Comput. –2017. – P. 1401–1408.
5. Heimdahl M., Whalen M., Rajan A., Staats M. On MC/DC and implementation structure: An empiricalstudy // In Proc. of Digital Avionics Systems Conf. –2008. –5 p.
6. Dupuy A., Leveson N. An Empirical Evaluation of the MC/DC Coverage Criterion on the HETE-2Satellite Software // In Proc. of Digital Aviation Systems Conf. –2000. –7 p.
7. Rapps S., Weyuker E. Data Flow Analysis Techniques for Test Data Selection // In Proc. of Int. Conf.of Software Engineering. –1982. –P. 272–277.
8. Natofos S. On Testing With Required Elements // In Proc. of COMPSAC '81, IEEE. –1981. –P.132–139.
9. Laski J., Korel B. A Data Flow Oriented Program Testing Strategy // IEEE Transactions on SoftwareEngineering. –1983. –Vol. 9 (3). –P. 347–354.
10. Harrold M., Soffa M. Interprocedual data flow testing // In Proc. of the ACM SIGSOFT '89 Symp. onSoftware testing, analysis, and verification. –1989. –P. 158–167.
11. Ostrand T., Weyuker E. Data flow-based test adequacy analysis for languages with pointers // In Proc.of the Symp. on Testing, analysis, and verification. –1991. –P. 74–86.
12. Qi Y., Kung D., Wong E. An agent-based data-flow testing approach for Web applications //Information and Software Technology. –2006. –Vol. 48(12). –P. 1159–1171.
13. Denaro G., Margara A., Pezze M., Vivanti M. Dynamic data flow testing of object oriented systems //In Proc. of Int. Conf. on Software Engineering. –2015. –P. 947–958.
14. Cadar C., Ganesh V., Pawlowski P., Dill D., Engler D. EXE: a system for Automatically GeneratingInputs of Death using symbolic execution // In ACM Comput. and Comm. Security. –2006. –P. 322–335.
15. Hessel A., Petterson P. A global algorithm for model-based test suite generation // Electr. Notes Theor.Comput. Sci. –2007. –Vol. 190(2). –P. 47–59.
16. Petrenko A., Silva S., Maldonado J. Model-based testing of software and systems: recent advances andchallenges // Software tools for technology transfer. –2012. –Vol. 14(4). –P. 383–386.
17. Fraser G., Wotawa F., Ammann P. Testing with model checkers: a survey // Software Testing,Verification and Reliability. –2009. –Vol. 19. –P. 215–261.
18. Rayadurgam S., Heimdahl M. Coverage based test-case generation using model checkers // In Proc. ofIEEE Int. Conf. on the Engineering of Computer Based Systems. –2001. –P. 83–91.
19. Hong H., Cha S., Lee I., Sokolsky O., Ural H. Data Flow Testing as Model Checking // In Proc. of Int.Conf. on Software Engineering. –2003. –P. 232–242.
20. Chen T., Zhang X. and oth. State of the art: dynamic symbolic execution for automated test generation// Future generation computer systems. –2013. –Vol. 29(7). –P. 1758–1773.
21. Pasareanu C., Rungta N., Visser W. Symbolic execution with mixed concrete-symbolic solving // InProc. of ACM Int. Sympos. of Software Testing and Analysis. –2011. –P. 35–44.
22. Godefroid O., Klarlund N., Sen K. DART: directed automated random testing // In Proc. of ACMSIGPLAN Conf. on Programming Language Design and Implementation. –2005. –P. 213–223.
23. Godefroid P., Levin M., Molnar D. Automated whitebox fuzz testing // In Proc. of Network andDistributed Systems Security. –2008. –16 p.
24. Godefroid P., Levin M., Molnar D. SAGE: Whitebox Fuzzing for Security Testing //ACM Queue. –2012. –Vol. 10(1). –20 p.
25. Tillmann N., Halleux J. Pex – White Box Test Generation for .NET // In LNCS, Tests and Proofs. –2008. –Vol. 4966. –P. 134–153.
26. Christakis M., Godefroid P. IC-Cut: A Compositional Search Strategy for Dynamic Test Generation //In Proc. of Int. Symp. SPIN 2015 on Model Checking Software. –2015. –Vol. 9232. –P. 300–318.
27. Teneja K., Zhang Y., Xie T. MODA: automated test generation for database applications via mockobjects // In Proc. of Int. Conf. on Automated Software Engineering. –2010. –P. 289–292.
28. Karp R. Reducibility among combinatorial problems // Complexity of computer computations. –1972.–P. 85–103.
29. Yoo S., Harman M. Regression testing minimization, selection and prioritization: a survey // SoftwareTesting, Verification & Reliability. –2012. –Vol. 22(2). –P. 67–120.
30. Schrammel P., Melham T., Kroening D. Generating test case chains for reactive systems // Int. J. Softw.Tools Technology Transfer. –2016. –Vol. 16(3). –P. 319–334.
31. Kolchin A., Letichevsky A., Peschanenko V., Drobintsev P., Kotlyarov V. An approach to creatingconcretized test scenarios within test automation technology for industrial software projects //Automatic Control and Computer Sciences. –2013. –Vol. 47(7). –P. 433–442.
32. Heimdahl M., Devaraj G., Weber R. Specification test coverage adequacy criteria = specification testgeneration inadequacy criteria? // In IEEE Computer society, HASE. –2004. –P. 178–186.
33. Kolchin A.V., Potienko S.V. Metod generatsii testovyih dannyih po ishodnomu kodu Java programm //Iskusstvennyiy intellekt. –2016. –#3. –S. 50–58.
34. Barr E., Harman M., McMinn P., Shahbaz M., Yoo S. The oracle problem in software testing: a survey// IEEE Transactions on Software Engineering. –2015. –Vol. 41. –P. 507–525.
35. Athanasiou D., Nugroho A., Visser J., Zaidman A. Test code quality and its relation to issue handlingperformance // IEEE Transactions on Software Engineering. –2014. –Vol. 40(11). –P. 1100–1125.
36. Rojas J., Fraser G, Arcuri A. Automated unit test generation during softweare development: a controlledexperiment and thing-aloud observations. // In proc. Of the Int. Sympos. on Software Testing andAnalysis. –2015. –P. 338–349.
37. Meszaros G. XUnit Test Patterns: refactoring test code. Addison-Wesley Professional. –2007. –944 p.
38. Palomba F., Panichella A., Zaidman A., Oliveto R., Lucia A. Automatic Test Case Generation: What ifTest Code Quality Matters? // In Proc. of Int. Symp. on Softw. Testing and Analysis. –2016. –P. 130–141.
39. Kolchin A. About efficiency problems of reachability proving using model checking approach // In Proc.of Int. Conf. on Computational Intelligence (results, problems and perspectives). –2017. –P. 95–96.
40. Braione P., Denaro G., Mattavelli A., Vivanti M., Muhammad A. Software testing with code-based testgenerators: data and lessons learned from a case study with an industrial software component //Software Quality Journal. –2014. –P. 311–333.
41. Cseppento L., Micskei Z. Evaluating symbolic execution-based test tools // In IEEE Int. Conf. onSoftware Testing, Verification and Validation. –2015. –P. 1–10.
42. Devaraj G., Heimdahl M., Liang D. Coverage-directed test generation with model checkers: challengesand opportunities // In Proc. of Int. Conf. COMPSAC’2005. –2005. –Vol. 1. –P. 455–462.
43. Fraser G., Arcuri A. 1600 faults in 100 projects: automatically finding faults while achieving highcoverage with Evosuite // Emperical software engineering. –2015. –Vol. 20(3). –P. 611–639.
44. Letichevsky A., Letychevskyi O., Peschanenko V. Symbolic Modelling in White-Box Model-BasedTesting // In Proc. of Int. Conf. on Artificial Intelligence, Modelling and Simulation. –2015. –P. 237–240.
45. Letychevskyi O. Paradigms of Model-Based and Symbolic Testing of Software Systems // Cyberneticsand Systems Analysis. –2015. –V. 51. –N 5. –P. 692–703.
46. Galler S., Aichernig B. Survey on test data generation tools // Int. Journal on Software Tools forTechnology Transfer. –2014. –Vol. 16(6). –P. 727–751.
47. [Elektronnyiy resurs]. –Rezhim dostupa:: http://mit.bme.hu/~micskeiz/pages/modelbased_testing.html