Abstract:
Software testing is a time consuming process. In general, software companies spend about 50% of development time on testing. On the other hand, lack of testing implies financial and other risks. In the case of systematic testing a suitable test suite should provide an appropriate code coverage. A lot of code-based test generators have been developed in order to provide systematic code coverage. Such tools tend to produce lots of almost unreadable test suites which hard to verify manually. This problem is formulated as a Human Oracle Cost Problem. This work introduces a method for readability optimization of automatically generated test suites in context of Symbolic Execution. It uses natural language model in order to optimze each test case. This conception has been applied first in the Search Based Testing paradyghm. In contrast of existing search based tool proposed DSE-based tool uses SMT-solver in order to incrementally improve readability of a single test for a single program path. To validate proposed method a tool on top of LLVM and CVC4 frameworks is created. Experimental evaluation on 12 string processing routins from the Linux repository shows that this method can improve test inputs gracefully.
Keywords:
code-based test generation, symbolic execution, human oracle cost, bigram language model.
Bibliographic databases:
Document Type:
Article
Language: Russian
Citation:
I. A. Yakimov, A. S. Kuznetsov, “Test readability optimization in context of symbolic execution”, Proceedings of ISP RAS, 28:5 (2016), 227–238
\Bibitem{YakKuz16}
\by I.~A.~Yakimov, A.~S.~Kuznetsov
\paper Test readability optimization in context of symbolic execution
\jour Proceedings of ISP RAS
\yr 2016
\vol 28
\issue 5
\pages 227--238
\mathnet{http://mi.mathnet.ru/tisp78}
\crossref{https://doi.org/10.15514/ISPRAS-2016-28(5)-14}
\elib{https://elibrary.ru/item.asp?id=27679162}
Linking options:
https://www.mathnet.ru/eng/tisp78
https://www.mathnet.ru/eng/tisp/v28/i5/p227
This publication is cited in the following 1 articles:
D V Gruzenkin, I A Yakimov, A S Kuznetsov, R Yu Tsarev, G V Grishina, A N Pupkov, N V Bystrova, “Algorithm diversity metric for N-version software”, J. Phys.: Conf. Ser., 1333:3 (2019), 032086