QUASI-RANDOM TESTING OF COMPUTER SYSTEMS
Abstract
Various modified random testing approaches have been proposed for computer system testing in the black box environment. Their effectiveness has been evaluated on the typical failure patterns by employing three measures, namely, P-measure, E-measure and F-measure. A quasi-random testing, being a modified version of the random testing, has been proposed and analyzed. The quasi-random Sobol sequences and modified Sobol sequences are used as the test patterns. Some new methods for Sobol sequence generation have been proposed and analyzed.
About the Authors
S. V. Yarmolik
Белорусский государственный университет информатики и радиоэлектроники
Russian Federation
Russian Federation
V. N. Yarmolik
Белорусский государственный университет информатики и радиоэлектроники
Russian Federation
Russian Federation
References
1. Rajsuman, R. System-On-A-Chip: Design and Test / R. Rajsuman. – London : Artech House Publishers, 2000. – 303 p.
2. Иванюк, А.А. Проектирование встраиваемых цифровых устройств и систем /А.А. Иванюк. – Минск : Бестпринт, 2012. – 338 с.
3. Semiconductor Intellectual Property: Continuing on the Path to Grow. ASIC IP report / Semiconductor Research Corp. Research Triangle Park. – NC, USA, 2007. – 100 p.
4. Harris, I.G. Hardware-Software Co-validation: Fault Models and Test Generation /I.G. Harris // IEEE Design & Test of Computers. – 2003. – Vol. 20, № 1. – P. 40–47.
5. Hamill, M. Common Trends in Software Fault and Failure Data / M. Hamill, K. GosevaPopstojanova // IEEE Transaction on Software Engineering. – 2009. – Vol. 35, № 4. – P. 484–496.
6. Comparative Analysis of Hardware and Software Fault Tolerance: Impact on Software Reliability Engineering / H. Ammar [et al.] // Institute for Software Research Fairmont, WV 26554 USA
7. [Electronic resourse] January 15, 1999. – Mode of access : www.isr.wvu.edu. – Date of access :12.07.2012.
8. Ярмолик, С.В. Маршевые тесты для самотестирования ОЗУ / С.В. Ярмолик, А.П. Занкович, А.А. Иванюк. – Минск : Изд. центр БГУ, 2009. – 270 с.
9. White, L. A domain strategy for computer program testing / L. White, E. Cohen // IEEE Transaction on Software Engineering. – 1980. – Vol. SE–6, № 3. – P. 247–257.
10. Schnekenburger, C. Towards the determination of typical failure patterns / C. Schnekenburger,J. Mayer // In Proc. of Fourth Intern. Workshop on Software Quality Assurance: in conjunction with the 6th ESE/FSE joint meeting, ser. SOQUA’07. – N.Y., USA : ACM, 2007. – P. 90–93.
11. Proportional sampling strategy guidelines for software testing practitioner / F.T. Chan [et al.] // Information and Software Technology – 1996. – Vol. 38, № 12. – P. 775–782.
12. Shahbazi, A. Centroidal Voronoi Tessellation – a New Approach to Random Testing / A. Shahbazi, A.F. Tappenden, J. Miller // IEEE Transaction on Software Engineering. – 2013. –Vol. 39, № 2. – P. 163–183.
13. Fault Pattern Oriented Defect Diagnosis for Memories / C.W. Wang [et al.] // In Proc. of Intern. Test Conference (ITC 2003). – Charlotte, NC, USA, 2003. – P. 29–38.
14. Using electrical bitmap results from embedded memory to enhance yield / A. Segal [et al.] //IEEE Design & Test of Computers. – 2001. – Vol. 15, № 3. – P. 28–39.
15. Goor, A.J. Testing Semiconductor Memories, Theory and Practice / A.J. Goor. – UK,Chichester : John Wiley & Sons, 1991. – 536 p.
16. Barzilai, Z. Exhaustive Generation of Bit Pattern with Application to VLSI Self–Testing /Z. Barzilai, D. Coppersmith, A. Rozenberg // IEEE Transactions on Computers. – 1983. – Vol. C–31,№ 2. – P. 190–194.
17. Furuya, K. A probabilistic approach to locally exhaustive testing / K. Furuya // IEEE Transactions on IEICE. – 1989. – Vol. E72, № 5. – P. 656–660.
18. Testing of embedded RAM using exhaustive random sequence / H. Maeno [et al.] // In Proc. of Intern. Test Conference (ITC 1987). – Washington, D.C., USA, 1987. – P. 105–110.
19. Mrozek, I. Antirandom Test Vector for BIST in Hardware/Software Systems / I. Mrozek,V. Yarmolik // Fundamenta Informaticae. – 2012. – Vol. 119, № 2. – P. 163–185.
20. Malaiya, Y.K. The coverage problem for random testing / Y.K. Malaiya, S. Yang // In Proc. of Intern. Test Conference (ITC 1984). – Philadelphia, PA, USA, 1984. – P. 237–242.
21. Malaiya, Y.K. An examination of fault exposure ratio / Y.K. Malaiya, A. Mayrhauser,P.K. Srimani // IEEE Transactions on Software Engineering. – 1993. – Vol. 19, № 11. – P. 1087–1094.
22. Malaiya, Y.K. Antirandom Testing: Getting the most out of Back-Box Testing / Y.K. Malaiya,S. Yang // In Proc. of Sixth Intern. Symposium on Software Reliability Engineering. – Toulouse,France, 1995. – P. 86–95.
23. Antirandom Testing: A Distance-Based Approach / S.H. Wu [et al.] // VLSI Design. –2008. – № 2. – P. 1–9.
24. Fast Antirandom (FAR) Test Generation / A. Mayrhause [et al.] // In Proc. of the Third IEEE Intern.High-Assurance System Engineering Symposium. – Washington, D.C., USA, 1998. – P. 262–269.
25. Mrozek, I. Iterative Antirandom Testing / I. Mrozek, V.N. Yarmolik // Journal of Electronic Testing: Theory and Applications (JETTA). – 2012. – Vol. 9, № 3. – P. 251–266.
26. Ярмолик, С.В. Управляемое случайное тестирование / C.В. Ярмолик, В.Н. Ярмолик //Информатика. – 2011. – № 1(29). – С. 79–88.
27. Ярмолик, С.В. Управляемые вероятностные тесты / C.В. Ярмолик, В.Н. Ярмолик //Автоматика и телемеханика. – 2012. – № 10. – С. 142–155.
28. Sobol, I.M. Uniformly distributed sequences with an additional uniform property /I.M. Sobol // USSR Comput. Math. Math. Phys. – 1976. – Vol. 16. – P. 236–242.
29. Niederreiter, H. Point sets and sequences with small discrepancy / H. Niederreiter //Monatshefte fur Mathematik. – 1987. – Vol. 104, № 4. – P. 273–337.
30. Halton, J.H. On the efficiency of certain quasi-random sequences of points in evaluatingmulti-dimensional integrals / J.H. Halton // Numerische Mathemati. – 1960. – Vol. 2, № 1. – P. 84–90.
31. Chi, H. Computational investigations of quasi-random sequences in generating test cases for specification-based tests / H. Chi, E.I. Jones // Proc. of the 38th on Winter Conference, ser. WSC’06.Winter Simulation Conference. – Monterey, CA, USA, 2006. – P. 975–980.
32. Chen, T.Y. Quasi-Random Testing / T.Y. Chen, R. Merkel // IEEE Transaction on Reliability. – 2007. – Vol. 56, № 3. – P. 562–568.
33. Ярмолик, В.Н. Генерирование и применение псевдослучайных сигналов в системах испытаний и контроля / В.Н. Ярмолик, С.Н. Демиденко. – Минск : Наука и техника, 1986. – 200 с.
34. Соболь, И.М. Вычисление несобственных интегралов при помощи равномерно распределенных последовательностей / И.М. Соболь // Доклады АН СССР. – 1973. – Т. 210, № 2. –С. 278–281.
35. Соболь, И.М. Точки, равномерно заполняющие многомерный куб / И.М. Соболь. –М. : Знание, 1985. – 32 с.
36. Savage, C. A survey of combinatorial Gray code // SIAM Review / C. Savage. – 1997. –Vol. 39, № 4. – P. 605–629.
Review
For citations:
Yarmolik S.V., Yarmolik V.N. QUASI-RANDOM TESTING OF COMPUTER SYSTEMS. Informatics. 2013;(3):65-81. (In Russ.)
Views: 844
Email this article 