informИнформатикаInformatics1816-03012617-6963UIIP NASBinform-93Research ArticleЛОГИЧЕСКОЕ ПРОЕКТИРОВАНИЕLOGICAL DESIGNКВАЗИСЛУЧАЙНОЕ ТЕСТИРОВАНИЕ ВЫЧИСЛИТЕЛЬНЫХ СИСТЕМQUASI-RANDOM TESTING OF COMPUTER SYSTEMSЯрмоликС. В.YarmolikS. V.yarmolik@cosmostv.byЯрмоликВ. Н.YarmolikV. N.yarmolik10ru@yahoo.comБелорусский государственный университет информатики и радиоэлектроникиRussian Federation201301102016036581Copyright © Ярмолик С.В., Ярмолик В.Н., 20162016Ярмолик С.В., Ярмолик В.Н.Yarmolik S.V., Yarmolik V.N.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://inf.grid.by/jour/article/view/93

Анализируются причинно-следственные связи при возникновении неисправностей вычисли-тельных систем. Даются определения понятий «неисправность», «ошибка» и «неисправное поведение вычислительных систем», показывается их общность для программной и аппаратной частей вычислительных систем. Рассматривается классификация обобщенных входных тестовых воздей-ствий на три категории: точечные тестовые наборы, узкополосные тестовые наборы и блочные тестовые наборы. Приводится анализ методов тестирования вычислительных систем по методике черного ящика, показывается эффективность использования квазислучайного тестирования. Анали-зируются и предлагаются методы формирования квазислучайных тестовых воздействий.

Various modified random testing approaches have been proposed for computer system testing in the black box environment. Their effectiveness has been evaluated on the typical failure patterns by employing three measures, namely, P-measure, E-measure and F-measure. A quasi-random testing, being a modified version of the random testing, has been proposed and analyzed. The quasi-random Sobol sequences and modified Sobol sequences are used as the test patterns. Some new methods for Sobol sequence generation have been proposed and analyzed.

ReferencesRajsuman, R. System-On-A-Chip: Design and Test / R. Rajsuman. – London : Artech House Publishers, 2000. – 303 p.Rajsuman, R. System-On-A-Chip: Design and Test / R. Rajsuman. – London : Artech House Publishers, 2000. – 303 p.Иванюк, А.А. Проектирование встраиваемых цифровых устройств и систем /А.А. Иванюк. – Минск : Бестпринт, 2012. – 338 с.Иванюк, А.А. Проектирование встраиваемых цифровых устройств и систем /А.А. Иванюк. – Минск : Бестпринт, 2012. – 338 с.Semiconductor Intellectual Property: Continuing on the Path to Grow. ASIC IP report / Semiconductor Research Corp. Research Triangle Park. – NC, USA, 2007. – 100 p.Semiconductor Intellectual Property: Continuing on the Path to Grow. ASIC IP report / Semiconductor Research Corp. Research Triangle Park. – NC, USA, 2007. – 100 p.Harris, I.G. Hardware-Software Co-validation: Fault Models and Test Generation /I.G. Harris // IEEE Design & Test of Computers. – 2003. – Vol. 20, № 1. – P. 40–47.Harris, I.G. Hardware-Software Co-validation: Fault Models and Test Generation /I.G. Harris // IEEE Design & Test of Computers. – 2003. – Vol. 20, № 1. – P. 40–47.Hamill, M. Common Trends in Software Fault and Failure Data / M. Hamill, K. GosevaPopstojanova // IEEE Transaction on Software Engineering. – 2009. – Vol. 35, № 4. – P. 484–496.Hamill, M. Common Trends in Software Fault and Failure Data / M. Hamill, K. GosevaPopstojanova // IEEE Transaction on Software Engineering. – 2009. – Vol. 35, № 4. – P. 484–496.Comparative Analysis of Hardware and Software Fault Tolerance: Impact on Software Reliability Engineering / H. Ammar [et al.] // Institute for Software Research Fairmont, WV 26554 USAComparative Analysis of Hardware and Software Fault Tolerance: Impact on Software Reliability Engineering / H. Ammar [et al.] // Institute for Software Research Fairmont, WV 26554 USA[Electronic resourse] January 15, 1999. – Mode of access : www.isr.wvu.edu. – Date of access :12.07.2012.[Electronic resourse] January 15, 1999. – Mode of access : www.isr.wvu.edu. – Date of access :12.07.2012.Ярмолик, С.В. Маршевые тесты для самотестирования ОЗУ / С.В. Ярмолик, А.П. Занкович, А.А. Иванюк. – Минск : Изд. центр БГУ, 2009. – 270 с.Ярмолик, С.В. Маршевые тесты для самотестирования ОЗУ / С.В. Ярмолик, А.П. Занкович, А.А. Иванюк. – Минск : Изд. центр БГУ, 2009. – 270 с.White, L. A domain strategy for computer program testing / L. White, E. Cohen // IEEE Transaction on Software Engineering. – 1980. – Vol. SE–6, № 3. – P. 247–257.White, L. A domain strategy for computer program testing / L. White, E. Cohen // IEEE Transaction on Software Engineering. – 1980. – Vol. SE–6, № 3. – P. 247–257.Schnekenburger, C. Towards the determination of typical failure patterns / C. Schnekenburger,J. Mayer // In Proc. of Fourth Intern. Workshop on Software Quality Assurance: in conjunction with the 6th ESE/FSE joint meeting, ser. SOQUA’07. – N.Y., USA : ACM, 2007. – P. 90–93.Schnekenburger, C. Towards the determination of typical failure patterns / C. Schnekenburger,J. Mayer // In Proc. of Fourth Intern. Workshop on Software Quality Assurance: in conjunction with the 6th ESE/FSE joint meeting, ser. SOQUA’07. – N.Y., USA : ACM, 2007. – P. 90–93.Proportional sampling strategy guidelines for software testing practitioner / F.T. Chan [et al.] // Information and Software Technology – 1996. – Vol. 38, № 12. – P. 775–782.Proportional sampling strategy guidelines for software testing practitioner / F.T. Chan [et al.] // Information and Software Technology – 1996. – Vol. 38, № 12. – P. 775–782.Shahbazi, A. Centroidal Voronoi Tessellation – a New Approach to Random Testing / A. Shahbazi, A.F. Tappenden, J. Miller // IEEE Transaction on Software Engineering. – 2013. –Vol. 39, № 2. – P. 163–183.Shahbazi, A. Centroidal Voronoi Tessellation – a New Approach to Random Testing / A. Shahbazi, A.F. Tappenden, J. Miller // IEEE Transaction on Software Engineering. – 2013. –Vol. 39, № 2. – P. 163–183.Fault Pattern Oriented Defect Diagnosis for Memories / C.W. Wang [et al.] // In Proc. of Intern. Test Conference (ITC 2003). – Charlotte, NC, USA, 2003. – P. 29–38.Fault Pattern Oriented Defect Diagnosis for Memories / C.W. Wang [et al.] // In Proc. of Intern. Test Conference (ITC 2003). – Charlotte, NC, USA, 2003. – P. 29–38.Using electrical bitmap results from embedded memory to enhance yield / A. Segal [et al.] //IEEE Design & Test of Computers. – 2001. – Vol. 15, № 3. – P. 28–39.Using electrical bitmap results from embedded memory to enhance yield / A. Segal [et al.] //IEEE Design & Test of Computers. – 2001. – Vol. 15, № 3. – P. 28–39.Goor, A.J. Testing Semiconductor Memories, Theory and Practice / A.J. Goor. – UK,Chichester : John Wiley & Sons, 1991. – 536 p.Goor, A.J. Testing Semiconductor Memories, Theory and Practice / A.J. Goor. – UK,Chichester : John Wiley & Sons, 1991. – 536 p.Barzilai, Z. Exhaustive Generation of Bit Pattern with Application to VLSI Self–Testing /Z. Barzilai, D. Coppersmith, A. Rozenberg // IEEE Transactions on Computers. – 1983. – Vol. C–31,№ 2. – P. 190–194.Barzilai, Z. Exhaustive Generation of Bit Pattern with Application to VLSI Self–Testing /Z. Barzilai, D. Coppersmith, A. Rozenberg // IEEE Transactions on Computers. – 1983. – Vol. C–31,№ 2. – P. 190–194.Furuya, K. A probabilistic approach to locally exhaustive testing / K. Furuya // IEEE Transactions on IEICE. – 1989. – Vol. E72, № 5. – P. 656–660.Furuya, K. A probabilistic approach to locally exhaustive testing / K. Furuya // IEEE Transactions on IEICE. – 1989. – Vol. E72, № 5. – P. 656–660.Testing of embedded RAM using exhaustive random sequence / H. Maeno [et al.] // In Proc. of Intern. Test Conference (ITC 1987). – Washington, D.C., USA, 1987. – P. 105–110.Testing of embedded RAM using exhaustive random sequence / H. Maeno [et al.] // In Proc. of Intern. Test Conference (ITC 1987). – Washington, D.C., USA, 1987. – P. 105–110.Mrozek, I. Antirandom Test Vector for BIST in Hardware/Software Systems / I. Mrozek,V. Yarmolik // Fundamenta Informaticae. – 2012. – Vol. 119, № 2. – P. 163–185.Mrozek, I. Antirandom Test Vector for BIST in Hardware/Software Systems / I. Mrozek,V. Yarmolik // Fundamenta Informaticae. – 2012. – Vol. 119, № 2. – P. 163–185.Malaiya, Y.K. The coverage problem for random testing / Y.K. Malaiya, S. Yang // In Proc. of Intern. Test Conference (ITC 1984). – Philadelphia, PA, USA, 1984. – P. 237–242.Malaiya, Y.K. The coverage problem for random testing / Y.K. Malaiya, S. Yang // In Proc. of Intern. Test Conference (ITC 1984). – Philadelphia, PA, USA, 1984. – P. 237–242.Malaiya, Y.K. An examination of fault exposure ratio / Y.K. Malaiya, A. Mayrhauser,P.K. Srimani // IEEE Transactions on Software Engineering. – 1993. – Vol. 19, № 11. – P. 1087–1094.Malaiya, Y.K. An examination of fault exposure ratio / Y.K. Malaiya, A. Mayrhauser,P.K. Srimani // IEEE Transactions on Software Engineering. – 1993. – Vol. 19, № 11. – P. 1087–1094.Malaiya, Y.K. Antirandom Testing: Getting the most out of Back-Box Testing / Y.K. Malaiya,S. Yang // In Proc. of Sixth Intern. Symposium on Software Reliability Engineering. – Toulouse,France, 1995. – P. 86–95.Malaiya, Y.K. Antirandom Testing: Getting the most out of Back-Box Testing / Y.K. Malaiya,S. Yang // In Proc. of Sixth Intern. Symposium on Software Reliability Engineering. – Toulouse,France, 1995. – P. 86–95.Antirandom Testing: A Distance-Based Approach / S.H. Wu [et al.] // VLSI Design. –2008. – № 2. – P. 1–9.Antirandom Testing: A Distance-Based Approach / S.H. Wu [et al.] // VLSI Design. –2008. – № 2. – P. 1–9.Fast Antirandom (FAR) Test Generation / A. Mayrhause [et al.] // In Proc. of the Third IEEE Intern.High-Assurance System Engineering Symposium. – Washington, D.C., USA, 1998. – P. 262–269.Fast Antirandom (FAR) Test Generation / A. Mayrhause [et al.] // In Proc. of the Third IEEE Intern.High-Assurance System Engineering Symposium. – Washington, D.C., USA, 1998. – P. 262–269.Mrozek, I. Iterative Antirandom Testing / I. Mrozek, V.N. Yarmolik // Journal of Electronic Testing: Theory and Applications (JETTA). – 2012. – Vol. 9, № 3. – P. 251–266.Mrozek, I. Iterative Antirandom Testing / I. Mrozek, V.N. Yarmolik // Journal of Electronic Testing: Theory and Applications (JETTA). – 2012. – Vol. 9, № 3. – P. 251–266.Ярмолик, С.В. Управляемое случайное тестирование / C.В. Ярмолик, В.Н. Ярмолик //Информатика. – 2011. – № 1(29). – С. 79–88.Ярмолик, С.В. Управляемое случайное тестирование / C.В. Ярмолик, В.Н. Ярмолик //Информатика. – 2011. – № 1(29). – С. 79–88.Ярмолик, С.В. Управляемые вероятностные тесты / C.В. Ярмолик, В.Н. Ярмолик //Автоматика и телемеханика. – 2012. – № 10. – С. 142–155.Ярмолик, С.В. Управляемые вероятностные тесты / C.В. Ярмолик, В.Н. Ярмолик //Автоматика и телемеханика. – 2012. – № 10. – С. 142–155.Sobol, I.M. Uniformly distributed sequences with an additional uniform property /I.M. Sobol // USSR Comput. Math. Math. Phys. – 1976. – Vol. 16. – P. 236–242.Sobol, I.M. Uniformly distributed sequences with an additional uniform property /I.M. Sobol // USSR Comput. Math. Math. Phys. – 1976. – Vol. 16. – P. 236–242.Niederreiter, H. Point sets and sequences with small discrepancy / H. Niederreiter //Monatshefte fur Mathematik. – 1987. – Vol. 104, № 4. – P. 273–337.Niederreiter, H. Point sets and sequences with small discrepancy / H. Niederreiter //Monatshefte fur Mathematik. – 1987. – Vol. 104, № 4. – P. 273–337.Halton, J.H. On the efficiency of certain quasi-random sequences of points in evaluatingmulti-dimensional integrals / J.H. Halton // Numerische Mathemati. – 1960. – Vol. 2, № 1. – P. 84–90.Halton, J.H. On the efficiency of certain quasi-random sequences of points in evaluatingmulti-dimensional integrals / J.H. Halton // Numerische Mathemati. – 1960. – Vol. 2, № 1. – P. 84–90.Chi, H. Computational investigations of quasi-random sequences in generating test cases for specification-based tests / H. Chi, E.I. Jones // Proc. of the 38th on Winter Conference, ser. WSC’06.Winter Simulation Conference. – Monterey, CA, USA, 2006. – P. 975–980.Chi, H. Computational investigations of quasi-random sequences in generating test cases for specification-based tests / H. Chi, E.I. Jones // Proc. of the 38th on Winter Conference, ser. WSC’06.Winter Simulation Conference. – Monterey, CA, USA, 2006. – P. 975–980.Chen, T.Y. Quasi-Random Testing / T.Y. Chen, R. Merkel // IEEE Transaction on Reliability. – 2007. – Vol. 56, № 3. – P. 562–568.Chen, T.Y. Quasi-Random Testing / T.Y. Chen, R. Merkel // IEEE Transaction on Reliability. – 2007. – Vol. 56, № 3. – P. 562–568.Ярмолик, В.Н. Генерирование и применение псевдослучайных сигналов в системах испытаний и контроля / В.Н. Ярмолик, С.Н. Демиденко. – Минск : Наука и техника, 1986. – 200 с.Ярмолик, В.Н. Генерирование и применение псевдослучайных сигналов в системах испытаний и контроля / В.Н. Ярмолик, С.Н. Демиденко. – Минск : Наука и техника, 1986. – 200 с.Соболь, И.М. Вычисление несобственных интегралов при помощи равномерно распределенных последовательностей / И.М. Соболь // Доклады АН СССР. – 1973. – Т. 210, № 2. –С. 278–281.Соболь, И.М. Вычисление несобственных интегралов при помощи равномерно распределенных последовательностей / И.М. Соболь // Доклады АН СССР. – 1973. – Т. 210, № 2. –С. 278–281.Соболь, И.М. Точки, равномерно заполняющие многомерный куб / И.М. Соболь. –М. : Знание, 1985. – 32 с.Соболь, И.М. Точки, равномерно заполняющие многомерный куб / И.М. Соболь. –М. : Знание, 1985. – 32 с.Savage, C. A survey of combinatorial Gray code // SIAM Review / C. Savage. – 1997. –Vol. 39, № 4. – P. 605–629.Savage, C. A survey of combinatorial Gray code // SIAM Review / C. Savage. – 1997. –Vol. 39, № 4. – P. 605–629.

The authors declare that there are no conflicts of interest present.