<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">inform</journal-id><journal-title-group><journal-title xml:lang="ru">Информатика</journal-title><trans-title-group xml:lang="en"><trans-title>Informatics</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1816-0301</issn><issn pub-type="epub">2617-6963</issn><publisher><publisher-name>UIIP NASB</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.37661/1816-0301-2023-20-3-37-49</article-id><article-id custom-type="elpub" pub-id-type="custom">inform-1243</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ОБРАБОТКА СИГНАЛОВ, ИЗОБРАЖЕНИЙ, РЕЧИ, ТЕКСТА И РАСПОЗНАВАНИЕ ОБРАЗОВ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>SIGNAL, IMAGE, SPEECH, TEXT PROCESSING AND PATTERN RECOGNITION</subject></subj-group></article-categories><title-group><article-title>Распознавание состава ткани предметов одежды на изображении в сфере электронной коммерции с использованием нейронных сетей</article-title><trans-title-group xml:lang="en"><trans-title>Recognition of fabric composition of clothing in an image in e-commerce using neural networks</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-2128-1943</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Сорокина</surname><given-names>В. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Sorokina</surname><given-names>V. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Сорокина Виктория Вадимовна - аспирант кафедры веб-технологий и компьютерного моделирования механико-математического факультета.</p><p>пр. Независимости, 4, Минск, 220050</p></bio><bio xml:lang="en"><p>Viktoria V. Sorokina - Postgraduate Student of web-Technologies and Computer Modeling Department of Mechanics and Mathematics Faculty, Belarusian State University.</p><p>Nezavisimosti av., 4, Minsk, 220050</p></bio><email xlink:type="simple">viktoria.sorokina.96@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Белорусский государственный университет</institution></aff><aff xml:lang="en"><institution>Belarusian State University</institution></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>29</day><month>09</month><year>2023</year></pub-date><volume>20</volume><issue>3</issue><fpage>37</fpage><lpage>49</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Сорокина В.В., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Сорокина В.В.</copyright-holder><copyright-holder xml:lang="en">Sorokina V.V.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://inf.grid.by/jour/article/view/1243">https://inf.grid.by/jour/article/view/1243</self-uri><abstract><sec><title>Цели</title><p>Цели. Поставлена цель разработать новый подход к распознаванию состава ткани предметов одежды на изображении в сфере электронной коммерции путем использования генеративно-состязательной сети для создания синтетических изображений предметов одежды с известным составом ткани, используемых затем для обучения сверточной нейронной сети при классификации состава ткани реальных изображений одежды. Вместо классического изображения предмета одежды генерируется копия, у которой материал увеличен до волокон и структуры ткани.</p></sec><sec><title>Методы</title><p>Методы. Основными методами распознавания состава ткани предметов одежды на изображении в сфере электронной коммерции являются создание и аннотация наборов данных для обучения нейронных сетей, синтез изображений ткани предметов одежды, выбор архитектуры и ее модификация, валидация и проведение тестов, а также интерпретация результатов.</p></sec><sec><title>Результаты</title><p>Результаты. Результаты экспериментов, проведенных с помощью предложенного подхода, показывают его эффективность при точном определении состава ткани предметов одежды в сфере электронной коммерции, что позволяет использовать данный метод для улучшения поиска и просмотра на веб-сайтах.</p></sec><sec><title>Заключение</title><p>Заключение. При помощи генеративно-состязательной сети был синтезирован набор данных товаров электронной коммерции, произведена его аннотация, построены нейронные сети для распознавания состава ткани предметов одежды, проведено сравнение результатов. Результаты исследования показали, что новый подход для распознавания ткани предметов одежды обладает высокой точностью в сравнении с уже известными методами. Дополнительное использование модели внимания также дает хорошие результаты, что отражается в улучшении метрик.</p></sec></abstract><trans-abstract xml:lang="en"><sec><title>Objectives</title><p>Objectives. Development of new approach for recognizing the fabric composition of clothing in e-commerce images by using generative adversarial network(GAN) to generate synthetic images of clothing with known fabric composition, to be used to train the CNN to classify the fabric composition of real clothing images. Instead of a classic clothing image, a copy is generated with the material zoomed to fibers and fabric structure.</p></sec><sec><title>Methods</title><p>Methods. The main methods to recognize the fabric composition of the clothing image in the e-commerce are the creation and annotation of a dataset for the neural network training, synthesis of the fabric of clothing, the choice of architecture and its modification, validation and testing, and interpretation of the results.</p></sec><sec><title>Results</title><p>Results. Experimental results with the constructed method show that it is effective for accurately recognizing the fabric composition of e-commerce clothing to be used to improve search and browsing on websites.</p></sec><sec><title>Conclusion</title><p>Conclusion. In the course of the experiment, using a generative adversarial network, a data set of e-commerce products was synthesized and annotated, neural networks were built to recognize the composition of the fabric of clothing items. The results of the study showed that the new approach for recognizing the fabric of clothing provides higher accuracy in comparison with already known methods, in addition, the use of the attention model also gives good results to improve the metrics.</p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>классификация состава ткани</kwd><kwd>генеративно-состязательная сеть</kwd><kwd>сверточная нейронная сеть</kwd><kwd>электронная коммерция</kwd><kwd>синтез изображений</kwd><kwd>модель внимания</kwd></kwd-group><kwd-group xml:lang="en"><kwd>classification of fabric composition</kwd><kwd>generative adversarial network</kwd><kwd>convolutional neural network</kwd><kwd>e-commerce</kwd><kwd>image synthesis</kwd><kwd>attention model</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Сорокина, В. В. Выделение отдельных участков тела человека на изображении с использованием нейронных сетей и модели внимания / В. В. Сорокина, С. В. Абламейко // Журнал Бел. гос. ун-та. Математика. Информатика. - 2022. - № 2. - С. 94-106.</mixed-citation><mixed-citation xml:lang="en">Sorokina V., Ablameyko S. Selection of individual parts of the human body in the image using neural networks and the attention model. Zhurnal Belorusskogo gosudarstvennogo universiteta. Matematika. Informatika [Journal of the Belarusian State University. Mathematics. Computer Science], 2022, no. 2, рр. 94-106.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Ronneberger, O. U-Net: convolutional networks for biomedical image segmentation / O. Ronnenberger, P. Fischer, T. Brox // 18th Intern. Conf. on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2015, Munich, Germany, 5-9 Oct. 2015. - Munich, 2015. - Part III. - Р. 234-241. https://doi.org/10.1007/978-3-319-24574-4_28</mixed-citation><mixed-citation xml:lang="en">Ronneberger O., Fischer P., Brox T. U-Net: convolutional networks for biomedical image segmentation. 18th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2015, Munich, Germany, 5 9 October 2015. Munich, 2015, part III, рр. 234-241. https://doi.org/10.1007/978-3-319-24574-4_28</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Suciati, N. Fractal-based texture and HSV color features for fabric image retrieval / N. Suciati, D. Herumurti, A. Y. Wijaya // 5th IEEE Intern. Conf. on Control System, Computing and Engineering, ICCSCE 2015, Batu Ferringhi, Penang, Malaysia, 27-29 Nov. 2015. - Batu Ferringhi, 2015. - Р. 178-182.</mixed-citation><mixed-citation xml:lang="en">Suciati N., Herumurti D., Wijaya A. Y. Fractal-based texture and HSV color features for fabric image retrieval. 5th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2015, Batu Ferringhi, Penang, Malaysia, 27-29 November 2015. Batu Ferringhi, 2015, рр. 178-182.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">A new method of printed fabric image retrieval based on color moments and gist feature description / J. Jing [et al.] // Textile Research J. - 2016. - Vol. 86, iss. 11. - Р. 1137-1150. https://doi.org/10.1177/0040517515606378</mixed-citation><mixed-citation xml:lang="en">Jing J., Li Q., Li P., Zhang L. A new method of printed fabric image retrieval based on color moments and gist feature description. Textile Research Journal, 2016, vol. 86, iss. 11, рр. 1137-1150. https://doi.org/10.1177/0040517515606378</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">SKL algorithm based fabric image matching and retrieval / Y. Cao [et al.] // Ninth Intern. Conf. on Digital Image Processing (ICDIP 2017), Hong Kong, China, 19-22 May 2017. - Hong Kong, 2017. - Vol. 10420. - Р. 104201F.</mixed-citation><mixed-citation xml:lang="en">Cao Y., Zhang X., Ma G., Sun R., Dong D. SKL algorithm based fabric image matching and retrieval. Ninth International Conference on Digital Image Processing (ICDIP 2017), Hong Kong, China, 19-22 May 2017. Hong Kong, 2017, vol. 10420, р. 104201F.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Wang, X. Fabric identification using convolutional neural network / X. Wang, G. Wu, Y. Zhong // Artificial Intelligence on Fashion and Textiles : Proceedings of the Artificial Intelligence on Fashion and Textiles (AIFT) Conf. 2018, Hong Kong, 3-6 July 2018. - Hong Kong, 2018. - Р. 93-100. https://doi.org/10.1007/978-3-319-99695-0_12</mixed-citation><mixed-citation xml:lang="en">Wang X., Wu G., Zhong Y. Fabric identification using convolutional neural network. Artificial Intelligence on Fashion and Textiles : Proceedings of the Artificial Intelligence on Fashion and Textiles (AIFT) Conference 2018, Hong Kong, 3-6 July 2018. Hong Kong, 2018, рр. 93-100. https://doi.org/10.1007/978-3-319-99695-0_12</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Sorokina, V. Neural network training acceleration by weight standardization in segmentation of electronic commerce images / V. Sorokina, S. Ablameyko // Studies in Computational Intelligence. - 2020. - Vol. 976. - P. 237-244.</mixed-citation><mixed-citation xml:lang="en">Sorokina V., Ablameyko S. Neural network training acceleration by weight standardization in segmentation of electronic commerce images. Studies in Computational Intelligence, 2020, vol. 976, рр. 237-244.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Fine-grained material classification using micro-geometry and reflectance / C. Kampouris [et al.] // 14th European Conf. on Computer Vision, Amsterdam, the Netherlands, 11-14 Oct. 2016. - Amsterdam, 2016. - Part V. - Р. 778-792.</mixed-citation><mixed-citation xml:lang="en">Kampouris C., Zafeiriou S., Ghosh A., Malassiotis S. Fine-grained material classification using micro-geometry and reflectance. 14th European Conference on Computer Vision, Amsterdam, the Netherlands, 11-14 October 2016. Amsterdam, 2016, part V, рр. 778-792.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Image-to-image translation with conditional adversarial networks / P. Isola [et al.] // 2017 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21-26 July 2017. - Honolulu, 2017. - Р. 1125-1134.</mixed-citation><mixed-citation xml:lang="en">Isola P., Zhu J.-Y., Zhou T., Efros A. A. Image-to-image translation with conditional adversarial networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21 -26 July 2017. Honolulu, 2017, рр. 1125-1134.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Simonyan, K. Very deep convolutional networks for large-scale image recognition / K. Simonyan, A. Zisserman // Intern. Conf. on Learning Representations, San Diego, 7-9 May 2015. - San Diego, 2015. - P. 1137-1149.</mixed-citation><mixed-citation xml:lang="en">Simonyan K., Zisserman A. Very deep convolutional networks for large-scale image recognition. International Conference on Learning Representations, San Diego, 7-9 May 2015. San Diego, 2015, рр. 1137-1149.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Bahdanau, D. Neural machine translation by jointly learning to align and translate / D. Bahdanau, K. Cho, Y. Bengio // 3rd Intern. Conf, on Learning Representations, ICLR 2015, San Diego, CA, USA, 7 -9 May 2015. - San Diego, 2015.</mixed-citation><mixed-citation xml:lang="en">Bahdanau D., Cho K., Bengio Y. Neural machine translation by jointly learning to align and translate. 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7-9 May 2015. San Diego, 2015.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Sorokina, V. Extraction of human body parts from the image using convolutional neural network and attention mode / V. Sorokina, S. Ablameyko // Proc. of 15th Intern. Conf. "Pattern Recognition and Information Processing". - Minsk : UIIP NASB, 2021. - Р. 84-88.</mixed-citation><mixed-citation xml:lang="en">Sorokina V., Ablameyko S. Extraction of human body parts from the image using convolutional neural network and attention mode. Proceedings of 15th International Conference "Pattern Recognition and Information Processing". Minsk, UIIP NASB, 2021, рр. 84-88.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
