Semantic models and tools for designing adaptive user interfaces of intelligent systems

Objectives. Models and tools for designing adaptive user interfaces for intelligent systems are being developed. The relevance is determined by the need to reduce overhead costs and development time for user interfaces and to provide their adaptation to the specific characteristics of the user of the intelligent system.

Methods. Existing approaches to designing user interfaces are being analyzed. A semantic model of an adaptive user interface for intelligent systems is proposed, implemented using a basic universal language for representing knowledge based on set theory and graph theory.

Results. An adaptive user interface model for intelligent systems has been developed, which includes a knowledge base model of the user interface, an agent-oriented model of the user interface, and a library of reusable components that provide integration of the user interface into both individual intelligent systems and intelligent systems groups. A method of transferring user interface components within an intelligent systems group during the operation of an intelligent system has also been developed.

Conclusion. Developed models and tools allow to simplify the reuse of user interface components together with knowledge base and problem-solving components in the design and development of individual intelligent systems, as well as in the design and development of a group of semantically compatible intelligent systems, ensuring automation of integration of user interfaces and their adaptation for each user. The developed set of user interface components has been included in a library of reusable user interface components. Further expansion of the set of components in the library and their integration into a group of semantically compatible intelligent systems is planned.

1. Sadouski М. Е. General principles of organization of interfaces of ostis-systems. Tehnologija kompleksnoj podderzhki zhiznennogo cikla semanticheski sovmestimyh intellektual'nyh komp'juternyh sistem novogo pokolenija [Comprehensive Support Technology for the Life Cycle of Semantically Compatible Intelligent Computer Systems of a New Generation]. In V. V. Golenkov. Minsk, 2023, chap. 4.1, pp. 417-432 (In Russ.).

2. Fomina Т., Novikova G. Designing an adaptive interface for an information system to support the activities of an educational institution. Vestnik Altajskoj akademii jekonomiki i prava [Bulletin of Altai Academy of Economics and Law], 2020, vol. 6, no. 1, pp. 125-133. https://doi.org/10.17513/vaael.1174 (In Russ.).

3. Boriskin A., Koronchik D., Zhukau I., Sadouski M., Khusainov A. Ontology-based design of intelligent systems user interface. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 16-18 fevralja 2017 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2017) : Proceedings of the International Scientific and Technical Conference, Minsk, 16-18 February 2017]. Ed. board: V. V. Golenkov, L. S. Globa, V. A. Golovko, N. A. Guljakina, O. P. Kuznecov, ..., V. F. Horoshevskij. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2017, pp. 95-106.

4. Belousova S., Rogozov Y. Analysis of approaches to user interface creation. Izvestija Juzhnogo federal'nogo universiteta. Tehnicheskie nauki [Proceedings of the Southern Federal University. Technical Science], 2014, vol. 6(155), pp. 142-148 (In Russ.).

5. Hussain J., Hassan A., Hafiz S., Rahman A., Muhammad A., Sungyoung L. Model-based adaptive user interface based on context and user experience evaluation. Journal on Multimodal User Interfaces, 2018, vol. 12, pp. 1-16. https://doi.org/10.1007/s12193-018-0258-2

6. Abrams M., Phanouriou C., Batongbacal A., Williams S., Shuster J. UIML: An appliance-independent XML user interface language. Proceedings of the 8th International Conference on the World Wide Web, Toronto, 11-14 May 1999. Toronto, 1999, pp. 1695-1708.

7. Limbourg Q., Vanderdonckt J. USIXML: A user interface description language supporting multiple levels of independence. Proceedings of Workshops in Connection with the 4th International Conference on Web Engineering (ICWE 2004), Munich, Germany, 28-30 July 2004. Munich, 2004, pp. 325-338.

8. Van den Bergh J., Luyten K., Coninx K. CAP3: Context-sensitive abstract user interface specification. Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems EICS, Pisa, Italy, 2011. Pisa, 2011, pp. 31-40. https://dl.acm.org/doi/10.1145/1996461.1996491

9. Paterno F., Santoro C., Spano L. D. Maria: A universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environment. ACM Transactions on Computer-Human Interaction, 2009, vol. 16, iss. 4, pp. 1-30. https://doi.org/10.1145/1614390.1614394

10. Szekely P., Sukaviriya P., Castells P., Muthukumarasamy J., Salcher E. Declarative interface models for user interface construction tools: the MASTERMIND approach. In L. J. Bass, C. Unger (eds.). Engineering for Human-Computer Interaction. EHCI 1995. IFIP Advances in Information and Communication Technology. Springer, Boston, MA, 1996, pp. 120-150. https://doi.org/10.1007/978-0-387-34907-7_8

11. Liu B., Chen H., He W. Deriving user interface from ontologies: A model-based approach. 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05), Hong Kong, 14-16 November 2005. Hong Kong, 2005, pp. 254-259. https://doi.org/10.1109/ICTAI.2005.55

12. Gaulke W., Ziegler J. Using profiled ontologies to leverage model driven user interface generation. The 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, Duisburg, 23-26 June 2015. Duisburg, 2015, pp. 254-259. https://doi.org/10.1145/2774225.2775070

13. Sahar A., Armin B., Shepherd H., Lexing L. ActiveRaUL: Automatically generated Web interfaces for creating RDF data. Proceedings of the 12th International Semantic Web Conference (Posters & Demos Track), Sydney, 21-25 October 2013. Sydney, 2013, pp. 117-120.

14. Hitz M., Kessel T. Using application ontologies for the automatic generation of user interfaces for dialog-based application. Research and Practical Issues of Enterprise Information Systems, 2016, vol. 268, pp. 16-31. https://doi.org/10.1007/978-3-319-49944-4_2

15. Gribova V. V., Cherkezishvili N. N. Automation of development of user interfaces with dynamic data. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 10-12 fevralja 2011 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2011) : Proceedings of the International Scientific and Technical Conference, Minsk, 10-12 February 2011]. Ed. board: V. V. Golenkov, T. A. Gavrilova, V. A. Golovko, V. V. Gribova, N. A. Guljakina, ..., S. S. Shherbak. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2011, pp. 287-292 (In Russ.).

16. Gribova V. V., Tarasov A. V. Ontology-driven user interface code generator. Iskusstvennyj intellekt [Artificial Intelligence], 2005, vol. 4, pp. 457-464 (In Russ.).

17. Hepp M. Ontologies: State of the art, business potential, and grand challenges. Ontology Management, Part of the Computing for Human Experience Book Series (ADSW, vol. 7). Boston, Springer, 2008, pp. 3-22. https://doi.org/10.1007/978-0-387-69900-4_1

18. Puetra A. R., Eriksson H., Gennari J. H., Musen M. A. Beyond data models for automated user interface generation. People and Computers IX, Proceedings of HCI '94. Glasgow, August 1994, pp. 353-366.

19. Sadouski M. The structure of next-generation intelligent computer system interfaces. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : sbornik nauchnyh trudov [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2022) : Research Papers Collection]. Ed. board: V. V. Golenkov, I. S. Azarov, V. A. Golovko, A. N. Gordey, N. A. Guliakina, ..., D. V. Shunkevich. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2022, iss. 6, pp. 199-208.

20. Golenkov V. V., Guliakina N. A., Shunkevich D. V. Open Technology of Ontological Design, Production, and Operation of Semantically Compatible Hybrid Intelligent Computer Systems. Minsk, Bestprint, 2021, 690 p.

21. Golenkov V. V., Guliakina N. A. An open semantic technology project for component-based design of intelligent systems. Part 1: Principles of creation. Ontologija proektirovanija [Design Ontology], 2014, no. 1(11), pp. 42-64.

22. Golenkov V. V., Guliakina N. A., Grakova N. V., Davydenko I. T., Nikulenka V. Y., Tarasov V. B. From training intelligent systems to training their development tools. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 15-17 fevralja 2018 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2018) : Proceedings of the International Scientific and Technical Conference, Minsk, 15-17 February 2018]. Ed. board: V. V. Golenkov, T. A. Gavrilova, V. A. Golovko, P. S. Grabust, N. A. Guljakina, ., A. A. Sharipbaj. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2018, pp. 81-98.

23. Davydenko I. Semantic models, method and tools of knowledge bases coordinated development based on reusable components. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 15-17 fevralja 2018 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2018) : Proceedings of the International Scientific and Technical Conference, Minsk, 15-17 February 2018]. Ed. board: V. V. Golenkov, T. A. Gavrilova, V. A. Golovko, P. S. Grabust, N. A. Guljakina, ., A. A. Sharipbaj. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2018, pp. 99-118.

24. Shunkevich D. V. Agent-oriented models, method and tools of compatible problem solvers development for intelligent systems. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 15-17 fevralja 2018 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2018) : Proceedings of the International Scientific and Technical Conference, Minsk, 15-17 February 2018]. Ed. board: V. V. Golenkov, T. A. Gavrilova, V. A. Golovko, P. S. Grabust, N. A. Guljakina, ., A. A. Sharipbaj. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2018, pp. 119-132.

25. Golenkov V. V., Shunkevich D., Davydenko I. T., Grakova N. V. Principles of organization and automation of the semantic computer systems development. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : materialy Mezhdunarodnoj nauchno-tehnicheskoj konferencii, Minsk, 21-23 fevralja 2019 g. [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2019) : Proceedings of the International Scientific and Technical Conference, Minsk, 21-23 February 2019]. Ed. board: V. V. Golenkov, Gavrilova T. A., V. A. Golovko, P. S. Grabust, N. A. Guliakina, ., A. A. Sharipbay. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2019, pp. 53-90.

26. Sadouski M. Semantic-based design of an adaptive user interface. Open Semantic Technologies for Intelligent Systems OSTIS-2021, Communications in Computer and Information Science. Springer, Cham, 2022, vol. 1625, pp. 165-191. https://doi.org/10.1007/978-3-031-15882-7_10

27. Zagorskiy A. Principles for implementing the ecosystem of next-generation intelligent computer systems. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : sbornik nauchnyh trudov [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2022) : Research Papers Collection]. Ed. board: V. V. Golenkov, I. S. Azarov, V. A. Golovko, A. N. Gordey, N. A. Guliakina, ..., D. V. Shunkevich. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2022, iss. 6, pp. 347-356.

28. Sadouski M. User interface of the OSTIS Ecosystem. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : sbornik nauchnyh trudov [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2023) : Research Papers Collection]. Ed. board: V. V. Golenkov, I. S. Azarov, V. A. Golovko, A. N. Gordey, N. A. Guliakina, D. V. Shunkevich. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2023, iss. 7, pp. 153-158.

29. Orlov M. Control tools for reusable components of intelligent computer systems of a new generation. Otkrytye semanticheskie tehnologii proektirovanija intellektual'nyh system : sbornik nauchnyh trudov [Open Semantic Technologies for Designing Intelligent Systems (OSTIS-2023) : Research Papers Collection]. Ed. board: V. V. Golenkov, I. S. Azarov, V. A. Golovko, A. N. Gordey, N. A. Guliakina, ., D. V. Shunkevich. Minsk, Belorusskij gosudarstvennyj universitet informatiki i radiojelektroniki, 2023, iss. 7, pp. 191-206.