Criteria of evaluating augmented reality applications
Автор: Ablyaev M. R., Abliakimova A. N., Seidametova Z. S.
Журнал: Вестник Донского государственного технического университета @vestnik-donstu
Рубрика: Информатика, вычислительная техника и управление
Статья в выпуске: 4 т.20, 2020 года.
Бесплатный доступ
Introduction. The field of augmented reality (AR) is growing rapidly and has great advances in interaction, navigation and tracking. Nowadays there are a lot of trends for AR applications in different areas (education, entertainment, business, medicine, etc.). However, there is a lack of research to provide the evaluating AR apps framework to support developers when creating suitable AR applications for specific needs. We provide a practical approach to quantify some of the AR applications features. We focus on the development of criteria for evaluating augmented reality applications. We discuss the criteria of choosing dimensions for that space such as standards for AR, tools for AR development, navigation and tracking, content management, usability. We provide analysis and evaluation of AR apps through each characteristic using guidelines which we have developed.Materials and Methods. An AR application is a software application that integrates digital visual, audio and other types of content into a real-world environment. The software quality and performance are the main characteristics of the application, which are key factors for AR applications. The analysis of scientific papers, documents and standards made it possible to determine characteristics that are the most significant quality indicators based on well-grounded users’ needs and demands.Results. The criteria we have developed for evaluating applications with augmented reality enable developers to create their own software products in stages, based on step-by-step requirements for them, evaluating the development process by characteristics. This approach will allow you to create high-quality software products using standardized, modern development tools.Discussion and Conclusions. In addition, developers will have a detailed understanding of each stage of creating the application and the necessary development tools and technologies to obtain the highest quality result. That will give an opportunity to decide on specific development tools, methods, models and technologies before starting work on a project. As a result, it will provide the final high-quality software product with good extensibility and compliance with the modern requirements of the digital industry market.
Augmented reality, software development kit, navigation and tracking, content management, usability
Короткий адрес: https://sciup.org/142225518
IDR: 142225518 | DOI: 10.23947/2687-1653-2020-20-4-414-421
Список литературы Criteria of evaluating augmented reality applications
- Ritsos PD, Ritsos DP, Gougoulis AS. Standards in augmented reality: a user experience perspective. In: 2nd International Workshop on AR Standards. 2011; 17:9.
- Lee J, Lee Y, Lee S, et al. Standardization for augmented reality: introduction of activities at ISO-IEC SC24 WG 9. In: Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, 2013. P. 279-280. DOI: 1145/2534329.2534379
- Perey C, Engelke T, Reed C. Current Status of Standards for Augmented Reality. Recent Trends of Mobile Collaborative Augmented Reality Systems. Springer, New York, NY, 2011. P. 21-38. DOI: 10.1007/978-1-4419-9845-3_2
- Endsley TC, Sprehn KA, Brill RM, et al. Augmented Reality Design Heuristics: Designing for Dynamic Interactions. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 2017;61(1):2100-2104.
- Dhir A, Al-kahtani M. A Case Study on User Experience (UX) Evaluation of Mobile Augmented Reality Prototypes. Journal of Universal Computer Science. 2013;19(8):1175-1196.
- Caudell TP, Mizell DW. Augmented reality: an application of heads-up display technology to manual manufacturing processes. In: Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences. IEEE. 1992;2:659-669.
- Olsson T, Lagerstam E, Karkkainen T, et al. Expected user experience of mobile augmented reality services: a user study in the context of shopping centres. Personal and ubiquitous computing. 2013;17(2):287-304.
- Knoerlein B, Luca MD, Harders M. Influence of visual and haptic delays on stiffness perception in augmented reality. In: 8th IEEE International Symposium on Mixed and Augmented Reality, IEEE. 2009. P. 49-52.
- Duenser A, Billinghurst M. Evaluating augmented reality systems. In: Handbook of augmented reality. Springer, New York, NY, 2012. P. 289-307.
- Arifin Y, Sastria TG, Barlian E. User experience metric for augmented reality application: a review. Proce-dia Computer Science. 2018;135:648-656.
- Gabbard JL, Swan JE. Usability Engineering for Augmented Reality: Employing User-Based Studies to Inform Design. In: IEEE Transactions on Visualization and Computer Graphics 14, 2008. P. 513-525.
- Pranoto H, Tho C, Warnars HL, et al. Usability testing method in augmented reality application. In: 2017 International Conference on Information Management and Technology (ICIMTech), 2017. P. 181-186.
- Martins VF, Sanches GB, de Almeida NG, et al. Usability Evaluation of an Augmented Reality Children's Book. In: 2019 XIV Latin American Conference on Learning Technologies (LACLO), IEEE. 2019;1:381-386.
- DOI: 10.1109/LACLO49268.2019.00070
- Da Silva MMO, Teixeira JMXN, Cavalcante PS, et al. Perspectives on How to Evaluate Augmented Reality Technology Tools for Education: A Systematic Review. Journal of the Brazilian Computer Socciety. 2019;25(1):1-18.
- DOI: 10.1186/s13173-019-0084-8
- Guimaraes MDP, Martins VF. A Checklist to Evaluate Augmented Reality Applications. In: 2014 16th Symposium on Virtual and Augmented Reality, IEEE, 2014. P. 45-52.
- DOI: 10.1109/SVR.2014.17
- Akgul O, Penekli HI, Genc Y. Applying deep learning in augmented reality tracking. In: 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), IEEE. 2016;1:47-54.
- Harders M, Bianchi G, Knoerlein B, et al. Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics. In: IEEE Transactions on Visualization and Computer Graphics. 2009;15(1):138-149.
- Ramirez H, Mendoza E, Mendoza M, et al. Application of augmented reality in statistical process control, to increment the productivity in manufacture. Procedia Computer Science. 2015;75:213-220. http://www.sciencedirect.com/science/article/pii/S1877050915037011
- Chen H, Dai Y, Meng H, et al. Understanding the Characteristics of Mobile Augmented Reality Applications. In: 2018 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Belfast, 2018. P. 128-138.
- Huang Z, Hui P, Peylo C, et al. Mobile augmented reality survey: a bottom-up approach. 2013. P. 112-126. arXiv preprint arXiv:1309.4413
- Ablyaev M, Abliakimova A, Seidametova Z. Design of mobile augmented reality system for early literacy. Ermolayev V, Mallet F, Yakovyna V, et al. (eds.) In: Proceedings of the 15th International Conference, ICTERI 2019, Vol. I: Main Conference, CEUR Workshop Proceedings (CEUR-WS. org) on ICT in Education, Research, and Industrial Applications. Ukraine, Kherson, 12-15 June 2019. 2019;2387:274-285. CEUR-WS.org http://ceur-ws.org/Vol-2387/20190274.pdf (accessed: 22 March 2020).
- Ablyaev M, Abliakimova A, Seidametova Z. Developing a mobile augmented reality application for enhancing early literacy skills. Ermolayev V, Mallet F, Yakovyna V, et al. (eds.) In: Information and Communication Technologies in Education, Research, and Industrial Applications. ICTERI 2019. Communications in Computer and Information Science Springer, Cham. 2020;1175:163-185.
- DOI: 10.1007/978-3-030-39459-2