Analysis of Using Telemedicine Application for Pregnant Women During COVID-19 Pandemic Based on ISO 9241-11


  • Nurani Zulfa Zakiya Midwifery Program Study, Faculty of Medicine, Airlangga University, Surabaya, Indonesia
  • Muhammad Ardian Cahya Department of Obstetrics and Gynecology, Faculty of Medicine, Airlangga University, Surabaya, Indonesia
  • Samsriyaningsih Handayani Department of Obstetrics and Gynecology, Faculty of Medicine, Airlangga University, Surabaya, Indonesia



Background: The COVID-19 pandemic has affected the performance of several sectors, one of which is the quality of maternal and child health services. One of the factors contributing to the decline in the quality of maternal and child health services is limited access during the COVID-19 pandemic. Telemedicine is here as one of the answers to overcome the problem of limited access to health services during the COVID-19 pandemic. This study aims to analyze the use of telemedicine applications by pregnant women during the COVID-19 pandemic using the ISO 9241-11 framework.

Subjects and Method: This research method is an observational study with a descriptive approach to analyze usability in three measurement aspects namely effectiveness, efficiency, and satisfaction. The number of samples used was 42 pregnant women who had used telemedicine applications that had been determined during the COVID-19 period with a sampling technique using random sampling. The instrument used is an adaptation of the Standardized Usability Questionnaire (SUQ) which will be analyzed using the Structural Equation Modeling-Partial Least Square (SEM-PLS) technique to determine the usability score of the application.

Results: Based on the results of the Structural Equation Model-Partial Least Square (SEM-PLS) analysis, the ISO 9241-11 model has a goodness-of-fit model with an R-square value of 0.760 and a Q-square value of 0.577 with a Goodness of Fit (GoF) of 0.780. The effectiveness variable has a significant effect on the usability variable of the Teman Bumil application at a significance level of 5% with a statistical T value of 1,955. There is not enough evidence for the efficiency and satis­faction variables to say they have a significant effect on the usability of the Teman Bumil applica­tion at a 5% significance level with T-statistic values of 0.866 and 1.452. The usability score for the Friends Pregnant application is 44.45.

Conclusion: The usability score obtained by the Teman Bumil application is 44.45, which means that Sahabat Bumil application has not been accepted by users as a system product that can help effectively, efficiently and satisfactorily.

Keywords: telemedicine, pregnant women, COVID-19, ISO 9241-11, usability.

Correspondence:Nurani Zulfa Zakiya, Midwifery Program Study, Faculty of Medicine, Universitas Airlangga, Indonesia. Jl. Mayjen Prof. Dr. Moestopo No. 47, Pacar Kembang, Tambaksari, Surabaya 60132, East Java . Email: Mobile: +6281217621007.


Aprillia, P (2019). Penerapan sistem tele-medicine di era revolusi industri 4.0 (Application of the telemedicine system in the era of the industrial revo-lution 4.0). Program Studi Ilmu Kesehatan Masyarakat. Universitas Sebelas Maret

ASEAN Biodiaspora Virtual Center (2021). COVID-19 situational report in the ASEAN Region. Retrieved from:

Awan M, Ali S, Ali M, Abrar MF, Ullah H, Khan D (2021). Usability barriers for elderly users in smartphone app usage: an analytical hierarchical process-based prioritization. 2021 (ID 27802-57): 1-14.

Clarke MA, Fruhling AL, Sitorius M, Windle TA, Bernard TL, Windle JR (2020). Impact of age on patients’ communication and technology preferences in the era of meaningful use: mixed methods study. 22(6).

Siboro MD, Surjoputro A, Budiyanti RT (2021). Faktor-faktor yang mempengaruhi penggunaan layanan telemedicine pada masa pandemi COVID-19 di Pulau Jawa (Factors influencing the use of telemedicine services during the COVID-19 pandemic on Java Island), 9(5). Retrieved from:

Fryer K, Delgado A, Foti T, Reid CN, Marshall J (2020). Implementation of obstetric telehealth during COVID-19 and Beyond. Matern Child Health J. 24(9):1104-1110. doi: 10.1007/s10995020029677.

Hair JF, Hult GTM, Ringle CM, Sarstedt M (2017). A primer on partial least squares structural equation modeling (PLS-SEM). California (US): Sage

Hatta H, Salman M (2016). Keputusan pembelian: pengaruh kualitas informasi dan komunitas virtual samsung galaxy Tab di E-Commerce (Purchase decisions: the influence of information quality and the virtual community of samsung galaxy Tab in E-Commerce)

Indria D, Alajlani M, Fraser H, (2020). Clinicians perceptisons of a telemedicine system: a mixed method study of Makassar City, Indonesia. BMC Medical Informatics and Decision Making, 20(1).

International Standard Organization (2018). 9241-11:2018(en), Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts [Online]. Retrieved from: [Accessed: 24 March 2022].

Kemenkes RI (2021). Keputusan menteri kesehatan Republik Indonesia (Decree of the Minister of Health of the Republic of Indonesia)

Kuswandi M, Primasari CH, Wibisono YP, Irianto ABP (2021). Analisis kebutuhan perancangan ulang aplikasi mobile teman bumil menggunakan framework scrum. (Analysis of the needs for redesigning the pregnant friend's mobile application using the Scrum framework). Rabit: Jurnal Teknologi dan Sistem Informasi Univrab (Rabit: Univrab Journal of Technology and Information Systems). 6(2):92–99.

Nurjasmi E (2020). Situasi pelayanan kebidanan pada masa pandemi COVID-19 dan era new normal (Situation of midwifery services during the COVID-19 pandemic and the new normal era). Ikatan Bidan Indonesia (Indonesian Midwives Association).

Sauro J (2018). 5 ways to interpret a SUS score. Retrieved from:

Wiweko B, Zakirah SC, Luthfi A, (2021). The essence of telemedicine for bridging the gap in health services. Kesmas: National Public Health Journal, 16(2).

World Health Organization, (2020), Archived: WHO Timeline-COVID-19 [Online]. Retrieved from: [Accessed: 23 March 2022].

World Health Organization, (2010). Global observatory for eHealth [Online]. Retrieved from: [Accessed: 23 March 2022].

Yulaikah N, Artanti Y (2022). Faktor-faktor yang mempengaruhi keputusan penggunaan telemedicine saat pandemi COVID-19 (Factors influencing the decision to use telemedicine during the COVID-19 pandemic). Retrieved from:




How to Cite

Zakiya, N. Z., Cahya, M. A., & Handayani, S. (2023). Analysis of Using Telemedicine Application for Pregnant Women During COVID-19 Pandemic Based on ISO 9241-11. Journal of Maternal and Child Health, 8(2), 176–187.