Authors: Simon Walzel, Radek Mikus, Veronika Rafl-Huttova , Martin Rozanek , Thomas E. Bachman and Jakub Rafl

Citation

Walzel, S., Mikus, R., Rafl-Huttova, V., Rozanek, M., Bachman, T. E., & Rafl, J. (2023). Evaluation of Leading Smartwatches for the Detection of Hypoxemia: Comparison to Reference Oximeter. Sensors, 23(22), 9164.

Fulltext in PDF & fulltext download

Published in Sensors

Download fulltext in PDF here: Evaluation of Leading Smartwatches for the Detection of Hypoxemia: Comparison to Reference Oximeter

 

Abstract

Although smartwatches are not considered medical devices, experimental validation of their accuracy in detecting hypoxemia is necessary due to their potential use in monitoring conditions manifested by a prolonged decrease in peripheral blood oxygen saturation (SpO2), such as chronic obstructive pulmonary disease, sleep apnea syndrome, and COVID-19, or at high altitudes, e.g., during sport climbing, where the use of finger-sensor-based pulse oximeters may be limited. The aim of this study was to experimentally compare the accuracy of SpO2 measurement of popular smartwatches with a clinically used pulse oximeter according to the requirements of ISO 80601-2-61. Each of the 18 young and healthy participants underwent the experimental assessment three times in randomized order—wearing Apple Watch 8, Samsung Galaxy Watch 5, or Withings ScanWatch—resulting in 54 individual experimental assessments and complete datasets. The accuracy of the SpO2 measurements was compared to that of the Radical-7 (Masimo Corporation, Irvine, CA, USA) during short-term hypoxemia induced by consecutive inhalation of three prepared gas mixtures with reduced oxygen concentrations (14%, 12%, and 10%). All three smartwatch models met the maximum acceptable root-mean-square deviation (≤4%) from the reference measurement at both normal oxygen levels and induced desaturation with SpO2 less than 90%. Apple Watch 8 reached the highest reliability due to its lowest mean bias and root-mean-square deviation, highest Pearson correlation coefficient, and accuracy in detecting hypoxemia. Our findings support the use of smartwatches to reliably detect hypoxemia in situations where the use of standard finger pulse oximeters may be limited.

References

  1. Jat, A.S.; Grønli, T. Smart Watch for Smart Health Monitoring: A Literature Review. In Proceedings of the 9th International Work-Conference Bioinformatics and Biomedical Engineering (IWBBIO 2022), Maspalomas, Gran Canaria, Spain, 27–30 June 2022; Springer International Publishing: Cham, Switzerland, 2022; pp. 256–268.
  2. Buelga Suárez, M.; Izco, M.P.; Pueyo, P.P.; Granero, C.L.; Montalvo, J.G.; Salinas, G.L.A. Smartwatch ECG Tracing and Ischemic Heart Disease: ACS Watch Study. Cardiology 2023, 148, 78–82.
  3. Wang, L.; Xian, H.; Guo, J.; Li, W.; Wang, J.; Chen, Q.; Fu, X.; Li, H.; Zhang, W.; Chen, Y. A novel blood pressure monitoring technique by smart HUAWEI WATCH: A validation study according to the ANSI/AAMI/ISO 81060-2:2018 guidelines. Front. Cardiovasc. Med. 2022, 9, 923655.
  4. Sarhaddi, F.; Kazemi, K.; Azimi, I.; Cao, R.; Niela-Vilén, H.; Axelin, A.; Liljeberg, P.; Rahmani, A.M. A comprehensive accuracy assessment of Samsung smartwatch heart rate and heart rate variability. PLoS ONE 2022, 17, e0268361.
  5. Sakadze, N.; Martin, S. How useful is the smartwatch ECG? Trends Cardiovasc. Med. 2020, 30, 442–448.
  6. Wasserlauf, J.; You, C.; Patel, R.; Valys, A.; Albert, D.; Passman, R. Smartwatch performance for the detection and quantification of atrial fibrillation. Circ. Arrhythm. Electrophysiol. 2019, 12, e006834.
  7. Quer, G.; Radin, J.M.; Gadaleta, M.; Baca-Motes, K.; Ariniello, L.; Ramos, E.; Kheterpal, V.; Topol, E.J.; Steinhubl, S.R. Wearable sensor data and self-reported symptoms for COVID-19 detection. Nat. Med. 2021, 27, 73–77.
  8. Sedaghat, T.; Liaqat, S.; Liaqat, D.; Wu, R.; Gershon, A.; Son, T.; Falk, T.H.; Gabel, M.; Mariakakis, A.; de Lara, E. Unobtrusive monitoring of COPD patients using speech collected from smartwatches in the wild. In Proceedings of the 20th International Conference on Pervasive Computing and Communications (PerCom 2022), Pisa, Italy, 21–25 March 2022; pp. 818–823.
  9. Kim, M.W.; Park, S.H.; Choi, M.S. Diagnostic Performance of Photoplethysmography-Based Smartwatch for Obstructive Sleep Apnea. J. Rhinol. 2022, 29, 155–162.
  10. De Barros, G.M.; de Barros, G.M.; dos Anjos, M.S.; Mazullo Filho, J.B.R. Smartwatch, oxygen saturation, and COVID-19: Trustworthy? ABCS Health Sci. 2021, 46, e021101.
  11. Shiota, S.; Horinouchi, Y.; Doi, E.; Miyazaki, E. Suspicion of pulmonary embolism after COVID-19 infection raised by a smartwatch. QJM Int. J. Med. 2023, 116, 123–124.
  12. Healthline. Blood Oxygen Levels: What Is a Normal Level? Available online: https://www.healthline.com/health/normalblood-oxygen-level (accessed on 1 April 2023).
  13. Karinen, H.M.; Peltonen, J.E.; Kähönen, M.; Tikkanen, H.O.; Schobersberger, W.; Burtscher, M.; Leichtfried, V.; Lorente-Aznar, T.; Perez-Aguilar, G.; García-Espot, A.; et al. Prediction of acute mountain sickness by monitoring arterial oxygen saturation during ascent. High Alt. Med. Biol. 2010, 11, 325–332.
  14. Priem, G.; Martinez, C.; Bodinier, Q.; Carrault, G. Clinical grade SpO2 prediction through semi-supervised learning. In Proceedings of the 20th International Conference on Bioinformatics and Bioengineering (BIBE 2020), Cincinnati, OH, USA, 26–28 October 2020; pp. 914–921.
  15. Phillips, C.; Liaqat, D.; Gabel, M.; de Lara, E. WristO2: Reliable peripheral oxygen saturation readings from wrist-worn pulse oximeters. In Proceedings of the International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops 2021), Kassel, Germany, 22–26 March 2021; pp. 623–629.
  16. Kirszenblat, R.; Edouard, P. Validation of the Withings ScanWatch as a wrist-worn reflective pulse oximeter: Prospective interventional clinical study. J. Med. Internet Res. 2021, 23, e27503.
  17. Apple. Blood Oxygen App on Apple Watch. Available online: https://www.apple.com/healthcare/docs/site/Blood_Oxygen_ app_on_Apple_Watch_October_2022.pdf (accessed on 1 April 2023).
  18. Lyden, B.; Dair, Z.; O’reilly, R. Classification of Sleep Apnea via SpO2 in a Simulated Smartwatch Environment. In Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI 2022), Ioannina, Greece, 27–30 September 2022; pp. 1–5.
  19. Santos, M.; Vollam, S.; Pimentel, M.A.; Areia, C.; Young, L.; Roman, C.; Ede, J.; Piper, P.; King, E.; Harford, M.; et al. The use of wearable pulse oximeters in the prompt detection of hypoxemia and during movement: Diagnostic accuracy study. J. Med. Internet Res. 2022, 24, e28890.
  20. Browne, S.H.; Bernstein, M.; Bickler, P.E. Accuracy of Samsung Smartphone Integrated Pulse Oximetry Meets Full FDA Clearance Standards for Clinical Use. medRxiv 2021.
  21. Guber, A.; Shochet, G.E.; Kohn, S.; Shitrit, D. Wrist-sensor pulse oximeter enables prolonged patient monitoring in chronic lung diseases. J. Med. Syst. 2019, 43, 230.
  22. ISO 80601-2-61:2017; Medical Electrical Equipment—Part 2-61: Particular Requirements for Basic Safety and Essential Performance of Pulse Oximeter Equipment. ISO: Geneva, Switzerland, 2017.
  23. U.S. Department of Health and Human Services; Food and Drug Administration; Center for Devices and Radiological Health; Office of Device Evaluation; Division of Anesthesiology, General Hospital, Infection Control, and Dental Devices; Anesthesiology and Respiratory Devices Branch. Pulse Oximeters—Premarket Notification Submissions [510(k)s]: Guidance for Industry and Food and Drug Administration Staff; US Department of Health and Human Services: Washington, DC, USA, 2013.
  24. Rafl, J.; Bachman, T.E.; Rafl-Huttova, V.; Walzel, S.; Rozanek, M. Commercial smartwatch with pulse oximeter detects short-time hypoxemia as well as standard medical-grade device: Validation study. Digit. Health 2022, 8, 20552076221132127.
  25. Lauterbach, C.J.; Romano, P.A.; Greisler, L.A.; Brindle, R.A.; Ford, K.R.; Kuennen, M.R. Accuracy and reliability of commercial wrist-worn pulse oximeter during normobaric hypoxia exposure under resting conditions. Res. Q. Exerc. Sport 2021, 92, 549–558.
  26. Spaccarotella, C.; Polimeni, A.; Mancuso, C.; Pelaia, G.; Esposito, G.; Indolfi, C. Assessment of non-invasive measurements of oxygen saturation and heart rate with an apple smartwatch: Comparison with a standard pulse oximeter. J. Clin. Med. 2022, 11, 1467.
  27. Pipek, L.Z.; Nascimento, R.F.V.; Acencio, M.M.P.; Teixeira, L.R. Comparison of SpO2 and heart rate values on Apple Watch and conventional commercial oximeters devices in patients with lung disease. Sci. Rep. 2021, 11, 18901.
  28. Littell, L.; Roelle, L.; Dalal, A.; Van Hare, G.F.; Orr, W.B.; Miller, N.; Silva, J.N.A. Assessment of Apple Watch Series 6 pulse oximetry and electrocardiograms in a pediatric population. PLoS Digit. Health 2022, 1, e0000051.
  29. Pätz, C.; Michaelis, A.; Markel, F.; Löffelbein, F.; Dähnert, I.; Gebauer, R.A.; Paech, C. Accuracy of the Apple Watch oxygen saturation measurement in adults and children with congenital heart disease. Pediatr. Cardiol. 2023, 44, 333–343.
  30. Schröder, C.; Förster, R.; Zwahlen, D.R.; Windisch, P. The Apple Watch spO2 sensor and outliers in healthy users. npj Digit. Med. 2023, 6, 63.
  31. Peterson, B.K. Physical Rehabilitation, Vital Signs (Chapter 22). In Physical Rehabilitation: Evidence-Based Examination, Evaluation, and Intervention; Elsevier: Amsterdam, The Netherlands, 2007.
  32. Counterpoint Research. Global Smartwatch Shipments Market Share Q4 2022. Available online: https://www.counterpointresearch.com/global-smartwatch-shipments-market-share/ (accessed on 3 May 2023).
  33. Wetsman, N. FDA Clears Withings’ EKG and Blood Oxygen Features. The Verge. Available online: https://www.theverge.com/ 2021/10/12/22722333/withings-fda-clearance-blood-oxygen-heart-rhythm (accessed on 27 March 2023).