Advertisement
Review article| Volume 25, 100203, March 2023

Download started.

Ok

Using virtual reality to prepare patients for radiotherapy: A systematic review of interventional studies with educational sessions

Open AccessPublished:March 01, 2023DOI:https://doi.org/10.1016/j.tipsro.2023.100203

      Highlights

      • Radiotherapy educational sessions are essential for patient engagement related to RT treatment.
      • VR technology as an educational tool can help patients to understand complex information and procedures.
      • This is the first systematic review of VR educational sessions' effect on adult patients’ psychological and cognitive variables related to RT.
      • Educational sessions with VR seem to enhance patients' knowledge about RT and decrease patients' anxiety, although with a less homogeneous impact.
      • More research is needed to clarify the effect of VR on psychological variables, to understand for which patients VR sessions are most effective.

      Abstract

      Purpose

      To understand the impact of radiotherapy educational sessions with virtual reality on oncologic adult patients’ psychological and cognitive outcomes related to the treatment experience.

      Methods

      This review was performed according to the Preferred Reporting Items for Systematic Reviews guidelines. A systematic electronic search in three databases, MEDLINE, Scopus, and Web of Science, was conducted in December 2021 to find interventional studies with adult patients undergoing external radiotherapy who received an educational session with virtual reality before or during the treatment. The studies that provided qualitative or quantitative information about the impact of educational sessions on patients’ psychological and cognitive dimensions related to RT experience were retained for analysis.

      Results

      Of the 25 records found, eight articles about seven studies were analysed that involved 376 patients with different oncological pathologies. Most studies evaluated knowledge and treatment-related anxiety, mainly through self-reported questionnaires. The analysis showed a significant improvement in patients’ knowledge and comprehension of radiotherapy treatment. Anxiety levels also decreased with virtual reality educational sessions and throughout the treatment in almost all the studies, although with less homogeneous results.

      Conclusion

      Virtual reality methods in standard educational sessions can enhance cancer patients' preparation for radiation therapy by increasing their understanding of treatment and reducing anxiety.

      Keywords

      Introduction

      Technology advancements have made it possible to transform two-dimensional (2D) images into three-dimensional (3D) images, enabling the construction of fictionalised computer realities. This interactive tool is a cutting-edge technology that uses computer programs to manipulate the virtual environment and combine information from multiple sources transforming it into virtual reality (VR). Introducing a new dynamic and interactive virtual learning environment makes learning more “real”, facilitating the entire education process [
      • Yu Duan Y.
      • Yao Zhang J.
      • Xie M.
      • Bo Feng X.
      • Xu S.
      • Wei Y.Z.
      Application of virtual reality technology in disaster medicine.
      ,
      • Williams C.L.
      • Kovtun K.A.
      The future of virtual reality in radiation oncology.
      ]. Several definitions of VR can be found in the literature; however, they can be divided into two categories: immersive virtual reality, where the user is transported into a virtual environment, losing the perception of the physical circumstances around him; and non-immersive virtual reality, where the projected VR is presented to the individual on a computer, preserving the connection with the external environment [
      • Biocca F.
      Virtual reality technology: a tutorial.
      ,
      • Zasadzka E.
      • Pieczyńska A.
      • Trzmiel T.
      • Hojan K.
      Virtual reality as a promising tool supporting oncological treatment in breast cancer.
      ].
      VR has been applied in several healthcare fields: medical education [
      • Pottle J.
      Virtual reality and the transformation of medical education.
      ,
      • Henn J.S.
      • Lemole G.M.
      • Ferreira M.A.T.
      • Gonzalez L.F.
      • Schornak M.
      • Preul M.C.
      • et al.
      Interactive stereoscopic virtual reality: a new tool for neurosurgical education.
      ,

      Pillai AS, Mathew PS. Impact of virtual reality in healthcare; 2019. p. 17–31.

      ], patient rehabilitation [
      • Lei C.
      • Sunzi K.
      • Dai F.
      • Liu X.
      • Wang Y.
      • Zhang B.
      • et al.
      Effects of virtual reality rehabilitation training on gait and balance in patients with Parkinson’s disease: a systematic review.
      ,
      • Feyzioğlu Ö.
      • Dinçer S.
      • Akan A.
      • Algun Z.C.
      Is Xbox 360 Kinect-based virtual reality training as effective as standard physiotherapy in patients undergoing breast cancer surgery?.
      ], patient emotional control [
      • Bani Mohammad E.
      • Ahmad M.
      Virtual reality as a distraction technique for pain and anxiety among patients with breast cancer: a randomized control trial.
      ] and patient education [
      • Shepherd T.
      • Trinder M.
      • Theophilus M.
      Does virtual reality in the perioperative setting for patient education improve understanding? A scoping review.
      ,

      van der Linde-van den Bor M, Slond F, Liesdek OCD, Suyker WJ, Weldam SWM. The use of virtual reality in patient education related to medical somatic treatment: a scoping review. Patient Educ Couns. 2022;105(7):1828–41.

      ,
      • Chen G.
      • Zhao Y.
      • Xie F.
      • Shi W.
      • Yang Y.
      • Yang A.
      • et al.
      Educating outpatients for bowel preparation before colonoscopy using conventional methods vs virtual reality videos plus conventional methods.
      ]. One of the first applications of VR in medical education was related to surgical training [
      • Henn J.S.
      • Lemole G.M.
      • Ferreira M.A.T.
      • Gonzalez L.F.
      • Schornak M.
      • Preul M.C.
      • et al.
      Interactive stereoscopic virtual reality: a new tool for neurosurgical education.
      ]. The authors developed an interactive stereoscopy virtual reality that creates an active learning experience of anatomy and surgical techniques [
      • Henn J.S.
      • Lemole G.M.
      • Ferreira M.A.T.
      • Gonzalez L.F.
      • Schornak M.
      • Preul M.C.
      • et al.
      Interactive stereoscopic virtual reality: a new tool for neurosurgical education.
      ]. More recently, immersive VR has shown significantly better results in empathic clinical communication than traditional role-playing training in radiographer students [
      • Sapkaroski D.
      • Mundy M.
      • Dimmock M.R.
      Immersive virtual reality simulated learning environment versus role-play for empathic clinical communication training.
      ]. Considering patient rehabilitation, Feyzioğlu et al. [
      • Feyzioğlu Ö.
      • Dinçer S.
      • Akan A.
      • Algun Z.C.
      Is Xbox 360 Kinect-based virtual reality training as effective as standard physiotherapy in patients undergoing breast cancer surgery?.
      ] investigated the potential effects of a VR-based physiotherapy programme (XBOX 360 Kinect) on upper limb rehabilitation in patients undergoing breast cancer surgery. The adapted video games stimulate arm movement by the patient, and the system monitors the movement aspect. The results were comparable to those obtained under face-to-face physiotherapy exercises. Besides, VR programmes increase patients' motivation and could complement standard physiotherapy without the patient having to leave home [
      • Feyzioğlu Ö.
      • Dinçer S.
      • Akan A.
      • Algun Z.C.
      Is Xbox 360 Kinect-based virtual reality training as effective as standard physiotherapy in patients undergoing breast cancer surgery?.
      ]. VR technology also demonstrated promising results in modulating emotional processes and reducing pain-related brain activity and anxiety associated with painful cancer procedures and treatments, such as chemotherapy, lumbar puncture, and surgery. It gives the patient a subjective immersive experience and physical placement in the virtual world while reducing the impact of the environment around him [
      • Li A.
      • Montaño Z.
      • Chen V.J.
      • Gold J.I.
      Virtual reality and pain management: current trends and future directions.
      ,
      • Schneider S.M.
      • Kisby C.K.
      • Flint E.P.
      Effect of virtual reality on time perception in patients receiving chemotherapy.
      ]. VR has been used in mental health hospitals, where adult hospitalised patients receive sessions to induce joy or relaxation through virtual environment navigation [
      • Baños R.M.
      • Espinoza M.
      • García-Palacios A.
      • Cervera J.M.
      • Esquerdo G.
      • Barrajón E.
      • et al.
      A positive psychological intervention using virtual reality for patients with advanced cancer in a hospital setting: a pilot study to assess feasibility.
      ].
      Finally, VR has been adapted for patient education regarding radiotherapy (RT) [
      • Bridge P.
      • Appleyard R.M.
      • Ward J.W.
      • Philips R.
      • Beavis A.W.
      The development and evaluation of a virtual radiotherapy treatment machine using an immersive visualisation environment.
      ,
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ]. It is estimated that approximately 50 % of patients diagnosed with cancer will receive RT treatments during their illness [
      • Baskar R.
      • Lee K.A.
      • Yeo R.
      • Yeoh K.W.
      Cancer and radiation therapy: Current advances and future directions.
      ]. This therapy involves complex and highly specialised concepts and procedures that may be difficult to understand, making the patient more apprehensive and anxious about the treatment [
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ,
      • Lewis F.
      • Merckaert I.
      • Liénard A.
      • Libert Y.
      • Etienne A.M.
      • Reynaert C.
      • et al.
      Anxiety and its time courses during radiotherapy for non-metastatic breast cancer: a longitudinal study.
      ]. Several studies have shown that approximately 50 % of RT patients suffer from anxiety and fear due to a lack of information about treatment [
      • Lewis F.
      • Merckaert I.
      • Liénard A.
      • Libert Y.
      • Etienne A.M.
      • Reynaert C.
      • et al.
      Anxiety and its time courses during radiotherapy for non-metastatic breast cancer: a longitudinal study.
      ,
      • Canil T.
      • Cashell A.
      • Papadakos J.
      • Abdelmutti N.
      • Friedman A.J.
      Evaluation of the effects of pre-treatment education on self-efficacy and anxiety in patients receiving radiation therapy: a pilot study.
      ,
      • Halkett G.K.B.
      • Kristjanson L.J.
      • Lobb E.
      • Little J.
      • Shaw T.
      • Taylor M.
      • et al.
      Information needs and preferences of women as they proceed through radiotherapy for breast cancer.
      ,
      • Halkett G.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Spry N.
      • Shaw T.
      • et al.
      Protocol for the RT Prepare Trial: a multiple-baseline study of radiation therapists delivering education and support to women with breast cancer who are referred for radiotherapy.
      ,
      • Halkett G.K.B.
      • Merchant S.
      • Smith S.K.
      • O’Connor M.
      • Jefford M.
      • Aranda S.
      • et al.
      Supporting and preparing patients for radiotherapy: patients’ and radiation therapists’ perspectives on their one-to-one consultations.
      ]. Overall, patients generally have higher information needs before planning computerised tomography (CT) scans and treatment and on the first session of RT [
      • Halkett G.K.B.
      • Kristjanson L.J.
      • Lobb E.
      • Little J.
      • Shaw T.
      • Taylor M.
      • et al.
      Information needs and preferences of women as they proceed through radiotherapy for breast cancer.
      ,
      • Halkett G.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Spry N.
      • Shaw T.
      • et al.
      Protocol for the RT Prepare Trial: a multiple-baseline study of radiation therapists delivering education and support to women with breast cancer who are referred for radiotherapy.
      ].
      Educational sessions have been delivered before the first session in some radiation departmentsto better prepare patients for their RT treatments [
      • Halkett G.K.B.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Shaw T.
      • York D.
      • et al.
      Pilot randomised controlled trial of a radiation therapist-led educational intervention for breast cancer patients prior to commencing radiotherapy.
      ,
      • Halkett G.
      • O’Connor M.
      • Jefford M.
      • Aranda S.
      • Merchant S.
      • Spry N.
      • et al.
      RT Prepare: a radiation therapist-delivered intervention reduces psychological distress in women with breast cancer referred for radiotherapy.
      ,
      • Kumar A.
      • Sarkar M.
      • Davis E.
      • Morphet J.
      • Maloney S.
      • Ilic D.
      • et al.
      Impact of the COVID-19 pandemic on teaching and learning in health professional education: a mixed methods study protocol.
      ,
      • Schnitzler L.
      • Smith S.K.
      • Shepherd H.L.
      • Shaw J.
      • Dong S.
      • Carpenter D.M.
      • et al.
      Communication during radiation therapy education sessions: the role of medical jargon and emotional support in clarifying patient confusion.
      ,
      • Zaheer S.
      • Gul R.B.
      • Bhamani S.S.
      • Memon M.A.
      The effect of individualized education with support on breast cancer patients’ anxiety and depression during radiation therapy: a pilot study.
      ]. These sessions aim to reduce anxiety, improve treatment effectiveness, and respond to the patient's needs, both emotional and informational, during treatment sessions. During educational sessions, several topics regarding different phases of the treatment course, side effects, and recommendations are explained; simultaneously, patients can clarify their doubts [
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ,
      • Reinhart R.
      • D’Alimonte L.
      • Osmar K.
      • Court A.
      • Szumacher E.
      • Bristow B.
      • et al.
      Educating our patients collaboratively: a novel interprofessional approach.
      ,
      • Smith S.K.
      • Nathan D.
      • Taylor J.
      • van Gelder E.
      • Dixon A.
      • Halkett G.K.B.
      • et al.
      Patients’ experience of decision-making and receiving information during radiation therapy: a qualitative study.
      ]. Educational sessions often employ traditional methods such as face-to-face communication [
      • Halkett G.K.B.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Shaw T.
      • York D.
      • et al.
      Pilot randomised controlled trial of a radiation therapist-led educational intervention for breast cancer patients prior to commencing radiotherapy.
      ,
      • Halkett G.
      • O’Connor M.
      • Jefford M.
      • Aranda S.
      • Merchant S.
      • Spry N.
      • et al.
      RT Prepare: a radiation therapist-delivered intervention reduces psychological distress in women with breast cancer referred for radiotherapy.
      ,
      • Zaheer S.
      • Gul R.B.
      • Bhamani S.S.
      • Memon M.A.
      The effect of individualized education with support on breast cancer patients’ anxiety and depression during radiation therapy: a pilot study.
      ], print materials [
      • Halkett G.K.B.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Shaw T.
      • York D.
      • et al.
      Pilot randomised controlled trial of a radiation therapist-led educational intervention for breast cancer patients prior to commencing radiotherapy.
      ,
      • Zaheer S.
      • Gul R.B.
      • Bhamani S.S.
      • Memon M.A.
      The effect of individualized education with support on breast cancer patients’ anxiety and depression during radiation therapy: a pilot study.
      ], and slides [
      • Li Z.
      • Geng W.
      • Yin J.
      • Zhang J.
      Effect of one comprehensive education course to lower anxiety and depression among Chinese breast cancer patients during the postoperative radiotherapy period - one randomized clinical trial.
      ]. Video materials have also been included in these sessions, achieving better patient knowledge outcomes, improving patient satisfaction regarding healthcare [
      • Dawdy K.
      • Bonin K.
      • Russell S.
      • Ryzynski A.
      • Harth T.
      • Townsend C.
      • et al.
      Developing and evaluating multimedia patient education tools to better prepare prostate-cancer patients for radiotherapy treatment (randomized study).
      ,
      • González-Arriagada W.A.
      • de Andrade M.A.C.
      • Ramos L.M.A.
      • Bezerra J.R.S.
      • Santos-Silva A.R.
      • Lopes M.A.
      Evaluation of an educational video to improve the understanding of radiotherapy side effects in head and neck cancer patients.
      ,
      • Hahn C.A.
      • Fish L.J.
      • Dunn R.H.
      • Halperin E.C.
      Prospective trial of a video educational tool for radiation oncology patients.
      ] and decreased anxiety after the first consultation [
      • Kumar A.
      • Sarkar M.
      • Davis E.
      • Morphet J.
      • Maloney S.
      • Ilic D.
      • et al.
      Impact of the COVID-19 pandemic on teaching and learning in health professional education: a mixed methods study protocol.
      ] However, understanding the RT treatment's technical aspects (e.g., the treatment procedure, location, and shape of the tumour) only through two-dimensional images, can be complex for several patients [
      • Halkett G.K.B.
      • Kristjanson L.J.
      • Lobb E.
      • Little J.
      • Shaw T.
      • Taylor M.
      • et al.
      Information needs and preferences of women as they proceed through radiotherapy for breast cancer.
      ,
      • Saeed N.
      Patient education in radiation oncology: evolution and innovation.
      ]. VR technology adds benefits that other teaching methods cannot provide in this context. Recently, Kelly et al. highlighted the impact of the low health literacy of patients undergoing radiotherapy [
      • Kelly T.
      • Surjan Y.
      • Rinks M.
      • Warren-Forward H.
      A radiation therapist’s guide to health literacy: a narrative review.
      ]. Patients are unfamiliar with radiotherapy equipment and environment and struggle to understand the radiation process and the intangible outcomes of the treatment [
      • Chierchini S.
      • Ingrosso G.
      • Saldi S.
      • Stracci F.
      • Aristei C.
      Physician and patient barriers to radiotherapy service access: treatment referral implications.
      ]. VR applied to educational sessions can address patients' information needs regarding the RT treatment process [
      • Fristedt S.
      • Smith F.
      • Grynne A.
      • Browall M.
      Digi-Do: a digital information tool to support patients with breast cancer before, during, and after start of radiotherapy treatment: an RCT study protocol.
      ], allowing the patient to have a realistic treatment experience with access to spacial and acoustic conditions during the radiation time [
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ,
      • Fristedt S.
      • Smith F.
      • Grynne A.
      • Browall M.
      Digi-Do: a digital information tool to support patients with breast cancer before, during, and after start of radiotherapy treatment: an RCT study protocol.
      ,
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education review and a case study using the virtual environment for radiotherapy training system.
      ]. The patient will be able to interact with the room, know the RT equipment, and visualize what will happen during the therapy due to virtual reality [
      • Williams K.
      • Blencowe J.
      • Ind M.
      • Willis D.
      Meeting radiation therapy patients informational needs through educational videos augmented by 3D visualisation software.
      ].
      Several review studies have recently addressed the impact of VR technology as a distraction tool in medical treatments [
      • Chirico A.
      • Lucidi F.
      • de Laurentiis M.
      • Milanese C.
      • Napoli A.
      • Giordano A.
      Virtual reality in health system: beyond entertainment. A mini-review on the efficacy of VR during cancer treatment.
      ] in specific populations [
      • Ridout B.
      • Kelson J.
      • Campbell A.
      • Steinbeck K.
      Effectiveness of virtual reality interventions for adolescent patients in hospital settings: systematic review.
      ], including the effectiveness of such interventions in reducing physical and emotional symptoms imposed by medical procedures [
      • Klllç A.
      • Brown A.
      • Aras I.
      • Hui R.
      • Hare J.
      • Hughes L.D.
      • et al.
      Using virtual technology for fear of medical procedures: a systematic review of the effectiveness of virtual reality-based interventions.
      ]. Other reviews concentrate on applying VR as an educational tool for patient and radiotherapy training [
      • Chamunyonga C.
      • Rutledge P.
      • Caldwell P.J.
      • Burbery J.
      • Hargrave C.
      The application of the virtual environment for radiotherapy training to strengthen IGRT education.
      ,
      • Rooney M.K.
      • Zhu F.
      • Gillespie E.F.
      • Gunther J.R.
      • McKillip R.P.
      • Lineberry M.
      • et al.
      Simulation as more than a treatment-planning tool: a systematic review of the literature on radiation oncology simulation-based medical education.
      ,
      • van der Kruk S.R.
      • Zielinski R.
      • MacDougall H.
      • Hughes-Barton D.
      • Gunn K.M.
      Virtual reality as a patient education tool in healthcare: a scoping review.
      ]. Although some studies have focused on the impact of prior patient preparation for radiotherapy treatments, there is no specific review on the effects of VR in educational sessions to prepare adult patients for radiotherapy treatments [
      • Pashaie S.
      • Estebsari F.
      • Matbouei M.
      • Nasiri M.
      Evaluation of the effect of patient education on the quality of life cancer patients undergoing radiotherapy: a review article.
      ,
      • Waller A.
      • Forshaw K.
      • Bryant J.
      • Mair S.
      Interventions for preparing patients for chemotherapy and radiotherapy: a systematic review.
      ]. The current systematic review attempted to answer the following question: What are the effects of RT educational sessions using VR on adult patients’ psychological and cognitive variables related to treatment experience?

      Methods

      The search protocol for the systematic literature review was conducted according to the PRISMA (Preferred Reporting Items for Systematic Reviews and meta-Analysis) statement [
      • Moher D.
      • Liberati A.
      • Tetzlaff J.
      • Altman D.G.
      Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.
      ]. The completed PRISMA checklist is available in Supplementary file S1.

      Search strategy and selection criteria

      Articles were screened for inclusion or exclusion based on PICOS criteria detailed in Table 1. A comprehensive search was run for titles, abstracts, and keywords, considering articles published from 2000 onwards. Keywords used in the search were “Radiotherapy”, “Virtual reality”, “Cancer”, “Patient experience”, “Patient knowledge”, “Patient subjective perception”, “Patient information needs”, “Anxiety”, and “Stress” and were combined simultaneously with the Boolean operator “AND” on the first three keywords and “OR” on the remaining. The universal language of the terms (MeSH) was chosen to achieve better results. The electronic database search was performed in February 2021 and updated in December 2021 on three databases (MEDLINE, Scopus, and Web of Science); grey literature was also considered.
      Table 1PICOS inclusion and exclusion criteria.
      ParameterInclusion CriteriaExclusion Criteria
      Population
      • -
        Adult patients undergoing external RT
        All cancer pathologies
      • -
        Pediatric patients (under 18 years old)
        Patients undergoing brachytherapy
        Students’ and health professionals training
      Intervention
      • -
        RT educational session and similar interventions to prepare patients for treatment, with VR (immersive and non-immersive systems) as learning tool.
      • -
        Patient́s positioning training/simulation
        Brachytherapy educational session with VR
        VR as a distraction tool for cancer patients during RT treatment.
      Comparator
      • -
        Control group (treatment as usual, usual care, waiting list, attention control, active comparator)
      Outcomes
      • -
        Patient knowledge
        Patient experience
        Patient subjective perception
        Patient information needs
        Anxiety
        Stress
      • -
        Quality of life
        Depression
      Study design
      • -
        Interventional study
        Qualitative study
        Quantitative study
        Randomized controlled trial
        Quasi-experimental
        Single-arm study
      • -
        Review
        Meta-analysis
        Study protocol
        Oral communication and poster abstracts
      The records were exported to a Word® document and examined independently by two authors to remove duplicates and confirm the inclusion/exclusion criteria considering the title and abstract information. The same authors performed a second-step screening of the retained full articles; other two authors were consulted when disagreements occurred to reach a final decision.

      Quality assessment of the studies

      Two authors independently appraised the selected studies using the Appraising the Evidence: Reviewing Disparate Data Systematically tool, developed by Hawker et al. [
      • Hawker S.
      • Payne S.
      • Kerr C.
      • Hardey M.
      • Powell J.
      Appraising the evidence: reviewing disparate data systematically.
      ]. This assessment tool evaluated each study in nine components (abstract and title; introduction and aims; method and data, sampling, data analysis, ethics and bias, findings/results, and transferability/generalizability), with a quality score ranging from 4 (Good) to 1 (Very Poor), to obtain a final quality score that could differ from 9 to 36 points [
      • Hawker S.
      • Payne S.
      • Kerr C.
      • Hardey M.
      • Powell J.
      Appraising the evidence: reviewing disparate data systematically.
      ]. Independent scores were cross-checked for consistency, and discrepancies were resolved with the other two authors.

      Data extraction and synthesis

      After reading the full-text articles, two authors extracted data from the eligible articles in Word forms. Extracted information included: study identification (authorship, publication date, country); study purpose(s); target population (oncological pathology; sample size); intervention design (control and experimental conditions, timing of educational session); assessment of cognitive and psychological variables (data collection, type of instruments and evaluated outcomes), and main results of the studies. Data findings were presented as a narrative synthesis and organised according to measured cognitive and/or psychological dimensions.

      Results

      Of the 25 articles (Fig. 1), eight [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] regarding seven studies complied with the inclusion criteria. The articles' quality scores ranged from 26 [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ] to 33 points [
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ]. The information regarding the articles retained for review is described in Table 2. The articles' quality assessment information is available in Supplementary file S2.
      Figure thumbnail gr1
      Fig. 1PRISMA flow diagram about the selection process of the articles
      [
      • Saeed N.
      Patient education in radiation oncology: evolution and innovation.
      ]
      .
      Table 2Study characteristics of the selected studies.
      Author, Year and CountryPathologyStudy purposeSampleIntervention designTiming of educational sessionData collection, Type of instruments and OutcomesMain resultsQuality score
      Gao et al, 2020

      China
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      Breast, lung, oesophageal, otherExplore the effectiveness of VR educational intervention on patients’ RT understanding and anxietyIG: n = 30 and relatives

      CG: n = 30
      IG: 30-min individual educational VR session

      CG: Standard educational session
      Prior to initiating RT treatmentPre- and post-intervention evaluation (prior to simulation, and prior to treatment) with self-reported questionnaires.

      Outcome(s): patient’s comprehension about RT treatment (simulation, planning and treatment); state-trait anxiety (State-Trait Anxiety Inventory-S, State-Trait Anxiety Inventory-T); psychological state regarding RT (VAS); anxiety-related physiological measures (heart rate, HR; respiration rate, RR; systolic blood pressure, SBP; and diastolic blood pressure, DBP).
      IG and CG did not significantly differ regarding variables in study at baseline (STAI-T: t = 0.448, p = 0.656; STAI-S: t = 1.248, p = 0.217; VAS: t = 0.462, p = 0.646; RT comprehension: t = −0.215, p = 0.831; SBP: t = −0.164, p = 0.870; DBP: t = −0.255, p = 0.799; HR: t = 0.050, p = 0.960; RR: t = −0.227, p = 0.831).

      When comparing IG and CG scores at post-intervention assessment: i) RT comprehension scores was significantly higher in the IG (t = 11.806, p < 0.001); ii) STAI-S score (t = −3.622, p = 0.001), SBP (t = −3.150, p = 0.003), and HR (t = −2.185, p = 0.033) were significantly lower in the IG.VAS

      (t = −1.747, p = 0.086), RR (t = −1.140, p = 0.259), and DBP (t = 0.230, p = 0.819) also decreased after the VR educational session, but without significant differences comparing with CG.
      30
      Jimenez et al, 2018

      Australia
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      BreastTo investigate the impact of a newly developed education tool using VERT system on patients’ RT knowledge, anxiety, and experience.IG: n = 19 and relatives

      CG: n = 18
      IG: 1-hour individual or group educational VR session

      CG: Written and verbal standard educational session
      Prior to the simulation appointmentPre- and post-intervention evaluation (at the time of clinic consultation, T1; on the day of simulation but prior to simulation, T2 for CG, or following the VERT education session, T2 for IG; first week of treatment, T3, and the last week of treatment, T4) with self-reported questionnaires.

      Outcome(s): patient’s knowledge about RT treatment; state-trait anxiety (State-Trait Anxiety Inventory-S, State-Trait Anxiety Inventory-T); patient’s RT experience (confidence regarding treatment).
      IG and CG did not significantly differ regarding variables in study at baseline (RT knowledge regarding Simulation, Preparation and Treatment, combined scores U = 131.5, p = 0.230; STAI-S: U = 162.5, p = 0.804), except for STAI-T (U = 53.00, p < 0.001).

      When comparing IG and CG scores at post-intervention assessment: i) RT knowledge combined scores were significantly higher in IG at T2 (U = 30.5; p < 0.001), T3 (U = 63.5; p < 0.001) and T4 (U = 80.5; p = 0.006); ii) there were no significant differences between groups regarding STAI-S after the intervention (all time points) (T2: U = 121.5, p = 0.135; T3: U = 125.0, p = 0.166; T4: U = 130.0, p = 0.217), iii) IG patient’s confidence mean values regarding RT treatment experience were higher (for all items) comparing with CG patients scores, at T3 and T4.
      28
      Jimenez et al, 2017

      Australia
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      BreastReport on the patient evaluation of the newly developed education using VERT.IG: n = 19 and relatives30-min individual or group educational VR session with oral explanations and pre-selected VERT imagesPrior the planning CT scanPost-intervention evaluation (after the VR session) with a self-reported questionnaire.

      Outcome(s): patient’s agreement regarding aspects of the VERT educationprogram (structure, content, venue and images)

      ; patient’s perception about VERT system support on RT concepts visualization; patient’s perception about the most and least useful about the educational session (open-ended question).
      Patients stated that VR education session improved their overall knowledge about the RT treatment from beginning to end, and specific understanding about the RT process at various steps.27
      Johnson et al, 2020

      Canada
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      Gastrointestinal, genitourinary, gynaecologicCreate and evaluate a prototype VR video as a supplement to traditional educational methodsIG: n = 7

      Group educational VR sessionFirst day of treatmentPost-intervention (after the VR session) focus group discussion.

      Outcome(s): patient’s thoughts and feedback about the VR session.
      After VR educational session, all patients reported an increased understanding of the treatment process and 57 % considered that VR has the potential to decrease RT-related anxiety.26
      Marquess et al, 2017

      USA

      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ProstateEvaluates the impact of VR on anxiety and comprehension in patients undergoing RTIG: n = 22 and relatives1-hour individual educational VR sessionAfter the planning CT scan, prior the RT treatmentPre- and post-intervention evaluation (before and after the VR session) with a self-reported survey.

      Outcome(s): patient’s RT comprehension; treatment-related anxiety (modified version of the Amsterdam Preoperative Anxiety and Information Scale).
      Patients significantly improved their RT comprehension (all items, p < 0.001; effect size from 1.84,”What I will feel during the treatment”, to 3.30, “What I need to do if I need the treatment to be interrupted.”). Patients also significantly decreased treatment-related anxiety in five of the eight items of the instrument (p-value from 0.001 to 0.026; effect size from 0.83 “Getting radiation to my prostate.” to 1.51 “How precise my treatment will be.”), from pre- to post-intervention evaluation.27
      Stewart-Lord et al, 2016

      United Kingdom
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ProstateExplore patients' perceptions of VR in RT as an information giving resource prior to the treatmentIG: n = 381-hour individual or group educational VR session4 weeks prior to the planning CT scanPost-intervention evaluation (2nd week of treatment) with a self-reported questionnaire.

      Outcome(s): patient’s knowledge about RT, benefits and limitations of using VR as a pre-treatment information resource (open-ended question).

      All patients felt that the session improved their understanding about RT and what to expect during treatment. The session also increased understanding about RT side effects and the importance of following correctly the radiotherapy preparation protocols (e.g., bowel and bladder preparation) for 97.4 % of the patients. A large number of patients also stated that the session reduced their treatment-related anxiety.28
      Sulé-Suso et al, 2015

      United Kingdom
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      Prostate, breast, rectum, lung, thymusTo assess the patients' and relatives' knowledge of RT after provision of information using VR.IG: n = 150 and relatives30-min individual educational VR sessionAfter the planning CT scan, prior the RT treatment, except when the time between the planning CT scan and the start of RT was too shortPost-intervention evaluation (after the VR session) with a self-reported survey.

      Outcome(s): patient’s needs regrading tumor visualization and RT planning; comments and observations about the educational session (open-ended question).
      All patients reported a better understanding about their disease and RT treatment on different levels (procedural, knowledge, technical delivery of treatment), which contributed to a reduction in anxiety and the “fear factor”.33
      Wang et al, 2022

      USA

      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      Breast, prostate, lung, oesophagus, rectal, endometrial cancerDetermine if VR can improve patient understanding of RT and/or reduce patient anxietyIG: n = 43Patient personalized 1-hour educational VR session1 to 2 days prior to the RT treatmentPre- and post-intervention evaluation (before and after the VR session) with self-reported questionnaires.

      Outcome(s): patient’s knowledge and understanding about illness and RT treatment; RT treatment-related anxiety.
      Most patients (93.7 %) agreed that VR educational session increased their knowledge and understanding about RT treatment. More than half (57 %) of the patients who expressed RT-related anxiety at baseline stated that the VR session helped decrease their anxiety about the treatment.31
      Legend: IG = Intervention group; CG = control group; VR = virtual reality; RT = radiotherapy; VERT = Virtual Environment for Radiotherapy Treatment.
      The selected studies were developed in several countries (i.e., Australia, Canada, China, the United Kingdom, and the United States of America). The studies used different research methods to fulfil their aims. Six studies had a one-arm design [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ]; the remaining two studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] had a two-arm design with a treatment and a control group (i.e., the hospital’s standard education). The studies involved 376 patients, with a sample size ranging from 7 [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ] to 150 [
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ]. The study samples included patients with different types of cancer [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] or patients with only a specific cancer type, such as breast [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ] and prostate [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ].
      The VR educational session was delivered through a computer educational program, the Virtual Environment for Radiotherapy Treatment (VERT) [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ], navigated by the patient or by the session’s facilitator, or through VR glasses, using technological solutions explicitly adapted for the study [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ]. VR components of the sessions included an immersive experience through which patients could visualize the RT environment and the equipment display, the linear accelerator functioning (e.g., sounds, rotation of the equipment, laser’s appearance), and a virtual demonstration of the RT treatment itself (e.g., patient’s positioning in the table, patient’s body area being irradiated by the beam). All educational sessions [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] included a complimentary informational component, delivered before, during, or after the VR experience [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ], Some technical components of the treatment or the images displayed in the VR session were explained. The VR session’s duration ranged between 30 min [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] and one hour [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ] (one of the articles did not mention the time frame of the session [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ]). The educational session was delivered before the CT scan in three studies [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ], prior to the treatment in four studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ], and on the first day of treatment in one study [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ]. Sessions were attended individually [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ], in a group [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ], or both modalities [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ]. In some studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ], a relative or a support person was invited to educational sessions.

      Assessment and impact of RT educational session using VR on adult patients’ psychological and cognitive variables related to the treatment experience

      Data collection regarding psychological and cognitive variables was gathered and analysed mainly through self-reported questionnaires (some rather include open-ended questions) completed pre and/or post-intervention, except in one of the studies that performed a pre and post-intervention focus group [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ]. The studies frequently assessed patient’s knowledge (also evaluated as patient’s comprehension or understanding) about aspects of RT simulation, planning and/or treatment [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] or about specific procedures to be performed before RT sessions (e.g., bowel and bladder treatment preparation instructions for prostate patients [
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ]. RT knowledge was assessed through surveys and scales predominantly developed for the study. Most studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] also evaluated patients’ perceived anxiety as a psychological state induced or related to the treatment experience. In two studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ], the patient’s anxiety levels were evaluated with the State-Trait Anxiety Inventory (STAI), a standardized and well-studied questionnaire; in Gao et al. [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ] study, other anxiety-related physiological measures (e.g., blood pressure, heart rate, and respiration) were also considered. The remaining studies developed questions to assess anxiety and concerns related to specific aspects of the RT treatment (e.g., RT machine’s movements, radiation exposure). Jimenez et al. [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] also addressed the educational session's impact on patients’ confidence regarding RT treatment.
      Impact of the educational session on patient’s RT knowledge. Independently of the study design, all the articles reported the benefits of the VR educational sessions on increasing patients’ knowledge about treatment. Two studies [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] assessed the effectiveness of VR educational sessions towards a treatment as usual control condition and compared, at least, the results of two repeated measures. In both cases, the experimental group samples were small (N ≤ 30), and the conclusions about the impact of the VR were based on different statistical analyses. Gao et al. [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ] found that patients that received the VR educational session had significantly improved their RT comprehension regarding simulation, planning and treatment after the intervention compared with the control group. After confirming the group equivalence at baseline, the difference between post and pre-intervention measurements in each group was computed (to eliminate the baseline effect), and the achieved scores were compared (statistical significance for p-values below 0.05). Jimenez et al. [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] analysed the impact of the VR educational sessions through comparisons between groups for each of the four-time points measurements separately, considering the same p-value for statistical significance. The authors concluded that patient’s RT knowledge (both the combined score and individual scores regarding simulation, planning, and treatment) was significantly higher in the intervention group (when compared with the control group) in all post-intervention assessments (immediately after the intervention, one week of treatment, and in the last week of treatment).
      The studies [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] that only enrolled patients in the VR educational session (without a control group to compare) also concluded that the intervention increased patients’ RT knowledge and comprehension regarding treatment. The dimensions under study were frequently evaluated with individual items and/or open-ended questions in these studies. As such, the conclusions drawn about the impact of VR technology were mainly supported by descriptive analysis; only one study [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ] performed inferential statistical analyses. Also, most studies included small samples (N < 50), except Sulé-Suso et al. [
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ] work that analysed data from 150 patients. Marquess et al. [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ] ran comparative statistical analyses to assess differences between the mean scores achieved by patients before and after the VR educational session considering a Bonferroni correction for p-value tests adjustment (p-value < 0.05); a standardized estimate of the effect size was also calculated. The authors found that RT comprehension significantly improved from baseline to post-intervention assessment for all items, which included aspects related to the RT environment (e.g., machine movements, noises, smells that patients could feel during the treatment), the treatment procedure itself (e.g., how the RT will be conducted and how will work on the patient’s tumour) and how the patient should behave during the treatment. The effect size was higher for “What I need to do if I need the treatment to be interrupted.” (d = 3.30), “What I will smell during the treatment.” (d = 2.95), and “Why lasers will be used.” (d = 2.63) items. In Wang et al. [
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] study, the proportion of patients that reported having a good understanding of RT treatment after the VR educational session increased after the session regarding the experience of being treated in the RT room (from 22 to 41 patients), side effects related to radiation (from 33 to 40 patients), and the tumour’s size (from 29 to 42 patients). Patients that participated in Sulé-Suso et al. [
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ], Jimenez et al. [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ] and Stewart-Lord et al. [
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ] studies reported a better understanding of how the RT treatment will be performed and what to expect after the educational session with VR. Specific aspects of the RT preparation procedures, such as the importance of following specific instructions regarding RT preparation procedures (i.e., bowel and bladder) [
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ], the patient positioning and dose administered in organs [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ], the treatment side effects [
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ], or the nature of their oncological disease [
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ] were also better understood by patients who were exposed to this virtual reality learning environment. Finally, Johnson et al. [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ] qualitative study performed a thematic analysis of a focus group discussion, where seven patients gave feedback about a prototype 360-degree VR video viewed before the RT treatment. The authors identified four main themes: Efficacy of traditional education, VR benefits, VR challenges/limitations, and VR logistic. Regarding VR benefits, all patients stated that the VR video delivered additional information that the earlier teaching session could not provide, and several of them referred to the potential of VR video to increase understanding of the view and sound components of the treatment.
      Impact of VR educational session regarding patient's treatment-related anxiety. The findings regarding the VR education sessions impact on patients' treatment-related anxiety levels were less homogeneous than patients' RT knowledge. In Gao et al. [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ] study, scores for three anxiety measures (i.e., STAI-S, systolic blood pressure, and heart rate) in the experimental condition were significantly lower than the control group after the intervention. Nevertheless, scores regarding the visual analogic scale, diastolic blood pressure, and the respiratory rate did not differ between groups compared with the baseline assessment. The analyses were run considering group equivalence at baseline for all the dimensions. In the Jimenez et al. [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] study, intervention and control groups consecutively diminished their anxiety scores across post-intervention assessments. Although the decrease in anxiety was higher for patients exposed to VR educational sessions, the results did not significantly differ from the control group. As mentioned previously, this study did not assess the interaction between condition and time on treatment-related anxiety outcomes.
      Marquess et al. [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ] found a significant decrease in patients' concerns after the VR educational session regarding treatment precision (“What I will feel while I am getting each radiation treatment.”), RT machine movements (“The treatment machine moving close to me during the treatment.”), radiation exposure (“Getting radiation to my prostate.”, “Having X-rays every day.”), or what he/she will feel during RT treatment (“What I will feel while I am getting each radiation treatment.”) items. Overall, the effect sizes were low; the item regarding treatment precision achieved the highest effect size (d = 1.51). On the other hand, concerns about the odors felt during the treatment, the need to wait for their turn, or being alone in the RT room did not significantly diminish after the session. The two studies [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] investigating patients' opinions regarding VR sessions’ effect on anxiety revealed positive results. Over half (57 %) of the 21 patients who expressed any treatment-related anxiety level at baseline reported that VR sessions helped decrease those concerns [
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ]. Patients that participated in Jimenez et al. [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ] study also highlighted how the VR session helped them to alleviate their treatment-related stress and focus on the positive effects of the RT rather than on the side effects. In Jonhson et al. [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ] qualitative study, 57 % of the participants agreed that VR video had the potential to reduce anxiety related to RT treatment in new patients.
      Impact of VR educational session regarding other psychological variables related to the RT experience. Jimenez et al. [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] also assessed the VR educational session impact on patient's level of confidence regarding RT treatment, asking questions about how the session helped patients to improve their RT experience, feel comfortable with the treatment machine and radiation therapist's procedures, or if the patient's initial expectations about RT were accurate. The evaluation of this dimension was accessed twice, in the first week (T3) and the last week of RT treatment (T4). Although no inferential statistical information was available regarding the significance of mean differences within or between groups, the descriptive analysis showed that the experimental groups achieved higher mean scores than the control group at T3 regarding all patient RT experience questions. Both groups' scores slightly increased or remained equal from T3 to T4.

      Discussion

      This systematic review aimed to assess the impact of the VR educational session on patients’ psychological and cognitive outcomes related to the treatment experience. We analysed eight articles regarding seven studies, primarily quantitative, with a one-arm design and including patients with different oncological diseases. VR educational sessions also varied greatly regarding the timing of the RT treatment at which patients received the session, the timing of the treatment when the complementary informational component was delivered, and its duration. These outcomes may indicate that RT educational sessions are not sufficiently documented and protocolled. Researchers and institutions are still looking for the best way to deliver them to patients, given that VR procedures are relatively recent. It is also noticeable that the studies were carried out in a hospital setting with a sensitive population (i.e., patients undergoing cancer treatment), which may have made using more detailed study designs difficult. Regarding the quality of the studies, although the overall evaluations were relatively good, we found many instruments used to assess cognitive and psychological variables. Some questionnaires were constructed specifically for the study, and details about their development, testing, and/or psychometric features were only sometimes available in the articles. These reasons justified some of the scores given to the studies’ methodological quality (i.e., two studies scored Good [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ], the remaining classified as Fair [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ] and one as Poor [
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ]. Also, particularly in studies with a two-arm design, the statistical analysis did not always allow us to understand whether there were differences regarding the effect of experimental conditions (between-groups variability) over time (within-groups variability).
      All studies assessed patients' RT knowledge and/or treatment-related anxiety as the primary cognitive and psychological dimensions to evaluate the impact of educational sessions with VR. Although these variables are usually considered in studies on procedures and treatments in oncologic patients, it would be interesting to understand the impact of VR on other variables that have also been shown to be essential for patients undergoing radiotherapy, such as self-efficacy [
      • Lewis F.
      • Merckaert I.
      • Liénard A.
      • Libert Y.
      • Etienne A.M.
      • Reynaert C.
      • et al.
      Anxiety and its time courses during radiotherapy for non-metastatic breast cancer: a longitudinal study.
      ]. Only one study [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ] evaluated the educational session’s impact on a different psychological dimension, i.e., patients’ confidence regarding RT treatment.
      The two-arm studies showed that, in general, patients' knowledge of RT treatment was higher after the educational session compared to usual care (without VR) [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ]; studies with only one experimental condition also showed significant positive differences after the VR session [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ,
      • Wang L.J.
      • Casto B.
      • Luh J.Y.
      • Wang S.J.
      Virtual reality-based education for patients undergoing radiation therapy.
      ]. Moreover, patients reported increased knowledge and understanding of the RT treatment process after the VR educational session in focus group discussion and open-ended questions [
      • Jimenez Y.A.
      • Wang W.
      • Stuart K.
      • Cumming S.
      • Thwaites D.
      • Lewis S.
      Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
      ,
      • Johnson K.
      • Liszewski B.
      • Dawdy K.
      • Lai Y.
      • McGuffin M.
      Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
      ,
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ]. It is possible that VR technology offers patients a virtual environment experience about the treatment of RT and how radiation will work on their bodies, which is hardly achieved through the explanations given by health professionals [
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ,
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education review and a case study using the virtual environment for radiotherapy training system.
      ]. On the other hand, this technology might allow some patients autonomy in exploring the available content and meeting their distinctive information needs [
      • Reinhart R.
      • D’Alimonte L.
      • Osmar K.
      • Court A.
      • Szumacher E.
      • Bristow B.
      • et al.
      Educating our patients collaboratively: a novel interprofessional approach.
      ,
      • Williams K.
      • Blencowe J.
      • Ind M.
      • Willis D.
      Meeting radiation therapy patients informational needs through educational videos augmented by 3D visualisation software.
      ,
      • Wieldraaijer T.
      • Duineveld L.A.M.
      • Bemelman W.A.
      • van Weert H.C.P.M.
      • Wind J.
      Information needs and information seeking behaviour of patients during follow-up of colorectal cancer in the Netherlands.
      ]. Although Halkett et al. [
      • Halkett G.K.B.
      • Kristjanson L.J.
      • Lobb E.
      • Little J.
      • Shaw T.
      • Taylor M.
      • et al.
      Information needs and preferences of women as they proceed through radiotherapy for breast cancer.
      ,
      • Halkett G.
      • O’Connor M.
      • Aranda S.
      • Jefford M.
      • Spry N.
      • Shaw T.
      • et al.
      Protocol for the RT Prepare Trial: a multiple-baseline study of radiation therapists delivering education and support to women with breast cancer who are referred for radiotherapy.
      ] found that patients have higher information needs before treatment planning and treatment, the differences between studies regarding the timing to deliver the educational session with VR to patients did not seem to interfere negatively with the effectiveness of the intervention regarding patients’ RT knowledge.
      Treatment-related anxiety levels were measured with standardized instruments (i.e., STAI), questions to assess concerns regarding RT treatment, and physiological data (blood pressure, heart rate, and respiration) that reflect the patient's psychological state. Although anxiety levels have decreased with VR educational sessions and throughout the treatment in almost all the studies, these outcomes were more heterogeneous and less precise than those concerning the knowledge about RT treatment. For example, in Jimenez et al. study [
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ], anxiety levels decreased significantly in the VR group at the T2 time point; however, there were no significant differences compared with the control group for each time point measurement. Several factors might have contributed to these results. First, patients may have high trait anxiety, a general anxiety vulnerability risk factor for adverse stress reactions. This dimension of anxiety was only considered in two studies of the present review, and its effect was not controlled when the differences between groups and repeated measures were assessed [
      • Gao J.
      • Liu S.
      • Zhang S.
      • Wang Y.
      • Liang Z.
      • Feng Q.
      • et al.
      Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
      ,
      • Jimenez Y.A.
      • Cumming S.
      • Wang W.
      • Stuart K.
      • Thwaites D.I.
      • Lewis S.J.
      Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
      ]. As early evidenced by Grilo et al., patients with trait anxiety need educational sessions with additional coping strategies training that was not the focus of these sessions [
      • Antoni D.
      • Vigneron C.
      • Clavier J.B.
      • Guihard S.
      • Velten M.
      • Noel G.
      Anxiety during radiation therapy: a prospective randomized controlled trial evaluating a specific one-on-one procedure announcement provided by a radiation therapist.
      ]. VR educational sessions might impact patients' understanding of the procedure, especially the effect of RT treatment on inside tissues [
      • Stewart-Lord A.
      • Brown M.
      • Noor S.
      • Cook J.
      • Jallow O.
      The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
      ,
      • Sulé-Suso J.
      • Finney S.
      • Bisson J.
      • Hammersley S.
      • Jassel S.
      • Knight R.
      • et al.
      Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
      ], not necessarily decreasing patients' emotional arousal. Second, there may be aspects related to the RT treatment experience that may generate anxiety that VR does not address. For instance, patients' overall treatment-related anxiety might be influenced by concerns about the RT's effect on the progression of the disease, which is unlikely to be reduced in educational sessions [
      • Grilo A.M.
      • Santos B.
      • Baptista I.
      • Monsanto F.
      Exploring the cancer patients’ experiences during external radiotherapy: a systematic review and thematic synthesis of qualitative and quantitative evidence.
      ]. Some studies analysed anxiety levels regarding specific aspects of RT but only related to procedural features of the treatment (e.g., RT machines movement, being alone in the room) [
      • Marquess M.
      • Johnston S.P.
      • Williams N.L.
      • Giordano C.
      • Leiby B.E.
      • Hurwitz M.D.
      • et al.
      A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
      ]. Third, in the studies in which anxiety was assessed at various times, anxiety was decreased throughout treatment, even in the control group. These results might suggest that daily exposure to treatment may have an anxiety desensitization effect [
      • Antoni D.
      • Vigneron C.
      • Clavier J.B.
      • Guihard S.
      • Velten M.
      • Noel G.
      Anxiety during radiation therapy: a prospective randomized controlled trial evaluating a specific one-on-one procedure announcement provided by a radiation therapist.
      ]. Further research is needed to clarify the effect of VR on psychological processes related to RT.
      On the other hand, it might be interesting to study what kind of cancer this tool could be more beneficial to improve patient understanding and adherence. Treatments that require preparation (like a bladder filling and bowel evacuation protocol) should be mainly studied, as they make the treatment experience more demanding [
      • Grilo A.M.
      • Santos B.
      • Baptista I.
      • Monsanto F.
      Exploring the cancer patients’ experiences during external radiotherapy: a systematic review and thematic synthesis of qualitative and quantitative evidence.
      ]. Examining how VR impacts patients’ preparation adherence would provide helpful knowledge for RT professionals. Considering patient characteristics, it is valuable to analyse the effect of VR on cognitive and psychological variables in older [
      • Bauer A.C.M.
      • Andringa G.
      The potential of immersive virtual reality for cognitive training in elderly.
      ] and low-health literacy [
      • Kelly T.
      • Surjan Y.
      • Rinks M.
      • Warren-Forward H.
      A radiation therapist’s guide to health literacy: a narrative review.
      ,
      • van der Kruk S.R.
      • Zielinski R.
      • MacDougall H.
      • Hughes-Barton D.
      • Gunn K.M.
      Virtual reality as a patient education tool in healthcare: a scoping review.
      ] radiotherapy patients. Finally, it could be interesting to analyse the effect of other VR systems, beyond VERT, on cancer patient radiotherapy education.
      Our findings seem to point to the usefulness of VR as an additional tool to educate patients undergoing radiotherapy without requiring patients’ previous or special skills [
      • Pottle J.
      Virtual reality and the transformation of medical education.
      ]. Nevertheless, VR tools for patient education are still at the beginning of their development, and possible limitations to their extensive use should be addressed. Besides time and resource consumption, [
      • Pandrangi V.C.
      • Gaston B.
      • Appelbaum N.P.
      • Albuquerque F.C.
      • Levy M.M.
      • Larson R.A.
      The application of virtual reality in patient education.
      ,
      • Vogiatzaki E.
      • Krukowski A.
      Rehabilitation after stroke using immersive user interfaces in 3D Virtual and augmented gaming environments.
      ,
      • Baniasadi T.
      • Ayyoubzadeh S.M.
      • Mohammadzadeh N.
      Challenges and practical considerations in applying virtual reality in medical education and treatment.
      ], which might interfere with RT departments’ workflow, the cost of this technology is not negligible [
      • Austin P.D.
      • Siddall P.J.
      • Lovell M.R.
      Feasibility and acceptability of virtual reality for cancer pain in people receiving palliative care: a randomised cross-over study.
      ]. Systems like VERT (used in most studies retained for our review), are costly and may not be easily acquired by RT departments [
      • Jimenez Y.A.
      • Lewis S.J.
      Radiation therapy patient education using VERT: combination of technology with human care.
      ]. Additionally, some studies pointed out that VR, particularly immersive technology, can generate cybersickness, described by disorientation, nausea, and oculomotor symptoms in some patients [
      • Gourlay D.
      • Lun K.C.
      • Lee Y.N.
      • Tay J.
      Virtual reality for relearning daily living skills.
      ,
      • Austin P.D.
      • Siddall P.J.
      • Lovell M.R.
      Feasibility and acceptability of virtual reality for cancer pain in people receiving palliative care: a randomised cross-over study.
      ]. Although no significant VR adverse effects were found in a recent study that used VR to relieve pain in cancer patients receiving palliative care, no significant adverse effects of VR were found, this possibility cannot be ignored. Zhou et al. [
      • Zhou Z.
      • Li J.
      • Wang H.
      • Luan Z.
      • Li Y.
      • Peng X.
      Upper limb rehabilitation system based on virtual reality for breast cancer patients: development and usability study.
      ] recommends avoiding VR use on patients that initiated RT immediately after chemotherapy due to possible increased nausea. It is also advised not to employ VR technology with patients who have vestibula or seizure history disorders [
      • Vogiatzaki E.
      • Krukowski A.
      Rehabilitation after stroke using immersive user interfaces in 3D Virtual and augmented gaming environments.
      ].

      Limitations

      The strength of the current systematic review is the rigorous methods implemented to identify and select all studies relevant to the purpose of this study, as well as evaluate their methodological quality in agreement with PRISMA guidelines [
      • Moher D.
      • Liberati A.
      • Tetzlaff J.
      • Altman D.G.
      Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.
      ]. However, we should mention some limitations of the study. The search strategy was not exhaustive regarding article language and time of publication. Although these criteria might have limited access to some articles, the authors believe that the most relevant literature about educational sessions with VR was screened and retained for analysis. The authors also found some clinical and methodological diversity in the included studies, and the sample of articles is small. These limitations prevented other statistical procedures (e.g., meta-analysis or sensitivity analysis for publication bias). Nevertheless, this work contributes significantly to enlightening which psychological and cognitive variables are assessed when studying the impact of educational sessions of radiotherapy with VR and to draw preliminary conclusions about the benefits of including VR in the preparation of cancer patients for radiotherapy.

      Conclusion

      The studies that assessed the impact of the educational session with VR psychological and cognitive variables focused mainly on RT knowledge and treatment-related anxiety. Overall, VR educational sessions improved patients' understanding and knowledge about RT and reduced their anxiety levels, with less homogeneous results. These results specific advantages of using VR to complement the standard educational methods in preparing oncological patients who start radiation therapy. Applying this technology would imply additional human resources, costs, and time for hospitals and dedicated equipment/VR systems. Nevertheless, RT departments might benefit from integrating a VR learning environment as a complementary patient education tool. Further research is also required to develop and implement guidelines regarding educational sessions with VR (regarding procedures for specific oncological populations, session duration, or the moment during the treatment process to deliver the session). It should also incorporate data about how VR can affect reproducibility and treatment accuracy.

      Funding

      This work received national funding from FCT – Fundação para a Ciência e a Tecnologia, I.P, through the Research Center for Psychological Science of the Faculty of Psychology, University of Lisbon (UIDB/04527/2020; UIDP/04527/2020).

      Declaration of Competing Interest

      The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

      Appendix A. Supplementary material

      The following are the Supplementary data to this article:

      References

        • Yu Duan Y.
        • Yao Zhang J.
        • Xie M.
        • Bo Feng X.
        • Xu S.
        • Wei Y.Z.
        Application of virtual reality technology in disaster medicine.
        Curr Med Sci. 2019; 39: 690-693
        • Williams C.L.
        • Kovtun K.A.
        The future of virtual reality in radiation oncology.
        Int J Radiat Oncol Biol Phys. 2018; 102: 1162-1164
        • Biocca F.
        Virtual reality technology: a tutorial.
        J Commun. 1992; 42: 23-72
        • Zasadzka E.
        • Pieczyńska A.
        • Trzmiel T.
        • Hojan K.
        Virtual reality as a promising tool supporting oncological treatment in breast cancer.
        Int J Environ Res Public Health. 2021; 18: 8768
        • Pottle J.
        Virtual reality and the transformation of medical education.
        Future Healthc J. 2019; 6: 181-185
        • Henn J.S.
        • Lemole G.M.
        • Ferreira M.A.T.
        • Gonzalez L.F.
        • Schornak M.
        • Preul M.C.
        • et al.
        Interactive stereoscopic virtual reality: a new tool for neurosurgical education.
        J Neurosurg. 2002; 96: 144-149
      1. Pillai AS, Mathew PS. Impact of virtual reality in healthcare; 2019. p. 17–31.

        • Lei C.
        • Sunzi K.
        • Dai F.
        • Liu X.
        • Wang Y.
        • Zhang B.
        • et al.
        Effects of virtual reality rehabilitation training on gait and balance in patients with Parkinson’s disease: a systematic review.
        PLoS One. 2019; 14: e0224819
        • Feyzioğlu Ö.
        • Dinçer S.
        • Akan A.
        • Algun Z.C.
        Is Xbox 360 Kinect-based virtual reality training as effective as standard physiotherapy in patients undergoing breast cancer surgery?.
        Support Care Cancer. 2020; 28: 4295-4303
        • Bani Mohammad E.
        • Ahmad M.
        Virtual reality as a distraction technique for pain and anxiety among patients with breast cancer: a randomized control trial.
        Palliat Support Care. 2019; 17: 29-34
        • Shepherd T.
        • Trinder M.
        • Theophilus M.
        Does virtual reality in the perioperative setting for patient education improve understanding? A scoping review.
        Surg Pract Sci. 2022; 10100101
      2. van der Linde-van den Bor M, Slond F, Liesdek OCD, Suyker WJ, Weldam SWM. The use of virtual reality in patient education related to medical somatic treatment: a scoping review. Patient Educ Couns. 2022;105(7):1828–41.

        • Chen G.
        • Zhao Y.
        • Xie F.
        • Shi W.
        • Yang Y.
        • Yang A.
        • et al.
        Educating outpatients for bowel preparation before colonoscopy using conventional methods vs virtual reality videos plus conventional methods.
        JAMA Netw Open. 2021; 4: e2135576
        • Sapkaroski D.
        • Mundy M.
        • Dimmock M.R.
        Immersive virtual reality simulated learning environment versus role-play for empathic clinical communication training.
        J Med Radiat Sci. 2022; 69: 56-65
        • Li A.
        • Montaño Z.
        • Chen V.J.
        • Gold J.I.
        Virtual reality and pain management: current trends and future directions.
        Pain Manag. 2011; 1: 147-157
        • Schneider S.M.
        • Kisby C.K.
        • Flint E.P.
        Effect of virtual reality on time perception in patients receiving chemotherapy.
        Support Care Cancer. 2011; 19: 555-564
        • Baños R.M.
        • Espinoza M.
        • García-Palacios A.
        • Cervera J.M.
        • Esquerdo G.
        • Barrajón E.
        • et al.
        A positive psychological intervention using virtual reality for patients with advanced cancer in a hospital setting: a pilot study to assess feasibility.
        Support Care Cancer. 2013; 21: 263-270
        • Bridge P.
        • Appleyard R.M.
        • Ward J.W.
        • Philips R.
        • Beavis A.W.
        The development and evaluation of a virtual radiotherapy treatment machine using an immersive visualisation environment.
        Comput Educ. 2007; 49: 481-494
        • Jimenez Y.A.
        • Lewis S.J.
        Radiation therapy patient education using VERT: combination of technology with human care.
        J Med Radiat Sci. 2018; 65: 158-162
        • Baskar R.
        • Lee K.A.
        • Yeo R.
        • Yeoh K.W.
        Cancer and radiation therapy: Current advances and future directions.
        Int J Med Sci. 2012; 9: 193-199
        • Lewis F.
        • Merckaert I.
        • Liénard A.
        • Libert Y.
        • Etienne A.M.
        • Reynaert C.
        • et al.
        Anxiety and its time courses during radiotherapy for non-metastatic breast cancer: a longitudinal study.
        Radiother Oncol. 2014; 111: 276-280
        • Canil T.
        • Cashell A.
        • Papadakos J.
        • Abdelmutti N.
        • Friedman A.J.
        Evaluation of the effects of pre-treatment education on self-efficacy and anxiety in patients receiving radiation therapy: a pilot study.
        J Med Imaging Radiat Sci. 2012; 43: 221-227
        • Halkett G.K.B.
        • Kristjanson L.J.
        • Lobb E.
        • Little J.
        • Shaw T.
        • Taylor M.
        • et al.
        Information needs and preferences of women as they proceed through radiotherapy for breast cancer.
        Patient Educ Couns. 2012; 86: 396-404
        • Halkett G.
        • O’Connor M.
        • Aranda S.
        • Jefford M.
        • Spry N.
        • Shaw T.
        • et al.
        Protocol for the RT Prepare Trial: a multiple-baseline study of radiation therapists delivering education and support to women with breast cancer who are referred for radiotherapy.
        BMJ Open. 2014; 4: e006116-e
        • Halkett G.K.B.
        • Merchant S.
        • Smith S.K.
        • O’Connor M.
        • Jefford M.
        • Aranda S.
        • et al.
        Supporting and preparing patients for radiotherapy: patients’ and radiation therapists’ perspectives on their one-to-one consultations.
        Eur J Cancer Care (Engl). 2020; 29: 1-11
        • Halkett G.K.B.
        • O’Connor M.
        • Aranda S.
        • Jefford M.
        • Shaw T.
        • York D.
        • et al.
        Pilot randomised controlled trial of a radiation therapist-led educational intervention for breast cancer patients prior to commencing radiotherapy.
        Support Care Cancer. 2013; 21: 1725-1733
        • Halkett G.
        • O’Connor M.
        • Jefford M.
        • Aranda S.
        • Merchant S.
        • Spry N.
        • et al.
        RT Prepare: a radiation therapist-delivered intervention reduces psychological distress in women with breast cancer referred for radiotherapy.
        Br J Cancer. 2018; 118: 1549-1558
        • Kumar A.
        • Sarkar M.
        • Davis E.
        • Morphet J.
        • Maloney S.
        • Ilic D.
        • et al.
        Impact of the COVID-19 pandemic on teaching and learning in health professional education: a mixed methods study protocol.
        BMC Med Educ. 2021; 21: 439
        • Schnitzler L.
        • Smith S.K.
        • Shepherd H.L.
        • Shaw J.
        • Dong S.
        • Carpenter D.M.
        • et al.
        Communication during radiation therapy education sessions: the role of medical jargon and emotional support in clarifying patient confusion.
        Patient Educ Couns. 2017; 100: 112-120
        • Zaheer S.
        • Gul R.B.
        • Bhamani S.S.
        • Memon M.A.
        The effect of individualized education with support on breast cancer patients’ anxiety and depression during radiation therapy: a pilot study.
        Eur J Oncol Nurs. 2020; 48101826
        • Reinhart R.
        • D’Alimonte L.
        • Osmar K.
        • Court A.
        • Szumacher E.
        • Bristow B.
        • et al.
        Educating our patients collaboratively: a novel interprofessional approach.
        J Cancer Educ. 2014; 29: 382-388
        • Smith S.K.
        • Nathan D.
        • Taylor J.
        • van Gelder E.
        • Dixon A.
        • Halkett G.K.B.
        • et al.
        Patients’ experience of decision-making and receiving information during radiation therapy: a qualitative study.
        Eur J Oncol Nurs. 2017; 30: 97-106
        • Li Z.
        • Geng W.
        • Yin J.
        • Zhang J.
        Effect of one comprehensive education course to lower anxiety and depression among Chinese breast cancer patients during the postoperative radiotherapy period - one randomized clinical trial.
        Radiat Oncol. 2018; 13: 111
        • Dawdy K.
        • Bonin K.
        • Russell S.
        • Ryzynski A.
        • Harth T.
        • Townsend C.
        • et al.
        Developing and evaluating multimedia patient education tools to better prepare prostate-cancer patients for radiotherapy treatment (randomized study).
        J Cancer Educ. 2018; 33: 551-556
        • González-Arriagada W.A.
        • de Andrade M.A.C.
        • Ramos L.M.A.
        • Bezerra J.R.S.
        • Santos-Silva A.R.
        • Lopes M.A.
        Evaluation of an educational video to improve the understanding of radiotherapy side effects in head and neck cancer patients.
        Support Care Cancer. 2013; 21: 2007-2015
        • Hahn C.A.
        • Fish L.J.
        • Dunn R.H.
        • Halperin E.C.
        Prospective trial of a video educational tool for radiation oncology patients.
        Am J Clin Oncol: Cancer Clin Trials. 2005; 28: 609-612
        • Saeed N.
        Patient education in radiation oncology: evolution and innovation.
        Appl Radiat Oncol. 2018; 7: 43-49
        • Kelly T.
        • Surjan Y.
        • Rinks M.
        • Warren-Forward H.
        A radiation therapist’s guide to health literacy: a narrative review.
        J Med Radiat Sci. 2021; 68: 465-474
        • Chierchini S.
        • Ingrosso G.
        • Saldi S.
        • Stracci F.
        • Aristei C.
        Physician and patient barriers to radiotherapy service access: treatment referral implications.
        Cancer Manag Res. 2019; 11: 8829-8833
        • Fristedt S.
        • Smith F.
        • Grynne A.
        • Browall M.
        Digi-Do: a digital information tool to support patients with breast cancer before, during, and after start of radiotherapy treatment: an RCT study protocol.
        BMC Med Inform Decis Mak. 2021; 21: 76
        • Jimenez Y.A.
        • Lewis S.J.
        Radiation therapy patient education review and a case study using the virtual environment for radiotherapy training system.
        J Med Imaging Radiat Sci. 2018; 49: 106-117
        • Williams K.
        • Blencowe J.
        • Ind M.
        • Willis D.
        Meeting radiation therapy patients informational needs through educational videos augmented by 3D visualisation software.
        J Med Radiat Sci. 2017; 64: 35-40
        • Chirico A.
        • Lucidi F.
        • de Laurentiis M.
        • Milanese C.
        • Napoli A.
        • Giordano A.
        Virtual reality in health system: beyond entertainment. A mini-review on the efficacy of VR during cancer treatment.
        J Cell Physiol. 2016; 231: 275-287
        • Ridout B.
        • Kelson J.
        • Campbell A.
        • Steinbeck K.
        Effectiveness of virtual reality interventions for adolescent patients in hospital settings: systematic review.
        J Med Internet Res. 2021; 23: e24967
        • Klllç A.
        • Brown A.
        • Aras I.
        • Hui R.
        • Hare J.
        • Hughes L.D.
        • et al.
        Using virtual technology for fear of medical procedures: a systematic review of the effectiveness of virtual reality-based interventions.
        Ann Behav Med. 2021; 55: 1062-1079
        • Chamunyonga C.
        • Rutledge P.
        • Caldwell P.J.
        • Burbery J.
        • Hargrave C.
        The application of the virtual environment for radiotherapy training to strengthen IGRT education.
        J Med Imaging Radiat Sci. 2020; 51: 207-213
        • Rooney M.K.
        • Zhu F.
        • Gillespie E.F.
        • Gunther J.R.
        • McKillip R.P.
        • Lineberry M.
        • et al.
        Simulation as more than a treatment-planning tool: a systematic review of the literature on radiation oncology simulation-based medical education.
        Int J Radiat Oncol Biol Phys. 2018; 102: 257-283
        • van der Kruk S.R.
        • Zielinski R.
        • MacDougall H.
        • Hughes-Barton D.
        • Gunn K.M.
        Virtual reality as a patient education tool in healthcare: a scoping review.
        Patient Educ Couns. 2022; 105: 1928-1942
        • Pashaie S.
        • Estebsari F.
        • Matbouei M.
        • Nasiri M.
        Evaluation of the effect of patient education on the quality of life cancer patients undergoing radiotherapy: a review article.
        J Pharm Res Int. 2019; 31: 1-10
        • Waller A.
        • Forshaw K.
        • Bryant J.
        • Mair S.
        Interventions for preparing patients for chemotherapy and radiotherapy: a systematic review.
        Support Care Cancer. 2014; 22: 2297-2308
        • Moher D.
        • Liberati A.
        • Tetzlaff J.
        • Altman D.G.
        Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.
        PLoS Med. 2009; 6: e1000097
        • Hawker S.
        • Payne S.
        • Kerr C.
        • Hardey M.
        • Powell J.
        Appraising the evidence: reviewing disparate data systematically.
        Qual Health Res. 2002; 12: 1284-1299
        • Gao J.
        • Liu S.
        • Zhang S.
        • Wang Y.
        • Liang Z.
        • Feng Q.
        • et al.
        Pilot study of a virtual reality educational intervention for radiotherapy patients prior to initiating treatment.
        J Cancer Educ. 2022; 37: 578-585
        • Jimenez Y.A.
        • Cumming S.
        • Wang W.
        • Stuart K.
        • Thwaites D.I.
        • Lewis S.J.
        Patient education using virtual reality increases knowledge and positive experience for breast cancer patients undergoing radiation therapy.
        Support Care Cancer. 2018; 26: 2879-2888
        • Jimenez Y.A.
        • Wang W.
        • Stuart K.
        • Cumming S.
        • Thwaites D.
        • Lewis S.
        Breast cancer patients’ perceptions of a virtual learning environment for pretreatment education.
        J Cancer Educ. 2018; 33: 983-990
        • Johnson K.
        • Liszewski B.
        • Dawdy K.
        • Lai Y.
        • McGuffin M.
        Learning in 360 degrees: a pilot study on the use of virtual reality for radiation therapy patient education.
        J Med Imaging Radiat Sci. 2020; 51: 221-226
        • Marquess M.
        • Johnston S.P.
        • Williams N.L.
        • Giordano C.
        • Leiby B.E.
        • Hurwitz M.D.
        • et al.
        A pilot study to determine if the use of a virtual reality education module reduces anxiety and increases comprehension in patients receiving radiation therapy.
        J Radiat Oncol. 2017; 6: 317-322
        • Stewart-Lord A.
        • Brown M.
        • Noor S.
        • Cook J.
        • Jallow O.
        The utilisation of virtual images in patient information giving sessions for prostate cancer patients prior to radiotherapy.
        Radiography. 2016; 22: 269-273
        • Sulé-Suso J.
        • Finney S.
        • Bisson J.
        • Hammersley S.
        • Jassel S.
        • Knight R.
        • et al.
        Pilot study on virtual imaging for patient information on radiotherapy planning and delivery.
        Radiography. 2015; 21: 273-277
        • Wang L.J.
        • Casto B.
        • Luh J.Y.
        • Wang S.J.
        Virtual reality-based education for patients undergoing radiation therapy.
        J Cancer Educ. 2022; 37: 694-700
        • Wieldraaijer T.
        • Duineveld L.A.M.
        • Bemelman W.A.
        • van Weert H.C.P.M.
        • Wind J.
        Information needs and information seeking behaviour of patients during follow-up of colorectal cancer in the Netherlands.
        J Cancer Surviv. 2019; 13: 603-610
        • Antoni D.
        • Vigneron C.
        • Clavier J.B.
        • Guihard S.
        • Velten M.
        • Noel G.
        Anxiety during radiation therapy: a prospective randomized controlled trial evaluating a specific one-on-one procedure announcement provided by a radiation therapist.
        Cancers (Basel). 2021; 13: 2572
        • Grilo A.M.
        • Santos B.
        • Baptista I.
        • Monsanto F.
        Exploring the cancer patients’ experiences during external radiotherapy: a systematic review and thematic synthesis of qualitative and quantitative evidence.
        Eur J Oncol Nurs. 2021; 52101965
        • Bauer A.C.M.
        • Andringa G.
        The potential of immersive virtual reality for cognitive training in elderly.
        Gerontology. 2020; 66: 614-623
        • Gourlay D.
        • Lun K.C.
        • Lee Y.N.
        • Tay J.
        Virtual reality for relearning daily living skills.
        Int J Med Inform. 2000; 60: 255-261
        • Pandrangi V.C.
        • Gaston B.
        • Appelbaum N.P.
        • Albuquerque F.C.
        • Levy M.M.
        • Larson R.A.
        The application of virtual reality in patient education.
        Ann Vasc Surg. 2019; 59: 184-189
        • Vogiatzaki E.
        • Krukowski A.
        Rehabilitation after stroke using immersive user interfaces in 3D Virtual and augmented gaming environments.
        EAI Endorsed Trans Pervasive Health Technol. 2015; 1: e7
        • Baniasadi T.
        • Ayyoubzadeh S.M.
        • Mohammadzadeh N.
        Challenges and practical considerations in applying virtual reality in medical education and treatment.
        Oman Med J. 2020; 35: e125
        • Austin P.D.
        • Siddall P.J.
        • Lovell M.R.
        Feasibility and acceptability of virtual reality for cancer pain in people receiving palliative care: a randomised cross-over study.
        Support Care Cancer. 2022; 30: 3995-4005
        • Zhou Z.
        • Li J.
        • Wang H.
        • Luan Z.
        • Li Y.
        • Peng X.
        Upper limb rehabilitation system based on virtual reality for breast cancer patients: development and usability study.
        PLoS One. 2021; 16: e0261220