TLDR: A new Extended Reality (XR) framework is proposed to enhance urban risk training, particularly for climate change-induced flooding. Developed with stakeholder input, this immersive platform simulates emergency scenarios for citizens, local authorities, and first responders, improving awareness and preparedness. Piloted in Senigallia, Italy, the framework uses VR/AR technologies for interactive learning, performance evaluation, and continuous refinement, aiming to foster a culture of resilience against urban hazards.
As urban areas increasingly face risks, particularly from climate change-induced flooding, a new framework leveraging Extended Reality (XR) technologies is emerging to significantly improve user risk training within built environments. This innovative approach aims to boost risk awareness and preparedness among a wide range of stakeholders, including everyday citizens, local authorities, and crucial emergency responders.
The core of this framework lies in its use of immersive XR technologies to simulate realistic emergency scenarios. By creating these virtual environments, the training experience encourages active participation and helps users develop a deeper understanding of potential hazards, especially those related to floods. A key aspect of its development has been the strong emphasis on stakeholder involvement, ensuring that the training modules are specifically tailored to meet the unique needs of different user groups. The framework also adopts an iterative design, allowing for continuous improvements based on user feedback and performance data, thereby enhancing the overall effectiveness of risk training initiatives.
The methodology behind this framework involves several critical phases: mapping user interactions, carefully selecting relevant scenarios, and evaluating performance. A pilot application of this framework is currently underway in Senigallia, Italy, a city chosen for its significant climate-induced flood risks.
The Power of Extended Reality in Training
Extended Reality, an umbrella term encompassing Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality, offers a powerful medium for safety training. It can create diverse simulated conditions without the complexities and dangers of real-world drills. This technology significantly increases user engagement, leading to higher levels of knowledge acquisition and retention compared to traditional training methods. When combined with serious gaming techniques, XR creates stimulating environments where users learn by doing, solving tasks and receiving immediate feedback without being exposed to actual risks.
While XR solutions have been widely applied to single buildings for fire safety, earthquake, and flood risks, this framework extends its application to broader outdoor and urban scenarios. This is crucial given that many significant risks impact entire urban areas, necessitating wide-scale training campaigns to improve preparedness among citizens and emergency personnel.
The CLIMRES Project Connection
This research is an integral part of the European project CLIMRES – “Leadership for climate resilient buildings.” The CLIMRES project focuses on providing practical advice and tools to help stakeholders evaluate and plan effective interventions against climate change, with end-user preparedness playing a vital role in enhancing overall urban resilience.
Framework Implementation Steps
The XR-based framework is structured around several key steps:
- Preparing the Training: Training programs for citizens and first responders are developed in collaboration with municipal advisors and flood risk experts. Immersive VR headsets are primarily used for widespread replication, while AR solutions are considered for in-situ training experiences in specific buildings and surrounding areas. An online platform with secure login allows for self-training, making content accessible to a wider audience, including tourists.
- Selecting a Training Scenario: Users can choose from various simulated flood emergency situations. These include ‘typological’ scenarios for general risk awareness and preparedness, as well as pilot-sensitive scenarios specifically tailored to the Municipality of Senigallia. AR applications can offer interactive content overlaid on real-world views.
- Initializing and Performing the XR Simulation: Users enter an interactive XR environment where they navigate and complete assigned tasks within the emergency setup. A brief introduction to flood risk and training objectives is provided, and direct feedback, such as health bars or score levels, guides users during the simulation. Actions performed are monitored for final training reports.
- Completing the Training and Receiving Final Reports: Upon finishing the XR experience, the system evaluates user performance based on actions, decision speed, and accuracy. Users receive reports highlighting their awareness and preparedness levels, along with suggestions for improvement. For training campaigns led by municipal advisors, administrators can access anonymous performance data to refine future scenarios.
- Repeating, Choosing Another Scenario or Exiting: Users have the option to repeat a scenario to hone their skills or select a different one. This allows for progression from general ‘typological’ scenarios to more specific, real-world ones, with comparative reports offering additional insights into preparedness levels.
The effectiveness of these XR training solutions is evaluated using metrics such as self-assessment questionnaires, user engagement levels, the number of errors made, and repetitions of VR experiences. Written feedback is also collected to gather suggestions for improvement.
Also Read:
- Generative AI and Extended Reality: A Comprehensive Review of Current Trends and Future Outlook
- UniDisMob: A Universal AI Model for Predicting Human Movement in Natural Disasters
Future Outlook and Challenges
The integration of XR technologies into urban risk training holds immense potential for increasing community resilience against hazards like floods. This framework, detailed in the paper An extended reality-based framework for user risk training in urban built environment, is adaptable, scalable, and designed for customized application across different urban contexts. It emphasizes multi-role training and continuous improvement based on feedback.
Future work will involve collecting relevant input data for the Senigallia pilot, designing intuitive user experiences, and developing both immersive and non-immersive XR solutions to ensure broad accessibility. Key challenges include managing limited bandwidth for real-time XR experiences and ensuring compatibility across various personal devices and operating systems. The pilot application will serve as a crucial testing ground, allowing for real-time adjustments and paving the way for replication in other urban settings and for other risks like earthquakes and wildfires.
