TLDR: Researchers developed hybrid deep learning models combining LSTM and Transformer architectures to accurately and efficiently measure the profiles of highway-railway grade crossings (hump crossings). Using IMU and GPS sensor data, two of the three developed models (LSTM-Transformer sequential and parallel) successfully identified hazardous crossing profiles, offering a cost-effective and rapid alternative to traditional methods, thereby improving road and rail safety.
Highway-railway grade crossings (HRGCs), often referred to as hump crossings, present a significant safety concern for vehicles on the road. These elevated sections of road where it crosses railway tracks can cause vehicles with low ground clearance or long wheelbases, such as school buses or trucks carrying hazardous materials, to get stuck or “hung up.” This can lead to dangerous situations, including potential collisions with trains, as tragically demonstrated by incidents in Indiana (2015) and Oklahoma (2021).
Traditionally, measuring the profile of these crossings to identify potential hazards has been a challenging task. Existing methods are often expensive, time-consuming, disrupt traffic flow, and can even pose safety risks to the personnel performing the measurements. For instance, physical models are heavy and require traffic control, while LiDAR-based techniques are costly and need specialized operators.
To address these limitations, researchers have developed an innovative approach utilizing advanced sensing technologies and deep learning. A team from Oklahoma State University and the Oklahoma Department of Transportation has introduced a novel hybrid deep learning framework designed to accurately and efficiently measure HRGC profiles. This research is detailed in their paper, “Hybrid LSTM-Transformer Models for Profiling Highway-Railway Grade Crossings,” which you can read more about here: Research Paper.
The core of their solution lies in combining two powerful deep learning architectures: Long Short-Term Memory (LSTM) and Transformer models. LSTMs are excellent at processing sequential data and capturing local features, while Transformers excel at understanding long-term dependencies and global patterns within data. By integrating these two, the hybrid model aims to leverage the strengths of both.
Data for this study was collected along the Red Rock Railroad Corridor in Oklahoma, encompassing 225 HRGCs. A highway testing vehicle equipped with Inertial Measurement Unit (IMU) and Global Positioning System (GPS) sensors gathered instrumentation data at normal traffic speeds. For ground truth measurements, an industry-standard walking profiler was used, providing highly precise profile data.
The input data for the deep learning models included various parameters from the IMU-GPS sensors, such as vehicle acceleration in three directions (X, Y, Z), roll, pitch, vehicle speed, and GPS altitude. The goal was for the models to predict the HRGC profile, which was then compared against the accurate ground truth data from the walking profiler.
Three different hybrid model configurations were developed and evaluated: a Transformer-LSTM sequential model (Model 1), an LSTM-Transformer sequential model (Model 2), and an LSTM-Transformer parallel model (Model 3). After rigorous testing on training, validation, and unseen test datasets, Models 2 and 3 consistently demonstrated superior performance compared to Model 1. They accurately determined HRGC profiles and showed strong ability to generalize to new, unobserved crossings, even when dealing with lower-resolution data, simulating less expensive instrumentation.
Notably, Model 3, the LSTM-Transformer parallel configuration, showed a slight advantage in computational efficiency due to having fewer trainable parameters while maintaining excellent accuracy. Both Model 2 and Model 3 have been successfully deployed to generate detailed 2D and 3D HRGC profiles that closely match the real-world ground truth data.
Also Read:
- Optimizing Bicycle Sensor Placement for Better Urban Planning
- OmniUnet: Enhancing Rover Navigation with Multimodal Terrain Perception
This research marks a significant step forward in enhancing highway and railroad safety. By providing a rapid, accurate, and cost-effective method for identifying high-profile hump crossings, authorities can proactively address these hazards, ultimately reducing the risk of accidents and improving overall transportation safety.


