TLDR: A new hybrid AI model, Augmented Structure Preserving Neural Networks (ASPNN), combines mechanical principles with machine learning to accurately predict complex cell trajectories and even mitosis events. It uses computer vision to analyze cell movements from videos, offering a comprehensive and non-invasive way to study cell biomechanics in various environments, from simulated to real-world scenarios.
Cell movement, a fundamental process in all living organisms, plays a crucial role in everything from the earliest stages of embryo development to the repair of damaged tissues and even the growth of tumors. Understanding how cells move and interact is vital, but the sheer complexity of these phenomena, influenced by countless internal and external factors, has long posed a significant challenge for researchers.
Traditional approaches often simplify the problem by focusing on single environmental factors in controlled laboratory settings. However, real-life biological environments are far more intricate, with multiple gradients (like nutrients, oxygen, or chemicals) and interactions constantly influencing cell behavior. This complexity makes it difficult to get a complete picture of cell migration mechanisms, especially in living organisms.
A new research paper, Augmented Structure Preserving Neural Networks for cell biomechanics, introduces an innovative solution: the Augmented Structure Preserving Neural Network (ASPNN). This hybrid model combines the strengths of two different machine learning approaches to provide a more holistic understanding of cell biomechanics. The goal is to predict complete cell trajectories and even significant events like cell division with high accuracy, using only visual data.
How the ASPNN Model Works
The ASPNN is built on two main components:
-
Structure Preserving Neural Networks (SPNN): This part of the model treats cell movement as a purely mechanical system. It’s designed to adhere to fundamental thermodynamic principles, such as the conservation of total energy and the natural increase of entropy. By focusing on the energetic behavior of the system, the SPNN can identify underlying mechanical drivers and even detect external energy sources like chemical gradients.
-
Correction Neural Network (CoNN/MLP): Recognizing that cell migration goes beyond simple mechanics, this component is a Multi-Layer Perceptron (MLP) that accounts for environmental factors. These factors, which can be observed in experiments (like chemical or density gradients) but are not always easily quantifiable in living systems, influence how cells respond to their surroundings. The MLP learns these complex, non-mechanical patterns, providing a crucial layer of understanding that complements the SPNN’s mechanical analysis.
The beauty of this combined approach is its ability to analyze a wide range of factors simultaneously, eliminating the need for specially designed experiments that isolate a single variable. Furthermore, the model relies solely on features extracted from video or image sequences using Computer Vision (CV) techniques. This means it can be applied to studies in living organisms (in vivo) without requiring invasive measurements or additional data.
Data Acquisition and Feature Extraction
To feed the ASPNN, the researchers developed a sophisticated data processing pipeline. It starts with video sequences, which are broken down into individual frames. A Segment Anything Model (SAM) is used for image segmentation, identifying and masking each cell to extract information about its shape and size. This is important because cells often change shape during processes like mitosis.
Once cells are detected, their movements are tracked across frames using the DeepOCSort algorithm, which employs Kalman Filters and Re-Identification models to associate cells in subsequent frames. From these segmented and tracked cells, a variety of features are extracted for each frame, including cell center coordinates, velocity, density gradients, the number and average velocity of surrounding cells, cell brightness, cell area variation, and eccentricity.
Testing the Model
The ASPNN was rigorously tested across three scenarios:
-
In-silico deterministic experiment: A simulated case where cell movement followed a simple, predictable two-dimensional gradient without any noise. Here, the SPNN successfully inferred the underlying movement mechanism.
-
In-silico case with noise: Similar to the first simulation, but with random Gaussian noise added to the data. This tested the model’s ability to generalize and filter out noise, mimicking the imperfections of real-world data.
-
Real in vitro experiment: The model was applied to a video of Madine-Darby canine kidney (MDCK) cells moving in a microchannel. This real-world test demonstrated the model’s capability to handle complex, fluctuating movements where environmental conditions play a significant role.
In all cases, the model achieved high accuracy in predicting cell velocities (over 85% for both x and y coordinates) and successfully maintained compliance with thermodynamic principles. Notably, in the real-world experiment, the MLP component’s contribution to velocity prediction became more prominent, highlighting the increased importance of environmental factors in complex biological systems.
Predicting Mitosis Events
Beyond trajectory prediction, the research also presents a separate mitosis event prediction model, also based on an MLP architecture. This model uses similar visual features as the ASPNN, with additional inputs like cell area and brightness variations over time. These additions are crucial because cells undergo distinct shape and brightness changes before dividing.
The mitosis prediction model achieved a precision of 69% in identifying mitotic events in a test set, with a very low rate of false positive predictions (0.1%). This demonstrates the potential to foresee cell division, which could be a major breakthrough in understanding rapidly growing systems like tumors.
Also Read:
- Structured AI Models Enhance Generative Thermal Design Efficiency
- CellPainTR: A Breakthrough in Generalizable Cell Painting Analysis for Large-Scale Biological Discovery
Conclusion
This work offers a powerful new framework for analyzing cell migration. By combining a physically informed neural network with a machine learning model that captures environmental influences, the Augmented Structure Preserving Neural Network provides a comprehensive, non-invasive, and highly accurate tool for studying cell biomechanics. This approach not only predicts cell movements but also offers insights into the underlying mechanisms, paving the way for a deeper understanding of biological processes and pathologies.


