TLDR: This research paper uses a system dynamics approach to model how biases evolve and are reinforced in Fashion Recommender Systems (FRS). It identifies that biases introduced during data management and system design (inductive biases) have a greater impact on system performance than user biases. The study also demonstrates that current debiasing strategies can improve recommendation quality, but further enhancements are needed to fully mitigate biases, especially those originating from researchers and design choices. The paper advocates for a proactive approach to ensure fairness and inclusivity in FRS.
In today’s digital age, recommender systems are everywhere, guiding our choices from movies to music and, notably, fashion. While these systems are designed to enhance our experience by suggesting items we might like, they can also inadvertently perpetuate and amplify existing biases. A recent research paper, “Modeling Bias Evolution in Fashion Recommender Systems: A System Dynamics Approach,” delves into this critical issue, particularly within the dynamic world of fashion e-commerce.
Authored by Mahsa Goodarzi and M. Abdullah Canbaz from the AI in Complex Systems Lab at the University at Albany SUNY, this study employs a unique system dynamics modeling approach. Their goal is to understand how biases are activated, reinforced, and evolve over time in Fashion Recommender Systems (FRS), and what can be done to mitigate them.
The Problem of Bias in Fashion Recommendations
Fashion is deeply intertwined with cultural identities and rapidly changing trends, making FRS a particularly sensitive area for bias. The paper highlights how historical biases in beauty standards, body shapes, and skin tones can be encoded into these systems. When FRS prioritize statistical objectives over the nuanced understanding of individual user identities, they risk reinforcing stereotypes and limiting exposure to diverse styles.
The researchers identify several types of biases:
- Position Bias: Items displayed prominently (e.g., at the top of a list) receive more attention.
- Popularity Bias: Algorithms favor items already popular, further boosting their visibility and sidelining niche products.
- Explicitly Injected Biases: Deliberately introduced by businesses to achieve specific goals, like promoting certain products.
- Unintentional Biases: Arise from errors in data collection, skewed training datasets, or flaws in algorithmic design.
A key insight from the paper is the concept of “feedback loops.” Biased recommendations lead to biased user interactions, which in turn feed more biased data back into the system, amplifying the original bias over time. This creates a self-reinforcing cycle that can degrade recommendation quality and user experience.
A Dynamic Approach to Understanding Bias
To tackle this complex problem, Goodarzi and Canbaz developed a structured system dynamics model. This model helps visualize and simulate the nonlinear interactions between different types of bias across various components of a recommender system. They broke down the system into four interconnected areas:
- Data Management and Design Biases (Green Box): This is where biases are initially introduced through data selection, feature engineering, and algorithmic adjustments. It’s the origin point for biases like popularity and inductive bias.
- User Behavior and Interaction Biases (Red Box): This section models how user preferences and interactions influence the skewness of recommendations. Biased user ratings, for example, can distort perceived item quality.
- Human-Computer Interaction Dynamics (Pink Box): This focuses on how user engagement reinforces bias. Frequent interactions with biased recommendations lead to more similar content being presented.
- Performance and Recommendation Quality (Blue Box): This closes the loop, showing how cumulative biases degrade recommendation quality, accuracy, and user satisfaction.
The model, while conceptual, provides a roadmap for identifying strategic intervention points.
Also Read:
- MICRec: A Unified Framework for Smarter, More Adaptable Recommendations
- CausalRec: Enhancing Recommendation Systems by Understanding Why Users Act
Key Findings from Simulations
The experimental simulations revealed several important dynamics:
- Bias Growth: In a base scenario without new biases, bias distribution initially grew exponentially before stabilizing.
- Inductive vs. User Bias: When biases were activated, inductive biases (those from data collection and model design) had a more significant impact on performance degradation than user biases. This suggests that foundational design choices are critical.
- Debiasing Effectiveness: The good news is that debiasing interventions, such as data rebalancing, algorithmic regularization, and new modeling choices, showed significant potential. Applying these interventions led to a notable improvement in recommendation quality, even in scenarios with high initial bias. However, the study also highlighted that inductive biases originating from researchers still present challenges that current interventions don’t fully resolve.
The research underscores the necessity for advancing debiasing strategies and considering broader contextual factors like user demographics and item diversity to foster inclusivity and fairness in FRS. The findings advocate for a proactive approach in recommender system design to counteract bias propagation and ensure equitable user experiences. For a deeper dive into their methodology and findings, you can read the full paper here: Modeling Bias Evolution in Fashion Recommender Systems: A System Dynamics Approach.
While this model is a simplification, it offers valuable insights into the complex, dynamic nature of bias. Future work aims to expand the model to include external factors and further refine intervention strategies, ultimately contributing to more fair and robust AI systems across various domains, not just fashion.


