TLDR: Autiverse is an AI-guided multimodal journaling app designed for autistic adolescents to improve narrative skills and emotional expression. It uses conversational AI and four-panel comic strips to scaffold storytelling, making it easier for users to organize daily events and feelings. A two-week study showed it enhanced narrative coherence, increased parental awareness of their child’s experiences, and fostered positive parent-child interactions, with adolescents perceiving the AI as a supportive peer.
A groundbreaking new application called Autiverse is transforming how autistic adolescents can share their daily experiences and emotions. Developed as an AI-guided multimodal journaling app for tablets, Autiverse aims to help these young individuals improve their narrative skills, which can be particularly challenging for them.
Traditional journaling often presents significant hurdles for autistic adolescents. Its reliance on text and high demands on executive functions like planning and sequencing can be overwhelming. Many struggle with open-ended questions like “What happened today?” and find it difficult to organize complex events into a coherent story. Additionally, expressing emotions can be tough, a condition often referred to as alexithymia.
How Autiverse Helps
Autiverse addresses these challenges through a carefully designed system that provides multiple layers of support:
- Structured Storytelling: Instead of a blank page, Autiverse starts by asking about concrete details like the place and people involved in an event. It then guides the user through a step-by-step conversation based on the ABC-E model: Antecedent (what happened before), Behavior (the main event), Consequence (what happened after), and Emotion (how they felt). This structure helps adolescents organize their thoughts and understand the flow of a story.
- Visual and Conversational Support: The app transforms the narrated events into an editable four-panel comic strip. Each panel corresponds to a part of the ABC-E model, using simple, token-based visuals to avoid distractions. This visual aid leverages the strong visual processing skills often found in autistic individuals, making it easier to recall and express details. The AI also uses step-by-step questioning to elicit missing information, breaking down the complex task of storytelling into manageable parts.
- A Peer-Like AI Companion: The AI agent in Autiverse is designed to have a customizable, peer-like persona. This friendly, non-authoritative approach creates a comfortable and non-judgmental space for adolescents to share. Users can even customize the AI’s name, voice, and appearance, fostering a stronger sense of engagement and companionship.
The Journaling Journey with Autiverse
A journaling session with Autiverse unfolds in six phases:
1. Preparation: The user selects a place and people involved in their story, like “School” and “Oliver.”
2. Articulation: The AI, acting as a curious friend, prompts the user to share what happened. For example, “I’m so curious about what happened with Oliver at school today! Tell me everything!”
3. Verification: The AI presents a preliminary summary of the user’s input, allowing them to confirm or correct it.
4. Elaboration: If parts of the ABC-E story are missing, the AI asks targeted questions to fill in the gaps. For emotions, it offers a selection of 12 emotion cards to choose from, simplifying expression.
5. Revision: The user reviews the complete four-panel comic strip and can request further changes or additions.
6. Wrap-up: The AI provides an empathetic response, suggests titles for the journal entry, and rewards the user with digital stamps, making the experience enjoyable and encouraging continued use.
Behind the Scenes: AI Power
The core of Autiverse relies on large language models (LLMs) to power its generative pipelines. These AI models extract events from conversations, generate context-aware questions, analyze the story for completeness, and reconstruct panel descriptions. They also help in constructing the visual scenes for the comic strips by identifying key elements, their relationships, and their placement within each panel.
Real-World Impact: A Two-Week Study
A two-week study involving 10 autistic adolescent-parent pairs in South Korea demonstrated Autiverse’s effectiveness. Adolescents actively engaged with the app, creating numerous journal entries about a wide range of activities, from school and after-school classes to leisure and special outings. The study found that:
- Improved Narrative Skills: The structured interactions helped adolescents organize their thoughts, leading to more coherent and specific stories. The “Emotion” part was particularly beneficial, encouraging reflection on feelings and their triggers.
- Enhanced Expression: The visual comic strips served as powerful memory cues, making it easier for children to recall and elaborate on details. The voice-driven conversation also encouraged verbalization and more precise articulation.
- Independent Journaling: Parents observed a significant decrease in their moderation over time, with many adolescents using Autiverse independently and even initiating journaling sessions on their own.
- Increased Parental Awareness: Parents gained new insights into their child’s daily events and emotions, often discovering details they wouldn’t have learned through routine conversations.
- Fostered Conversations: The journal entries provided a natural starting point for positive parent-child discussions, helping to initiate everyday talk, maintain joint attention, and offer timely empathy and praise.
Also Read:
- AutiHero: Empowering Parents with AI-Generated Social Narratives for Autistic Children
- Digital Peer Support: How AI Chatbots Aid Eating Disorder Recovery
Perceptions and Future Directions
Adolescents generally found Autiverse easy to use, enjoyable, and useful for recounting their day. They perceived the AI peer as a “good friend” and felt a strong sense of ownership and autonomy over their journal entries. Parents also highly accepted the system, finding it effective and enriching for their family conversations.
While promising, the study also highlighted areas for future development. There’s a need for adaptive scaffolding that can evolve with the child’s abilities, balancing parental control with data-driven recommendations. The design of the AI peer also raises questions about its relational positioning – it should be a scaffold for rehearsing social skills, not a substitute for human connection. Furthermore, future versions could incorporate more advanced gamification features to boost long-term engagement and explore LLMs specifically fine-tuned for the Korean language and culture.
Autiverse represents a significant step forward in supporting autistic adolescents’ narrative development and emotional expression, bridging communicative gaps and fostering greater autonomy. You can read the full research paper here: Autiverse: Eliciting Autistic Adolescents’ Daily Narratives through AI-guided Multimodal Journaling.
