TLDR: This paper explores how industry researchers use Obsidian, a note-taking tool, to build and manage their “second brains” or personal knowledge bases (PKBs). Through a case study involving interviews and observations, the research reveals that participants’ knowledge retrieval strategies significantly influence how they create and organize their notes. Key findings highlight the effective use of folders and tags for contextual organization and various retrieval methods like search and linked tags. The study suggests potential AI-powered features to support dynamic knowledge organization and retrieval within such systems, emphasizing the importance of connecting creation strategies with future retrieval needs.
In an era defined by information overload, both in our professional and personal lives, effectively managing and retrieving knowledge has become a critical challenge. To address this, many individuals are turning to what is often called a “second brain” – a personal knowledge base (PKB) built and maintained using digital tools. These electronic personal knowledge bases (ePKBs) are designed to extend human cognitive abilities, helping us capture, organize, and retrieve information for future reference.
A recent case study, detailed in the paper “How People Manage Knowledge in their “Second Brains” A Case Study with Industry Researchers Using Obsidian”, delves into how industry researchers utilize the popular note-taking application Obsidian to construct and navigate their digital knowledge repositories. Authored by Juliana Jansen Ferreira, Vinícius Segura, Joana Gabriela Souza, and Joao Henrique Gallas Brasil, the research offers valuable insights into the strategies and behaviors employed by experts in managing their intellectual assets.
The Concept of a “Second Brain”
The idea of an external knowledge system isn’t new, tracing back to Vannevar Bush’s 1945 concept of the MEMEX, a hypothetical device for storing and linking personal information. Today, note-taking apps like Notion, Microsoft OneNote, and Obsidian serve this purpose, offering intuitive interfaces for creating, categorizing, and organizing notes. The “second brain” metaphor highlights how these tools enhance memory and cognition, acting as an auxiliary brain to expand thoughts and ideas, boosting productivity and creativity.
Investigating Researchers’ Habits with Obsidian
The case study involved interviews with seven Computer Science researchers from a Brazilian lab, all active users of Obsidian. The researchers were observed as they used their personal Obsidian vaults, providing a rich understanding of their daily practices. The methodology included defining an interview protocol, careful participant selection, conducting open-ended interviews, and thorough content analysis of the collected data.
Key Findings: Creation, Organization, and Retrieval
The study revealed two primary areas of focus: how notes are created and organized, and the strategies employed for knowledge retrieval. A crucial insight was the strong connection between these two aspects: participants’ planned knowledge retrieval strategies significantly influenced how they built and maintained their PKB content.
Creating and Organizing Notes
Participants emphasized the importance of maintaining context for their knowledge. They extensively used folders to define specific contexts of interest, ensuring that new notes were created within relevant categories. Beyond folders, tags emerged as a powerful organizational tool. Tags allow users to categorize notes by concepts or subjects, adding an extra layer of meaning and facilitating connections that might be harder to establish with just a folder-based structure. For instance, a researcher might tag a concept with “#concept,” “#signs,” and “#SemEng” to link it to related ideas and fields.
Knowledge Retrieval Strategies
Obsidian offers several ways to retrieve information, and the researchers utilized them strategically:
- Search Field: The most direct method, allowing users to type keywords or expressions to find relevant notes.
- Tag-Based Search: Users can click on the search field and select from existing tags to filter notes, or click on tags embedded within the text of a note to see all related entries.
- Internal Links: Within notes, users create links to other related notes, providing a web of interconnected information that can be navigated associatively.
These strategies demonstrate a conscious effort by researchers to make their future selves’ knowledge retrieval easier, often thinking about how they would look for information when they are initially organizing it.
Implications for AI-Powered Knowledge Management
This research contributes to a broader project aiming to develop the XPTO framework, which supports the scientific discovery process through AI components. The findings from the Obsidian case study offer valuable insights for designing such a framework. The study suggests that an effective AI system for knowledge management should:
- Provide a Basic Organization Structure: While users prefer to customize, a starting template can prevent the overwhelming feeling of a “blank page.”
- Allow Dynamic Changes: Knowledge organization is not static; the tool must support continuous adjustments and evolution of the structure.
- Connect Creation/Organization with Retrieval: Offer examples or templates that illustrate how specific organizational strategies facilitate particular retrieval methods, helping users build their PKBs with future access in mind.
Ultimately, the study underscores that a personal knowledge base is more than just a collection of notes; it’s an externalization of an individual’s mental models and expertise, reflecting their unique discovery process within their domain.
Also Read:
- Navigating the Depths of LLM Memory: A Unified Framework for Understanding, Evaluating, and Managing Knowledge in AI
- Beyond Pre-Training: How Experience Scaling Enables Continuous Learning for Large Language Models
Future Directions
While this study focused on Computer Science researchers using Obsidian, future work will involve a broader inspection of other note-taking tools, including their AI capabilities. Additionally, researchers plan to conduct studies with expert users from diverse domains to gain a more comprehensive understanding of how personal knowledge bases support various discovery tasks.
