TLDR: A new research paper outlines ethical guidelines for Medical Image Synthesis (MISyn), emphasizing the need to prevent misinformation and algorithmic bias. It highlights that synthetic medical images are not equivalent to real ones and proposes practical recommendations for transparent development, rigorous evaluation, and stakeholder oversight to ensure MISyn serves genuine clinical and public interests.
Medical Image Synthesis (MISyn) involves using computational techniques to create “visually realistic and quantitatively accurate images” in biomedicine. These synthetic images are generated based on various inputs like source images, modalities, or text prompts. MISyn is used in many medical image analysis tasks, including image-to-image translation, super-resolution, data augmentation, and privacy protection. Recent advancements in generative AI, such as variational autoencoders (VAEs), generative adversarial networks (GANs), and diffusion models, have significantly propelled MISyn capabilities.
However, alongside these technical strides, there’s a growing concern about the ethical implications of AI, particularly in generative AI. Issues like algorithmic discrimination, data exploitation, widening inequalities, and misinformation are becoming more prevalent. In the medical field, ethical considerations are paramount, as they are regulated by bioethics and existing medical practices. While some ethical discussions around MISyn have begun, they are still in early stages, covering topics like misinformation, patient privacy, informed consent, and algorithmic bias.
The research paper, “Ethical Medical Image Synthesis,” delves into these critical ethical challenges. It highlights three main hurdles in effectively implementing ethics in MISyn practice. First, ethical principles are often abstract and lack systematic support for translation into concrete technical practices. Second, ethics is frequently treated as an afterthought, a “post-hoc fix,” rather than being integrated into the initial design of AI systems. The paper argues against the myth that ethics impedes technical progress, suggesting it acts as a necessary “brake” for healthy technological development. Third, there’s the risk of “ethicswashing,” where superficial measures are taken to appear ethical without genuine commitment, often serving the interests of powerful entities rather than those most impacted.
To address these challenges, the authors propose a comprehensive framework for ethical MISyn. They conduct a theoretical analysis to identify the inherent limits and potential harms of synthetic images. A key finding is that synthetic images inherently lack “grounding authenticity” in real medical phenomena. Unlike real medical images, which are derived directly from patients, synthetic images are approximations based on existing data and knowledge. Therefore, even highly realistic synthetic images cannot automatically be considered equivalent to real medical images. Failing to acknowledge this distinction can lead to misinformation, eroding trust in medical imaging datasets and potentially causing algorithmic discrimination.
The paper defines misinformation in MISyn as presenting synthetic images or systems built on them in a way that leads people to assume they are real medical images or entirely based on real images, without proper acknowledgment. This “surreptitious substitution” can mislead healthcare professionals and pollute the medical image data environment, requiring extra effort to verify image authenticity. Furthermore, synthetic data can introduce new distribution shifts and biases, which might disproportionately affect marginalized patient groups when used in downstream clinical applications.
To counter these risks, the researchers propose practical recommendations for ethical MISyn. These include clear terminology, such as avoiding terms like “synthetic medical image” to prevent confusion, and instead suggesting “synthetic image” or even “symage.” They also recommend technical standards for labeling synthetic images in all outputs (reports, code, interfaces, DICOM fields, watermarks) and declaring their usage in downstream tasks, datasets, and models. Justifiable motivation is crucial, ensuring that MISyn techniques genuinely serve clinical and public interests, not just technical advancements. Design assumptions should be transparent, detailing incorporated clinical knowledge, potential data distribution shifts, and biases introduced by the model.
Evaluation practices also need rethinking. Realism evaluations should be grounded in actual patient images and medical knowledge, not solely on pre-trained models. Claims of efficacy and benefits should avoid overgeneralization, especially from hold-out test data to real-world performance. Thorough limitation analysis, akin to assessing side effects for medications, is essential. This includes quantifying distribution shifts and biases, acknowledging technique-specific limitations, and recognizing the intrinsic limits of synthetic data that cannot be overcome by technology alone.
For non-technical stakeholders, the paper offers oversight recommendations. These empower external reviewers, regulators, clinical users, and patients to question the appropriateness of MISyn, be aware of misinformation, check for proper labeling, and be vigilant against overclaimed benefits. They also emphasize the importance of transparent limitation analysis and disclosure of funding or conflicts of interest.
Also Read:
- Navigating the Pitfalls: Hallucinations in AI-Powered Medical Imaging
- Synthetic Data in Healthcare AI: Navigating Privacy and Progress in EU Law
The authors illustrate their recommendations with two case studies: DermSynth3D, a traditional MISyn work for skin lesion images, and MedSyn, a foundation model-based MISyn for 3D lung CT images. These case studies highlight gaps between current practices and the proposed ethical guidelines, demonstrating how to apply the recommendations in real-world research and review processes. This comprehensive approach aims to foster a more scientifically rigorous and ethically sound development of medical image synthesis technologies. You can find more details in the full research paper available here.


