RESEARCH PROJECT · RSNA 2026

KNEE-SWARM AI

Evidence-Grounded Multi-Agent Intelligence for Weakly Supervised Knee MRI Abnormality Detection and Multilingual Clinical Reasoning

Agentic AI Medical Computer Vision Multilingual Clinical NLP Weak Supervision Trustworthy AI Multi-Plane MRI

Kaggle Notebook ↗ RSNA Competition ↗ GitHub ↗

01 — Research Overview

KNEE-SWARM AI is a research-stage framework investigating weakly supervised multilabel classification of knee MRI examinations. It combines multilingual radiology-report analysis, MRI representation learning, and proposed evidence-grounded assurance mechanisms.

The system targets twelve clinically important abnormalities. During development, radiology reports provide potential training supervision. The planned competition inference pipeline operates on MRI examinations without requiring test radiology reports.

02 — Dataset Audit

4,407
Training examinations
24,371
Training MRI series
58
Expert-labeled examinations
12
Prediction targets

Dataset statistics derive from the project's Kaggle training-data audit. Automatic language identification found 11 language categories; these predictions have not yet been manually validated.

03 — Proposed System Architecture

INPUT
MRI DICOM series + training radiology reports
↓

Clinical Evidence Pipeline

Multilingual language identification, pathology extraction, negation analysis and weak-label confidence assessment.

MRI Vision Pipeline

DICOM quality checks, anatomical-plane processing, pretrained visual encoders and sequence representation learning.
↓
WEAKLY SUPERVISED MODEL TRAINING
Gold annotations + validated report-derived labels
↓
MULTI-PLANE REPRESENTATION LEARNING
2.5D convolutional encoders + multiple-instance aggregation
↓
PROPOSED ASSURANCE LAYER
Image QC · Evidence consistency · Uncertainty analysis
↓
OUTPUT
12 study-level abnormality probabilities

04 — Prediction Targets

Ligaments

ACL, MCL

Menisci

Medial Meniscus, Lateral Meniscus

Osteoarthritis

Medial OA, Lateral OA, PF OA

Other Findings

Effusion, Synovitis, Baker's Cyst, Contusion, Fracture

05 — Research Methodology

ComponentPlanned methodology
Study designWeakly supervised multilabel classification
SupervisionGold annotations and report-derived weak labels
Image representationPretrained CNN with multi-plane MRI aggregation
ValidationFive-fold gold-label cross-validation
Primary metricMacro-averaged ROC-AUC
AssuranceQuality checks and uncertainty analysis
InferenceOffline MRI-only prediction

06 — Development Status

Dataset structure audit: Completed

Gold-label distribution audit: Completed

Five-fold class coverage: Verified

Exact report-duplicate audit: Completed

Language identification: Completed

Clinical label extraction: In progress

Image model training: Pending

Kaggle submission: Pending

Patient-level independence has not been established. The proposed model and agent components have not yet been validated for predictive performance.

07 — Evaluation Protocol

The primary evaluation metric is macro-averaged ROC-AUC across twelve binary targets. Model development will use fixed study-level validation folds, with attention to weak-label contamination and duplicate examinations. Per-target performance and uncertainty will be reported where statistically estimable.

08 — Research Resources

KNEE-SWARM Kaggle Notebook

RSNA Knee Abnormality Detection Challenge

Hugging Face Research Profile

Research GitHub