CRAFT-MD

A Comprehensive Benchmarking Framework for Conversational Reasoning Assessment in Medicine.

CRAFT-MD Submission Guideline (Round 1)

The CRAFT-MD Challenge is a competition to evaluate the clinical reasoning ability of LLMs, running from January 2, 2025, to April 2, 2025. The competition welcomes participation from academic institutions, industry professionals, and independent researchers worldwide. Are you developing a new model that can beat the existing LLMs in clinical conversational reasoning? Submit your model to the CRAFT-MD leaderboard now!

Model Submission Guidelines

Models can be submitted via email. Your model submission should include the following:

  1. Model Description: This description identifies your submission on the leaderboard: Name of the model, Institution, Paper link, Code link, Year.
  2. Conda Environment File: Include the environment.yaml file support conda install.

Any questions or concerns? Please reach out to us with email.