MedSegAgent (https://ieeexplore.ieee.org/document/11455620) を再現するためのWebAppを実装

@Haoyu Wang Haoyu Wang authored on 4 Jun 2025
GitHub committed on 4 Jun 2025
agents FEAT: update MedSegAgent V1 Core (#1) 1 year ago
assets FEAT: update MedSegAgent V1 Core (#1) 1 year ago
dataset FEAT: update MedSegAgent V1 Core (#1) 1 year ago
prompts FEAT: update MedSegAgent V1 Core (#1) 1 year ago
results FEAT: update MedSegAgent V1 Core (#1) 1 year ago
utils FEAT: update MedSegAgent V1 Core (#1) 1 year ago
.DS_Store FEAT: update MedSegAgent V1 Core (#1) 1 year ago
.gitignore FEAT: update MedSegAgent V1 Core (#1) 1 year ago
LICENSE FEAT: update MedSegAgent V1 Core (#1) 1 year ago
OAI_CONFIG_LIST.example FEAT: update MedSegAgent V1 Core (#1) 1 year ago
README.md Update README.md 1 year ago
eval_diff_llms.sh FEAT: update MedSegAgent V1 Core (#1) 1 year ago
eval_example.sh FEAT: update MedSegAgent V1 Core (#1) 1 year ago
evaluate.py FEAT: update MedSegAgent V1 Core (#1) 1 year ago
model_selection_bench.jsonl FEAT: update MedSegAgent V1 Core (#1) 1 year ago
model_selection_test_case.jsonl FEAT: update MedSegAgent V1 Core (#1) 1 year ago
requirements.txt FEAT: update MedSegAgent V1 Core (#1) 1 year ago
README.md

Med-SegAgent: Universal & Scalable Multi-Agent System for Instructive Medical Image Segmentation

Key Features:

  • Universal & Scalable: Tackle diverse medical image segmentation tasks using natural language instructions.
  • Precise Automation: Automatically selects the most suitable segmentation models.
  • Enhanced Robustness: Improves reliability through multi-model integration and ensemble capabilities.

Quick Start:

Setup your environment

conda create -n medsegagent python=3.12
conda activate medsegagent
pip install uv
uv pip install -r requirements.txt

Then set your LLM service API keys like OAI_CONFIG_LIST.example, the config file should be named OAI_CONFIG_LIST.

[
    {
        "model": "Qwen/Qwen2.5-32B-Instruct",
        "api_key": "<Your API KEY>",
        "base_url": "https://api.siliconflow.cn/v1",
        "tags": ["silicon"]
    },
    {
        "model": "gpt-4o-2024-08-06",
        "api_key": "<Your API KEY>",
        "base_url": "<your BASE URL>",
        "tags": ["openai"]
    }
]

Test script

Start from eval_example.sh to try our Coarse-to-Fine setting of seg model selection.

python ./evaluate.py \
    --test_file_path "model_selection_test_case.jsonl" \
    --test_pattern "C2F"  \
    --model "gpt-4o-2024-08-06"    \
    --log_to_file