Hosting MedRax, AI-Powered X-Ray Reasoning Agent

chevron-icon
Back
Top
chevron-icon
project-presentation-img
Anthony Oliko
Project Owner

Hosting MedRax, AI-Powered X-Ray Reasoning Agent

Expert Rating

n/a
  • Proposal for BGI Nexus 1
  • Funding Request $23,000 USD
  • Funding Pools Beneficial AI Solutions
  • Total 4 Milestones

Overview

This proposal aims to deploy and host MedRAX—an open-source AI-driven Medical Reasoning Agent for Chest X-ray analysis—onto the cloud, making advanced diagnostic tools accessible to underserved communities and healthcare practitioners. This project empowers early detection and improved patient care by delivering efficient, reliable X-ray interpretations while adhering to strict ethical and data privacy standards. By bridging the gap between cutting-edge AI and real-world medical needs, MedRax drives social impact and fosters a more equitable healthcare landscape.

Proposal Description

How Our Project Will Contribute To The Growth Of The Decentralized AI Platform

MedRax advances the BGI mission by delivering ethical, beneficial AI to healthcare. It deploys an AI-driven chest X-ray analyzer for underserved communities, reducing diagnostic disparities and enhancing outcomes. By offering a free public version alongside an advanced, fee-based option on the SNET Marketplace, MedRax fosters equitable access and sustainable innovation in AI, driving real-world social impact.

Our Team

  1. Anthony Oliko, Software Developer, leads system design and implementation.
  2. Ubong Williamson, Project Manager, drives strategy and milestone delivery.
  3. Omojeminiyi Damilola, Outreach Specialist, engages target communities and raises project awareness online and on-site.

AI services (New or Existing)

MedRax

Type

New AI service

Purpose

MedRax is an AI-powered chest X-ray analysis platform that enhances diagnostic accuracy for underserved communities. Built on LangChain with GPT-4o vision it integrates advanced tools for segmentation classification and reporting. Initially funded by BGI as a free service an advanced premium version will launch on the SingularityNET AI Marketplace ensuring sustainable innovation and broader access to cutting-edge diagnostics.

AI inputs

Chest X-ray images and optional metadata (in DICOM or standard image formats) are uploaded by healthcare providers. The system validates image quality and extracts relevant details preparing the data for comprehensive AI analysis.

AI outputs

The AI service delivers a detailed diagnostic report featuring disease detection segmentation maps and classification results. It produces annotated images and textual insights supporting clinical decision-making and enhancing diagnostic accuracy.

Company Name (if applicable)

Trenches AI

The core problem we are aiming to solve

Underserved communities frequently suffer from a lack of timely, affordable diagnostics due to limited healthcare resources and unequal service distribution. This gap leads to delayed disease detection, worsened prognoses, and higher mortality. MedRax addresses this challenge by deploying an AI-driven chest X-ray analysis platform that enhances diagnostic accuracy and enables early intervention, ultimately transforming patient care. By leveraging advanced AI, MedRax democratizes access to high-quality healthcare diagnostics for those who need it most.

Our specific solution to this problem

The hosted MedRax is a cutting-edge, AI-driven diagnostic platform designed to revolutionize chest X-ray analysis by providing rapid, accurate, and accessible insights. Built on a robust technical foundation, MedRax leverages LangChain and LangGraph frameworks to create a modular, tool-agnostic architecture that integrates seamlessly with advanced AI components. At its core, MedRax employs GPT-4o with vision capabilities as the backbone LLM and offers a production-ready Gradio interface that supports both local and cloud-based deployments.

Integrated tools enhance MedRax’s capabilities: CheXagent and LLaVA-Med enable complex visual Q&A, while MedSAM and PSPNet (trained on ChestX-Det) ensure precise segmentation of anatomical structures. Maira-2 provides grounding to localize specific findings, and the SwinV2 Transformer (trained on CheXpert Plus) generates detailed medical reports. DenseNet-121 from TorchXRayVision detects 18 pathology classes, and RoentGen facilitates synthetic chest X-ray generation. Additional utilities handle DICOM processing, visualization, and custom plotting.

Funded by BGI, MedRax will be deployed as a free, publicly accessible service to empower underserved communities and individuals with vital diagnostic tools. An advanced version—with extended features and enhanced performance—will also be hosted on the SingularityNET AI Marketplace and offered as a fee-based service, ensuring sustainable innovation and broader accessibility.

GitHub repository.

Existing resources

Yes. MedRax leverages robust open-source technology, built on an Apache 2.0-licensed codebase available at https://github.com/bowang-lab/MedRAX. This existing resource enables community contributions and allows us to focus funding on cloud deployment and advanced features without additional development costs.

Open Source Licensing

Apache License

Links and references

MedRax code repository: https://github.com/bowang-lab/MedRAX

MedRax

@misc{fallahpour2025medraxmedicalreasoningagent,
      title={MedRAX: Medical Reasoning Agent for Chest X-ray}, 
      author={Adibvafa Fallahpour and Jun Ma and Alif Munim and Hongwei Lyu and Bo Wang},
      year={2025},
      eprint={2502.02673},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2502.02673}, 
}

Was there any event, initiative or publication that motivated you to register/submit this proposal?

Online event

Proposal Video

Placeholder for Spotlight Day Pitch-presentations. Video's will be added by the DF team when available.

  • Total Milestones

    4

  • Total Budget

    $23,000 USD

  • Last Updated

    24 Feb 2025

Milestone 1 - Cloud Deployment & API Setup

Description

This milestone focuses on establishing a robust cloud environment and integrating MedRax with a production-ready Gradio interface. The goal is to deploy the free version of MedRax on cloud infrastructure ensuring reliable API endpoints secure data processing and seamless accessibility for initial users. This phase includes setting up servers configuring API endpoints and conducting basic system tests using sample chest X-rays.

Deliverables

A fully operational cloud deployment of MedRax accessible via a public API and an intuitive Gradio interface. Deliverables include complete server and API configurations test reports and initial user feedback from pilot testing. Comprehensive documentation of the integration process will also be provided.

Budget

$5,000 USD

Success Criterion

MedRax is live on the cloud, with Gradio interface and API endpoints accurately processing sample images and demonstrating secure, reliable functionality.

Milestone 2 - Module Integrations

Description

Integrate core AI components to build a cohesive diagnostic system. This includes visual QA modules (CheXagent and LLaVA-Med) segmentation tools (MedSAM and PSPNet) grounding (Maira-2) and report generation (SwinV2 Transformer). The focus is on ensuring seamless interoperability among modules to deliver accurate and comprehensive chest X-ray analyses. Integration will be validated using benchmark datasets and the ChestAgentBench framework.

Deliverables

A fully integrated AI system where each module functions cohesively. Deliverables include a unified codebase performance evaluation reports and documented integration processes demonstrating effective communication between modules and overall system accuracy.

Budget

$7,000 USD

Success Criterion

All AI modules work together, achieving over 90% accuracy on test cases and passing interoperability evaluations.

Milestone 3 - Safety & Ethical Testing

Description

Establish comprehensive safety protocols and ethical guidelines to ensure MedRax’s reliable operation in clinical environments. This milestone involves developing a detailed safety plan conducting risk assessments stress testing the system in simulated scenarios and ensuring compliance with data privacy and medical regulatory standards. Mitigation strategies for potential failure modes will be identified and documented.

Deliverables

A complete safety and ethics report outlining risk assessments compliance checklists and test results. The deliverable includes documented procedures for secure data handling ethical guidelines and detailed reports on system performance under stress tests.

Budget

$4,000 USD

Success Criterion

MedRax meets all safety standards, successfully passes risk assessments, and complies with established ethical guidelines.

Milestone 4 - Marketplace Advanced Deployment

Description

Develop and deploy the advanced premium version of MedRax on the SingularityNET AI Marketplace. Enhancements include an improved user interface real-time diagnostic analysis secure payment integration and additional advanced features. This phase focuses on optimizing performance ensuring data security and providing extensive documentation and support for marketplace users. Beta testing with select users will guide iterative refinements.

Deliverables

A premium MedRax version live on the AI Marketplace featuring enhanced diagnostics a refined user interface secure payment processing and comprehensive user guides. Deliverables include a fully tested system with pilot user feedback and performance metrics along with full deployment documentation.

Budget

$7,000 USD

Success Criterion

The advanced service is successfully deployed on the AI Marketplace, receiving positive user feedback and securely processing transactions.

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

    No Reviews Avaliable

    Check back later by refreshing the page.

feedback_icon