Challenge background
In this project, collaborators will develop a multimodal model using chest X-rays and electronic health records (EHR)/clinical data to detect pneumonia and tuberculosis. The goal is to leverage both visual information from X-rays and textual information from EHR/clinical data to improve the accuracy of disease detection. Today Multi-Modal data is commonly collected and used in diagnosing diseases; this technique is relatively new and will give participants a gist of this methodology.
The problem
Chest diseases are prevalent in countries, and this methodology will help us use two modalities to diagnose accurately and provide richer contextual information leading to better patient outcomes.
Goal of the project
Learn about Multimodal models. How to build them. Become more familiar with NLP and or Computer Vision. This project touches on both topics and more.
Project timeline
- 1
Week 1
Project Setup and Data Exploration
- 2
Week 2
NLP and Computer Vision Basic to advance
- 3
Week 3
CNN for Computer vision
- 4
Week 4
Natural Language Processing (NLP) for EHR/Clinical Data
- 5
Week 5
Multimodal basics
- 6
Week 7
More Multimodal learning and Project wrap up
What you'll learn
NLP, Computer Vision, Multimodal Learning, Leadership & Public Speaking Skills, Teamwork and Collaboration