Visual Question Answering on Radiology Image with BLIP

Technical Overview

• Python 3.11.5.
• Hugging Face's transformers.
• PyTorch - Notebook for model fine-tuning:

Installation

• Clone this repo:

git clone https://github.com/ndtduy/blip-vqa-rad.git

• In the main directory of the app, to install all the dependencies, use:

pip install -r requirements.txt

• To run the web app locally, use:

streamlit run app.py

• Quick deployment of Streamlit Community Cloud: https://docs.streamlit.io/deploy/streamlit-community-cloud/deploy-your-app.
• Deployed demo for the web app:

Reference

• Hugging Face - BLIP.
• Transformer Tutorials.