We perform the distillation recipe on VLM-SFT dataset curated by SOLO.
huggingface-cli download --repo-type dataset yangyiy/VLM-SFT --local-dir ./data/vlm_sftThen you should unzip all the chunk.tar.gz files into the 'images' folder.
We use the pre-trained HoVLE model as the teacher model.
huggingface-cli download OpenGVLab/HoVLE --local-dir ./weights/HoVLENote
If you do not have the access to huggingface, you can use the mirror site by setting the environment variable export HF_ENDPOINT=https://hf-mirror.com.