Scripts download link : https://www.patreon.com/posts/sota-very-best-90744385

YouTube 2K link : https://youtu.be/V8iDW8iprqU

8bit_precision_10_GB_VRAM.py supporting below models

(“Salesforce/blip2-opt-6.7b”, “~16.5 GB VRAM”),

(“Salesforce/blip2-flan-t5-xxl”, “~24+ GB VRAM”),

(“Salesforce/blip2-opt-6.7b-coco”, “~16.5 GB VRAM”)

half_precision_17_GB_VRAM.py supporting below models

(“Salesforce/blip2-opt-6.7b”, “~9.5 GB VRAM”),

(“Salesforce/blip2-flan-t5-xxl”, “~19.5 GB VRAM”),

(“Salesforce/blip2-opt-6.7b-coco”, “~9.5 GB VRAM”)

coca_ViT-L-14 uses around 5 GB VRAM