Sharded checkpoints
Collection
useful sharded checkpoints for users to run inference / fine-tuning on a Google colab without having to deal with CPU OOM issues. β’ 7 items β’ Updated β’ 4
How to use ybelkada/blip2-opt-2.7b-fp16-sharded with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("visual-question-answering", model="ybelkada/blip2-opt-2.7b-fp16-sharded") # Load model directly
from transformers import AutoProcessor, AutoModelForVisualQuestionAnswering
processor = AutoProcessor.from_pretrained("ybelkada/blip2-opt-2.7b-fp16-sharded")
model = AutoModelForVisualQuestionAnswering.from_pretrained("ybelkada/blip2-opt-2.7b-fp16-sharded")No model card