모델 (facebook/sam2-hiera-large)

모델 (facebook/sam2-hiera-large)

facebook/sam2-hiera-large는 Meta AI가 Hugging Face에 배포한 SAM 2 대표 체크포인트예요. Apache 2.0 라이선스고, 논문은 arXiv:2408.00714예요. transformers에서 Sam2Model, Sam2Processor, Sam2VideoModel, Sam2VideoProcessor로 바로 쓸 수 있어요.

이미지 세그멘테이션 (단일 포인트)

from transformers import Sam2Processor, Sam2Model
import torch
from PIL import Image
import requests

device = "cuda" if torch.cuda.is_available() else "cpu"
model = Sam2Model.from_pretrained("facebook/sam2-hiera-large").to(device)
processor = Sam2Processor.from_pretrained("facebook/sam2-hiera-large")

image_url = "https://huggingface.co/datasets/hf-internal-testing/sam2-fixtures/resolve/main/truck.jpg"
raw_image = Image.open(requests.get(image_url, stream=True).raw).convert("RGB")

배치 추론

from transformers import Sam2Processor, Sam2Model
import torch

model = Sam2Model.from_pretrained("facebook/sam2-hiera-large").to(device)
processor = Sam2Processor.from_pretrained("facebook/sam2-hiera-large")

비디오 세그멘테이션·트래킹

from transformers import Sam2VideoModel, Sam2VideoProcessor
import torch

device = "cuda" if torch.cuda.is_available() else "cpu"
model = Sam2VideoModel.from_pretrained("facebook/sam2-hiera-large").to(device, dtype=torch.bfloat16)
processor = Sam2VideoProcessor.from_pretrained("facebook/sam2-hiera-large")

sam2-hiera-large는 224 파라미터 규모(0.2B 계열)로, large 크기의 Hiera 백본을 써요.

더 알아보기