XPU - Intel® GPUs 지원 하드웨어
XPU - Intel® GPUs 지원 하드웨어
이 문서는 Intel GPU(XPU) 플랫폼에서 vLLM을 실행할 때 검증된 하드웨어와 권장 모델 목록을 보여줘요. 텍스트 전용 언어 모델, 멀티모달 언어 모델, 임베딩/리랭커 모델이 각각 지원되는 dtype으로 정리돼 있어요.
출처: 문서
본문
검증된 하드웨어
- Intel® Arc™ Pro B-Series Graphics
권장 모델
참고: Online FP8 = Online Quantization to FP8.
텍스트 전용 언어 모델
| Model | Architecture | Dtype |
|---|---|---|
| openai/gpt-oss-20b | GPTForCausalLM | MXFP4 |
| openai/gpt-oss-120b | GPTForCausalLM | MXFP4 |
| deepseek-ai/DeepSeek-R1-Distill-Llama-8B | LlamaForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-14B | QwenForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-R1-Distill-Qwen-32B | QwenForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-R1-Distill-Llama-70B | LlamaForCausalLM | BF16/Online FP8 |
| Qwen/Qwen2.5-72B-Instruct | Qwen2ForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-14B | Qwen3ForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-32B | Qwen3ForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-30B-A3B | Qwen3ForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-30B-A3B-FP8 | Qwen3ForCausalLM | FP8 |
| Qwen/Qwen3-30B-A3B-GPTQ-Int4 | Qwen3ForCausalLM | Int4 |
| Qwen/Qwen3-coder-30B-A3B-Instruct | Qwen3ForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-Next-80B-A3B-Instruct | Qwen3NextForCausalLM | BF16/Online FP8 |
| Qwen/Qwen3-Next-80B-A3B-Thinking | Qwen3NextForCausalLM | BF16/Online FP8 |
| Qwen/QwQ-32B | QwenForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-V2-Lite | DeepSeekForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-V4-Flash | DeepseekV4ForCausalLM | BF16/Online FP8 |
| meta-llama/Llama-3.1-8B-Instruct | LlamaForCausalLM | BF16/Online FP8 |
| microsoft/Phi-3.5-mini-instruct | Phi3ForCausalLM | BF16/Online FP8 |
| THUDM/GLM-4-9B-chat | GLMForCausalLM | BF16/Online FP8 |
| THUDM/CodeGeex4-All-9B | CodeGeexForCausalLM | BF16/Online FP8 |
| chuhac/TeleChat2-35B | LlamaForCausalLM (TeleChat2 기반) | BF16/Online FP8 |
| 01-ai/Yi1.5-34B-Chat | YiForCausalLM | BF16/Online FP8 |
| deepseek-ai/DeepSeek-Coder-33B-base | DeepSeekCoderForCausalLM | BF16/Online FP8 |
| meta-llama/Llama-2-13b-chat-hf | LlamaForCausalLM | FP16/Online FP8 |
| Qwen/Qwen1.5-14B-Chat | QwenForCausalLM | BF16/Online FP8 |
| Qwen/Qwen1.5-32B-Chat | QwenForCausalLM | BF16/Online FP8 |
| RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic | LlamaForCausalLM | FP8 |
멀티모달 언어 모델
| Model | Architecture | Dtype |
|---|---|---|
| OpenGVLab/InternVL3_5-8B | InternVLForConditionalGeneration | BF16/Online FP8 |
| OpenGVLab/InternVL3_5-14B | InternVLForConditionalGeneration | BF16/Online FP8 |
| OpenGVLab/InternVL3_5-30B-A3B | InternVLForConditionalGeneration | BF16/Online FP8 |
| OpenGVLab/InternVL3_5-38B | InternVLForConditionalGeneration | BF16/Online FP8 |
| meta-models/Muse-Glimmer-30B | MuseGlimmerForConditionalGeneration | BF16/Online FP8 |
| Qwen/Qwen2-VL-7B-Instruct | Qwen2VLForConditionalGeneration | BF16/Online FP8 |
| Qwen/Qwen2.5-VL-72B-Instruct | Qwen2VLForConditionalGeneration | BF16/Online FP8 |
| Qwen/Qwen2.5-VL-32B-Instruct | Qwen2VLForConditionalGeneration | BF16/Online FP8 |
| Qwen/Qwen3-VL-32B-Instruct | Qwen3VLForConditionalGeneration | BF16/Online FP8 |
| Qwen/Qwen3.5-35B-A3B | Qwen3_5MoeForConditionalGeneration | BF16/Online FP8 |
| google/gemma-3-27b-it | Gemma3ForConditionalGeneration | BF16/Online FP8 |
| google/gemma-4-31B-it | Gemma4ForConditionalGeneration | BF16/Online FP8 |
| google/gemma-4-26B-A4B-it | Gemma4ForConditionalGeneration | BF16/Online FP8 |
| THUDM/GLM-4v-9B | GLM4vForConditionalGeneration | BF16/Online FP8 |
| openbmb/MiniCPM-V-4 | MiniCPMVForConditionalGeneration | BF16/Online FP8 |
임베딩 · 리랭커 언어 모델
| Model | Architecture | Dtype |
|---|---|---|
| Qwen/Qwen3-Embedding-8B | Qwen3ForTextEmbedding | BF16/Online FP8 |
| Qwen/Qwen3-Reranker-8B | Qwen3ForSequenceClassification | BF16/Online FP8 |