# Supported Models

## Generative Models

| Model         | Support | INT8(W8A8) | AWQ(W4A16) | GPTQ(WNA16) | LoRA  | Tensor Parallel | Expert Parallel | Data Parallel | Kunlun Graph |
| :------------ | :-----: | :--------: | :--------: | :---------: | :---: | :-------------: | :-------------: | :-----------: | :----------: |
| Qwen2         |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen2.5       |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen3         |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen3-Moe     |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |        ✅        |       ✅       |      ✅       |
| Qwen3-Next    |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |        ✅        |       ✅       |      ✅       |
| MiMo-V2-Flash |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| Llama2        |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Llama3        |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Llama3.1      |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| gpt-oss       |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |               |              |
| GLM4.5        |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| GLM4.5Air     |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| GLM4.7        |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| GLM5          |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| Kimi-K2       |    ✅    |     -      |     ✅      |      -      |       |        ✅        |                 |       ✅       |      ✅       |
| DeepSeek-R1   |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| DeepSeek-V3   |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| DeepSeek-V3.2 |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |

## Multimodal Language Models

| Model          | Support | INT8(W8A8) | AWQ(W4A16) | GPTQ(WNA16) | LoRA  | Tensor Parallel | Expert Parallel | Data Parallel | Kunlun Graph |
| :------------- | :-----: | :--------: | :--------: | :---------: | :---: | :-------------: | :-------------: | :-----------: | :----------: |
| Qwen2-VL       |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen2.5-VL     |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen3-VL       |    ✅    |     ✅      |     ✅      |      ✅      |   ✅   |        ✅        |                 |       ✅       |      ✅       |
| Qwen3-VL-MoE   |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |        ✅        |       ✅       |      ✅       |
| Qwen3-Omni-MoE |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |        ✅        |       ✅       |      ✅       |
| InternVL-2.5   |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| InternVL-3.5   |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |
| InternS1       |    ✅    |     ✅      |     ✅      |      ✅      |       |        ✅        |                 |       ✅       |      ✅       |