pytorch/Phi-4-mini-instruct-INT4
Text Generation
•
Updated
•
75
TorchAO Quantized Phi-4-mini-instruct
TorchAO quantized Phi-4-mini-instruct models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
-
-
pytorch/Phi-4-mini-instruct-FP8
Text Generation • Updated • 102 • 1 -
pytorch/Phi-4-mini-instruct-INT8-INT4
Text Generation • Updated • 899 • 2 -
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation • Updated • 181 • 3 -
pytorch/Phi-4-mini-instruct-parq-3w-4e-shared
Text Generation • Updated • 135 -
pytorch/Phi-4-mini-instruct-parq-2w-4e-shared
Text Generation • Updated • 108 -
pytorch/Phi-4-mini-instruct-parq-4w-4e-shared-gsm
Text Generation • Updated • 78