ModelOpt/vLLM Corruption issues
#1
by GulfCoastAI - opened
So this fixes the looping issue but not the modelopt/vLLM corruption issues being seen with NVFP4 quants any plans for an EXL3 or Autoround quant? or an idea when the modelopt/vLLM corruption issues will be addressed?