ModelOpt/vLLM Corruption issues

#1
by GulfCoastAI - opened

So this fixes the looping issue but not the modelopt/vLLM corruption issues being seen with NVFP4 quants any plans for an EXL3 or Autoround quant? or an idea when the modelopt/vLLM corruption issues will be addressed?

Sign up or log in to comment