dolfsai/Qwen3-Reranker-0.6B-seq-cls-vllm-W8A8
Quantization vs Qwen/Qwen3-Reranker-0.6B. dolfsai/Qwen3-Reranker-0.6B-seq-cls-vllm-W8A8 is a quantized version of the other (I8/BF16).
Quantization vs Qwen/Qwen3-Reranker-0.6B. dolfsai/Qwen3-Reranker-0.6B-seq-cls-vllm-W8A8 is a quantized version of the other (I8/BF16).