mradermacher/Orin-Instruct-Alpaca-JP-i1-GGUF

Quantization (fewer layers) vs MakiAi/Orin-Instruct-Alpaca-JP. mradermacher/Orin-Instruct-Alpaca-JP-i1-GGUF matches part of MakiAi/Orin-Instruct-Alpaca-JP (809 of its 1676 tensors; the rest of MakiAi/Orin-Instruct-Alpaca-JP has no counterpart). On the shared part: mradermacher/Orin-Instruct-Alpaca-JP-i1-GGUF is a GGUF quantization (Q4_K_S) of the same weights: 493 tensors match exactly and 316 within quantization error.

Tensors changed: Embeddings 0/1, other 0/246, Norms 0/317, MLP 0/105, Attention 0/140

On the Hub · Downloads on Model Pulse