Underdog-Saluki-27B-1.0

He aha Underdog-Saluki-27B-1.0

He tauira 2-bit GGUF kua whakaitihia i runga i Qwen3.8-27B, me te rahi i raro i te 8GB. E arotahi ana ki te pupuri i te kaha karanga-uta, ā, ka taea te whakahaere tika me te llama.cpp.

Ngā āhuatanga matua

• He tauira 2-bit GGUF kua whakaitihia i runga i Qwen3.8-27B, rahi 7.89GB
• E arotahi ana ki te pupuri i te kaha karanga-uta, ā, e tautoko ana i ngā karanga-uta whakarara
• E tautoko ana i te whakaputa kuputuhi, ā, ka taea te whakatutuki i te māramatanga whakaahua mā tētahi tāpiri ataata kōwhiringa
• Kua whakahohea te aratau whakaaro i te taunoa, ā, ka taea te whakawhiti i ia tono, e rite ana ki te Qwen3.8
• E hototahi ana ki te llama.cpp tūturu mō te whakahaere tika

Mā wai

Kaiwhakamahi e hiahia ana ki te whakahaere i ngā mahi karanga-utaonga me ngā mahi whakamahora-ā-wāhanga ki ngā tauira nui engari he iti rawa ngā rawa pūrere. E tika ana mō ngā kaiwhakawhanake me ngā kairangahau e whakatakoto ana i te llama.cpp ki tōna ake rorohiko.

Me pēhea te tīmata

1. Whakahaerehia te llama-server -m Underdog-Saluki-27B-1.0-IQ2-mix.gguf --jinja -ngl 99 -fa on -c 32768 ki te whakaara i te ratonga
2. Mō te āheinga matakite, tikiake i te mmproj-Underdog-Saluki-27B-1.0-F16.gguf ā, whakauruhia ki te --mmproj paramita
3. Tukuna ngā tono mā te OpenAI-compatible chat API (tauranga 8080), e tautoko ana i ngā karanga-utaonga me te mana whakaaro

I whakahiatohia mai i ngā whakaahuatanga tūmatanui i te pae mana / README / whārangi whakarewatanga o te taputapu. Kāore anō kia whakamanahia ngā utu me ngā tau kaiwhakamahi; tirohia te pae mana. I hangaia ētahi wāhanga mā te āwhina AI. Kua tuhia ki te reo Hainamana me te reo Ingarihi; ko ētahi atu reo he whakamāoritanga mihini.