Qwen3.8-Flash-Next-FP4-Local

He aha Qwen3.8-Flash-Next-FP4-Local

Ko te putanga FP4 whakamōhiotanga i tukuna e NVIDIA o Qwen3.8B Flash Next, he tauira reo nui māmā mō te whakahaere ā-roto.

Ngā āhuatanga matua

• Putanga FP4 whakamōhiotanga o Qwen3.8B Flash Next, e tautoko ana i te whakahaere ā-roto
• I whakamōhiotia mā te hangarau Quantisation-Aware Distillation (QAD)
• E tautoko ana i te kaiwhakawae matakite, te aro nui ranu, MoE, ngā awa toenga kua kati me ngā whakauru n-gram
• E whakarato ana i tētahi ipu vLLM hei tautoko i te hōputu kōpeke NVFP4 kore-ngaro hou

Mā wai

Kaiwhakawhanake me ngā kairangahau e hiahia ana ki te whakatakoto me te whakahaere i ngā tauira reo nui whakamahora-ā-wāhanga māmā ki runga i ngā pūrere NVIDIA ā-roto (pērā i te RTX PRO 6000 Blackwell, DGX Spark rānei).

Me pēhea te tīmata

1. Haere ki https://huggingface.co/nvidia/Qwen3.8-Flash-Next-FP4-Local ki te tikiake i ngā taumaha tauira
2. Whakahaerehia te tauira mā te ipu vLLM e whakaratohia ana i roto i te README
3. Whakatakotohia ki runga i ngā pūrere NVIDIA RTX PRO 6000 Blackwell, DGX Spark rānei e tautokona ana

I whakahiatohia mai i ngā whakaahuatanga tūmatanui i te pae mana / README / whārangi whakarewatanga o te taputapu. Kāore anō kia whakamanahia ngā utu me ngā tau kaiwhakamahi; tirohia te pae mana. I hangaia ētahi wāhanga mā te āwhina AI. Kua tuhia ki te reo Hainamana me te reo Ingarihi; ko ētahi atu reo he whakamāoritanga mihini.