Bukatun Na'ura
A wannan shafin
Aikace-aikacen ShareAI yana ba da shawarar waɗanne samfuran AI suka dace don rabawa bisa ga GPU VRAM na na'urarka. Don taimaka maka ka ƙara gudummawarka yayin tabbatar da ingantaccen aiki, muna amfani da nau'ikan buƙatu guda biyu:
Bukatun Da Aka Ba da Shawara#
- Waɗannan suna nuna adadin VRAM da ya dace don gudanar da samfura cikin inganci.
- Idan GPU ɗinka ya cika VRAM da aka ba da shawara, za ka iya tsammanin kyakkyawan aiki da saurin sarrafa ayyuka cikin inganci.
- Idan GPU ɗinka ya kasa VRAM da aka ba da shawara, har yanzu za ka iya shigarwa da gudanar da samfurin, amma aikin na iya zama a hankali sosai. Na'urarka za ta sarrafa ƙananan ayyuka a kowace dakika idan aka kwatanta da yanayi mafi kyau.
Mafi Karancin Bukatu#
- Waɗannan su ne mafi ƙarancin ƙimar VRAM da GPU ɗinka dole ne ya cika don gudanar da samfura na musamman.
- Idan GPU ɗinka bai cika mafi ƙarancin VRAM ba, ba za ka iya shigarwa ko raba samfurin ba. Wannan yana tabbatar da amincin hanyar sadarwa kuma yana hana amfani da albarkatu ba tare da inganci ba.
Rarraba GPU VRAM#
Bisa ga VRAM na GPU ɗinka, na'urarka tana faɗa cikin ɗaya daga cikin waɗannan rukunoni:
| Matsakaicin VRAM (GB) | Samfuran Da Aka Ba da Shawara |
|---|---|
| 4–6 GB | 1B, 3B |
| 8–12 GB | 7B (quantized 4/8-bit) |
| 16–24 GB | 7B, 14B (quantized 4-bit) |
| 32–48 GB | 14B, 20B (quantized 4/8-bit), 70B (4-bit) |
| 48–96 GB (GPU da yawa) | 70B (8-bit quantized) |
| 96 GB+ (GPU da yawa) | 70B (16-bit precision ko lokuta da yawa) |
Misali:
- RTX 3060 (12GB): An ba da shawarar amfani da samfura kusan 7–8B sigogi (misali, DeepSeek-r1:8B). Za ka iya shigar har zuwa samfura 13B idan ka yarda da yiwuwar raguwa a aiki.
- RTX 4080 (16GB): An ba da shawarar don samfura 7–14B (quantized 4-bit).
Faɗakarwa da Sanarwa#
Lokacin ƙara sabbin samfura:
- Idan GPU ɗinka ya cika buƙatun da aka ba da shawara:
- Babu faɗakarwa ko ƙuntatawa.
- Idan GPU ɗinka ya kasa wanda aka ba da shawara amma ya fi mafi ƙaranci:
- Saƙon faɗakarwa mara toshewa zai bayyana yana sanar da kai game da yiwuwar matsalolin aiki.
- Misalin faɗakarwa: ⚠️ Sanarwar Aiki: GPU VRAM ɗinka ya kasa adadin da aka ba da shawara. Wannan samfurin na iya gudana a hankali kuma ya sarrafa ƙananan ayyuka a kowace dakika.
- Idan GPU ɗinka bai cika mafi ƙarancin buƙatu ba:
- Faɗakarwa mai toshewa tana hana shigarwa.
- Misalin faɗakarwa: 🔴 VRAM Bai Isa Ba: GPU VRAM ɗinka bai cika mafi ƙarancin buƙatu don wannan samfurin ba. Da fatan za a haɓaka GPU ɗinka ko zaɓi samfurin da ya fi ƙarami. Koyi ƙarin.
Shari'o'in Musamman#
- K-Quant Overhead: Ana ɗauki ƙarin amfani da VRAM idan ana amfani da samfura waɗanda aka ƙididdige su da K-quants (K_S, K_M, K_L). ShareAI tana lissafi ta atomatik kuma tana daidaita shawarwari yadda ya kamata.
:latestSamfura:- Tun da
:latestsamfura ba sa bayyana adadin sigogi a gaba, ShareAI tana gudanar da bincike ta amfani daollama showumarni kafin ta ba da damar raba su. - Idan albarkatunku ba su dace da mafi ƙarancin buƙatun samfurin bayan bincike ba, samfurin ba zai kunna ba.
- Tun da
Shawarwari Na Ƙarshe#
- Duba shawarwarin GPU akai-akai a cikin keɓaɓɓen ShareAI.
- Ci gaba da sabunta direbobin GPU ɗinku don samun mafi kyawun aiki.
- Yi la'akari da haɓaka GPU idan kuna son bayar da gudummawa sosai ga hanyar sadarwa ko karɓar manyan samfura.
Wannan yana tabbatar da ingancin gudummawarku da lafiyar hanyar sadarwar AI mai zaman kanta ta ShareAI.
An sabunta karshe ranar 14 ga Satumba, 2025