π§
Llavaqwen2.5 0.5b Finetune Col Mask Moe Sparse 4e 2k Sp0.9 20260418 062427 model by KKHYA
β 38.3
π¬Technical Deep Dive
Full Specifications [+]
π Updated daily
Source summary: Based on Hugging Face metadata. Not a recommendation.
π‘οΈ Model Transparency Report
Technical metadata sourced from upstream repositories.
Open Metadata
π Identity & Source
- id
- hf-model--kkhya--llavaqwen2.5-0.5b-finetune-col-mask-moe-sparse-4e-2k-sp0.9_20260418_062427
- slug
- kkhya--llavaqwen2.5-0.5b-finetune-col-mask-moe-sparse-4e-2k-sp0.9_20260418_062427
- source
- huggingface
- author
- KKHYA
- license
- Apache-2.0
- tags
- transformers, pytorch, safetensors, col_mask_moe_llava_qwen2, text-generation, generated_from_trainer, conversational, base_model:kkhya/llavaqwen2.5-0.5b-finetune, license:apache-2.0, endpoints_compatible, region:us
βοΈ Technical Specs
- architecture
- ColMaskMoELLaVAQwen2ForCausalLM
- params billions
- 0.94
- context length
- 2,048
- pipeline tag
- text-generation
- vram gb
- 2
- vram is estimated
- true
- vram formula
- VRAM β (params * 0.75) + 0.8GB (KV) + 0.5GB (OS)
π Engagement & Metrics
- downloads
- 0
Data indexed from public sources. Updated daily.