gte-Qwen2-7B-instruct
by Alibaba-NLP
gte-Qwen2-7B-instruct is an open-source AI model by Alibaba-NLP
Technical Specifications
View Config (4 entries)
{
"architectures": [
"Qwen2ForCausalLM"
],
"auto_map": {
"AutoModel": "modeling_qwen.Qwen2Model",
"AutoModelForCausalLM": "modeling_qwen.Qwen2ForCausalLM",
"AutoModelForSequenceClassification": "modeling_qwen.Qwen2ForSequenceClassification"
},
"model_type": "qwen2",
"tokenizer_config": {
"bos_token": null,
"chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": null
}
}
Est. VRAM Required
~7 GB
Estimation Formula
VRAM = params Γ 0.6 + 2 GB
Based on FP16 precision.
β οΈ Does not account for KV cache or parallel overhead.
π Estimate only. Actual requirements may vary.
Based on open-source metadata snapshot. Last synced: Dec 31, 2025
π§ Architecture Explorer
Neural network architecture
Technical Specifications
View Config (4 entries)
{
"architectures": [
"Qwen2ForCausalLM"
],
"auto_map": {
"AutoModel": "modeling_qwen.Qwen2Model",
"AutoModelForCausalLM": "modeling_qwen.Qwen2ForCausalLM",
"AutoModelForSequenceClassification": "modeling_qwen.Qwen2ForSequenceClassification"
},
"model_type": "qwen2",
"tokenizer_config": {
"bos_token": null,
"chat_template": "{% for message in messages %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": null
}
}
π Limitations & Considerations
- β’ Benchmark scores may vary based on evaluation methodology and hardware configuration.
- β’ VRAM requirements are estimates; actual usage depends on quantization and batch size.
- β’ FNI scores are relative rankings and may change as new models are added.
- β License Unknown: Verify licensing terms before commercial use.
- β’ Source: Huggingface
π Related Resources
π Related Papers
No related papers linked yet. Check the model's official documentation for research papers.
π Training Datasets
Training data information not available. Refer to the original model card for details.
π Related Models
Data unavailable