Phi-3-medium-128k-instruct
by microsoft
Phi-3-medium-128k-instruct is an open-source AI model by microsoft
Technical Specifications
View Config (4 entries)
{
"architectures": [
"Phi3ForCausalLM"
],
"auto_map": {
"AutoConfig": "configuration_phi3.Phi3Config",
"AutoModelForCausalLM": "modeling_phi3.Phi3ForCausalLM"
},
"model_type": "phi3",
"tokenizer_config": {
"bos_token": "<s>",
"chat_template": "{% for message in messages %}{% if (message['role'] == 'user') %}{{'<|user|>' + '\n' + message['content'] + '<|end|>' + '\n' + '<|assistant|>' + '\n'}}{% elif (message['role'] == 'assistant') %}{{message['content'] + '<|end|>' + '\n'}}{% endif %}{% endfor %}",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": "<unk>",
"use_default_system_prompt": false
}
}
Est. VRAM Required
~11 GB
Estimation Formula
VRAM = params Γ 0.6 + 2 GB
Based on FP16 precision.
β οΈ Does not account for KV cache or parallel overhead.
π Estimate only. Actual requirements may vary.
Based on open-source metadata snapshot. Last synced: Dec 31, 2025
π§ Architecture Explorer
Neural network architecture
Technical Specifications
View Config (4 entries)
{
"architectures": [
"Phi3ForCausalLM"
],
"auto_map": {
"AutoConfig": "configuration_phi3.Phi3Config",
"AutoModelForCausalLM": "modeling_phi3.Phi3ForCausalLM"
},
"model_type": "phi3",
"tokenizer_config": {
"bos_token": "<s>",
"chat_template": "{% for message in messages %}{% if (message['role'] == 'user') %}{{'<|user|>' + '\n' + message['content'] + '<|end|>' + '\n' + '<|assistant|>' + '\n'}}{% elif (message['role'] == 'assistant') %}{{message['content'] + '<|end|>' + '\n'}}{% endif %}{% endfor %}",
"eos_token": "<|endoftext|>",
"pad_token": "<|endoftext|>",
"unk_token": "<unk>",
"use_default_system_prompt": false
}
}
π Limitations & Considerations
- β’ Benchmark scores may vary based on evaluation methodology and hardware configuration.
- β’ VRAM requirements are estimates; actual usage depends on quantization and batch size.
- β’ FNI scores are relative rankings and may change as new models are added.
- β License Unknown: Verify licensing terms before commercial use.
- β’ Source: Huggingface
π Related Resources
π Related Papers
No related papers linked yet. Check the model's official documentation for research papers.
π Training Datasets
Training data information not available. Refer to the original model card for details.
π Related Models
Data unavailable