Phi-3 Small

What is Phi-3 Small?

Phi-3 Small is a 7 billion parameter model in Microsoft’s Phi-3 family, released in May 2024. It utilizes a block-diagonal attention mechanism to speed up token generation.

Like its sibling models, it is trained on curated synthetic data and high-quality web sources, providing a balanced profile for mid-tier tasks.

Key Capabilities

• Optimized attention: Block-diagonal attention reduces processing times.
• MIT License: Open for commercial deployment.
• Balanced profile: Strong reasoning relative to its footprint.

Ideal Use Cases

• Local assistants: Powering coding and drafting assistants on work laptops.
• Data extraction: Parsing specific fields from unstructured text.
• API orchestration: Translating inputs to API routing commands.