smollm:1.7b-base-v0.2-q4_0

481.8K 1 year ago

🪐 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.

135m 360m 1.7b

1 year ago

97f3f0aef2df · 991MB ·

model
llama
·
1.71B
·
Q4_0
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

Readme

SmolLM is a series of small language models available in three sizes: 135M, 360M, and 1.7B parameters.

References

Blog post

Hugging Face