Author: Distillio · License: odc-by · Format: jsonl
0 downloads · 0 stars · 0 mirrors · size unknown · 1 file
AI2's 9T-token pretraining pool considered for training OLMo 3.
Tags: pretraining · web-text · multi-source
AI2's 9T-token pretraining pool (web, science PDFs, code, and more) considered for training OLMo 3 — released February 2026.
Direct download: https://huggingface.co/datasets/allenai/dolma3_pool/tree/main
Or via the API: curl -L -o file "https://huggingface.co/datasets/allenai/dolma3_pool/tree/main"
Added 2026-08-11. Platform: Distillio — the open source training data collective.