Datasets

← Home

4 datasets found (tag “web-text”)

Filter by tag: sft (36) · reasoning (25) · distilled (24) · agentic (21) · tool-calling (20) · coding (19) · math (8) · open-harness (8) · nvidia (6) · code (6) · cot (6) · deepseek-v4 (5) · deepseek-r1 (5) · grpo (5) · instruction-tuning (5) · non-commercial (5) · pretraining (4) · synthetic (4) · web-text (4) · stem (4) · multilingual (4) · glm (3) · zhipu (3) · rl (3) · dpo (3) · function-calling (3) · tiger-lab (3) · huggingface (3) · swe (3) · multi-turn (3)

Sort: popular · downloads · stars · newest

• RedPajama-Data-1T — Together AI's 1.2T-token open reproduction of the LLaMA pretraining mix. (0 downloads, 0 stars, apache-2.0, pretraining, web-text, open-reproduction)
• Dolma 3 Pool — AI2's 9T-token pretraining pool considered for training OLMo 3. (0 downloads, 0 stars, odc-by, pretraining, web-text, multi-source)
• Falcon RefinedWeb — ~600B-token filtered, deduplicated CommonCrawl extract used to pretrain Falcon. (0 downloads, 0 stars, apache-2.0, pretraining, web-text, filtered)
• FineWeb-Edu — Education-filtered subset of FineWeb web text for pretraining. (0 downloads, 0 stars, odc-by, pretraining, web-text, filtered)