RedPajama-Data-1T

← All datasets

Author: Distillio · License: apache-2.0 · Format: jsonl

0 downloads · 0 stars · 0 mirrors · size unknown · 1 file

Together AI's 1.2T-token open reproduction of the LLaMA pretraining mix.

Tags: pretraining · web-text · open-reproduction

Description

Together AI's 1.2T-token open reproduction of the LLaMA pretraining dataset mix.

Download

Direct download: https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T/tree/main

Or via the API: curl -L -o file "https://huggingface.co/datasets/togethercomputer/RedPajama-Data-1T/tree/main"

Added 2026-08-11. Platform: Distillio — the open source training data collective.