Author: Distillio · License: apache-2.0 · Format: parquet
0 downloads · 0 stars · 0 mirrors · size unknown · 1 file
~600B-token filtered, deduplicated CommonCrawl extract used to pretrain Falcon.
Tags: pretraining · web-text · filtered
~600B-token filtered and deduplicated CommonCrawl extract built by TII (UAE), used to pretrain the Falcon model family.
Direct download: https://huggingface.co/datasets/tiiuae/falcon-refinedweb/resolve/main/data/train-00995-of-05534-f5e4f8b779f6c170.parquet
Or via the API: curl -L -o file "https://huggingface.co/datasets/tiiuae/falcon-refinedweb/resolve/main/data/train-00995-of-05534-f5e4f8b779f6c170.parquet"
Added 2026-08-11. Platform: Distillio — the open source training data collective.