Falcon RefinedWeb
← All datasets
Author: Distillio · License: apache-2.0 · Format: parquet
0 downloads · 0 stars · 0 mirrors · size unknown · 1 file
~600B-token filtered, deduplicated CommonCrawl extract used to pretrain Falcon.
Tags: pretraining · web-text · filtered
Description
~600B-token filtered and deduplicated CommonCrawl extract built by TII (UAE), used to pretrain the Falcon model family.
Download
Direct download: https://huggingface.co/datasets/tiiuae/falcon-refinedweb/resolve/main/data/train-00995-of-05534-f5e4f8b779f6c170.parquet
Or via the API: curl -L -o file "https://huggingface.co/datasets/tiiuae/falcon-refinedweb/resolve/main/data/train-00995-of-05534-f5e4f8b779f6c170.parquet"
Files in the Hugging Face repository
- .gitattributes (2.2 KB)
- data/train-00000-of-05534-b8fc5348cbe605a5.parquet (299 MB)
- data/train-00001-of-05534-9bca3ce859516338.parquet (287 MB)
- data/train-00002-of-05534-01680948bd81de83.parquet (283 MB)
- data/train-00003-of-05534-b7806bb8ca893c23.parquet (288 MB)
- data/train-00004-of-05534-cbe1137f523084a7.parquet (294 MB)
- data/train-00005-of-05534-e4a5eae6c1419c9b.parquet (291 MB)
- data/train-00006-of-05534-5bc49be138fd315b.parquet (286 MB)
- data/train-00007-of-05534-c185da59aece723d.parquet (281 MB)
- data/train-00008-of-05534-8ed029166c6795cf.parquet (277 MB)
- data/train-00009-of-05534-f0954d1648b16e88.parquet (287 MB)
- data/train-00010-of-05534-5373970b3705bfc5.parquet (281 MB)
- data/train-00011-of-05534-7d7970b7bb98922c.parquet (290 MB)
- data/train-00012-of-05534-acf3fb5fee2b7e50.parquet (306 MB)
- data/train-00013-of-05534-a2a70ea6a8536f67.parquet (281 MB)
- data/train-00014-of-05534-2628ae1bc45a28c9.parquet (287 MB)
- data/train-00015-of-05534-0c056156dc81ffc2.parquet (292 MB)
- data/train-00016-of-05534-0e0c9b82ed6ccecc.parquet (290 MB)
- data/train-00017-of-05534-81d837539550c007.parquet (309 MB)
- data/train-00018-of-05534-6d374c09460d8143.parquet (306 MB)
- data/train-00019-of-05534-724cfbde611d86f5.parquet (296 MB)
- data/train-00020-of-05534-442ffd4b989fb05d.parquet (285 MB)
- data/train-00021-of-05534-8ada25673bef5f61.parquet (291 MB)
- data/train-00022-of-05534-77181f7417ee27cb.parquet (288 MB)
- data/train-00023-of-05534-68a7ffc65bb0793d.parquet (294 MB)
- data/train-00024-of-05534-fd6960561baf3ed9.parquet (285 MB)
- data/train-00025-of-05534-364c4d103a621e0f.parquet (295 MB)
- data/train-00026-of-05534-031de1cf0c1afcb0.parquet (279 MB)
- data/train-00027-of-05534-bddc08d9377fbb66.parquet (288 MB)
- data/train-00028-of-05534-09ffe38fe3bb6c59.parquet (275 MB)
- data/train-00029-of-05534-fd33dccd28c51349.parquet (280 MB)
- data/train-00030-of-05534-bfbcdce619c0f298.parquet (288 MB)
- data/train-00031-of-05534-ee852b432a95e05a.parquet (296 MB)
- data/train-00032-of-05534-50284d5c130b0be0.parquet (295 MB)
- data/train-00033-of-05534-1f8fe78125424cc4.parquet (271 MB)
- data/train-00034-of-05534-06a9248bcdf8d5ee.parquet (295 MB)
- data/train-00035-of-05534-4af1fa8b5ec251d2.parquet (286 MB)
- data/train-00036-of-05534-75f410e082912165.parquet (300 MB)
- data/train-00037-of-05534-378fea92f8c1f986.parquet (294 MB)
- data/train-00038-of-05534-422efc900cd120fe.parquet (306 MB)
- data/train-00039-of-05534-9b84156534f2e079.parquet (289 MB)
- data/train-00040-of-05534-22ecdb900499b2bf.parquet (292 MB)
- data/train-00041-of-05534-4b0e16289c2c41a8.parquet (289 MB)
- data/train-00042-of-05534-6e461fee85cdb6c2.parquet (290 MB)
- data/train-00043-of-05534-6711ba24927f3382.parquet (293 MB)
- data/train-00044-of-05534-5c643be3cd561476.parquet (296 MB)
- data/train-00045-of-05534-fb61b8a4dae74c99.parquet (287 MB)
- data/train-00046-of-05534-bbd7d5cc9a0dbc0d.parquet (281 MB)
- data/train-00047-of-05534-dbeffe2b7bddff3a.parquet (280 MB)
- data/train-00048-of-05534-566af6f2a7886a09.parquet (286 MB)
- data/train-00049-of-05534-ac30a4f756ec5504.parquet (286 MB)
- data/train-00050-of-05534-db9cb02b30b9febe.parquet (291 MB)
- data/train-00051-of-05534-b8a6dc2a89918893.parquet (289 MB)
- data/train-00052-of-05534-d9a6e1c915c881aa.parquet (278 MB)
- data/train-00053-of-05534-c1c1849e35427103.parquet (311 MB)
- data/train-00054-of-05534-2008415143812d16.parquet (290 MB)
- data/train-00055-of-05534-20ab314489388791.parquet (293 MB)
- data/train-00056-of-05534-bab7a09c5bc0f9f6.parquet (304 MB)
- data/train-00057-of-05534-3fe06a60d8b3ba1f.parquet (308 MB)
- data/train-00058-of-05534-16676af65bdbad78.parquet (303 MB)
- data/train-00059-of-05534-2fff3086a5fa9908.parquet (287 MB)
- data/train-00060-of-05534-4bafdfed36441e65.parquet (283 MB)
- data/train-00061-of-05534-d355002fb13ad062.parquet (286 MB)
- data/train-00062-of-05534-84e72000997f426c.parquet (296 MB)
- data/train-00063-of-05534-b27f057082a3e9f8.parquet (288 MB)
- data/train-00064-of-05534-7e4804af07754936.parquet (283 MB)
- data/train-00065-of-05534-91137f3a22c0cca2.parquet (287 MB)
- data/train-00066-of-05534-c1f9ba4a23071c6a.parquet (285 MB)
- data/train-00067-of-05534-7a8cb676094897cc.parquet (273 MB)
- data/train-00068-of-05534-b56b1f4c725392a1.parquet (283 MB)
- data/train-00069-of-05534-5743137cb33052d6.parquet (287 MB)
- data/train-00070-of-05534-330b81f4c3f94ff0.parquet (296 MB)
- data/train-00071-of-05534-8b484b161e70dd43.parquet (292 MB)
- data/train-00072-of-05534-ae1892f64ae73ae8.parquet (290 MB)
- data/train-00073-of-05534-db93eea48ce598eb.parquet (295 MB)
- data/train-00074-of-05534-2b8a7b240832dfde.parquet (286 MB)
- data/train-00075-of-05534-0b6c9f2b28225773.parquet (290 MB)
- data/train-00076-of-05534-42a64bb49b8bf958.parquet (293 MB)
- data/train-00077-of-05534-bb1d6c5f8f17e48e.parquet (318 MB)
- data/train-00078-of-05534-601f9e694ff7fcae.parquet (284 MB)
- data/train-00079-of-05534-e41759ad964dbae0.parquet (295 MB)
- data/train-00080-of-05534-a6f7f0439e40e41a.parquet (290 MB)
- data/train-00081-of-05534-8a16c202e4607e4a.parquet (294 MB)
- data/train-00082-of-05534-bdf99f9dec6ba189.parquet (292 MB)
- data/train-00083-of-05534-21c7338f7b2b20b7.parquet (284 MB)
- data/train-00084-of-05534-776ff5f53d9ead52.parquet (286 MB)
- data/train-00085-of-05534-45857fc6672cdfb9.parquet (277 MB)
- data/train-00086-of-05534-4fb12f9c2d75f685.parquet (285 MB)
- data/train-00087-of-05534-1ffb77754ceef6f4.parquet (279 MB)
- data/train-00088-of-05534-f706579f543911ea.parquet (285 MB)
- data/train-00089-of-05534-c02d24e27f31fec6.parquet (289 MB)
- data/train-00090-of-05534-2aebd6305a70c177.parquet (297 MB)
- data/train-00091-of-05534-406347232c8aa09c.parquet (281 MB)
- data/train-00092-of-05534-5232c08a82e6f739.parquet (289 MB)
- data/train-00093-of-05534-9d6e3ed23f7e7305.parquet (295 MB)
- data/train-00094-of-05534-b35e35308dda16c0.parquet (292 MB)
- data/train-00095-of-05534-814563e01c316c64.parquet (294 MB)
- data/train-00096-of-05534-d3643727463a6e6d.parquet (306 MB)
- data/train-00097-of-05534-932e63c2fa334d06.parquet (291 MB)
- data/train-00098-of-05534-b38b0885cadd90dd.parquet (283 MB)
- data/train-00099-of-05534-a06243ee7e32c8f9.parquet (286 MB)
- data/train-00100-of-05534-acdb79aedf886539.parquet (293 MB)
- data/train-00101-of-05534-d77d330a057843ed.parquet (290 MB)
- data/train-00102-of-05534-ab771fca22025d64.parquet (285 MB)
- data/train-00103-of-05534-10a0aff1b2b58a44.parquet (283 MB)
- data/train-00104-of-05534-72b473c76ae9bc85.parquet (285 MB)
- data/train-00105-of-05534-7a1432e4ffdf1ab2.parquet (285 MB)
- data/train-00106-of-05534-f7ebe659ae8f9295.parquet (285 MB)
- data/train-00107-of-05534-44e4fd8d19310a36.parquet (284 MB)
- data/train-00108-of-05534-1e251a9d777ccf1b.parquet (288 MB)
- data/train-00109-of-05534-f5c48a7e32ac607d.parquet (292 MB)
- data/train-00110-of-05534-6ed62191e9892fe4.parquet (281 MB)
- data/train-00111-of-05534-95e6207f5f01dd36.parquet (292 MB)
- data/train-00112-of-05534-2c36fe06992a527f.parquet (289 MB)
- data/train-00113-of-05534-4a11afd5bf44f7e7.parquet (291 MB)
- data/train-00114-of-05534-43364aab51dc8851.parquet (291 MB)
- data/train-00115-of-05534-39c454293ffb416a.parquet (296 MB)
- data/train-00116-of-05534-38a6ebda3ecc9820.parquet (295 MB)
- data/train-00117-of-05534-3090190724999dfe.parquet (287 MB)
- data/train-00118-of-05534-16923b7c15ccd9e6.parquet (288 MB)
- data/train-00119-of-05534-9b4051d4bd9f679b.parquet (289 MB)
- data/train-00120-of-05534-1ad21301c09e5b49.parquet (297 MB)
- data/train-00121-of-05534-e64a33f704f2a798.parquet (291 MB)
- data/train-00122-of-05534-55c0ccf9976b15b6.parquet (307 MB)
- data/train-00123-of-05534-d95aba7da432e60f.parquet (284 MB)
- data/train-00124-of-05534-8298dbe59ce89650.parquet (288 MB)
- data/train-00125-of-05534-cd4b7466e7875a70.parquet (281 MB)
- data/train-00126-of-05534-ee074d3075ae3fc1.parquet (285 MB)
- data/train-00127-of-05534-3b854c149ef7b5a6.parquet (285 MB)
- data/train-00128-of-05534-fd393f4fe594bef4.parquet (288 MB)
- data/train-00129-of-05534-2056d5af86486aca.parquet (294 MB)
- data/train-00130-of-05534-57e3e084844d09c3.parquet (285 MB)
- data/train-00131-of-05534-a158c019b425f106.parquet (284 MB)
- data/train-00132-of-05534-67699cca7a28123a.parquet (288 MB)
- data/train-00133-of-05534-8ae8b21751ee2cc3.parquet (290 MB)
- data/train-00134-of-05534-e66d33b7ba5f0dbe.parquet (299 MB)
- data/train-00135-of-05534-c1f18a3187d6b3f3.parquet (301 MB)
- data/train-00136-of-05534-9b0bbea5f23479a7.parquet (284 MB)
- data/train-00137-of-05534-a13f109a07b3b15b.parquet (288 MB)
- data/train-00138-of-05534-511e76363cc9aafe.parquet (288 MB)
- data/train-00139-of-05534-49f0279caea9252c.parquet (290 MB)
- data/train-00140-of-05534-8b71e0d0ad80c859.parquet (286 MB)
- data/train-00141-of-05534-c406fb725c92cdf1.parquet (308 MB)
- data/train-00142-of-05534-ed7839a84178e5ab.parquet (291 MB)
- data/train-00143-of-05534-92de0737da2a5532.parquet (281 MB)
- data/train-00144-of-05534-125a4beb5d8dcd6f.parquet (284 MB)
- data/train-00145-of-05534-acf7d11b68333cc7.parquet (281 MB)
- data/train-00146-of-05534-878c64c9e35ac31b.parquet (286 MB)
- data/train-00147-of-05534-dcbd6ce283e4a630.parquet (282 MB)
- data/train-00148-of-05534-3c0d040d3f5c0760.parquet (301 MB)
- data/train-00149-of-05534-06adb7f12069d0ae.parquet (282 MB)
- data/train-00150-of-05534-d51f84c711429e72.parquet (289 MB)
- data/train-00151-of-05534-f024a1bd9c94067f.parquet (294 MB)
- data/train-00152-of-05534-b1ec3dbf60fa1405.parquet (290 MB)
- data/train-00153-of-05534-a821219b6aa8da2d.parquet (292 MB)
- data/train-00154-of-05534-b2f353cd0a205a61.parquet (304 MB)
- data/train-00155-of-05534-718a14faa3c69244.parquet (289 MB)
- data/train-00156-of-05534-f6e6e4714ca97866.parquet (284 MB)
- data/train-00157-of-05534-bca47f178f51ff11.parquet (287 MB)
- data/train-00158-of-05534-6066081db775fc98.parquet (293 MB)
- data/train-00159-of-05534-4c935cd3424e6254.parquet (305 MB)
- data/train-00160-of-05534-70d497ee8319b256.parquet (285 MB)
- data/train-00161-of-05534-d2b24adaa9e2a07c.parquet (302 MB)
- data/train-00162-of-05534-8f2413fdd7523544.parquet (289 MB)
- data/train-00163-of-05534-2298e36fbf1b7f3a.parquet (283 MB)
- data/train-00164-of-05534-8fbd36a824d86621.parquet (284 MB)
- data/train-00165-of-05534-197ee6aeacdaab43.parquet (285 MB)
- data/train-00166-of-05534-cc83f148af30fc38.parquet (295 MB)
- data/train-00167-of-05534-bf1ed291bf8fd851.parquet (291 MB)
- data/train-00168-of-05534-c4b65b331db89747.parquet (289 MB)
- data/train-00169-of-05534-f29492d78a9d7f09.parquet (287 MB)
- data/train-00170-of-05534-93d28ba49dda347f.parquet (287 MB)
- data/train-00171-of-05534-27d402c24130fbc4.parquet (291 MB)
- data/train-00172-of-05534-3f007943fdd4afe1.parquet (294 MB)
- data/train-00173-of-05534-21d26837183e7e03.parquet (299 MB)
- data/train-00174-of-05534-7ba095d94da7ed63.parquet (294 MB)
- data/train-00175-of-05534-d87add6f13493403.parquet (289 MB)
- data/train-00176-of-05534-5ada51d425b0421f.parquet (287 MB)
- data/train-00177-of-05534-404956ca754840bf.parquet (290 MB)
- data/train-00178-of-05534-2b8eb801b9940fdd.parquet (311 MB)
- data/train-00179-of-05534-c4a7b1c9e98dde59.parquet (289 MB)
- data/train-00180-of-05534-81ae4866a3642e76.parquet (310 MB)
- data/train-00181-of-05534-bc954f85800a90c7.parquet (291 MB)
- data/train-00182-of-05534-5e803ae8e43f6604.parquet (286 MB)
- data/train-00183-of-05534-1129050f79943fa3.parquet (282 MB)
- data/train-00184-of-05534-352bee4adbab626a.parquet (279 MB)
- data/train-00185-of-05534-e918a8437cd2811c.parquet (289 MB)
- data/train-00186-of-05534-fb8d4f13f526f35f.parquet (316 MB)
- data/train-00187-of-05534-41a662d8ae15378f.parquet (303 MB)
- data/train-00188-of-05534-f7615098a6f6915a.parquet (281 MB)
- data/train-00189-of-05534-c62b99afb05b143a.parquet (290 MB)
- data/train-00190-of-05534-f3750a82b1196ef8.parquet (294 MB)
- data/train-00191-of-05534-4b27d3911e4d43dd.parquet (290 MB)
- data/train-00192-of-05534-98753c7bef9dad4d.parquet (291 MB)
- data/train-00193-of-05534-4e26c7d875ec7d65.parquet (297 MB)
- data/train-00194-of-05534-eba898b6aac4b181.parquet (283 MB)
- data/train-00195-of-05534-ecb8a3850459f868.parquet (297 MB)
- data/train-00196-of-05534-abeae17143addf6c.parquet (294 MB)
- data/train-00197-of-05534-22576c5fda806dfc.parquet (305 MB)
- data/train-00198-of-05534-fe861978567e8467.parquet (283 MB)
- data/train-00199-of-05534-a65136edfd34a810.parquet (298 MB)
- data/train-00200-of-05534-9a9f2f5b8846ad1b.parquet (294 MB)
- data/train-00201-of-05534-038701a294c276df.parquet (284 MB)
- data/train-00202-of-05534-a14e684d27af4079.parquet (281 MB)
- data/train-00203-of-05534-45d926844e97acae.parquet (279 MB)
- data/train-00204-of-05534-f3864737dc6fd3c8.parquet (287 MB)
- data/train-00205-of-05534-4468dacd1fbb1be8.parquet (295 MB)
- data/train-00206-of-05534-09e0dde8aed8bcfa.parquet (299 MB)
- data/train-00207-of-05534-f68a406b1381f677.parquet (276 MB)
- data/train-00208-of-05534-624cbd797163c537.parquet (286 MB)
- data/train-00209-of-05534-f33d9b83d3425343.parquet (294 MB)
- data/train-00210-of-05534-2f2ea1e04b8b9a40.parquet (288 MB)
- data/train-00211-of-05534-828a9ff84fb03c6c.parquet (283 MB)
- data/train-00212-of-05534-6c7fe995b5dc3faf.parquet (321 MB)
- data/train-00213-of-05534-8342a483425b76f9.parquet (299 MB)
- data/train-00214-of-05534-d0094c60317981e2.parquet (283 MB)
- data/train-00215-of-05534-51cf69b04e625a0e.parquet (291 MB)
- data/train-00216-of-05534-bf563f41853b819c.parquet (295 MB)
- data/train-00217-of-05534-95297730c8b556ac.parquet (301 MB)
- data/train-00218-of-05534-cf5d7c62c19caece.parquet (281 MB)
- data/train-00219-of-05534-970fe29f5dec1489.parquet (303 MB)
- data/train-00220-of-05534-d70906a3d8edf48f.parquet (289 MB)
- data/train-00221-of-05534-c5b0309348fb40fa.parquet (280 MB)
- data/train-00222-of-05534-e30e06e214deae15.parquet (282 MB)
- data/train-00223-of-05534-ee9fd999cd0fba22.parquet (285 MB)
- data/train-00224-of-05534-f1fa1d71f944e4c4.parquet (316 MB)
- data/train-00225-of-05534-f02b3d20fb70925a.parquet (299 MB)
- data/train-00226-of-05534-9bf4609890ea97b7.parquet (283 MB)
- data/train-00227-of-05534-a59b4abdd0d487d6.parquet (288 MB)
- data/train-00228-of-05534-635516e7725bdafc.parquet (292 MB)
- data/train-00229-of-05534-9d34d4bd8dd28df4.parquet (289 MB)
- data/train-00230-of-05534-bb601f039488735c.parquet (308 MB)
- data/train-00231-of-05534-bcac65dd0ad88b0c.parquet (305 MB)
- data/train-00232-of-05534-f454aa5c49698a48.parquet (306 MB)
- data/train-00233-of-05534-e11522a9f3d501aa.parquet (290 MB)
- data/train-00234-of-05534-09e00edd2e0a89b5.parquet (291 MB)
- data/train-00235-of-05534-713eb3ff03c5ea78.parquet (290 MB)
- data/train-00236-of-05534-3a5d0c440f596e1c.parquet (309 MB)
- data/train-00237-of-05534-5d8c143ef8656186.parquet (277 MB)
- data/train-00238-of-05534-a877b0645b4814c8.parquet (302 MB)
- data/train-00239-of-05534-2ced819e53dd6f22.parquet (287 MB)
- data/train-00240-of-05534-73bf6fbcf793cac6.parquet (294 MB)
- data/train-00241-of-05534-82c135cf43aa2cde.parquet (276 MB)
- data/train-00242-of-05534-e9de6755ce1a1c92.parquet (283 MB)
- data/train-00243-of-05534-e3c1141323be926e.parquet (287 MB)
- data/train-00244-of-05534-93f7af7b89d4a6c3.parquet (306 MB)
- data/train-00245-of-05534-74090ac89e908d79.parquet (295 MB)
- data/train-00246-of-05534-0db8886fa332bc53.parquet (289 MB)
- data/train-00247-of-05534-83eef969064fe1f7.parquet (288 MB)
- data/train-00248-of-05534-0ec72d85e1f81798.parquet (287 MB)
Browse all files in the tiiuae/falcon-refinedweb repository on Hugging Face — 999 files total, listing the first 250.
Added 2026-08-11. Platform: Distillio — the open source training data collective.