Common Crawl Foundation

commoncrawl's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

pjox 

published a dataset about 8 hours ago

commoncrawl/CommonLID

Viewer • Updated about 21 hours ago • 373k • 58 • 2

pjox 

updated a dataset about 21 hours ago

commoncrawl/CommonLID

Viewer • Updated about 21 hours ago • 373k • 58 • 2

malteos 

updated a Space 4 days ago

Running

cc-citations

📜

Scientific articles using or citing Common Crawl data

laurievb 

in commoncrawl/CommonLID 6 days ago

[bot] Conversion to Parquet

#1 opened 7 days ago by

parquet-converter

laurievb 

updated a dataset 7 days ago

commoncrawl/CommonLID

Viewer • Updated about 21 hours ago • 373k • 58 • 2

laurievb 

in commoncrawl/CommonLID 7 days ago

feat: upload data as tsv

#2 opened 7 days ago by

laurievb

pjox 

authored a paper 12 days ago

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025

tvaughan 

updated a dataset 13 days ago

commoncrawl/statistics

Viewer • Updated 13 days ago • 610k • 146 • 25

dalhuijsen 

updated 2 datasets 2 months ago

commoncrawl/gneissweb-annotation-host-testing-v1

Viewer • Updated Dec 11, 2025 • 617M • 36

commoncrawl/gneissweb-annotation-url-testing-v1

Viewer • Updated Dec 10, 2025 • 11.5B • 119

greglindahl 

updated 2 datasets 2 months ago

commoncrawl/gneissweb-annotation-host-testing-v1

Viewer • Updated Dec 11, 2025 • 617M • 36

commoncrawl/gneissweb-annotation-url-testing-v1

Viewer • Updated Dec 10, 2025 • 11.5B • 119

greglindahl 

published a dataset 2 months ago

commoncrawl/gneissweb-annotation-host-testing-v1

Viewer • Updated Dec 11, 2025 • 617M • 36

greglindahl 

published a Space 2 months ago

Running

cc-citations

📜

Scientific articles using or citing Common Crawl data

jenglish-cc 

updated a dataset 2 months ago

commoncrawl/gneissweb-annotation-url-testing-v1

Viewer • Updated Dec 10, 2025 • 11.5B • 119

greglindahl 

published a dataset 2 months ago

commoncrawl/gneissweb-annotation-url-testing-v1

Viewer • Updated Dec 10, 2025 • 11.5B • 119

malteos 

updated a dataset 3 months ago

commoncrawl/statistics

Viewer • Updated 13 days ago • 610k • 146 • 25

catherinearnett 

authored 3 papers 3 months ago

Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training

Paper • 2506.01732 • Published Jun 2, 2025 • 6

Explaining and Mitigating Crosslingual Tokenizer Inequities

Paper • 2510.21909 • Published Oct 24, 2025

Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures

Paper • 2510.24081 • Published Oct 28, 2025 • 19