Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

datablations

https://github.com/huggingface/datablations
Activity Feed Request to join this org

AI & ML interests

Scaling Data-Constrained Language Models

Recent Activity

craffel  authored a paper about 18 hours ago
TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior
thomwolf  authored a paper 2 months ago
Robot Learning: A Tutorial
thomwolf  authored a paper 6 months ago
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
View all activity

Thomas Wolf's profile picture Teven Le Scao's profile picture Sasha Rush's profile picture Niklas Muennighoff's profile picture Aleksandra Piktus's profile picture Nouamane Tazi's profile picture Sampo Pyysalo's profile picture Colin Raffel's profile picture Risto Luukkonen's profile picture

datablations 's datasets 13

datablations/scripts

Viewer • Updated Jun 15, 2023 • 3.48M • 2.92k

datablations/oscar-subsets

Viewer • Updated Jun 14, 2023 • 365k • 1.37k

datablations/c4-subsets

Viewer • Updated Jun 14, 2023 • 729k • 1.17k • 5

datablations/c4-filter-megatron

Updated May 28, 2023 • 731

datablations/oscar-filter-megatron

Updated May 27, 2023 • 352

datablations/python-megatron

Updated May 22, 2023 • 4.89k • 1

datablations/subsets

Viewer • Updated May 10, 2023 • 365k • 91

datablations/oscar-filter

Viewer • Updated May 10, 2023 • 432M • 9.01k

datablations/oscar-dedup-expanded

Viewer • Updated May 10, 2023 • 432M • 7.06k

datablations/mup

Updated Apr 24, 2023 • 1.34k

datablations/c4-filter

Viewer • Updated Feb 1, 2023 • 365M • 6.12k

datablations/c4-filter-small

Viewer • Updated Jan 17, 2023 • 100k • 84

datablations/oscar-filter-small

Viewer • Updated Nov 24, 2022 • 100k • 21
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs