About
Sampled version of cerebras/SlimPajama-627B. Since the original data was shuffled before chunking, it contains train/chunk1 (of 10 total) and further sampled 10%. This should result in roughly 6B tokens, hence SlimPajama-6B.
2 commits
1 contributor
1 download
14 gb
0 stars
Repository contents
50 tabular files 98.0%
1 text files 2.0%
