Language Modeling Datasets
Language modeling is a natural language processing task that predicts the next word in a sequence of words. This is an important task in natural language processing and the base for creating Large Lanugage Models (LLMs).
Displaying Page 2 of 2 (17 total Repositories)
The WikiText language modeling dataset is a collection of over 100 million tokens extracted from the set of verified Good and Featured articles on Wikipedia. The dataset is available under the Creative Commons Attribution-ShareAlike License.