AI Training Datasets: the Books1+Books2 that Big AI eats for breakfast
An article examining the Books1 and Books2 datasets used to train large language models, noting they may overlap substantially with the BookCorpus dataset of roughly 11,000 books. It discusses how Books1 is believed to draw from public-domain works while Books2's contents remain undocumented.