There is a large dataset for training Large Language Model’s called The Pile. It can be found here. It is an 825 GiB open-source dataset including books, github repositories, webpages, chat logs, and medical, physics, math, computer science, and philosophy papers.
@article{yaltirakli, title = "2023 02 28", author = "Yaltirakli, Gokberk", journal = "gkbrk.com", year = "2024", url = "https://www.gkbrk.com/journal/2023-02-28" }
Gokberk Yaltirakli, "2023 02 28", July, 2024. [Online]. Available: https://www.gkbrk.com/journal/2023-02-28. [Accessed Jul. 24, 2024].
Yaltirakli, G. (2024, July 24). 2023 02 28. https://www.gkbrk.com/journal/2023-02-28
Gokberk Yaltirakli, 2023 02 28, GKBRK.COM (Jul. 24, 2024), https://www.gkbrk.com/journal/2023-02-28
