RT @Dorialexander: As a reminder, Common Crawl does not index PDFs because… they cannot afford it. The entire pretraining ecosystem is like…