A dataset of different files that robots tried to crawl through webfiddle.net Mostly html files but other files too pdfs, images, binary- i have no idea what is in here at this stage - but gives an interesting idea of what crawlers like to visit and could be the basis of interesting SEO or coding LLM reasearch. Collected as part of my work on web simulators. https://webfiddle.net JS/CSS editor for the web, https://websim.netwrck.com Coding Editor for the web. https://x.com/leeleepenkman Its uploading soon/right now. split into different sqlite.db files. Example row
Independent publisher
Lee Penkman
lee101
ML/AI/neural networks, surfaces/3d
Models in Library0
Datasets in Library1
Models on Hugging Face4
Followers1