lainchan / Ω

Scanning the internet for imageboards

Cypher · 2022-10-05 01:41
I've recently decided that I want to scan more or less the entire internet for imageboards and textboards. Reason being I want to find really rare and undocumented ones. I expect that to take a few weeks, or a month. I am thinking that I could use nmap to scan ports 80 and 443 of the entire valid range of IP addresses, and then search the output of that to find out whether it is common textboard/imageboard software. I am fairly proficient in Lua programming (which is the language used by nmap scripting) so that will be a plus. Is nmap a good tool to use or are there better alternatives?
Netrunner · 2022-10-05 01:48
This thread's topic has been recycled. Why?
Zero Cool · 2022-10-05 01:52
>>64221 I think this link here could prove quite useful if you already don't know about it. https://github.com/ccd0/imageboards.json
Mentat · 2022-10-05 05:08
>>64221 Would a lot of programming experience needed to do something similar to what you're planning on doing? I like the idea and would love to replicate it but sadly have little to no programming experience
Mitnick · 2022-10-05 07:17
>>64225 >Would a lot of programming experience needed to do something similar to what you're planning on doing? I like the idea and would love to replicate it but sadly have little to no programming experience Not that much, you would need a bit of lua scripting to use it with nmap tool and then I guess you could use simple regex to check for strings in the requests trying to find indications of a chan
Erik Johansson · 2022-10-07 10:20
>>64221 You're gonna have a hard time finding the rare ones because they generally use ancient, now uncommon backends. At the very least I can provide you one directly, the MobiusNet message board: http://www.mobiusnet.jp/FS-APL/FS-BBS/index.cgi?Code=ita For context, MobiusNet was a Japanese BBS from 1992 that migrated to the Web in 1996. It has a message board section similar to Ayashii World (which I linked above) that removes old posts after a certain period of time. Unfortunately it's been deserted since 2004, so the board is nearly always empty.