Scanning the internet for imageboards

I've recently decided that I want to scan more or less the entire internet for imageboards and textboards. Reason being I want to find really rare and undocumented ones. I expect that to take a few weeks, or a month. I am thinking that I could use nmap to scan ports 80 and 443 of the entire valid range of IP addresses, and then search the output of that to find out whether it is common textboard/imageboard software. I am fairly proficient in Lua programming (which is the language used by nmap scripting) so that will be a plus. Is nmap a good tool to use or are there better alternatives?

>>10210 You might be able to use nmap but I don't think it'd be very useful. What you want to do is just iterate from ip 0.0.0.0 to 255.255.255.255, minus the one that are private. You'd probably have a better time writing your thing in a language that supports light threads (e.g. Go) or async IO. It'd just be a matter of scanning the output and seeing if part of it matches parts of what's produced by the boards listed here: http://9ch.in/overscript/ . I see two issues with this though, the first being custom imageboard software that is unknown to you and the second boards hosted on VPS that use the "Host:" HTTP header to resolve which site you want to access. You'd probably get a more exhaustive list by connecting to every domain name ever registered but there are far, far more domain names than there are IP addresses.

You are looking for zmap. https://zmap.io/ >ZMap is a fast single packet network scanner designed for Internet-wide network surveys. On a computer with a gigabit connection, ZMap can scan the entire public IPv4 address space in under 45 minutes. With a 10gigE connection and PF_RING, ZMap can scan the IPv4 address space in 5 minutes. You'll want to find all the HTTP and HTTPS servers. To narrow down which ones are imageboards you could try seeing if some common api endpoint exists. For example https://www.lainchan.org/bans.json though you might want to poke around some more. Obviously this will miss imageboards which aren't hosted from the root directory and will miss ones without that api endpoint and might turn up with false positives. These are just some ideas to help you out.

>>10210 >I am thinking that I could use nmap to scan ports 80 and 443 of the entire valid range of IP addresses, and then search the output of that to find out whether it is common textboard/imageboard software. Have you considered Google dorks? Google has already done the whole scanning and analysis thing, all you really need to do is figure out the last part. What would you search in a html file to identify it as a chan? And convert that into a Google query.

>>10216 >>10210 That dorks idea is solid and hasle free. OP just go through the HTML of different Chan's and image boards and look for similarities it shouldn't be that hard at all considering the layouts Also please post results

>>10213 >zmap Oh nice. I remembered something similar which people used to map the entire address range, but couldn't remember the name. Thanks for that. >>10217 >please post results Will do

>>10217 Do you think that the regex ' /.*/ ' would work for many of the sites? I don't think many places other than imageboards use the /something/ notation for boards. Sage for doublepost.

Found something very uninteresting (hence the sage). http://71.227.233.211/ (only port 80 open) references "noodlechan", does this exist?

Here's another. 128.199.177.21 I did reverse DNS but found no result (because cloudflare). This one's name is 314chan/32chan and seems to be reasonably active. The actual domain name seems to be 32ch.org (which is behind cloudflare). In other words I found 32ch's real IP address, thus demonstrating that cloudflare is reasonably useless.

>>10220 made me lol

>>10224 I wonder whether that website actually contains anything, or if it's just misconfigured. According to the HTTP headers it was last modified in 2009, and according to reverse DNS it's just a residential commiecast IP, so I find it rather hard to believe that the owner just left it on for so long without any reason. That's why I posted it.

>>10225 I once found an unprotected home raspberry pi server in my country just laying around with info back from 2015 and never updated again Most people tend to set up this soykaf, get bored and forget about itt

Another. http://178.32.60.166 Seems to be an imageboard about porn. Domain http://porn-chan.com. It's relatively inactive. Apparently this one isn't behind cloudflare.

>>10227 Raspberry pis are especially vulnerable because a lot of normal users leave the default u/p combination of "pi"/"raspberry" and leave SSH on.

Your ISP won't like that. They will contact you and ask you what the fuarrrk are you doing. https://www.youtube.com/watch?v=Hk-21p2m8YY

>>10223 Funny how it foes from mobile-first responsive flatmeme frontpage to plain yellow yotsuba boards.

>>10219 I think that would work, considering all chan use the /blahblah/ type of board distinguishing I have never sued the software you are using but I would assume there is a way to search for sites specific types of things, in that case I would search for things such as >Websites with two '//' with a maximum of four or maybe even five integers in between >The IRC forum system and of course >Websites with a "chan" in the address Here's a random wallpaper for attention too

Not an imageboard in the traditional sense but the only thing of significance which has come up in the last 12 hours. http://217.182.253.11/ (domain: https://magiichan.net/), a site for anime pictures. >>10230 Nah I'm sure I'm fine. I live in a country where ISPs don't give a soykaf if you literally torrent stuff 24/7.

You'll need to setup some sort of static web page so people don't think your trying to hack them or some sort of bot network like internetpolice.us

>>10237 There's so many machines infected with malware that are just scanning the internet creating background noise that OP making a couple requests to port 80 and 443 won't be noticeable. Also, OP is just checking HTTP ports instead of scanning ports, so he's not going to run into any issues with businesses thinking he's trying to hack them. Nobody hacks via a parameter-less GET request. OP, you should also try port 8080.

>>10210 common textboard/imageboard software is 1) garbage, and 2) can be run by any casual retard the sites you want to find, places that might actually be of real actual interest will certainly be running something homespun

>>10241 a string search would be better suited to find sites like these. You don't even need to roll your own scanner to do this. Just get a paid account over at Shodan

>>10242 >using paid services why in the fuarrrk would I do that when I can write my own scanner in 5 minutes with zmap, zgrab and grep?

>>10241 You're posting on an imageboard based on tinyboard and vichan. >real actual interest OP just wants to find obscure imageboards he wouldn't have otherwise found. >>10243 Would you mind posting your list of strings you're looking for? Then we can contribute to it and hopefully produce more results.

>>10247 I haven't had much time to do it properly so right now I'm just downloading the root of port IP of each address and searching for the string "imageboard". That isn't optimal; I will come up with a better solution later.

Found some glitterboy's personal page http://212.47.237.202/, which contains a link to http://nerve.codingneko.com/ (which is an imageboard). This is the first imagbeoard I've found so far which I have not previously heard of. It seems to be reasonably active.

It's not a bad project but be wary of child modeling IBs, some undocumented boards stay that way for a reason.

>>10251 >http://212.47.237.202/ Wtf is wrong with this nigga holy crap. I think I have eye cancer now. This project is interesting as hell OP, I'll be lurking Keep up the good work!

>>10241 >the sites you want to find, places that might actually be of real actual interest will certainly be running something homespun Who do you want to hang out with, people who waste time reinventing wheels nobody cares about or people who setup an off the shelf imageboard and spend the rest of their time doing cool soykaf? >>10243 >why in the fuarrrk would I do that when I can write my own scanner in 5 minutes with zmap, zgrab and grep? Because shodan pulls everything down into a searchable database. With your hacked together solution you need to rescan the whole internet everytime you think of something new to search for.

Are you going to scan IPv6 too? If not I think you should, it could be very interesting (at least statistically).

Oh look I found 8chan's real IP address. http://206.223.147.218/ >>10259 >because xxxx...... Yeah but it costs money and I'm poor. Scanning the whole internet with zmap takes 10 hours only, even with my soykafty internet connection, even with throttling so I can still use my internet connection. >>10266 I don't think my ISP provides that yet.

Dunno what this is. http://169.47.64.24/ it's not an imageboard and it doesn't have a domain name afaik, but it has a copy of 8chan's front page from 2017 for some reason. Heh. Sage for boring post.

Here we go. Another actual imageboard. (I used new search terms which seem to be finding more useful results.) http://100.4.54.33/

Spacechan (pretty sure I've heard of that before): http://164.132.194.22/

>>10277 That one's domain is https://spacechan.xyz >>10276 And this one is just hosted off someone's residential internet, so it could disappear at any moment. This is the kind of really obscure and undocumented soykaf I was looking for.

This is really neat. I am interested what else you'll find.

Found an imageboard which appears to be broken (blank page). http://37.233.99.98 domain http://perch.perch.p3.tiktalik.io

What about kelly chan? https://mewch.net

ive been thinking about running a reskinned clone of lainchan from my laptop as an easter egg for the rare handful of people that are likely to find it. i could use my phone to host it at that point but android is not kind to things that run all the time

>>10296 With all the shiIIing they do, they're hardly obscure. >>10302 I don't think anyone will find it unless you set up port forwarding or connect it directly to the internet. Hosting something behind a NAT without performing additional configuration is patchy and unreliable at best.

milchan (zeronet) http://127.0.0.1:43110/1ADQAHsqsie5PBeQhQgjcKmUu3qdPFg6aA/

Found another one. http://95.216.3.168/vichan/sidebar.html Domain: https://anmon.pw Run by a bunch adherents to some faggy obscure political ideology.

Another. http://37.186.11.144/tb/chan Not really a traditional imageboard; more like a textboard.

http://205.185.124.121/ Fapchan - porn ib using lynxchan. Fairly active.

>>10343 Everyone's heard of that.

>>10253 oh, looks like you found my chat, it's not exactly an imageboard tho, more like a chat, but yeah, loved your soykafposts m9, also, my personal website does not contain any links to Nerve itself, it contains a link to the GitHub repo (https://github.com/codingneko/nerve), which contains a link to Nerve. and you could've deduced my personal site's domain name... http://codingneko.com

>>10347 why did I tag that post? meant to tag >>10251 pardon my autism

>>10339 The tree structure of this one is neat.

>>10305 thats the idea. its local only. its intended for the proud few people who both know how to and regularly do portscan the most common ports on all the computers on their network. would have to check if my university isolates every client from each other though

Finnish imageboard Loistolauta. http://81.4.104.200/

>>10278 >And this one is just hosted off someone's residential internet, so it could disappear at any moment. This is the kind of really obscure and undocumented soykaf I was looking for. It's disappeared now. Maybe their IP changed or they noticed the posts and took it down.

>>10370 I wonder if I will ever find it again. I've changed to doing slow scans (~10Kp/s) on a loop, because fast scans slow down my internet connection and don't yield many results because there's no time for the remote server to respond. So if it ever comes up again I'll know within a week.

>>10371 I am bumping to show my support. Anything you find should be added to existing chan list: http://allchans.org/ Ed has a decent list too. I keep wishing someone would write a little chan RSS reader so I can keep an eye on the more obscure ones. I used to pop in to some of the weirder ones to see what was going on.

>>10374 >chan RSS reader That cannot exist; most imageboards don't have any RSS capabilities. You need a custom reader which downloads JSON from the imageboard (most major IB software have JSON APIs) and displays the list of threads. If you are interested I think I could write one in a day or two; sounds like a rather easy project actually.

>>10378 I think that's what he was suggesting.

>>10278 Another thing, inside the site they have a board dedicated to another chan refugees, http://bunkerchan.xyz/ Just another one to add to the list in case you might miss

>>10381 >dedicated to another chan refugees Looks like a leftist chan in disguise though

>>10383 Do you have a point or just trying to stir sh¡t up as usual?

>>10384 You sound rather unjustifiably annoyed, why is that?. I simply wished to note down the content of that imageboard, just like I have done for every time I posted my own links in this thread.

http://50.116.0.201/ is a Brazilian imageboard. On their front page it says that non-Brazilian IPs are derezzed. Anyone from brazil here who can go in and look?

3-thread imageboard programmed by some russian http://87.252.241.43

>>10210 Speaking of scanning the web. Is there a way to scan/crawl the web for certain keywords?

>>10417 zmap -p 80 -r 10000 | zgrab --port 80 --http="/" 2>/dev/null | grep -Ei "(search term 1|search term 2|search term 3)" >results.json That will scan port 80 of every website for your search terms. Keep in mind that with 10 Kp/s you will take around 5 days to scan the internet, and you need to do so two or three times to make absolutely sure that you get all the search terms. If you had better internet than mine you could get it done a lot faster. 10 Kp/s is fairly low, I use that number because I need to use my internet connection for other things.

>>10412 I'm brazillian and even I cannot access through this IP. Try their domain: https://dogolachan.org right now they are allowing IP's from VPN's, Portugal, France and Japan. This ib is not that small, and has a history of mentally ill people doing crazy soykaf. One of the owners recently was taken into custody by the police, the same man that made bomb threats in the USA; that uploaded a vlog on youtube (and shared it on Facebook, and mind you, he was showing his face and name the whole time) advocating that a father should rape his daughter for it is his right to do so; he also raids a brazillian feminist with death and rape threats so much and for so long, that the politicians enacted a law criminalising internet mysogyny, especifically; and the list goes on and on.

>>10419 Off topic, but in Brazil does "alt-right" mean National Socialist or just the type of dribbling trump supporter of Kampfy-era 8 ⁄pol⁄, like american alt-right?

Ticklechan http://185.176.41.161/ Domain: http://ticklechan.biz The board list layout is a copy of 4chan, but the actual post contents aren't.

>>10422 They like to think it's the first option, but in reality they act more like neo nazis: hate niggers, hate women, hate people from the northwest of our contry, hate muslims, hate everything. So I'm not sure where they fit amongst your definition. Oh, I just remembered this http://www.wikinet.pro/wiki/Anexo:Lista_de_chans_brasileiros_ativos

>>10423 >ticklechan Sounds a bit shifty

Found a sh​itty 8chan ripoff dedicated to cryptocurrencies. http://54.38.50.137/ Board creation and posting works. Of the listed boards on the front page, only /gen/ seems to exist. Probably abandoned.

Tounsi. Seems to be broken. Hosted in the netherlands http://188.226.190.107/ If you go to tounsi/b/ and try to make a post, "post.php" is not found. You need to modify the form so that the action attribute is set to "/post.php" instead.

>>10418 Thanks a lot, I'll try that.

chan.parrot.coffee

Samachan: http://45.55.150.132/ (domain name https://samachan.org/) Focus on anime; fairly active.

>>10210 I like your idea, I scan the internet fairly often and have set up dedicated scanners to do this. i use masscan to do this and have an irc bot you can use to do the initial scanning ssl://irc.blackcatz.org:6697/#blackcatz

Found another imageboard today. UBChan http://35.203.138.207 Domain: https://ubchan.com One board, is fairly inactive but not dead either.

Can you find even everyone on ipv4? ipv6 is supposedly a decent hiding place due to the large range, not yet perfect because most of the net is clustered in a small space.

>>10594 *with ipv4 alone

>>10594 Finding everyone is impossible due to virtual hosts. There could be multiple websites hosted from a single IP.

>>10596 i was just wondering if some could only be found over ipv6 and thus a ipv4 search would make you blind to them. The issue you mention would be there either way of course.

>>10596 You can counteract that with DNS recon and Vhost bruteforcing. To some degree. Bruteforcing would likely knock over a small chan server though.

Nmap for scanning the internet is not effective. Masscan is the way to go, Nmap will take you a fuarrrking eternity to scan the net. Even doing it with Masscan will take a few days to a week.

>>10646 IIRC masscan has some issues that makes it miss stuff. Nmap author gave an explanation of it at one point. As far as I know the limit on scanning speed is more about IO/bandwidth/threads than it is about what you are asking. From what I recall, mass scan relies on ping scans or something that are often ignored. In my experience hosts need a little love to give up the magic, so a simple scan often isn't enough. I would use a botnet or a cluster to get this done.

OP, how are you going to handle IBs behind virtual hosts? Could you write a script to rdns any hosts that seem like they're behind a virtual host?What about subdomains?

>>10662 Not the op, but you can always do rdns, dns dumpster, and bruteforcing. Subdomains are really the exact same problem.

Mychan http://185.62.136.138/ It's basically dead.

>>10662 nerve.codingneko.com is a subdomain, AND a virtual host on the same server as codingneko.com and he still found it so I believe he has that sorted out already.

touhou music imageboard http://151.80.40.155:81/ No domain name, not active but not totally dead either. Hosted on a residential internet connection.

Another touhou imageboard. http://voile.gensokyo.org Reasonably active. IP: 70.40.202.40; if you visit it the website is http://gensokyo.org

>>10374 Another big list of imageboards: https://github.com/ccd0/imageboards.json

>>10781 This would be really really cool to write a spam-bot and supply it with this. I bet you could get some really good advertising in.

>>10800 probably most of the boards are either actively moderated, dead and nobody will see your spam, or require capcha.

http://pastebin.com/raw/HNp6NuSA This was posted on 4ch by someone a while back.

Have you found anything else?

>>11626 I have stopped my scanning because it was eating my bandwidth. so i guess not.

>>10276 > http://100.4.54.33/ Someone's hosting their anime episodes on there lmao

>>11748 Mind share with us your tools or how you did it? Someone probably can keep it going

>>10338 Hahaha you absolute dolt anmon isnt a real thing we're just a brewing soykaf insider trade

try using leviathan, can port scan entire countries worth of IPs

>>10807 I just went through 10 random boards on the list. 1 was active, 1 was dying and 8 were so dead spam bots stopped posting there 4 years ago. I did leave some posts behind though. Thinking of writing up some code to check periodically if someone else stumbles into one of these boards.

>>12535 >Thinking of writing up some code to check periodically if someone else stumbles into one of these boards. Is there any good imageboard aggregation software out there? I'm pretty sure it exists but I've never used it. Seems like it'd be easy to make since most of these boards use the same handful of upstream backends. There really should be a standard. I'm still sad nobody uses RSS any more.

>>12536 Not that I know of unfortunately. I was thinking of just diff-ing the pages or something similar. It's a shame rss is no longer a primary concern for a lot of websites, I still use it daily.

How do those mewch spamposts end up on every single obscure board hosted from home toasters? Some of them aren't even in any overchan lists. Holy streef. >that feel when we will no longer be able to find cool places on Internet this way once ipv6 gets fully adopted

Overchans usually list IBs, boorus and textboards, anything directly related to anonymous culture only. What about SSH, Telnet and Gopher BBSes, or more conventional web forums that are not friggin R*ddit [/spoiler]Btw, do such lists exist for English-language forums?[/spoiler]

>>12862 >gopher chans Pretty unintuitive to use in my experience. But very, very cool nonetheless. Same with SSH or telnet BBSs

I'm working on an imageboard that's not quite ready for public use. The website is set up so it's [domain]/[name]chan/ rather than just [domain]. Have I inadvertently saved myself from embarrassment by setting it up like this?

>>12880 I also thought that mapping IRC servers with their chatrooms, Jabber network and public mailing lists, basically anything that's free as in liberty, not corporate and centralized would be nice to understand the ways to escape this electronic concentration camp. >>12881 Hosting chans for sake of hosting is kinda dum-dum imo. A chan should be attached to some theme or culture with base audience, unless it serves as your personal site guestbook which is fine too and shouldn't end up on this list.

http://allchans.org/ :]

This is probably the most updated list so far: https://github.com/ccd0/imageboards.json Here are two threads on other boards I found concerning anonymous board archaeology: http://4-ch.net/iaa/kareha.pl/1439333638/ http://afternoon.dynu.com/read/1453819488 It's dead, Jim. It's all dead.

A year ago here somebody dumped a list of non-english boards, anyone have that thread saved?

>>10251 does anyone else wanna try the puzzle? There's a commented hint when you inspect the page and it looks like it checks whatever you input against a hash. I tried radium, polonium, pitchblende, tobernite, and chalcolite, with and without the first letter capitalized.

>>10302 >lainchan it's so fuarrrking hard to get the board software up and running. Just write your own software vichan is a rotting pile of garbage.

Do you guys remember those two ssh boards? I can't recall what the addresses are, but those were great.

Einchan.god.jp was one of them, though it doesn't seem to be up. Any one know another address for it? Can't remember the second board.

>>14161 >>14158 einchan.blue whisper.onthewifi.com

>>14164 Is einchan down right now?

>>14165 my bad its ein.blue , its up.

Besides 2ch and 5ch, what other Japanese oriented boards exist?

>>15017 http://xn--u8jm6cyd8028a.net/ some kind of hotgluing imageboard? pretty gross, don't know why i have it bookmarked but here you go excuse the url, i think its supposed to be written in japanese but it comes out like this

>>15020 Set IDN punycode to disabled using about:config. The developers disabled it for the layman’s safety. It should show the URL in Japanese.

>>10218 You're thinking of masscan

>>15020 Very lewd site

I made a list of nearly a hundred here https://heyuri.cf/view.php?key=nwCq63BDMt

>>10675 I can't connect

>chan RSS reader I am using one. Not only for chans, but for basically everything. Learn to scrap html.

>>15045 Never knew about that about:config option, that's pretty cool. As for the overall thread: this is an awesome project, I'd love to see people contribute to this even more. I'll try to set something up when I get home. I'm not only looking for imageboards tho, I would love to find textboards and kareha installs.

>>15020 The thread of the guy that came on the anime beachballs made me laugh.

>>17227 sometimes i wonder why textboards don't get that much love in english speaking world...

>>13921 no need to even do that... there's enough software coming out all the time... just find one that's old enough that the chances of abandoning it by dev team is lower... install it, have fun.

>>15020 >pretty gross, don't know why i have it bookmarked but here you go Nah, seems pretty tame to me, just some lonely guys jacking off onto some anime figures, I'll click around on that site some more OH JESUS CHRIST *THAT* IS GROSS. Shame on me for clicking, though. You did warn us, I can't blame you for this.

>>17234 Most people are not good readers. They want visuals, they want sound, and will not take another option.