/tech/ - Technology★

I'd understand if it was over I2p with this kind of approach, but clearnet and aws? This must be bait.

Basically, this is what will happen:

>someone posts CP

>everyone automatically downloads it and gets vanned

>>841250

it's just hosted on aws for testing, in a full scale deployment an admin could host it on whatever

Sounds alright enough even though I wish I could do this with a normal torrent client instead of just having my browser become an unregulated client.

The idea to let votes decide what to show and what not is a bad idea however.

>>841250

>gets vanned

Challenge accepted.

>>841247 (OP)

I really love this idea.

Previously I thought you would need a decentralized clear net website which allows newfags to connect sort of like what gnu social/mastodon does, but you seem to solve this differently, nj anon.

>put strict limits on file size & type webm/webp/pdf because otherwise it's going to be slow af

>make sure their is no duplication so if a image is already downloaded and uploaded in another post it doesn't redownload.

<Question how does the webtorrent work? Do I have to stay on the page to seed, or does it continue to seed after I leave? how can you make sure you have a healthy network?

>>841250

That's not how this would work presumably their would be some sort of moderation system so just like how if someone posted cp on any platform and someone downloaded it by accident before a mod was able to take it down you wouldn't be held liable.

Why even bother with images anyway. Plain text is enough.

I'll play around with it as soon as I figure out how to get Firefox to use any fucking XHR at all.

>their

>their

>their

This is a nice way to spot a native speaker who skipped his English classes.

>>841302

I'm sleepy anon.

>>841304

I wouldn't do that even if I was asleep t: not native english speaker

>>841247 (OP)

Great concept but it's a little buggy.

>>841308

kek. I'm sure I wouldn't be misspelling much in asleep either, speaking of which I'm off to bed.

>>841247 (OP)

I just realized something, wouldn't this make it ez af to dox people?

>>841311

>in asleep

goddamn kill me lel

>>841311

Are the posts actually tied to IPs? I doubt they are because that would be really stupid. Imageboards struggle with P2P because imageboards weren't designed to be immutable, so maybe there is an IP/post link. In that case, a simple hashing of the IP would be in order and solve most of your problems.

Other than that, you'd only be able to correlate IPs to posts if you were the first person to see the post, and thus you saw the IP of the original poster. Even so, could you really be sure it was actually the poster and not someone else who happened to be seeding it alone? It would require being there the moment the post was made for each post and, while it might be possible, I wouldn't exactly call that easy.

ITT: we make life easier to enforcement agencies and media monopolies by making imageboards vulnerable to MAFIAA attacks.

You need something else than torrent for this to work. Maybe a Tor-like protocol where a download may ask to be hopped through several other clients or not, but the payload is encrypted an arbitrary number of times to simulate several hops even if it's a direct download.

Like:

>You broadcast to your peers "hey, I want file X! Does anybody have file X?"

>If any of your peers have it, it sends random data to some of its other peers just to simulate data transfers, then sends it to you.

>If they don't, they broadcast the same message

>The program is continuously simulating high bandwidth usage after these reqests with some random peers to be able to deny where did a download exactly came from

>Files should be encrypted and scrambled, then separated in multiple parts so peers don't have to store the whole file and can't be held liable for distributing illegal content. If parts can be small and identified by a hash so several files may share the same parts, even better

>>841324

OP wants to make hosting easier not go full lockdown. One step at a time anon

or just do it yourself :^)

I think this would be a WAY better idea if you just focused on p2p hosting the media instead of the entire imageboard. You could have a much larger impact on strengthening imageboard communities if you found a way to squeeze Webtorrent or js-ipfs into vichan, or even just into OpenIB. We have immutable, decentralized imageboards now, but what we need is to reinforce the ones we use now.

>>841338

I'm not saying it's not a perfect idea, I'm saying it is a terrible idea. I am all for small but significant steps, but this is a significant step in the wrong direction, unless getting caught is part of your plan.

With this shit, you can profile who visited certain threads with ease, and with some resources, when, or even the original poster. That's a terrible idea and should be reworked as soon as possible, unless you want the feds knocking on your door for distributing CP because some funny guy decided to post it in a thread you were watching.

>>841250

>>everyone gets vanned

Why am I laughing so much?

>>841455

Because “The 4chan Party Van” actually sounds like a really fun time.

>>841295

Because images are what creates issues with hosting costs. It doesn't cost anything to host a text only board.

>>841291

yeah you are only seeding while you have the page open, as soon as you close the tab its gone unless someone else got it. The idea is that after a certain point there would always be someone on the website so posts wouldn't disappear. Getting people to use the site until that point would be the main challenge.

>>841301

let me know how that goes, I did most of my testing in chromium

>>841309

appreciate the feedback, and yeah most of the bugs come from the fact that the backend is hot garbage right now cause I just slapped it together

>>841315

posts aren't tied to an ip, they just are a magnet link. however since the way you are connecting to others, just like a torrent your ip is exposed when you are seeding.

>>841324

this actually would be possible since you could modify the way webtorrent uses webRTC to get a similar functionality. It would get slower though.

>>841339

I actually really like this idea, and I think it makes sense since I don't have to completely rewrite the whole imageboard. I'm probably gonna look into this next.

>>841379

the purpose of the post rating system would be to mitigate this. A post below a certain threshold would be hidden by default and not downloaded.

and thanks again to everyone who checked it out!

>>841462

Mario kart ftw

>>841557

sleepy anon here.

I was also running on firefox. captcha worked on third attempt. Image and text loaded fine although it was quite slow. (if this was a firefox issue sorry for talking so much about network health)

I know this sort of defeats the purpose a little bit but webtorrent does have support for webseeds so if you or someone else automatically made a webseed you could have reasonable performance until there are enough users.

A similar pretty easy to implement and more decentralized alternative would be to have a rss feed of all magnet links so that users could automatically seed using rutorrent as posts occur.

>>841606

Or you could use a fake user that's actually just a torrent client seeding all images from all threads.

>>841637

I'm not quite sure what you mean by this. I guess you could as a individual scrape the site and automatically seed the torrents if that's what you mean. Probably wouldn't be that much to demand of users although it is a little more than just having a rss link people can copy/paste into rutorrent and have automatically seed everything.

Funny, I'm looking into booru-like boards because I'm tired of every damn one of the existing one missing the most obvious and simple features one can think of. I had been thinking of, God willing, do something that doesn't use any js, but your idea is interesting. But I don't know how sites with persistent images like boorus compare with imageboards with temporary images.

While I'm at it, might as well ask about a couple of topics I haven't looked into it yet: image duplicate finders, and possibly image recognition software so it can tell resized versions of the same pic. The former are trivial, tho I don't know what's the favored software by imageboards. The former, I have absolutely no idea. Any knowledge to impart?

>>841324

>Maybe a Tor-like protocol where a download may ask to be hopped through several other clients or not, but the payload is encrypted an arbitrary number of times to simulate several hops even if it's a direct download.

I wonder about the viability of doing this to stealthily off-load the image hosting onto Imgur or the like.

>>841675

Image duplication is usually solved by just comparing hashes of images. To do this visually you just need more advanced hashing algorithms libraries or programs. There are quite a few of these.

https://en.wikipedia.org/wiki/Perceptual_hashing

>>841684

Wait, you can tell which pics are similar by comparing hashes? I thought the whole point was to create a ridiculously and rather unpredictably different hash even if you alter just a single pixel.

>>841649

I tried to suggest that a site admin could run a seedbox like this to keep his site alive when there are not enough users online.

>>841697

It's a specially spooky type of hash.

>Perceptual hash functions are analogous if features are similar, whereas cryptographic hashing relies on the avalanche effect of a small change in input value creating a drastic change in output value.

>>841697

oh cool. I dig it.

>>841557

So saging is what happens when people stop seeding? This isn't a bad idea.

>>841324

You sound like you have no idea what you're talking about.

>>841339

This 100%. I don't think hosting text is the issue, its the thousands of blob files. Plus, rewriting the entire imageboard software and having sites like 8ch and 4chan adopt it is very ambitious. On the other hand, creating p2p software that plugs in to what already exists seems more reasonable.

>>841695

If you want unique inputs to be the exact image it would be different if you changed just a pixel. In certain cases, you might define an image to be the same because just a single pixel being different doesn't really make it a unique image.

>>841247 (OP)

why don't use ipfs instead?

>>841695

Usually that's the case, but perceptual hashes want the opposite. They're badly named.

>>841831

Isn't the whole point of ipfs to have a immutable web, that seems to be the opposite of what a image board would want.

Also you'd need a browser extension to access ipfs.

>>841930

Ipfs has a p2p library that can be used to share the hash of new posts and such.

https://github.com/libp2p/js-libp2p

why not just use embedding of images hosted on another site in addition to the textboard? preferably with tiny thumbnails and click to open/straight up link

>>841934

That's awesome!

>>841247 (OP)

>Imageboards have always had issues with hosting costs since they end up transferring so much data.

>transferring so much data

Don't use megabytes of javascript or just create a desktop/mobile client for it so people only have to download and update the most minimal amount of text.

If you really want a web client make it a single-page thing, and host it somewhere else.

>webtorrent

No! Fucking make a desktop/mobile client.

>>841339

this is a good idea. have users individually decide for single files wether they're going to share them, this way cp won't be as big of a problem

>>841250

this

>>841274

>Challenge accepted.

this

While you're at it, OP, try to implement some layers of native darknet or deepsec on that new torrent imageboard. It's the only way to do it op, and maybe. just maybe, those time travelers will have courage to post another disclosure since all imageboards (if not) and clearnet connections are currently compromised or compromisable and jeopardizes them.

remember when proxies were enough opsec?

>>841953

>being clinically retarded

lol

>>841930

Immutable is not "see everything, both good and bad, forever." Look at what NNTPchan does. Just because every post is technically visible doesn't mean you can't hide them or refuse to host them. This also assumes that you are decentralizing the entire thing and not just using it to offload your bandwidth-heavy media hosting onto your clients. Obviously you'd still have moderators blacklisting and deleting any CP if the setup is centralized or federated.

I also don't think it would be feasible to host CP on IPFS just like it isn't feasible to host it with torrents. There has been no security audit for IPFS through Tor; and js-ipfs uses (among other things) WebRTC, which is more likely to leak a CP poster's IP than reliably host their content. Plus you have to consider that js-ipfs will not cache forever and will stop hosting once you close all the site's tabs.

This may give you the impression that it wouldn't do a whole lot to benefit this site, but adding something like this to 8chan is more enthusiast-oriented: The idea is for people to volunteer to host their pictures folders through go-ipfs, a js-ipfs browser addon, or a more user-friendly GUI running on top of IPFS. Plus, how often do you browse this site for a couple minutes and then turn it off? How many tabs do you have open here right now, and how long have they been open?

>>841677

The burden on the hop networks would be far greater than the benefits that Imgur hosting would provide, and they're getting more aggressive about shutting down people using them for serving images.