[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]

/g/ - Technology

Make /g/ Great Again
Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options
dicesidesmodifier

Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf
Max filesize is16 MB.
Max image dimensions are15000 x15000.
You may upload5 per post.


File: df81a1f3a53e85c⋯.gif (72.12 KB,896x1160,112:145,scaled85pc.gif)

 No.11260

Are any of you faggots gonna create an 8kun archive, or atleast a thread/image downloader?

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.11266

>>11260

You can make it yourself.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.11270

>>11260

Just alter the URL from 8chan to 8kun with what's already out there anon, it ain't rocket science.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.11271

>>11266

I'm too retarded to even figuring out bash, how the fuck will i be able to cope with python or other scripting languages?

>>11270

I've looked, sadly couldn't find anything that works.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.11306

you could probably find one made for 8chan and just change the host name

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.11762

>>11260

Not if you call me a faggot, you glowing niggger.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12329

>>11260

literally this easy.

#./downloader.bash threadURL

curl $1 | egrep -o "\/file_store\/[a-z0-9]{64}.[a-zA-Z]{3,4}" | sed "s/^/http:\/\/media.8kun.top/g" | sort | uniq | xargs wget

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12341

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12521

I created a thread downloader in Python 3 specifically for 8kun just now: https://pastebin.com/raw/fAVnFR6T

 Usage: python3 8kun.py https://8kun.top/board/res/thread.html 

It will automatically download every file from the thread into an 8kun folder. It works with Tor too. I wrote it quickly so it might have a few bugs. It could definitely be improved to be more robust and feature-rich but it werks. I would appreciate any feedback on the code, I'm not that experienced.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12523

>>11260

Download all images from a thread:


wget -nd -nc -r -l 1 -H -e robots=off -D 8kun.top,media.8kun.top -A png,gif,jpg,jpeg,webm http://8kun.top/url/to/thread.html

-nd tells wget not to create a whole new folder, if you want that you can, iirc use -p foldername

-nc tells it not to overwrite files that are already there

-r means recursive

-l NUMBER are how many levels of links it follows on the page in question

-H is span hosts

-e robots=off tells it not to follow the robots.txt, don't know if that is even needed on 8kun

-D is the domains you're working with, obviously. 8kun has images hosted on a different subdomain so just following links to 8kun.top won't get you the images.

-A is the formats that will be downloaded

You can alter it for different imageboards too. If some site doesn't want to comply you can add arbitrary shit like some commonly used user agent and waits:


--user-agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:21.0) Gecko/20100101 Firefox/21.0" --random-wait --limit-rate=1M

to make it seem more natural. Of course this didn't work while vanwanet was going, but after they changed it to be less obnoxious is works well again.

You could probably make it ignore thumbnails somehow, but honestly, it's easier to just remove them manually afterwards, they are pretty obvious due to their small file size, some imageboards even prefix them with somethin like

t_ which makes it even easier.

Also there is a really good tool called httrack to download whole websites and create local mirrors, you may also try that.

When it comes to archiving whole pages, always pay attention to the recursion levels, as most sites use tons of external stuff like scripts from cdns. 8kun not so much, but you still will not want whatever tool you use to follow every damn link which at some point would lead to downloading the whole fucking internet if you don't put a limit to it, either by defining the number of allowed recursion or by limiting to domains, or both.

On imageboards in particular it's annoying when your download tool probes all the links to other boards first. They're at the top of the page so they're processed first.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12538

File: 1419caf8df90ced⋯.png (460.39 KB,1024x768,4:3,disc_jin.png)

https://pastebin.com/qWWe4UmB

make sure to be the biggest ingreat as possible and piss every one off.

kisses.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12572

>>12341

>rust

sjw nigger, you advocate bloat.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

 No.12575

>>12341

Kill yourself, sjw soy drinker.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



[Return][Go to top][Catalog][Nerve Center][Random][Post a Reply]
Delete Post [ ]
[]
[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]