No.13705
The command-line tool `wget` is pretty powerful if you know how to use it properly, as it has loads of flags…
Say, for example you wanted to download an entire 8kun board onto your local machine and have all the links work within, locally. More difficult than just `wget https://8kun.top/freedomzine/` or something idiotic like that, because it would only grab the front page .html, not the Catalog, or any of the threads, blah blah. If you do a -r flag it will go recursively, but what a can of worms that would open up! I don't feel like going into all the parameters of what it is I would do and why, you can research for yourself, but I will touch on the only concern I have at this time, which is that, while I have written a nice script for this kind of activity, and I can get all the goodies like the CSS and internal links working locally, I want to keep it at the board level and not download the entire fucking 8kun site, but I do want the pictures, which are at a higher level, in https://8kun.top/files/* (which sucks for snagging just the images associated with one board.) Nonetheless, check out this script, lads… So far I have only tested it on a tiny board: >>>/wethepatriots/ and it works nicely. FYI, running this script on that board at this time will download only 1.8 MB, so it's a nice test.
I rate-limited it so VanwaFuck would not think I'm an attacker, and made myself look like I'm a Firefox browser making browser requests every 5 seconds. I guess I could have done a `random-wait` instead… The script is a work in progress. I also don't think `no-clobber` and `convert-links` will work very well together, as `convert-links` will supercede, depending on the circumstances. I'm rambling… Here's the script:
```
wget \
–recursive \
–no-clobber \
–page-requisites \
–html-extension \
–convert-links \
–restrict-file-names=unix \
–domains 8kun.top \
–wait=5 \
–limit-rate=20K \
–user-agent=Mozilla \
–level=10 \
–output-file /home/anon/test/activity.txt \
–no-parent \
https://8kun.top/wethepatriots/ &
```
you can do a `tail -f activity.txt` in another terminal to see wtf is happening after you make that command…
This is assuming you have made a Directory in your Home Folder called `test`, that your username is `anon`, and that you are running this command in a terminal inside that `test` folder…
Read the Code! Don't just copy/paste!
But yeah, if any anons have an idea for a simple way I can snag all the images for just one board and have the links work locally,hook me up!
Otherwise, clicking on a thumbnail or image link will take you to https://8kun/top/files/* and that just plain isn't very local! I'm sure a Python script could work, but I was hoping for a simple `wget` solution.ANY IDEAS?
>inb4 kys
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13706
>>13705
>I guess I could have done a `random-wait` instead… The script is a work in progress. I also don't think `no-clobber` and `convert-links` will work very well together, as `convert-links` will supercede, depending on the circumstances
8kun-formatting fucked up that whole sentence; purple-texting the fuck out of it, instead of putting the double dashes in where I put them, but you get the idea…
It also fucked up the script: (the formatting turned the double "-" "-"s into an emdash "–"), so be sure to put 2 "-"s instead of the emdashes, which are not the same character)
I had a feeling about the purple-text, but at least it translated the code correctly (except for the emdash thing). You could run that code as is by changing those emdashes into two dashes, inserting your own username, and making a `test` directory in /home/
>inb4 that board gains more popularity than it warrants!
Also, gonna check the settings on this board, as I thought I could put code-blocks in here without the formatting messing with the stuff inside the code-block…
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13707
There's another thread about this here:
>>>/tech/1086085
< because OP is a fag
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13722
Whelp! That script works really nice for grabbing any 8un board and storing it locally. I modified the code and ended up with a really nice local copy of >>>/freedomzine/ in a folder called `FreedomZine-wget`. Inside went 343 files in (15 Subfolders) and the entire board was only 34.6 MB as it is right now, if you want to run the script yourself. I may slap it up as a backup somewhere, considering I do not see this place continuing for much longer… As for the images, only the thumbs work locally, as they call on a higher level at 8kun.top/file_store/*, so if you really care about any images here, you know what to do… but yeah this script works pretty nice. You don't have to go 17 levels deep though, lol! I just have 17 pages on this board and wanted to make sure it got 'em all… The wait and limit-rate flags aren't fully necessary either, but you don't wanna get VanwaFucked either, amirite?
Don't forget what I said in >>13706 about changing the emdashes in the following code-block into two dashes… Frickin' 8kun-formatting…
HERE BE THE SCRIPT:
```
wget \
–recursive \
–no-clobber \
–page-requisites \
–html-extension \
–convert-links \
–restrict-file-names=unix \
–domains 8kun.top \
–wait=3 \
–limit-rate=44K \
–user-agent=Mozilla \
–level=17 \
–output-file /home/anon/FreedomZine-wget/activity.txt \
–no-parent \
https://8kun.top/freedomzine/ &
```
Where `anon` is your username, `FreedomZine-wget` is a folder in your /home/ directory (you can call it what you want), and `freedomzine` is the 8kun board you are downloading locally. Again, this will work with any 8kun board. Just subsitute that board-name.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13723
>>13722
Works Good.
Doesn't look done without running `tail - f activity.txt` in another terminal though, so you can see what it's up to. It doesn't take that long. You can add a -c flag for continue if your connection gets whacked during. Also why the no-clobber, which helps on re-runs too.
You're gonna like this script, Killcen!
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13726
> inb4 "Johnny Neptune" is too stupid to read the tea leaves, the writing on the wall, as it were, that this thread actually implies…
< "Imblying?"
Implying what?
> Web-Get
If it quacks like a duck…
it ain't a "stay wild cat".
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13727
>>13726
Also,"I'm Sorry."
> .mp4 related
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13794
Well, I don't have a Security Certificate for it yet, but one is on its way!
So sorry, no https:// address yet, butHere is the 8kun.top/freedomzine/ Offline Backup Copy / Clone I snagged with the above code…
http://freedomzine.42web.io
ENJOY!
As you can see, it works pretty well, considering…
I mean, for an offline copy.
That I put back online!
Just playing here….
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13795
>>13794
That would be a bigYES!
I pulled that off! Got a Security Certificate:
GO CHECK IT OUT:
https://freedomzine.42web.io/
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13796
>>13794
>>13795
Anyway, it kinda takes Killcen's Archive Links to a whole nother level!
And sub-domains can be added also, that would be whole separate websites (unless various links were established); say, for example Killcen wanted to document his end-of-the-world archive-link extravaganza, I could register one called https://freedomzine.cllik.42web.io/ which looks nice forward and backward, and he would have his own website.
I don't know if Killcen still does Beaker Browser; but the new one just came out three days ago, and it's really nice, especially for sharing files P2P. I've tried it on several platforms. They changed from the dat:// protocol to the hyper:// protocol last version upgrade.
DAT is still good, but has nothing to do with DIS, Penelope…
DIS IS About Learning While Archiving. I too am archiving. Will be dumping shit in obscure locations, kinda no better than Johnny in that regard, or in any other regard, compared to anybody, for that matter; but JN likes to pretend there are "others" who think they are 'better than' …
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13817
Guess I should have archived it! I'll find a less evil solution than the hoster I snagged last night, who took down the site due to some fucking Karen. Didn't even last half a day….
Speaking of Archives, I tried out the Wayback Machine again. It appears to work:
https://web.archive.org/web/20201213200615/https://8kun.top/freedomzine/res/13705.html
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13823
>>13817
You must be unaware of how mass censorship is being used as a weaponized tactic now by the establishment because truth be told we are in a civil war RIGHT NOW, and it hasn't even begun getting hot yet. So yes, they're DDoSing anyone who is speaking TRUTH these days, full blown purging underway NOW!
And this has only begun, the next step is shutting down people on the ISP level, and then having mobile death squads targeting those speaking the TRUTH in public.
Seriously. This is no longer a game anymore. People are being killed behind the scenes, it's gettting NASTY.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13824
>>13817
Today Johnny informed me that they intend on killing people like you and me, very soon. They will use government to do it too. Let that sink in.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13914
>>13824
>Today Johnny informed me that they intend on killing people like you and me, very soon. They will use government to do it too. Let that sink in.
Lucky for me, I don't identify as something that can be killed; nor do I try to escape the inevitable.
There Are No Dancers — Just the Dance
And we'll all be dancing that last song… together at last…>>13824
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13920
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13921
>>13824
Nobody said anything about killing you…
You're simply going to be swept up in a giant wave of arrests, and tossed into a military prison without formal charges, with no habeas corpus
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13922
Whenever you want people to perceive you as being an 'elightened, all-knowing wise man', simply use word circles…
Words circles dazzle uneducated idiots….
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13923
By using primal rhetorical empty words circles, you can trick stupid people into thinking you had some deep meaning behind your idiotic words.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13924
It works best on uneducated adults….
Because even the average third grade child is intelligent enough to realize your words circles have said NOTHING
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13925
using empty meaningless words circles makes some people feel 10 ft tall…
Overcompensation
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13926
>>13705
So, in other words……
You still spend your days jumping backwards through hoops of fire, desperately trying to defeat Johnny Neptune from turning your imageboard into a toilet?…..
This is what you've been working on while Nancy has to go clock in at the pharmacy and spent 8 hours on her feet?…..
REALLY??
No wonder she's disgusted… Why don't you go get a REAL JOB ???!!!!!
Pull yourself up out of that sunken in chair, get on your feet like a real man, AND GO GET A FUCKINGJOB!!!!!!!
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13927
>>13705
bad news……
Your board was a toilet long before Neptune ever stumbled in here….
You begged him and begged him and begged him to please come visit your board…
And when he finally honored your request, he discovered you had one of the most boring toilets on the internet…
What did you expect him to do with a toilet?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13928
I'm detecting a big TEMPER TANTRUM TONIGHT
Somebody's going to lash out because he's frustrated again….
When Nancy gets off work, her feet are going to hurt, and she's not going to be interested in any of your bullshit boringWGETconversation
And you're going to throw another temper tantrum, in a futile effort to exert control over the woman who earns three times as much as you do.
(although the term EARN isn't technically correct for a comparison between you and Nancy, because you don't actually EARN your government welfare disability benefits)
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13929
>>13705
> I'm rambling
We got used to that years ago
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13930
I can't even imagine what it must be like to be Nancy, and coming home from work everyday, and having to listen to you Rant, Ramble & Vent about your boring computer coding nonsense, well aware that you are simply using childish distraction techniques, trying to prevent her from realizing that you are literally wasting her existence…
Poor Nancy !!!
Certainly, there's a more eligible companion for Nancy within walking distance of her mother's house….
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13931
Today is December 15th… And now it's painfully clear for you….
Things didn't go 'your way' this year…..
Better luck in 2028
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13932
nobody gives a fuck about your boring coding nonsense….
Not Killcen
Not Me
And NOT NANCY
get a JOB, you mooch !!
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13933
dear lord, we all feel SO SORRY for poor nancy…
YOU'VE GOTZERO RESPECT FOR HER
every day, the same old boring distraction technique…..
"Look at what I'm working on !!"
but you are NOT working
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13934
>>13921
>>13920
>>13922
>>13923
>>13924
>>13925
>>13926
>>13927
>>13928
>>13929
>>13930
>>13931
>>13932
>>13933
>but you are NOT working
A Lot of "Projection" here from someone who thinks he knows more about the lives of others than they even know about themselves, and even presumes to think he knows better than them about everything in life!
Typical leftist, really.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13935
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13936
Boy… You've got the wool pulled over my eyes, don't you?
You're the master of distraction…..
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13937
Your distraction techniques and temper tantrums stop twerking on Nancy a long time ago
What made you think they were going to work on us?
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13938
lol @ stop twerking
I'm pretty sure when she finds an emotionally stable financially independent man, she'll start twerking more than ever before
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13939
I would call you a typical Trump turd
But in all honesty, even though the average Trump turd is nothing more than a pile of trailer park white trash garbage, even THEY refuse to settle for nigger welfare benefits
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13940
So I'm guessing the only appropriate terminology would be LESS THAN AVERAGE TRUMP TURD
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13941
you and major burdock have a lot in common
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13942
Except Philip's mother doesn't live across the street from the cramped 1 bedroom apartment they share
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13943
The main difference between Nancy and Philip:
Philip still enjoys being Major's girlfriend
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13944
when major burdock runs out of distractions, and tries intimidating Philip with temper tantrums,unlike Nancy, it turns Philip on
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13946
YouTube embed. Click thumbnail to play.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13947
YouTube embed. Click thumbnail to play.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.13948
SWAMI SAYS :
'There' becomes 'Here' when you get 'There'
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.14017
>>13936
No "N".
Also,
>>13937
>stop twerking on Nancy?
But why? Maybe she likes it!
Also, your continuous obsession with focusing on the imagery you have built up in your mind about supposed "Others", when All That ISLies WITHIN, seems kinda silly.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
No.14551
If you use The Great Suspender AddOn, you may want to consider not auto-updating it. You shouldn't really be auto-updating ANYTHING nowadays…
SECURITY: New maintainer is probably malicious #1263
https://github.com/greatsuspender/thegreatsuspender/issues/1263
'''
> On November 6th, @lucasdf discovered a smoking gun that the new maintainer is malicious. Although OpenWebAnalytics is a real software, it does not provide the files executed by the extension. Those are hosted on the unrelated site owebanalytics.com, which turns out to be immensely suspicious. That site is one month old, and is clearly designed to appear innocent, being hosted on a public webhost, and being given a seemingly innocent homepage from the CentOS project. However, the site contains no real information other than the tracking scripts, and is only found in the context of this extension. Most importantly, the minified javascript differs significantly from that distributed by the OWA project.
> While there does exist an innocent explanation for this, I can no longer say that it is the most likely. Using the chrome web store version of this extension, without disabling tracking, will execute code from an untrusted third-party on your computer, with the power to modify any and all websites that you see. The fact that disabling tracking still works is irrelevant given the fact that most of the 2 million users of this extension have no idea that that option even exists. The fact that the code is not obvious malware is meaningless in light of the fact that it can be changed without notice, and that it is minified (human-unreadable).
> Many users are worried enough about the changes that they completely uninstalled the extension, preferring AutoTabDiscard instead. That extension has much fewer features, but is slightly better for performance. Others have begun building it from source, and installing it manually. If a person were to try to create a new web store release, they would need to change it significantly enough that Google wouldn't reject it as spam.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
