/hydrus/ - Hydrus Network

Slowly eating away at the inbox (and at the same time keep adding more)

i try to tag a couple hundred pictures everyday, but im not even chipping my fuckhuge porn folder.

so much untagged shit, and i haven't opened my porn "social media" in weeks, i must have around 1k new pictures on each by now, but since there is no parser for these sites, i have to do all downloads manually.

some pictures i barely even tag, i just drop a folder, select everything, throw in the name of the series or character that folder was dedicated to, and call it evens. Because as far as im interested, i just need a quick way to find my pictures, im not really that interested in tagging every single fucking little detail (like the color of the socks or the hair, who cares).

i find it a little frustrating when there's like 5 different misspelled tags for the same series/character or they just throw it in there, no "character:" or "creator:" or "series:", fucking check your spelling you niggers, im sick of having to petition tags for namespacing/typos.

Oh my god!!!! I just discovered this program from a rec in 4chan's stupid question thread on /g/, and I am so excited to get started. I barely know anything about tech, but I save a hell of a lot of porn. My tastes are rather vanilla, though.

In my gross tech ignorance, I once day just felt I'd found a porn image I really, unironically liked. Wasn't sure how to sort it beyond my broadly-named ~5 porn folders. So I created a specific folder for it, and put a shortcut to the image in it. And that started my really inefficient sorting method.

At this point my old folders are laughably broad, where right now I have folders for pubic hair or no; how low panties etc. are worn; whether a blush is from lust or embarrassment; layers of clothing and whether they're opaque or translucent or show bare skin and which layer is where; "erect nipples" defined as erect areolae, or erect nipples, or color without necessarily any distinction otherwise… It's basically unlimited perversion, even if my sorting methods were dumb. Until now. Thank you based hydrus_dev- may my eyes through which I see sexy things continue to flourish from your work!

>decided to set up porn hydrus some time ago

>a bit over 1k pics to tag from my video and pictures folders

>now

>over 5k pics, only tagged most of them on simplest tags (number of girls, 2D or 3D, etc)

>eventually come up with a new combination of tags or artist to download in batches from boorus

>haven't even touched gif folder yet

>have a bunch of zipped artist folders I got from panda

I hate it.

TIL you can access raw quality files on tumblr. I have 5k files in lower quality dating back to 2015 and I don't have source url's for any of them. Kill me.

>>7610

>almost two months since post

>less than 100 pics fully tagged on all old tags

>almost double on the tags I plan on using

>almost done deleting all unwanted pics

>11.5k pics and I still have folders upon folders of yet to import content

All I wanted was to tag my one thousand porn pics. I never asked for this.

>>5267

>almost exactly 1 year since post

>decided to put an old pool of files back into inbox to re-check them for quality and filter them into my newer (ratings-based) processing queues

>write new subscription system that allows better handling of mass subscriptions

>improve how import folders work

>write better thread watchers that only stop checking when the files run out

>write nested pages so I can have more importers working at once

>increase page limit so more pages can be open at once

>reduce CPU load of mass importers so more can run at once

>500-1000 new files a day

>inbox and all subsidiary queues spiral out of control

>the scale of the problem completely eclipses my understanding, I can only keep digging away at the coal face, praying for salvation

>the situation is literally in every possible way my own fault

I just wanted to play video games.

Its ok though, because when the downloader overhaul is done, many new sites will be supported.

>>8163

>>8165

>>8163

>500-1000 new files a day

>600,533 inbox

>131,919 archive

What exactly are you doing?

>>8171

>not almost doubling your 10k files in a day by importing from a folder you think it's mostly duplicates except it isn't and after deleting shit files and duplicates you're still left with 18k files

>not doing a md5 gelbooru search on said 18k pics for tags only for it to still being ongoing after more than 24 hours and oh god I don't know how many are even left

What the fuck do you use your hydrus for? 3 pictures and a gif?

>>8177

Finally done downloading all the tags. Took fucking 72 hours.

Now onto organizing this shit.

>>7587

>In my gross tech ignorance, I once day just felt I'd found a porn image I really, unironically liked. Wasn't sure how to sort it beyond my broadly-named ~5 porn folders. So I created a specific folder for it, and put a shortcut to the image in it. And that started my really inefficient sorting method.

Ok. So this post was me. It was actually horrifying converting this sorting method to Hydrus, since Hydrus couldn't fetch target images from a shortcut fed to it. I opened a folder full of shortcuts in Irfanview, but it saw nothing. My only recourse as far as I could tell at that point was to manually open each and every shortcut in a browser (my choice was Firefox,) and manually resave each and every image. Which was exactly what I did for the first 305 folders, and 9,652 files (shortcuts; I just highlighted everything then looked at Windows properties for this number). Until I asked for help in 4chan /g/'s /sqt/ thread, and an anon replied saying he'll take a crack at it. It was like that scene in Bleach, where that asshole character offered to save Rukia, but seconds later said he was joking, so Rukia lost resolve she never knew she still had, and she screamed in anguish on the spot. I basically didn't want to do this anymore after this anon showed up. I had 62 folders left, and 4,107 files (shortcuts) left, since I was going chronologically reversed order, so the older ones were more dense with sorting, and poor sorting.

MAKE BACKUPS BEFORE ATTEMPTING ANY OF THE FOLLOWING

Anon told me to run the following in powershell:

https://archive.rebeccablacktech.com/g/thread/65734824/#65747352

#must be run from admin prompt as it modified the registry
Set-ExecutionPolicy RemoteSigned;

And then run the following in powershell as well*:

(*note: "Set $simulate = $false when you want to actually run it, $simulate = $true will just output the actions it will take." He says this alongside an earlier draft of the following script)

https://archive.rebeccablacktech.com/g/thread/65747475/#65747990

$simulate = $true;
$directory = "D:\inc\test shortcuts";

$shortcuts = gci -Path $directory -Recurse -Filter *lnk;
$shell = New-Object -ComObject WScript.Shell;
foreach ($shortcut in $shortcuts) {
 $link = $shell.CreateShortcut($shortcut.FullName);
 echo "copy $($link.TargetPath) $($shortcut.Directory.FullName)";
 echo "rm $($shortcut.FullName)";
 if ($simulate -ne $true) {
 try {
 copy -LiteralPath $link.TargetPath $shortcut.Directory.FullName -ErrorAction Stop;
 rm -LiteralPath $shortcut.FullName;
 } catch {
 write-host -ForegroundColor Red "Error replacing shortcut, skipping.`n$($_.Exception)";
 }
 }
}

This works perfectly for turning shortcuts into their original target files, provided the shortcuts aren't broken. The original targets are still left intact, so I was able to use his earlier script, give feedback of it failing, to which he amended it, and I was able to run the better script without problems. The only thing is the shortcuts folder itself is overwritten, and any broken shortcuts are lost, hence why you should make a backup before attempting this, so the data is not lost forever.

I realize literally no one in the history of time will ever sort things this way, but just for archival purposes I wish to share it, since I googled for literally an hour- the archives there tell the tale- and I found no answer for my situation. In the end, Hydrus might one day undermine this problem, so even my unique case will have extreme ease converting to Hydrus. Today, though, I needed this script. Also, full disclosure, I am the anon from the Q&A thread >>8720 who delayed switching to Hydrus for four months, since 4chan's /g/ introduced me to it, and their elitist bullying attitude made me try extremely hard to make sure I wouldn't fuck up on my own, since they would be so apprehensive to helping me if I needed help. I'm too shy to read the reply I got in that thread. I'm too shy, also, to read anon's reply to my thanking him for the script working on /g/, since others seeing my autistic folder names for my shortcut sorting (which I slightly shared to him) makes me cold sweat. I'm a ball of anxiety, really. Thanks for your tolerating me, if you do.

>>5267

in about 10 years if storage becomes huge and affordable we should attempt The Great Merge where you can opt in to starting a new database and have all your files and tags P2P distributed with everyone else

>need to tag 250 images from two and a half months ago

>keep getting distracted

>keep importing more files

>400 in inbox

I need to cut off my internet and sort this shit before I end up with thousands of images with only 1 or 2 tags

>>8744

Wait, you had folders for various tags, and if an image fit into multiple tags, you would have the actual image in one folder, and then you would have shortcuts in the other folders? Wow I am impressed honestly, I never thought of something like that. I used to just put them in the folder I thought was the best match, then eventually gave up and literally dumped everything into one big folder. It worked kinda well honestly, I would sort it by date created and then recent porn would be at the top, and as I went down it would show me older stuff. But I had to remember how far down to scroll for particular porn.

Anyway my system:everything is 107,970. Almost completely untagged. The good news is I mostly collect loli, so it doesn't grow too fast. I just need to do a ton of Gelbooru searches to rip all the tags.

>the archived stuff isn't even tagged yet

>nothing is

>>7574

An update on my progress nearly a year later, with 2945 untagged files.