[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog  Archive

Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf
Max filesize is16 MB.
Max image dimensions are15000 x15000.
You may upload5 per post.


This board will be deleted next Wednesday. I am moving to a General on 8chan.moe /t/. This board is archived at 8chan.moe /hydrus/!

File: 04b3e019f0141f4⋯.gif (124.09 KB,300x300,1:1,04b3e019f0141f476374527eef….gif)

6731c2 No.9885 [Open thread]

I had a great week. A big milestone in the downloader overhaul is done: all downloads, from start to finish, now happen on the new system's code. Any advanced user can create and share a completely custom downloader for any site the new parser can figure out. I am really pleased with it.

There are some final important objects to update. Most users will hopefully experience no big changes, but anyone who uses a custom booru (that they created or imported through the manage boorus dialog) will want to read the release post before they update. There will be nice new downloaders for Artstation and Derpibooru, and the Newgrounds downloader makes a return.

I've got a bit more to test, but the release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8edc36 No.9887

>>9885

Praise The Lord!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8edc36 No.9889

Invidious embed. Click thumbnail to play.

Current Mood.

The time has come.

Ascension into godhood

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

ce499d No.9822 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v320/Hydrus.Network.320.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v320/Hydrus.Network.320.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v320/Hydrus.Network.320.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v320/Hydrus.Network.320.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v320/Hydrus.Network.320.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v320.tar.gz

I had a great week. The downloader overhaul is in its last act, and I've fixed and added some other neat stuff. There's also a neat hydrus-related project for advanced users to try out.

Late breaking edit: Looks like I have broken e621 queries that include the '/' character this week, like 'male/female'! Hold off on updating if you have these, or pause them and wait a week for me to fix it!

miscPost too long. Click here to view the full text.

26 posts and 6 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d3ade4 No.9863

>>9862

Yeah, zero inbox. I just archive all the imports.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

328f31 No.9866

>>9854

Thanks, I didn't notice it before partly because it label is sort of an unclickable line inside the list box.

That label isn't that bad, can't really thing of another one. Maybe take off "services"? I know it's subdivided by them, but might not need to be in the label. It would be clearer (to me) if it were a text line above the box rather than in it.

While I'm here I should tell you that if you have an old import folder and you delete it, then edit the hydrus entry for it and hit Apply without changing the path to something valid, the same popup (or a very similar one, I didn't actually read all the text on each one) pops up four or five times before you're finally allowed to cancel out. Might be intended behavior though, like I said I didn't actually read other than the first two.

I have a low-priority thing to request for the todo also: can you add a potato mode to importing? The full-throttle approach sort of fucks my shit up, if it could import slower with less system resources at a lower CPU priority, that would be helpful.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fa52c8 No.9867

>>9851

Based, it worked.

ty

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ce499d No.9869

>>9866

Thanks. I'll check out the spammy popup on missing location.

I'll be revisiting file import options in the nearish future to do some url- and hash-checking logic options. While I am in there, I'll see if I can add an option for an artificial 'wait x seconds after every import' to throttle things.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1abef3 No.9872

A web interface for the server? Hell yes! Hopefully, I will be able to figure out how to set up all that crap. Being able to host my own little Booru from my Hydrus db is something I wanted to do for a while now.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

ef894a No.9757 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v319/Hydrus.Network.319.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v319/Hydrus.Network.319.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v319/Hydrus.Network.319.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v319/Hydrus.Network.319.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v319/Hydrus.Network.319.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v319.tar.gz

I had a mixed week, but I got some good work done. It is mostly improvements to the downloaders, and then some stuff for advanced users to play with.

downloaders and urls

Following the success of the new gallery page 'delay' system, where gallery page hits across the program are spread out over time, I have made several improvements: the system's logic is more reliable, it occurs on a per-domain bPost too long. Click here to view the full text.

18 posts and 9 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fcadb2 No.9804

File: 024bb2dc6ca516a⋯.jpg (710.24 KB,1200x924,100:77,1466741901564-5.jpg)

>>9802

oh my god thats all i had to do? thanks hydev, you solved it.

>>9803

>a fucking typo breaks the site

this is Aliens tier

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d9592b No.9809

>>9785

>Can you remember what you were doing at the time? Had you recently closed a dialog, or were attempting to? Do you have a 'busy' client with say dozens of pages and downloaders all working at once?

I might be mistaken but I think I was closing a manage tags window. It's not a busy client. Less than 10 pages with few items in them, nothing downloading.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ef894a No.9812

>>9809

I happened to get this error myself this week and think I figured it out. Please let me know if you have any more trouble in v320 on!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

dd22c0 No.9819

I found a cool bug in v318, but not sure what it is or if you already know about it. Here goes:

>I had several multiwatcher tabs open, most idle but one downloading 12 or so threads at once

>I had one simple downloader tab open, downloading from around fifteen threads from an off-site archive

>also syncing tumblr subscriptions at same time

>switch to the dupes tab and run the rebalancing, hadn't done it since before the new tumblr fuckery so I had I think 84 branches to rebalance

>goes for a while, I'm tabbed out reading a thread and messing with jdown and stuff

>tab back in, it's just finished, hit OK, instead of letting it sit a minute and then running dupe discovery, I immediately switch back to the working multiwatcher, but hydrus hangs as it tends to because my laptop sucks, especially after finishing big operations, a message box has popped up under the subscriptions box, but it's blank because the client froze there

>after ten or twenty seconds it resolves itself and refreshes the screen, seems normal, except the subscriptions downloader box and the message box below it are just gone

>figure it was just a message saying it thought it was done syncing for the day, not sure why they closed themselves though

>elapse ten or twenty seconds of normal behavior

>open up tags to enter in new tag for thread I'm about to paste into multiwatcher, enter them and remove last thread's unique tags, hit OK or Apply or whatever, box closes

>client hangs again, this time doesn't recover, but rather than going (Not Responding) it just makes that annoying system bell whenever I try to click on any tab or anything at all

>downloader pops back up and starts, figure it's fine and I can just wait a bit since it's actually downloading

>stays frozen, can't select anything, but downloader still going and there's a rare C++ level error spat out at me instead of Python

>running it in debug, so go to console window and look at it, shows basicallyPost too long. Click here to view the full text.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ef894a No.9821

>>9819

Thank you for this report. This looks the same as >>9782 . The 'modal' popup that comes up during idle maintenance and a couple of other places was being rude to any pre-existing dialogs. The dialog gets hidden but then can't restore when the maintenance job is over, and since the dialog is still modal, ui functionality can't return to the main ui frame. In your case, it was probably the tags window for your new multi-watcher. Maybe some idle job got delayed while the dupe search was going on, arrived late once your db-commit hang finished, and then blatted itself into the ui event loop right when you had that dialog open.

I believe I have this fixed for today, but if you experience it again, particularly with the dupe search stuff–which works on slightly different logic–please let me know. I now know what the error is actually about!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 58266a57be46780⋯.gif (23.36 KB,100x100,1:1,58266a57be46780767ecdc0946….gif)

4f2e77 No.9818 [Open thread]

I had a great week. All the 'default' galleries are now parsed on the new system, and I am completely prepped for the last big switchover. I also fixed some bugs, including issues with new subscriptions and source url checking, and sped up some tag searches significantly. There is also some cookies.txt import stuff for advanced users to play with.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

ea9080 No.9695 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v318/Hydrus.Network.318.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v318/Hydrus.Network.318.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v318/Hydrus.Network.318.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v318/Hydrus.Network.318.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v318/Hydrus.Network.318.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v318.tar.gz

I had a great week. I caught up on more small stuff and put some more work into the new gallery downloaders.

downloaders

Unfortunately, tumblr decided to kill their 'raw' url access this week. There is not a lot of firm word from tumblr on the issue, but there is some scattered conversation around, and it seems it is dead and not to return. Whatever the ultimate reason for this, it broke our tumblPost too long. Click here to view the full text.

23 posts and 4 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

f859d4 No.9742

>>9740

some retarded soyboy bitch who couldn't be bothered resizing his files before uploading them to tumblr complained to tumblr that people were getting his patreon content through it because of the _raw URLs, so tumblr removed _raw urls all together, because soyboy bitches reason through groupthink instead of logic.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

397bdd No.9744

>>9742

So even the Amazon link fails?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

15e1fa No.9745

>>9742

would love to know who it was.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ea9080 No.9784

>>9735

I don't have that in my version, but I think I remember maybe turning something like that off when I was using it more. There's some auto-backup options somewhere, maybe there are some indexing options near there? Like you can tell it not to check for updates to file structure or something.

That shit was one reason why I started thinking about hydrus, actually. The difficulty of keeping up with a disparate file structure.

>>9737

Yeah, looks like e621 has several examples of these unreliable source urls. I will add options to file import options to change the url check logic here (e.g. '[] don't trust source urls for 'already in db/deleted' checks).

>>9744

Yeah, it is all gone. The amazon links still respond in different ways, suggesting the 'bucket' still exists, but you get variants of 'authorisation missing'. I presume they have basically tightened up their AWS-side back-end CDN to require authentication, so it is back to being a way for their cache servers to grab originals. tumblr are aware of the issue and have strongly suggested it is never coming back, so I imagine if we ever find a new way back in, they will only shut it down again.

This is happening all over the place. My feeling is the future of original source is going to be the various boorus 'inheriting' from the actual original source, be that patreon or some tumblr post that links to HD on imgur or mega or whatever (although if the boorus use CloudFlare, they may be compressing jpegs on the fly! fuck!). In five years, I expect hydrus to have P2P file-sharing components. You can trust that any system I make wouldn't do this shit. But I can also imagine more complicated waifu2x-style systems in future that may nullify most of the issue.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

eec8b9 No.9806

>>9745

A furporn Patreon artist

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: afce1fb7c68c55e⋯.png (1.52 MB,1280x1732,320:433,afce1fb7c68c55e7d5ade0f1e7….png)

File: 5f505978378ccd3⋯.png (7.83 MB,3400x4600,17:23,5f505978378ccd323ed5e04eec….png)

File: 1125a234c31ad6d⋯.png (227.42 KB,1939x557,1939:557,client_2018-06-01_18-03-28.png)

9f4afb No.9010 [Open thread][Last50 Posts]

I think that suggestions make the program better, improvements here and there also go a long way, but really there are hard aspects of the program that cause people to stop everything they are doing till they are improved/reworked.

let me give an example. I have an image db that is currently 2 million images large.

There was no way in fuck that I was keeping tabs on this shit on its own, so the program is very good in that regard, at least my shit is sorted and can be brought up if I tag/rate something.

now, here comes the stop gap.

I have 2 million files, and before my db corrupted, I had something around the area of 200k potential matches for duplicates

so I need to go through the duplicates first

my database broke through so I have only 827k images in the dup finder with 73k images.

Now thinking ok, while things get sorted out, why not do them? dup finder only works on 2 images at a time, regardless of if the rest of my db in or not there is work that can be done

well here is a random pair

im on a 4k monitor, a 55 inch 4k, so when an image is small and one is big, you can generally see one is better easily, however the smaller one is not worse by a lot, note the bigger ones embers, on the yellow shit at the bottom right, zooming into 100% on it makes it clear its not just an upscale, and that it actually is a higher resolution. but if you put these in the program, and find these in dup detector, note that due to the slightly different resolution the program won't keep zoom or where its zoomed in between the two images.

also note that trying to move where its zoomed into fast with the mouse results in making a selection rather then moving the image.

I also noted at least with ratings a while back making a 'this one is better/prefer this one' selection did not transfePost too long. Click here to view the full text.

48 posts and 8 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9244c2 No.9711

File: 82e8a5ad412dd0a⋯.jpg (192.67 KB,1914x1041,638:347,Capture.JPG)

>>9481

>1.Lack of tag trees

You might like Daminion (pic related) or Adobe Lightroom if you can stomach the eye rape interface.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

02dfeb No.9724

>>9683

One of the issue is that some accounts are protected. Example: https://twitter.com/uzusio04

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

02dfeb No.9725

>>9493

For #2, dumb-search to smart regex translator? Anyone? Maybe use https://github.com/VerbalExpressions/PythonVerbalExpressions ?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

620210 No.9758

File: e10618530454311⋯.jpg (84.87 KB,820x310,82:31,Capture.JPG)

>>9481

>>9482

>>9483

Most of this garbage is user error / lack of knowlege. Since others have explained some of your other gripes pretty well, I'll explain custom namespaces.

It's SUPER EASY if you took more than a minute to look at the options. Just go to file > options > tag summaries. From there, just select what part of the thumbnail you want to change and you can add whatever namespaces your little heart desires. You can also change their colors so the dark theme won't look as bad (pic related).

You can also go to file > options > sort/collect to make custom namespace sorting options for your shitty porn collection, and file > options > colours will let you make your namespaces look pretty.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ab9f14 No.10250

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: fe1679aaa8ea27f⋯.png (411.29 KB,680x736,85:92,fe1679aaa8ea27f1fe94d907db….png)

eaf2ee No.9755 [Open thread]

I had a mixed week, but I got some good stuff done. The new downloader systems have a variety of improvements and I finished a first version of the new 'searcher' object for advanced users to play with.

I have a bit of additional testing to do, but the release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

744617 No.9608 [Open thread][Last50 Posts]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v317/Hydrus.Network.317.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v317/Hydrus.Network.317.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v317/Hydrus.Network.317.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v317/Hydrus.Network.317.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v317/Hydrus.Network.317.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v317.tar.gz

I had a great week. I polished some ongoing download stuff and caught up on a bunch of smaller jobs.

tag filter and tag import options

A while ago, I wrote a new 'tag filter' that applies blacklist and whitelist rules to a list of tags. It is more powerful than some of the old systems I was using at the time, but the ui was pretty ugly, so I didn't roll it out everywhere it could be. This week, itPost too long. Click here to view the full text.

50 posts and 10 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

744617 No.9692

>>9665

>>9666

Thank you for this report. That swirl looks like PIL's doing. I don't know if my PIL code is just shit or if they can't handle some palettes, but that's a long-time problem that I eventually fixed by moving to OpenCV as default. Please check options->media–do you have the 'PIL instead of OpenCV' bugfix setting checked for some reason?

I think PIL also steps in as backup if OpenCV throws an error. I wonder if that GStreamer error is related. What PIL (Pillow) and OpenCV versions do you have under help->about?

Yeah, I don't care about nsfw.

EDIT: Yeah, when I turn on the PIL bugfix option, I get the same swirl as you in Windows. PIL is kicking in for some reason.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

744617 No.9693

>>9677

>>9678

Yeah, I'd like to make the new 'searcher' object nestable, so you'll be able to say 'search for artist x', and it'll generate four separate queries on four different boorus. This will only work well, of course, for those boorus that use the exact same search strings for what you are looking for. Seems like gelb and danb would be good mergable candidates for artist names, I think?

The hentai foundry artist search has always secretly been those two streams, so this new system just exposes that, and things are actually a bit simpler as a result now. I still have to think about this nesting as I build the searcher, though. Things like 'should a nestable searcher create multiple subscription queries or throw everything into the same gallery log'. I don't want to accidentally fuck everyone or let new users completely fuck themselves with infinite looping searches or anything.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

244d75 No.9696

File: 28147575f83cc57⋯.png (5.69 KB,181x182,181:182,ACDSeeUltimate10_2018-08-1….png)

>>9693

The way that I see it, and less so from dan then gel or other boorus, it seems like artists can have multiple names and get tagged that way, however the thing is most boorus, if one has multiple names for an artist, you can bet that everyone does. so lets say I had a rule for all the r34 pages and gel, and I want to search an artists name, lets say

Hereismyname

So I put it in there

I find out he has a second name

Nothatassholeislyinghereismyname

so I do it again, and finally I find out they go under an alias for some art

Fuckyouthisismyname

its likely each one of those is going to be a hit, so instead of entering those each once for each one on their own, hitting them all at once with each name would be a better option.

The only one this wouldnt work for is derpibooru, as derp does an annoying thing where to search an artist you have to type artist: to search artists, rather then just their name, and if you search by name you are never finding them.

but on the topic of nesting, would it be possible to make a collapsible nest? something kind of like this, sure its for folders by this could work similar.

nvme boot could be artist search

brother could be an artists name which could be expaned to show its source

nvme boot could open all the images under it in one tab

brother would open all of its

and an inner one would open from a specific source

If you can do something like this, I think several issues would be immediately solvable however I don't know if its possible.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

244d75 No.9697

>>9685

ok I have it and its in, though not 100% sure how to use it

Ok, got it in the parser,

it still returned a gif

Ok, thinking there was a conflict, I deleted the original parser after exporting it,

Now I get there are no parsers

Ok, import the original parser again

No parsers

Delete the new one

No parser

I think I did something stupid and i'm not seeing how to fix it/enable a parser

do I have to restart the program each time or am I just doing something really wrong and dont realize it?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

31e267 No.9699

>>9686

The file sizes look fine and I have all 4. I did the cloning/renaming correctly but only did client.db, that's the only one it said in the help txt. Should I do the other 3?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: b63e241a8065aa8⋯.gif (204.84 KB,400x293,400:293,b63e241a8065aa85049876a927….gif)

7f5df3 No.9680 [Open thread]

I had a great week. I caught up on a bunch of smaller issues and bugs and worked on a variety of gallery stuff–gelbooru and xbooru gallery searches are fixed, the tumblr parser is (regrettably) 'fixed' for the 'raw url' issue, and there's plenty of behind-the-scenes downloader improvements as well.

This release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


File: 059b0c500891970⋯.gif (158.61 KB,500x556,125:139,059b0c500891970314a6fa0187….gif)

8a5d48 No.9593 [Open thread]

I had a great week. I have completely revamped some important tag filtering ui, polished the new multi-gallery and -watcher, caught up on a bunch of older issues, and added parsers for imgur and derpibooru.

This release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4936fd No.9596

fantastic, Just get hydrus down to a reasonable image size and then you add derpi… hello 600k+ images again.

cant wait

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fdf70d No.9597

>>9593

Getting Fiber in next few weeks… looks like I should get a server/NAS for Hydrus!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



HookTube embed. Click on thumbnail to play.

d7b61a No.9429 [Open thread][Last50 Posts]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v315/Hydrus.Network.315.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v315/Hydrus.Network.315.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v315/Hydrus.Network.315.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v315/Hydrus.Network.315.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v315/Hydrus.Network.315.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v315.tar.gz

I had a mixed week. The gallery rewrite proved more complicated than I expected, so I put it off for a week.

all misc stuff this week

I updated to the new version of wxPython. It has a bunch of bug fixes that I think will help some menu regeneration problems some users have had, and I hope improve stability for the platforms/flavours where crashing has been a persistent issue. Please let me know iPost too long. Click here to view the full text.

50 posts and 6 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7b61a No.9561

>>9516

>>9515

>>9517

>>9518

>>9520

>>9521

>>9526

>>9535

Thanks for all this. I am not working on dupe stuff at the moment, but I have written these points down and will keep them in mind. I am overall happy with the first version of dupe stuff but agree that it could really do with a full pass.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7b61a No.9562

>>9519

I don't know much about vim–what sort of shortcuts are you looking for?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7b61a No.9563

>>9531

I was talking to someone else who had this issue a couple of weeks ago and couldn't reproduce it. When I do 4/5/6 on my test machine, I get more each time. The fundamental object that is being tested here is a 8x8 matrix representing some simplified vertical/horizontal waveforms in the image (it is a DCT), so I wonder perhaps if certain classes of image tend to be 'mirrored' in some way on the two axes represented in the matrix, but I am not sure.

I'd be interested if you discover anything new about this. The max potential number here would be 63 or 64 but most of the action is in the 0-8 range, with anything above, say, 12, being completely useless, so I may end up re-doing the shape-based dupe detection to be a 16x16 matrix (i.e. 256 bits) to give us more resolution here, although this would slow search significantly, so it might be better just to put my time into better workflows. The big bottleneck now seems to be human attention (it takes ages to go through pairs by hand), so I wonder if I should attack that first.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7b61a No.9564

>>9532

Yeah, this is highly requested, so I'll roll it in before this whole overhaul is done. There's some stuff here for it already:

https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/tree/master/NEW%20Download%20System

but I haven't tested it myself and it isn't easy mode yet. You might just want to wait for me to add it naturally.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7b61a No.9565

>>9532

>>9564

Shit, sorry, I read that wrong. Yeah, I'll add a gallery parser and 'searcher' for it when I have that system ready, so it'll just pop into the gallery selector button soon enough!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 394b5cb77be6dce⋯.gif (249.76 KB,500x375,4:3,394b5cb77be6dce092d06ef952….gif)

037702 No.9525 [Open thread]

I had an excellent week. A good first version of the new gallery parser is done for gallery pages, subscriptions, and simple drag-and-drop. Furthermore, all gallery pages are now 'multiple' (much like the thread watcher, which is now also multiple-only) and support multiple queries for different sites running on the same page at the same time!

This will be a big release. I still want to do some more testing, but I think I will have it out at the normal time. I recommend heavy gallery users wait for the release post to review the changes and make sure you update well.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

912504 No.9527

Thanks, looking forward to it!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: f5c97ffef11977e⋯.gif (263.73 KB,711x797,711:797,f5c97ffef11977e610309257be….gif)

bfa69a No.9475 [Open thread]

This week went well, with plenty of work going into the gallery update, but I am afraid I felt more and more ill throughout the week and no longer feel confident I can put out a good release. I could tie off the work I have done and rush something out tomorrow, but I am not thinking completely straight and this is a big change, so I am putting v316 off for a week so it can all be tested properly and isn't in buggy limbo.

I'll just restart next week as usual schedule, so v316 should now be on the 1st August. Thanks everyone, and sorry for the delay!

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0c1783 No.9479

Im curious, these don't need to happen soon, just wondering if they are on the docket of things that will happen

is gallery log for multi thread watchers a thing, I ran into a thread where 14 images were deleted, and because I dont delete things currently, I wondered what the hell happened, so I had to load up that thread, ultimately they were images in trash not deleted and they were there for a reason, but opening the thread and trying to find what images did not download was tedious.

and on multi thread watchers, i have one of my multi pages that has 170k images, but 70k are already in db, would there be a way to add a 'highlight new' to the highlight options? I don't think the current file import options works with highlighting, either that or all the threads of 150+ images I just checked with only show new checked all had only new images, which would be shocking.

Like I said, neither of these need priority as my use for them is going to come several months down the road in the case of highlight, or just a nice resource to have in the case of the log, just wondering if they are on the docket of things to do, already in in a way im not seeing, or if they just got added to the ideas pile.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8d9ee9 No.9480

File: abb0bdd7547e603⋯.jpg (86.74 KB,1006x921,1006:921,1332267360830.jpg)

take a vacation nigga. you deserve it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

dd9d3b No.9487

>>9475

Take care of yourself man, get some rest.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

bfa69a No.9510

File: 0bb8c518b34a080⋯.jpg (285.95 KB,1242x1583,1242:1583,0bb8c518b34a080f8a2b927966….jpg)

>>9479

Yeah, I have a panel rolling out for v316 that will show the highlighted watcher in detail, and you'll see the gallery log there.

I am not sure I totally follow this. The thumbs that show when you highlight should be those set to present in the watcher's file import options, so if you have it only to set 'new', it should not show 'already in db' ones. You'll be able to check this better with the new highlight panel, so please let me know what you figure out there!

>>9480

>>9487

Thanks lads. I played vidya all Wed, now I am back to it. 6/10 health, 10/10 enthusiasm, so we'll see how it goes.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



HookTube embed. Click on thumbnail to play.

8097cc No.9368 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v314/Hydrus.Network.314.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v314/Hydrus.Network.314.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v314/Hydrus.Network.314.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v314/Hydrus.Network.314.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v314/Hydrus.Network.314.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v314.tar.gz

I had a great week. Tag import options are now easy to mass-manage, and I have fleshed out the new downloader system's file page parsers.

default tag import options

Almost done with tag import options, I promise!

This is an important but slightly complicated update. Nothing huge will change, and you'll see what is going Post too long. Click here to view the full text.

13 posts and 3 image replies omitted. Click [Open thread] to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8097cc No.9425

File: ee47c64520d991e⋯.png (3.62 KB,512x86,256:43,tumblr api post page parse….png)

>>9406

Thank you for this report. I've had a devil of a time getting xdg-whatever to work on some different flavours. What happens if you set an explicit launch path under options->files and trash? Does that work, or do you get a different error?

>>9408

Thanks. I have split the job up into like five pieces that I can slip in a bit every week. I'll basically make notes into multi-notes and then auto-attach a 'deleted' note in several new ways. Let me know how it works for you when I get to rolling out the fun bit.

>>9410

wx has a bunch of ways you can do it, I think, including like some popular 'ui builder' app where you are drag-and-dropping elements into a test window and it writes all the code for you, but I prefer to hand-code it all. There's a 'wx demo' that you can get alongside the base code, here:

https://extras.wxpython.org/wxPython4/extras/4.0.3/

https://extras.wxpython.org/wxPython4/extras/4.0.3/wxPython-demo-4.0.3.tar.gz

Which is the absolute shit and lets you see how different widgets go. It works well for me in doing multiplat with native controls, but it has instability issues if you do things in the wrong way and I know a lot of people who don't like it for a variety of reasons.

I've got a ton of experience with it now, so let me know if you end up liking it but want to know the right way to do sizers and layout flags or whatever. Feel free to copy any of my code or classes if they are useful.

Post too long. Click here to view the full text.
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9a73bb No.9426

some feedback

i looked at the program for half an hour or so, tried to do some things and failed. if you have 150 IQ and are in software design or programming its probably easy to use but for just avg IQ person like myself i found the program to be not very intuitive :(

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9182e6 No.9427

>>9426

Did you use the help pages? Hydrus has a bit of an initial learning curb, but it functions like any booru so you should be able to do some basics.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9a73bb No.9428

>>9405

>>9427

ok, ill study it some more

i dot know what a booru is, i just manually downloaded about 500 memes from 4chan-pol over the last year or so and then i got the program ChanThreadWatch to download some image threads. Was hoping that i could just put about 100 images in a folder and then point Hydrus to that folder and let it go online and find some matches. Looks like it will take a few hours of reading though

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4d3c80 No.9436

>>9425

re: db migration

With the new version I'm not getting the issue anymore, thanks for fixing it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



bf0584 No.9407 [Open thread]

After SQlite run out of disk space on after exit maitenance, with following errors:

DBException: OperationalError: database or disk is full

and then

OperationalError: no such savepoint: hydrus_savepoint

(log https://pastebin.com/8JWzsrwj)

Hydrus client does not offer to do maitenance anymore after exit and does none while idle. Encountered on 310, after updating to 313 Hydrus asked to do maitenance once, but no maitenance was actually done, and it wasn't asking anymore again.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d7089e No.9424

>>9407

Thank you for this report. The big maintenance routines need to make some large temporary files when they work, so they sometimes need up to, say, 5GB free space. There is a check for this free space for Vacuum jobs but not for repository processing. I will add one.

How big are the four client*.db files in your install_dir/db folder? How much free space is on that drive? How much free space does your system partition have, if that is different (some of the db files are written to your system temp location)?

It may be not doing more maintenance now because it may have successfully 'paused' the repository on the previous failure.

Best solution to your problem is probably to make sure your hydrus drive (and any drive with active files on tbh) is at the bare minimum 5%/10GB free, whichever is larger. Ideally, system drives should be 20% free, but I appreciate this is not always doable. Then check services->review services to see if the repository needs unpausing or whatever to continue work. If it has a more complicated error in its status reports there, please let me know and we'll work on it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

bf0584 No.9437

Actually, that "lack of space" is somewhat my fault, I temporarily moved database files from hdd to a ram-disk for them to be processed.

Total size of db files is about 4.5 gb, the disk was 9gb.

Also, public tag repository was indeed paused. After reenabling it, after-exit maitenance was again offered. So, solved ))

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



Delete Post [ ]
[]
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]Next | Catalog | Nerve Center | Random
[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]