/hydrus/ - Hydrus Network

Thanks for the update! Currently trying to get my database pared down some so I can do a backup and then the new thumbnail change-over more painlessly. Going to reply here since I wasn't around last week.

>>12047

I haven't touched booru tags, I just thought default was to import them. If I change settings and then reimport will it just search and apply the tags to the already downloaded images? I'm also noticing that if I delete images I downloaded under one tag, then they get found again by another tag, it reimports them and adds them back into the download page of the original tab I deleted them from too, but only sometimes. Thinking it's just something with rule34 messing up versions of their images and having unreliable md5s, but thought I'd mention anyways. Having some trouble duplicating it so can't really provide examples I'm afraid.

When you change the thumbail by even 1 pixel is there an option to do auto regeneration instead of having to manually click it? The blurry thumbnails look better now after using it.

Also how do I make it so when I open a new page that it automatically has "system: everything" in the search?

hey dev.

for the past few versions, export folder sync has been real wonky. Just deleting the sync folders and leaving them empty. syncing all, or half of the content after being poked. Generally unreliable and inconsistent.

Please take a look at that!

>Further shift-enter actions will increase the OR 'chain', making 'tag A OR tag B OR tag c', and a final non-shift enter will cap the chain and send the OR search predicate up to the main search. It works! You can even add system predicates!

I keep adding systems tags I don't want ;_;

I already have X and Y with shift but when I try to finish and do the search I end up adding a system tag I don't want, like everything, and tried clicking outside the tag box but that doesn't work.

>>12092

The trick is to only use [shift + enter] once. so type:

>tag1

>[shift+enter]

>tag2

>[enter]

>>12092

>>12094

of course for three tags, you'd use it twice, but the basic idea is to type enter and not shift+enter when the last tag is in the input box.

Having played with the new thumbnail throttling a bit, I am overall happy with certain bits of the tech. I am still a little annoyed at how slow it takes certain thumbs to get on screen, so I think the next step here is to draw all thumbs to screen as quickly as possible, even if they are scaled and fuzzy, and then to schedule regen and swapping the nicer thumb into place in the ui in the coming seconds. So you'll get something on screen, and it'll get more beautiful as needed in the near future.

>>12086

Hey, I am sorry for the confusion. I wrote up some better downloader 'getting started' help somewhat recently, which talks about setting up default tags more completely than I can do quickly here:

https://hydrusnetwork.github.io/hydrus/help/getting_started_downloading.html

Basically do some trial runs to figure out what 'tag import options' you want (for most people, this is just 'get everything' and a few blacklist tags like 'vore' and 'diaper'), and then apply that as the defaults, and all new pages will start with that. Let me know if you run into trouble with any of it.

—-

To fetch tags for the files you already have, you'll need to make a one-time change just for those jobs. I recommend opening up a completely new download page for 'getting tags for files I already have' and keeping it set only there. By default, the client will skip any download pages it has 'seen before', so it won't get tags, but if you go into the 'tag import options' of that page, you can check boxes for 'fetch tags even if xxx recognised and file already in db'. Hit both of those and then run your retroactive searches, and the client will pursue the files' html post pages and grab the tags but still skip actually downloading the files themselves again.

I am afraid I am not sure what is going on with your URLs going into different pages/tabs. That should not typically ever happen in normal operation, but I may be misunderstanding something. If you can figure out a way to recreate this, please do let me know.

>>12089

My ultimate idea here, rather than doing it always through a selection right-click menu, is to have a big db command under the database menu that'll let you say, "Hey, I just changed my thumb size. I want you to regen everything over time." I don't like burning the CPU right as you view thumbs when I could be doing it in the background during idle time. And now my maintenance routine has the thumb-only options, I need only now make some db tables and a new maintenance job to actually action this. Maybe not this week, but within the next few weeks, I think.

As for mandating regeneration on load, I am mixed. I don't like the old system of forcing complete regen on load, and the new system of throttling it is also imperfect. I'll now try my idea here >>12102 , which will resize everything over, say, 30s, without lagging it all up.

You know, if I were feeling clever, I could even order thumbnail regeneration in idle time by number of media views as a proxy for 'popular'. I will think about this.

There is no current way to set a default search for regular new search pages. As for system:everything in particular, as soon as your client hits I think 10,000 files, your system:everything will disappear (although you can turn this off if you want). 'everything' becomes less and less useful the more files you have. Even so, you might like to play with middle-click on a tag. If you middle-click on 'system:everything', it should open a new search with just that tag. Or you can just hit enter as soon as you open a new page–the tag entry is supposed to get your keyboard focus, and enter will open sys:everything immediately.

>>12092

>>12094

>>12095

I think I am leaning more towards inserting the currently-under-construction OR tag into the dropdown list below, like this:

[blue…]

—–

green eyes OR red eyes

blue eyes (2,100)

blue hair (124)

blue benis (65,536)

If it is in the selection list, then a bare enter press will select it as-is, but you can still hit DOWN, SHIFT-ENTER, to OR-append the 'blue eyes'.

I was personally pleased with myself for making the new box above do its unhide and layout correctly as needed, ha ha, but I think it better I put the OR in the normal place.

This still doesn't solve the 'cancel' and 'rewind' problems, so I'll keep thinking about that. Maybe just add a couple buttons on the right of the text input box when an OR is under construction that you can click.

>>12090

Thank you for this report. I had another report from someone else recently that they weren't firing on time. I will give them a complete pass this week to see what is going wrong here. Sounds like there are several problems.

Can you give a concrete example of an export search that is failing for you? Is it by chance a 'system:rating' only search?

>>12105

>blue benis (65,536)

damn wtf

>>12114

>he doesn't play minecraft

>>12115

>>he plays minecraft

>>12105

Ok, I've done this for 347, but it skips selection on that first under-construction OR item. You can cancel, rewind, and add the under-construction OR item as-is.

I also sped up some OR search speed for weird cases.

I'm pleased, and OR v1.0 is now basically done but for some small stuff I'll put in sometime like 'make an OR out of this' on right-click menu from multi- tag selection in a list. Unless something big comes to me, I'll probably be putting together a new thread this Wed for talking about a new 'big things' poll.

>>12119

>Maybe just add a couple buttons on the right of the text input box when an OR is under construction that you can click.

Buttons on the side of the input box sound like a good and easy way to fix a few issues at once.

One issue I ran into is that the OR chain got pretty long pretty quickly, and since the search terms are horizontally arranged, they exceeded the width of the left panel and I wasn't able to see my whole search at once.

I plan on having a session of OR searches saved in Hydrus kind of like Danbooru's "saved search" function, and I'll want to keep developing them, so any way to easily edit the searches and display all of the terms in a vertical list would be fantastic.

I was pleasantly surprised at how fast the searches completed too. Thanks for working on this!

>>12115

wait how does blue bepins relate to minecraft?

Came looking for the 'or' search, found it freshly implemented. Thanks.

The interface… I don't think it is globally useful to avoid parsing a tag expression string.

Even with the current 'or' feature, you get 'copy "a a OR b b OR c b"' in the context menu of the resulting tag.

But copypasting the copied result anywhere makes no sense.

But it could. By adding a little bit of quoting support.

Same with 'copy selected', by the way.

A simple way to add quoting and expressions is:

1. use double quotes when necessary, e.g. `"some tag"`,

2. double the double quotes in tags, e.g. `some "proper" tag` -> `"some ""proper"" tag"` (the way CSV does it),

3. Somehow distinguish interfaced input `some "proper" tag` from expression `"some ""proper"" tag"`, e.g. by a flag or by prepending a `#`

4. dumps and loads a list of tags into such expression

5. …

6. P-… I mean, voila, you get a copypasteable expression such as

`# ("a a" OR "b b" OR "c c") AND "some ""proper"" tag"`,

or `# (a OR b OR c) AND e`

If you happen to agree on the design part I will likely assist in implementing that.

>>12074

have been away for a bit

This will help immensely, while this won't cover a general culling as in, I go through a thread and just delete the shit thats low quality, this will allow me to use the dup filter. seeing as i'm in the 450k duplicate file range right now, and this is with about 1.8 million files in my db not being seen but the dup filter, I will be able to get quite a lot done.

>>12121

Yeah, in my testing I have had the same issue with long ORs stretching too far to see and to edit. This phase doesn't have better edit than this new rewind button, but I've long wanted the ability to right-click->edit system predicates that are in the current search, so when I go for that, I'll see if I can throw together a dialog with some sort of regular taglist with all the OR sub-tags listed so you can see the whole lot and just easily double-click to delete or whatever.

Yeah, single tags are always happily always pretty quick in the client, and the current OR search tech fits into that nicely. ORs with certain system tags or '-tags' can be exceedingly slow, but I also have a new optimisation in for tomorrow that will speed these slow searches up significantly if the overall search is mixed with other simple terms, like:

series:evangelion

character:asuka OR -character:rei

In 347, the 'evangelion' search will be run first, so the potential search domain of '-rei' is cut down from your entire collection to your x eva files.

Is it possible to make something like Windows where you can make a box and drag it with your mouse and select images within that box? Would be nice to have that feature

> Can you give a concrete example of an export search that is failing for you? Is it by chance a 'system:rating' only search?

I have two exports, both are a simple search for one tag.

One to sync tag "bg", another to sync the tag "potential bg".

Both export folders have been left empty or incomplete when I use hydrus. I have to poke around the export settings to make sure they actually worked before closing hydrus.

>>12135

>In 347, the 'evangelion' search will be run first, so the potential search domain of '-rei' is cut down from your entire collection to your x eva files.

Oh nice, especially with various system tags in place to limit the search, that'll cut down the time quite a lot for me.

On another topic, for the list of next big things, was the booru something you had in mind for working on? I had an idea about how it could be integrated more directly into the main UI, which I could write more about provided that there's interest in the booru right now.

>>12136

I would like to have that, particularly for my own use, but unfortunately this functionality does not seem to be built in to my ui library, and furthermore my thumbnail panel is all my own custom code. I will have to write both ends of a system like this, so I have it as a 'big job' for now. It is currently "Write some ui to allow selecting thumbnails with a dragged bounding box" here: >>12152

>>12145

Thank you, the 'delete after export run' bug should be fixed in 347 for export folders that make filenames that include subdirectories. Please let me know if you still get it in the new version.

>>12146

Yeah, now here as a new 'big job' to work on: >>12152 . However, I am not totally sure what to do with the current booru. It was always a prototype that then never got revisited. I think next step is probably to convert it to the nicer new Client API code just so it is all operating on the same system, and then work on templating so users have more CSS/HTML customisation options.

Then again, I do know of some users working on booru wrappers for the Client API as-is, so if they can do a better job than I can fit in, it may be better ultimately for me to abandon it. If the booru does not prove all that popular in the poll and some other users can fill in the gap, perhaps we can revisit the whole idea and instead I give more power to them via the Client API.

If you have particular ideas on integrating the booru into the actual client ui, I am interested to know what you are thinking of. Please post in that big poll thread if you would like.