[ / / / / / / / / / / / / / ] [ dir / britfeel / had / imouto / jp / lewd / maka / marx / o ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.
Name
Email
Subject
Comment *
File
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options
Password (For file and post deletion.)

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 16 MB.
Max image dimensions are 15000 x 15000.
You may upload 5 per post.


New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Current to-do list has: 1,178 items

Current big job: finishing login and domain managers and overhauling the downloader


YouTube embed. Click thumbnail to play.

13c19b No.7367

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v284/Hydrus.Network.284.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v284/Hydrus.Network.284.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v284/Hydrus.Network.284.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v284/Hydrus.Network.284.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v284/Hydrus.Network.284.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v284.tar.gz

I had a great week. There are a bunch of different fixes and improvements, and one new thing for advanced users to play with.

subscription fixes

I fixed the 'new-queries-initialising-as-dead' issue! As well as fixing the problem for the future, any queries you have that died due to this will be reattempted.

Subscriptions now also consume bandwidth on a per-query basis, so subs with a lot of queries won't get throttled so easily.

misc stuff

The thumbnail 'select' menu now lists the number of files to be selected for the simpler selection types. This is small, but it is neat for inbox/archive.

Import folders will now catch if you put in an invalid path in the dialog, and they'll let you know if you try to manually run them while import folders are globally paused.

The weird issue where drag and drop events were sometimes not working if dropped on the top-left area of the main gui window is also fixed!

I added an experimental 'thumbnail fill' mode under options->gui. This takes the existing thumb and zooms it until it fills the whole thumbnail 'window'. It looks ugly at the moment due to the zoom (rather than generating larger clipped thumbnails), but it gives a decent idea of how thumbs appear under this fit style. If you are interested in this stuff, give it a go and let me know what you think. I am open to adding good options for this with higher quality thumbnails sometime in the future, but I suspect 100% fill is not desirable, and that we really want a compromise for extreme cases so that very tall or wide images produce thumbs that fill say 75% of the available space.

url class

This is only for advanced users who are interested in the new parsing system.

After making several small tools for the new parsing system, I now have a first version of a medium-sized tool–the 'url class'. This object defines a type of URL, like 'gelbooru post url', and how the client can recognise them. It will be used in the final downloader engine to connect URLs to appropriate parsers.

It can also do URL 'normalisation', which will let the client strip off redundant URL data and hence collapse URL dupes. For instance, e621 and some other boorus put user-managed metadata in the URL, which means the file post URL can change from time to time (and result in the client downloading it again, thinking it could be a new file). For example, the URLMatch can collapse this:

https://e621.net/post/show/1389870/-absurd_res-ambiguous_gender-bow-cheek_tuft-clothe

Down to this:

https://e621.net/post/show/1389870

Which is still valid!

I have thrown together a simple listctrl in the services->manage network rules dialog to hold a list of these for now. It doesn't do anything except editing atm. I expect to add a larger layer of options here to handle misc settings like 'show/hide these urls on the media viewer' and some stuff for retroactively collapsing duplicates at the db level, but please do play with this stuff and let me know if there are any types of URL this object cannot handle and normalise.

I also made some Hentai Foundry url classes as an example–just hit the button on the dialog to load them and see how it all works. If you need any more help, please send me a message or grab me on the discord.

full list

- fixed subscription queries turning dead on the initial sync

- all dead subscription queries have been set to check again in case they can revive

- added query file velocity to edit subscription panel

- subscription network contexts now reflect the new multiple subscription query system, and are named "sub_name: query_text". as every query now counts as its own separate subscription network context, this will stop query-heavy subscriptions from throttling so much on bandwidth limits

- finished URLMatch object, which matches and normalises URLs into certain 'classes' like 'gelbooru post url'

- expanded some URLMatch subdomain options

- fixed some test logic in URLMatch

- finished the last of the EditURLMatchPanel

- split the 'manage network rules' dialog into two panels–it now has a 'url classes' tab

- wrote a panel for managing url matches

- added export/import/duplicate buttons to EditURLMatchesPanel

- wrote some URLMatches for hentai-foundry as an initial test of the system and added a temp button to add them–please check them out to see how it all works

- all, invert, inbox, and archive (and none, lol) thumbnail 'select' menu items now have counts

- invert is now at the bottom

- the thumbnail select menu now has local/remote entries if applicable (this typically is only true in 'all known files' file domain)

- added png/clipboard export/import/duplicate code to the generic new listctrl button wrapper panel, which will save a bunch of time as the png/clipboard sharing system expands

- added a human-facing serialisable name to all objects on the new serialisation system and tied the new import/export code into it for png presentation

- the edit import folder dialog will now complain (but not veto) on an ok event if any of the entered paths do not exist

- if you attempt to manually run an import folder while import folders are globally paused, you'll get a little popup telling you so

- added an experimental 'thumbnail fill' setting to options->gui. it zooms the existing thumbnails so they fill the whole thumb space. feedback on this from those who would be interested in a prettier system would be appreciated

- added 'paste tags' buttons to filename tagging options panel

- the paths/urls in the file import cache are now their own object that holds the creation/modified/source times and current status and note. this object can also hold prospective urls, tags, and hashes for future use

- a bunch of file import actions are faster

- all the different importers now use this new file import object

- fixed a screen position calculation in the new drag and drop filtering code that was accidentally including too many possible drop candidates on drops in the top-left corner of the main gui (if you had trouble moving tabs to the left, this should be it fixed!)

- fixed a problem display volume/chapter/page tags that included unicode characters in thumbnail banners and media viewers

- fixed a rare media display bug in the dupe filter

- fixed some 'C++ part of panel has been deleted' bugs in review services if the frame is shut down before delayed db info is fetched

- cleaned up some more 'C++ deleted' errors in import files selection dialog

- fixed the network context custom header panel 'add' action, which wasn't saving the value of the panel

- fixed a bunch of bugs in the newish QueueListBox class

- SynchroniseRepositories daemon will be better about quitting early on application shutdown

- cleaned up some pending pretty timestamp grammar

- when the client cannot clean up a temporary file, it will print more error information

- added pylzma to the 'running from source' library recommendations. this is not required, but if available it adds ZWS flash support

next week

Domain manager stuff to handle these new url classes, and maybe some parsing engine improvements.

f956fc No.7368

Can I suggest two simple quality-of-life features for the next update?

- clear button for pending queries

- ability to select multiple pending queries for selective deletion/priority update


4eb71e No.7371

YouTube embed. Click thumbnail to play.

I made an alternate Linux build for people having trouble with the official build. A few things are still weird, but overall it works better for me than the official. Run from source works slightly better, but pip is a headache. Built on Linux Mint 18, so it should also work on Ubuntu 16.04.

If you want open externally to work, you will have to manually set the open program for each mimetype in options->files and trash. For some reason, when Hydrus invokes xdg-open it opens a program in WINE.

https://www.mediafire.com/file/smwrp6b9ms59ek1/hydrus-284.tar.gz

I'll post one of these every week until the official Linux build works on my machine. If anything is broken, tell hydrus_dev (and thank him while you're at it). He was kind enough to give me his build command, but I don't know Python. If something is broken, I'm probably just as clueless as you are.


6579b7 No.7381

File: bb2dfc462c0a438⋯.png (3.89 MB, 1920x1200, 8:5, toztraps.png)

OR search when?


39ae64 No.7385

File: c184d7e67c4bfb6⋯.gif (7.85 KB, 63x105, 3:5, original.gif)

File: e12154dc1f330a4⋯.png (2.53 KB, 152x127, 152:127, before.png)

File: 668acb8bbc917b7⋯.png (27.29 KB, 152x127, 152:127, after.png)

>I suspect 100% fill is not desirable

You are correct.

I think zoomed thumbnails should scroll based on your cursor position when hovered over


e9de8a No.7386

I hope that, at some point, someone makes an ios app for viewing and searching images. That would be AMAZING. I've read that it wouldn't be too difficult to create an api, but hopefully someone actually makes an app.

Also does anyone know if there's a way to change the theme of hydrus / a single application in windows 10 to windows 98 style?


39ae64 No.7388

File: 783d766d5277862⋯.png (21.58 KB, 836x159, 836:159, click the second thing fro….png)

>>7386

I don't know if 10 still has it but in Windows 7 you can change to a Windows Classic theme and get the older-style look. You can't apply it to only a single window, if that's what you're asking.


0471b2 No.7392

Have an idea based on my current need for over 165 tabs but getting crashes every now and than.

is it possible to implement a rolling page save?

Some way to crash, load blank, do what I need to do, then go to the menu and reload a rolling save? a new one would be made on the session start, or when users want it to start (I personally leave the program on till I update barring crashes, some people may open it multiple times a day so a rolling save may not be the best to have on automatically for them)

I have just had a few crashes recently trying to get some shit done, that has had me loose 5 tabs of images to quick parse.

what saved me is the nature of the tabs, the last thing acquired in the newest tab + age filter allowed me to bring the tabs back to life, but something like this tab

221 successful, 5927 failed, 4 previously deleted, 1435 already in db

This tab would need to have its failed images links saved off program, and possibly go through the previously deleted images just to know what they are.

I can't think of much use case other than just being able to start a blank page with no worry or able to recover a stupid tablist you have without losing some data.

Also, is it possible to set the program to not worry about tabs before you make the blank page or last left off choice ?


13c19b No.7396

File: 7c5a3b1282c0689⋯.jpg (118.05 KB, 736x1078, 368:539, 7c5a3b1282c0689321f7b38ac6….jpg)

>>7368

Can you explain this more? What do you mean by 'pending query'? Is that in the subscription system or a reguar file search? What would these clear/deletion/priority actions do in more detail?

>>7381

This will be a big job. It will be up for vote to work on next when the current downloader overhaul is done.

>>7392

Yeah, I think I will make all the sessions auto-save like 'last session'.

Can you explain your last question more? What do you mean by 'not worry about tabs' before the post-crash choice?


f956fc No.7398

>>7396

Sorry, Im a little scatterbrained when it comes to details.

The queries I was referring to are those under the gallery downloader. You know how you have a box for pending queries while the gallery parser is currently running?

I would like a clear button to quickly delete all pending queries instead of having to manually click one then click the X over and over.

Alternatively, I might not want to delete them all, but maybe some of them. Hence it would be nice to be able to ctrl-click multiple pending queries and delete them by clicking the X.

Hope thats more clear.


0471b2 No.7401

>>7396

so i'm at 170 tabs, yea I know, I have a fuck ton to go through after the import of an image archive so I put it off, said import is also 3 saved sessions big to give some perspective on why I'm putting it off.

so, here I am, 170 tabs, the program crashes when I try to fullscreen but before I save the sessions last 3 days.

so the program crashes, I load it back up, the program defaults, at least for me, to not remember the no page limit. so it loads up 165 tabs, and tells me to fuck off with the last 5 and no real way to recover those 5.

passed 170 tabs for me introduces instability, 175 is most pages I can open without consistent crashes, but due to the archive imports, i'm constantly working on 160-170 tab range.

what saved me in this case what the 5 tabs that were lost were shit that I can easily recover, but like I mentioned >>7392

this tab

221 successful, 5927 failed, 4 previously deleted, 1435 already in db

I would have lost the failed data so there would be no method of recovery for the failed files.

Is it possible to put a check box on the session recovery to start it up in no page limit mode?


0471b2 No.7402

File: ed7912b7e5705c8⋯.png (1.54 MB, 1920x1200, 8:5, client_2017-12-03_15-57-19.png)

File: 4c1e16259456fb6⋯.png (1.54 MB, 1920x1200, 8:5, client_2017-12-03_15-57-30.png)

Oh, I also forgot, the reason i'm here today.

I asked this awhile back but don't think I ever got a response to it.

I tag almost exclusively with ratings because it's honestly easier than tags for chewing though MANY files.

When I made the short cuts, I want to say they only added the rating, not also remove it. Is there any way to remove the on off status from tags? I can see it being useful in some cases, but honestly I remove rating more often then I mistakenly add them.

If there isn't a way to currently remove the on off switch and just have it be exactly what the rating is for?

here, let me go this way.

The rating i'm using when parsing images right now is just favorite and tag later.

favorite being an image I want to have on a short list, tag later being a 'there is something special about this make damn sure you do it right' tag.

However, this tab has 230 new imports and 139 already in db, so if they were rated in the past, lets give an example, this image was one that was already imported and rated.

The difference is very small, and very hard to notice, something I like given I want ratings out of the way. outside of just being able to see that they are working whenever the program hangs.

wanting to parse the images fast, I may not notice if the thing has a rating, which if the rating shortcut isn't on off isn't a problem, it changed nothing, but is a problem if its on off, as the image is no longer rated.


9de990 No.7404

File: c402f161161d310⋯.gif (973.46 KB, 245x184, 245:184, bunny.gif)

Hydev do you think you could add a gallery download option for inkbunny like there is one for HF and FA in future versions??


6bd278 No.7411

bash: ./client: cannot execute binary file: Exec format error

Am I retarded? What am I doing wrong? This is debian btw.


b0a3bd No.7412

>>7411

Did you extract with the command "tar xvf <filename>"?

What does it say when you run "uname -a"?


6bd278 No.7413

>>7412

Linux Hostname 4.13.0-1-686-pae #1 SMP Debian 4.13.13-1 (2017-11-16) i686 GNU/Linux

I just used xarchiver because it's just easier to use a gui at times.


b0a3bd No.7414

>>7413

You're using i686 which is 32bit and the linux binary was compiled for 64bit operating systems

If possible upgrade to Debian's amd64 version or maybe try running from source if your cpu doesn't supoprt 64bit


6bd278 No.7415

>>7414

Ah thats what I thought but I wasn't sure. How would I run from source with this? I would try make but I didn't see any kind of makefile.


b0a3bd No.7416

>>7415

It's a python script so just execute it with python.

Be warned it requires a boatload of dependancies that you'll have to hunt down.

$python2 client.py


6bd278 No.7417

>>7416

Well hey its a start! I'm going to just run it a shit ton of times finding each thing that fails because I didn't notice a dependencies list on the github.


6bd278 No.7419

heres all the dependencys for the client that I found, I don't know if the server requires any other ones but it probably does.


python-yaml
python-bs4
python-lz4
python-psutil
python-send2trash
python-wxtools
python-requests
python-pafy
python-opencv
python-pil
python-hsaudiotag (in debain requires pip to install)
python-pypdf2

Also here's the desktop file I made for the client if someone gives a shit for some reason.

[Desktop Entry]
Version=284+
Name=Hydrus client
Comment=A personal booru-style media tagger
Exec=python2 client.py
Path=/opt/hydrus/
Icon=/opt/hydrus/static/hydrus.png
Terminal=false
Type=Application
Categories=Graphics;
Name[en_US]=Hydrus client

If I did something retarded call me out, thanks.


13c19b No.7423

File: 3dbec33b2379809⋯.jpg (485.68 KB, 1350x2474, 675:1237, 3dbec33b2379809ffa711d73ca….jpg)

>>7398

Sure, thanks for the follow-up! I haven't touched that control in ages, and I hadn't realised it was still single selection. I actually have a new control to handle this stuff better. I can't fit it in for tomorrow, but I will make sure to update this next week.

>>7401

I see, thanks for explaining. I have changed the strict notification to have a yes/no dialog that optionally turns 'no limit' mode on.

I think I fucked up the logic as well here, as the new standard was supposed to be 'warn at 165, force-stop at 200'. I've now set this correctly, so you might not even see the new dialog.

>>7402

Thanks. There isn't a way to set a 'set only' shortcut at the moment, but I built the code to eventually extend to support this. A future iteration of the shortcut system will support choosing this action.

In the meantime, I'll add a debug option in the main options to prohibit the unsetting for next week.

>>7404

I don't have time to write any new parsers in the current downloader system, but my current big job is a download engine overhaul which will ultimately allow any user to create and share their own downloaders without needing my intervention.

If you don't have the html knowledge to create your own even when the new system is ready, I expect another user will, and absent that, please tell me again and I'll throw one together.

>>7419

Hey, I'm sorry you had trouble getting the client going. It looks like you have it figured it out here, but I made a 'running from source' guide in the help if you would like to check it out anyway:

http://hydrusnetwork.github.io/hydrus/help/running_from_source.html

Users running from source in 32bit are rare, so if you decide you like the client, please keep me updated on how it goes! If I break anything for you, let me know and I'll see if I can write a safer exception or whatever.


6bd278 No.7425

>>7423

Alright I will. I honestly don't know why I still run my os in 32bit though. Probably because I fucked up by picking i386 instead of x86 when installing Debian. Well I feel retarded now that I know that I could have been running an 64 bit Debian for the last few months. Guess you gotta learn the retarded way sometimes. I'll probably reinstall whenever I can get my hands on some kind of usb harddrive to fit all my files on. Do you think moving any hydrus database created in this system onto a hypothetical 64bit system would mess anything up?

/blog


f39a77 No.7429

>>7423

>If you don't have the html knowledge to create your own even when the new system is ready, I expect another user will, and absent that, please tell me again and I'll throw one together.

thanks hydev.

yeah, sadly i dont have the knowledge to build that, so i'll just have to wait in the meantime, download pictures manually like i've been doing for years.


0471b2 No.7430

>>7423

That honestly fixes/helps both my issues, thanks.


13c19b No.7431

>>7425

It should be fine. The db should be completely fine to work on any platform, no matter which one it was created on. Make a backup beforehand, though, just in case!




[Return][Go to top][Catalog][Nerve Center][Cancer][Post a Reply]
Delete Post [ ]
[]
[ / / / / / / / / / / / / / ] [ dir / britfeel / had / imouto / jp / lewd / maka / marx / o ]