[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf
Max filesize is16 MB.
Max image dimensions are15000 x15000.
You may upload5 per post.

This board will be deleted next Wednesday. I am moving to a General on 8chan.moe /t/. This board is archived at 8chan.moe /hydrus/!
YouTube embed. Click thumbnail to play.

58a2c9 No.10656

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v330.tar.gz

I had a great week. There are some more login scripts and a bit of cleanup and speed-up.

The poll for what big thing I will work on next is up! Here is the thread: >>10654

login stuff

The new 'manage logins' dialog is easier to work with. It now shows when it thinks a login will expire, permits you to enter 'empty' credentials if you want to reset/clear a domain, and has a 'scrub invalid' button to reset a login that fails due to server error or similar.

After tweaking for the problem I discovered last week, I was able to write a login script for hentai foundry that uses username and pass. It should inherit the filter settings in your user profile, so you can now easily exclude the things you don't like! (the click-through login, which hydrus has been doing for ages, sets the filters to allow everything every time it works) Just go into manage logins, change the login script for www.hentai-foundry.com to the new login script, and put in some (throwaway) credentials, and you should be good to go.

I am also rolling out login scripts for shimmie, sankaku, and e-hentai, thanks to Cuddlebear (and possibly other users) on the github (which, reminder, is here: https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/tree/master/Download%20System ).

Pixiv seem to be changing some of their login rules, as many NSFW images now work for a logged-out hydrus client. The pixiv parser handles 'you need to be logged in' failures more gracefully, but I am not sure if that even happens any more! In any case, if you discover some class of pixiv URLs are giving you 'ignored' results because you are not logged in, please let me know the details.

Also, the Deviant Art parser can now fetch a sometimes-there larger version of images and only pulls from the download button (which is the 'true' best, when it is available) if it looks like an image. It should no longer download 140MB zips of brushes!

other stuff

Some kinds of tag searches (usually those on clients with large inboxes) should now be much faster!

Repository processing should also be faster, although I am interested in how it goes for different users. If you are on an HDD or have otherwise seen slow tag rows/s, please let me know if you notice a difference this week, for better or worse. The new system essentially opens the 'new tags m8' firehose pretty wide, but if that pressure is a problem for some people, I'll give it a more adaptable nozzle.

Many of the various 'select from a list of texts' dialogs across the program will now size themselves bigger if they can. This means, for example, that the gallery selector should now show everything in one go! The manage import/export folder dialogs are also moved to the new panel system, so if you have had trouble with these and a small screen, let me know how it looks for you now.

The duplicate filter page now has a button to edit your various duplicate merge options. The small button on the viewer was too-easily missed, so this should make it a bit easier!

full list

- login:

- added a proper username/password login script for hentai foundry–double-check your hf filters are set how you want in your profile, and your hydrus should inherit the same rules

- fixed the gelbooru login script from last week, which typoed safebooru.com instead of .org

- fixed the pixiv login 'link' to correctly say nsfw rather than everything, which wasn't going through last week right

- improved the pixiv file page api parser to veto on 'could not access nsfw due to not logged in' status, although in further testing, this state seems to be rarer than previously/completely gone

- added login scripts from the github for shimmie, sankaku, and e-hentai–thanks to Cuddlebear and any other users who helped put these together

- added safebooru.donmai.us to danbooru login

- improved the deviant art file page parser to get the 'full' embedded image link at higher preference than the standard embed, and only get the 'download' button if it looks like an image (hence, deviant art should stop getting 140MB brush zips!)

- the manage logins panel now says when a login is expected to expire

- the manage logins dialog now has a 'scrub invalidity' button to 'try again' a login that broke due to server error or similar

- entering blank/invalid credentials is now permitted in the manage logins panel, and if entered on an 'active' domain, it will additionally deactivate it automatically

- the manage logins panel is better at figuring out and updating validity after changes

- the 'required cookies' in login scripts and steps now use string match names! hence, dynamically named cookies can now be checked! all existing checks are updated to fixed-string string matches

- improved some cookie lookup code

- improved some login manager script-updating code

- deleted all the old legacy login code

- misc login ui cleanup and fixes

- .

- other:

- sped up tag searches in certain situations (usually huge inbox) by using a different optimisation

- increased the repository mappings processing chunk size from 1k to 50k, which greatly increases processing in certain situations. let's see how it goes for different users–I may revisit the pipeline here to make it more flexible for faster and slower hard drives

- many of the 'select from a list of texts' dialogs–such as when you select a gallery to download from–are now on the new panel system. the list will grow and shrink depending on its length and available screen real estate

- .

- misc:

- extended my new dialog panel code so it can ask a question before an OK happens

- fixed an issue with scanning through videos that have non-integer frame-counts due to previous misparsing

- fixed a issue where file import objects that have been removed from the list but were still lingering on the list ui were not rendering their (invalid) index correctly

- when export folders fail to do their work, the error is now presented in a better way and all export folders are paused

- fixed an issue where the export files dialog could not boot if the most previous export phrase was invalid

- the duplicate filter page now has a button to more easily edit the default merge options

- increased the sibling/parent refresh delay for 1s to 8s

- hydrus repository sync fails due to network login issues or manual network user cancel will now be caught properly and a reasonable delay added

- additional errors on repository sync will cause a reasonable delay on future work but still elevate the error

- converted import folder management ui to the new panel system

- refactored import folder ui code to ClientGUIImport.py

- converted export folder management ui to the new panel system

- refactored export folder ui code to the new ClientGUIExport.py

- refactored manual file export ui code to ClientGUIExport.py

- deleted some very old imageboard dumping management code

- deleted some very old contact management code

- did a little prep work for some 'show background image behind thumbs', including the start of a bitmap manager. I'll give it another go later

next week

I have about eight jobs left on the login manager, which is mostly a manual 'do login now' button on manage logins and some help on how to use and make in the system. I feel good about it overall and am thankful it didn't explode completely. Beyond finishing this off, I plan to continue doing small work like ui improvement and cleanup until the 12th December, when I will take about four weeks off over the holiday to update to python 3. In the new year, I will begin work on what gets voted on in the poll.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10657

Someone is telling me the e-hentai login script I have put in here may not work well. If you are interested in that, please check the github later this week for an updated version! I will roll any better versions into v331.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10658

>>10657

I am told this new one should work better: https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/blob/master/Download%20System/Login%20Scripts/e-hentai%20login%202018.11.12.txt

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10662

>>10652

Yea, my sub is a bit autistic, wont lie about that, but the main aspect of it is the low end where a 5 gap can have 10-20 results easily,

could probably try a 50 or 100 gap and see if that has any major differences or if that decides to stop looking which is the main thing I want to avoid. I'll have to look into that.

as for the show new files, would it be possible to have that one's set specifically to show new files and the other one shows user preference?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10664

Ok updated and had a look at the login,

had a specific hentai foundry I wanted to look up

Set it up so I think I log in

tested it worked

then went to download

the program was logging in, but it went ahead with downloading anyway.

3 downloaded, of the 36 images they had on the second download.

I think you need to stager downloading a bit from logging in.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2c2a2c No.10666

Is >>10385 fixed yet?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a9081f No.10672

Three more versions until trips, l/a/ds!

I can't wait, to be honest.

How should it be celebrated?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10686

>>10662

Ok, have enough data now from a smaller list, each of the subs that have more then 15 images constantly have a 'we seen 5 similar images, were done now' problem.

granted, this will be solved once a derpi log in script happens and I can catch more then 50 images a look up

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fc6450 No.10688

Hi master chief

baraa272

could you please look at your email ?

all love and respect though <3

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

77893d No.10690

>>10688

Oy who you?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ba5c70 No.10691

File: cd2db2c71ad64ae⋯.png (236.38 KB,393x575,393:575,1425519042965.png)

yo hydev, do you think it'd be possible to make a user gallery downloader for https://beta.furrynetwork.com/ and weasyl.com like its been done for inkbunny and FA?

cheers to you.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9e1e8f No.10693

>>10691

Learn 2 Write Scripts like https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10697

>>10662

I am very sorry, I still do not understand what 'show new files' vs 'shows user preference' means. Can you give me an example of the workflow you are going for here?

>>10657

That's odd–any request on the domain is supposed to wait for the login process to finish. Could it be possible that the old requests maybe thought they were still logged in with the old click-through HF login? Let me know if you experience other unusual HF behaviour or missed files.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10698

>>10666

Not yet. I have it in my list. I got it started, but I'll first have to add some faster db sibling fetching/lookup code before I can actually fold in the additional sibling results.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10699

>>10691

I am afraid I am trying not to put time into making new parsers. I made the new download system completely user-editable to spread the load a bit, as I was getting overwhelmed with the infinite list of new sites to deal with. I will post your request to the hydrus discord at https://discord.gg/3H8UTpb . If you are comfortable with discord, you are welcome to join and talk to the parser writers there, who can also help you add downloaders if you are uncertain how to do it. Those look like big sites, so I am sure it will get a parser eventually on the github at >>10693 .

If you are familiar with html, you may be able to help out as well! If you are experienced, here is the help on writing your own:

https://hydrusnetwork.github.io/hydrus/help/downloader_intro.html

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5f58fd No.10711

File: c6fd4cb1bc28ff6⋯.png (4.38 KB,512x110,256:55,weasyl tag search.png)

>>10691

Here's one for ya, working on the other

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10712

File: e150f914b626ef6⋯.png (2.4 KB,1046x26,523:13,client_2018-11-18_06-50-37.png)

File: 33061b9d2e71e3c⋯.png (4.04 MB,2002x2021,2002:2021,client_2018-11-18_06-53-06.png)

>>10697

Ok, generally when I open up a watcher, I want to see the images the thread gave me, such as…

lets use this one as an example as it illustrates it best.

https://boards.4chan.org/trash/thread/19470741

https://desuarchive.org/trash/thread/19470741/#19470741

4chan link and the archive link in case you don't see it fast enough.

these threads are fun to go through see if I win the games with the least compromises

With the ability to show new files counts in the watcher list, i can easily see it has 60 new images as of this post,

If I right click it and have it open in its own window I get 117 image, or what the watcher has in total

but if I change the settings to only show new images, ill get the reduced count and i can easily see if there are any updated games, of which there are few.

Now, the process to only show new, or show all while simple, is cumbersome to keep going back and forth, which is why i'm wondering if there is a way to hard code an only new filter alongside the whatever the user has set filter.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10713

File: cd702a1b9c834cb⋯.png (3.53 MB,2002x2021,2002:2021,client_2018-11-18_06-52-58.png)

>>10712

bah the third image did not upload

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10720

>>10711

Top stuff, thank you for figuring this out. >>10691 Save this png and then drop it onto Lain under network->downloaders->import downloaders.

>>10713

>>10712

I see, thanks for explaining! I will figure out a right-click menu entry or something for this.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10728

>>10720

I dont think its menitoed here yet, but 4chan is apparently splitting itself to family friendly domain and the adult domain.

as of now everything is the same, besides some boards being able to be hosted under 4channel.org instead of 4chan.org

probably want to update the watcher to take in 4channel along with 4chan

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a73707 No.10729

>>10728

>4chan is apparently splitting itself to family friendly domain and the adult domain.

Seems fucking retarded, what's wrong with just having blue boards?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10730

>>10729

the problem is gook moot wants to monetize 4chan, and passes aren't good enough for him.

He constantly tries to look for ways to guilt people into buying passes and considered ways to monetize, some of which are so questionable people decided domain culling was required for 4chan going forward.

If he splits 4chan off from blueboards and adult ones, it will appeal to more advertisers then just the weeb porn ones.

Apparently 4chan itself will still work the same way it always has, but the blue boards will be under a different domain. for me, I use a custom header so that has no real change to me, I have a pass and I ad block, so nothing will change there, and for the most part I dont like the blue boards because 4chan has went from a place where nigger and faggot were the go to insults to saying someone is a moron and disagreeing with them will get you a 4 day suspension. only reason I have a pass at all are the boards I go to and am active on, I got so sick of captchas that I said fuck it and went pass.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

be0786 No.10732

WARNING:root:pafy: youtube-dl not found; falling back to internal backend. This is not as well maintained as the youtube-dl backend. To hide this message, set the environmental variable PAFY_BACKEND to "internal".

Traceback (most recent call last):

File "/opt/hydrus/client.pyw", line 20, in <module>

from include import ClientController

File "/opt/hydrus/include/ClientController.py", line 14, in <module>

import ClientCaches

File "/opt/hydrus/include/ClientCaches.py", line 5, in <module>

import ClientRendering

File "/opt/hydrus/include/ClientRendering.py", line 2, in <module>

import ClientImageHandling

File "/opt/hydrus/include/ClientImageHandling.py", line 3, in <module>

import cv2

ImportError: No module named cv2 looks like

opencv update on Arch makes hydrus unable to boot, 3.4.3-5 -> 3.4.4-1

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0e7d2f No.10735

>>10729

>Seems fucking retarded, what's wrong with just having blue boards?

He has done the same thing to 2ch.

His explanation was like this.

If something wrong occurs in an adult board like someone uploading CP and law enforcement will shuts down 2ch entirely.

But as far as 2ch and adult boards called pink server separated and we treat these two as complete different sites.

At least 2ch is kept safe.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10737

>>10732

Thanks. I found this after a bit of searching:

https://bugs.archlinux.org/task/60855

https://github.com/opencv/opencv/issues/13202

So I guess those are some places to watch? If the python bindings for cv got messed up in the new version, I should think reverting is the simplest solution for now.

OpenCV is critical to Hydrus's drawing, so I'm afraid there isn't much I can easily do on my end.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

58a2c9 No.10738

>>10728

Thank you for reminding me of this. I made a new url class, rolling out tomorrow, that seems to add complete support. (we'll see if after the official split if sfw content/api is still stored on 4cdn domain, which the current watcher goes to)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7b47b9 No.10745

>>10730

>>10729

learned a new thing since posting that.

4chan lost stripe, you cant buy passes with credit cards, this is the reason for the split.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


[Return][Go to top][Catalog][Nerve Center][Random][Post a Reply]
Delete Post [ ]
[]
[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]