/hydrus/ -Version 338

Name
Email
Subject	REC STOP
Comment *
File	Select/drop/paste files here
Password	(Randomized for file and post deletion; you may also set your own.)
Archive	Archive [500 char limit]
* = required field	[▶Show post options & limits] Confused? See the FAQ.

Embed	(replaces files and can be used instead)
Options	Do not bump (you can also write sage in the email field)
Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf Max filesize is16 MB. Max image dimensions are15000 x15000. You may upload5 per post.

File: fa486f8bbe5b89a⋯.mp4 (11.61 MB,1280x720,16:9,yata.mp4)

Version 338 hydrus_dev ## Board Owner 01/30/19 (Wed) 23:15:46 5b9262 No.11493

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v338/Hydrus.Network.338.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v338/Hydrus.Network.338.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v338/Hydrus.Network.338.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v338/Hydrus.Network.338.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v338.tar.gz

The recent v335 was an important update. If you are updating from v334 or earlier, please go read that release post for your special one-time update instructions and update to v335 before you try this week. Once you have updated to v335, the process for updating to anything newer is back to normal.

I had a great week. There's some bug fixes and neat new tag stuff.

tags

After talking to some users this week, I decided to knuckle down and improve autocomplete tag input. This has been in the works for a long time, but I have had trouble just putting the time in.

So, the autocompletes for both file searching (on pages) and tag management (on manage tags dialog) now work asynchronously! They search in the background, letting you continue typing smoothly without hanging you up. Large and laggy searches are cancelled mid-job as needed. Hitting enter before results come in is much smoother and more reliable, so if you just want to add simple tags like 'green eyes' by typing them in and hitting enter, it is much easier and less janky.

I am very happy with this change. Improving the core experience is something I want to do more. That said, I did this in a slightly rough way (I am wrestling with some terrible ancient code here), so there may be some bugs for certain workflows. If you discover you are getting false positives when typing fast or any other strange behaviour, let me know. This new system may want some different fetch timing settings, as well. All feedback welcome, basically.

Also, any 'selection tags' taglist on a regular page now lets you right-click->select all files with (selected tags)! If you select multiple tags for your right-click, you can either select the files with all the tags (AND), or those with any of the tags (OR). This is pretty neat, so give it a go!

misc

Pages now have a 'sort by approx bitrate' in their sort dropdown. This does a very basic (filesize / duration) calculation (putting durationless files on the smaller end) and lets you prioritise bloated gifs and other short, high-filesize (i.e. easy and useful to filter) vids.

Gelbooru changed up how some of their URLs work, so they suddenly started giving 403s for the hydrus default downloader. This release folds in a new parser that works again and a couple of new downloaders for gelbooru user favourites and pools.

I fixed an issue that meant preview view duration was ofter being counted in the new file viewing statistics system even while previews were in hidden pages.

full list

- after talking with some users, put a bit of time into tag autocomplete wolkflow. both read (search pages) and write (manage tags) autocomplete inputs now operate ~asynchronously~, with the tag fetch working on a separate thread. tag jobs can also now cancel at certain checkpoints in the tag search process if overwritten by a new request. therefore, a variety of tag lookup scenarios _should_ be less painful. this change was executed in a semi-inelegant way, so please report if you encounter bugs from fast typing etc…

- I also improved some of the "I hit enter before results were in" code as a result of this. not sure I have it totally nailed, so please give feedback on errors here

- wildcard search tags now have an explicit '(wildcard search)' after their label

- taglists that have an attached page of media (basically the 'selection tags' box and the 'active search predicates' up top) now have a right-click menu entry to 'select files with (all these tags)' and, if more than one tag is selected, 'select files with (any of these tags)'! This is pretty neat in action, so give it a go!

- added a 'sort by approx bitrate' file sorting option that does a basic filesize/duration so you can filter out dense gifs and other short-but-big vids a bit easier. anything without a duration is shoved to the 'smallest' side

- some of the file sort options now default to their respective 'biggest' first, see how you like it

- folded in updated gelbooru file page parser (fixing the 403 errors that just appeared) and added searches for gelbooru user favourites and pools

- if a gallery or watchable url ends up in the file processing queue (and hence fails), it now says the believed-to-be url class name in the error, which should help some false positive url class matching debugging

- fixed a focused-file selection issue that meant preview viewtime was frequently counting in file viewing statistics even while a page was not currently in view

- fixed the local booru review service panel, which wasn't fully deleting shares when the button was clicked

- wrote a service object and basic server skeleton for the client api (basically refactoring the existing local booru code). client api now appears in manage and review services and can boot and present the normal hydrus browser welcome page at '/'

- the client api and the local booru now have an 'allow non-local connections' checkbox! defaulting to off and on respectively

- updated a wx-thread call function to more safely and universally deal with instances where the responsible window died before the call could be made

- removed some old experimental crypto code that isn't used any more–pycryptodome is no longer needed to run the program from source

- improved some misc client service code

- deleted some old unused code

- misc cleanup

- updated to ffmpeg 4.1 on windows release

- updated to sqlite 3.26 on windows release

- updated to wxpython 4.0.4 on all platforms

next week

The Client API continued to go better than expected this week. If you explore manage/review services, you'll see the stubs of the new 'client api' service and can even boot a skeleton server. I'll work on a bit more ui and access code this week, and with a bit of luck, I'll actually have it doing something fun for v339.

____________________________

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Post last edited at 01/31/19 (Thu) 01:01:11

Anonymous 01/31/19 (Thu) 00:42:34 de0b8d No.11494

the fuck is that image? modded game or someone being stupid with something like source filmmaker?

also what's up with the exe version?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 00:44:01 05ee52 No.11495

>The recent v335 was an important update. If you are updating from v334 or earlier, please go read that release post for your special one-time update instructions and update to v335 before you try this week. Once you have updated to v335, the process for updating to anything newer is back to normal.

I did, I'm still not sure what I'm fucking up. I even tried the automated .exe for v335 but still nothing.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 01:03:33 5b9262 No.11496

Hey lads, the first exe installer I put out earlier was broken–it wasn't updating four wx dlls in the base dir. The new exe link in the OP is now the fixed installer. If you got the 338 exe within about 50mins of the post going up and you can't run the client, please get the new one and try again.

I am sorry for this problem. Due to a testing mistake, I missed it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 01:06:44 5b9262 No.11497

>>11494

Don't know the game, but some nips are having fun with modding, I think:

https://twitter.com/_TAKUMI928_/status/745625326340890624

https://twitter.com/toribako145/status/1089427764946432000

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 01:08:40 5b9262 No.11498

>>11495

Hey, did you get hit by my bad exe just now, as per >>11496? If you updated to this 338 just after my OP went up and your client doesn't boot, please try the new link in the OP, which is a fixed exe installer. If you are having trouble with the 334->335 step, what happens when you try to run the client?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 01:11:17 05ee52 No.11499

>>11498

>Hey, did you get hit by my bad exe just now, as per >>11496?

No, it was the 335 exe, before that I tried the 337, 336 and 335 zip.

>If you are having trouble with the 334->335 step, what happens when you try to run the client?

I run client.exe and nothing happens, when I check on the processes I can see that the process starts then instantly closed.

It's either FUBAR or somehow regarded as a normal execution because it doesn't leave any crash logs anywhere.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 01:18:26 5b9262 No.11500

>>11499

The 335 exe installer is supposed to perform the 'clean install', as described in the 335 release post, automatically. If your install directory has had some custom changes, it might have not removed everything it needed to. Something else might have gone wrong as well.

If you have a backup, please roll back to it. If not, you might like to make one right now–copy everything in your install_dir/db folder to a usb drive with some space.

Then try following the 'clean install' instructions for 'extract only' users in the 335 release post. Read it fully, but essentially you'll be manually deleting everything in the install dir except the 'db' directory and its contents (where your db and all your files are) and then extracting the new 335 onto that.

If you are a Windows 7 user, you may need to some OS updates and the VCRedist 2015 to run the new build.

If you still have problems, what version are you updating from? Is it fairly recent, like 330-334, or much earlier?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 01:24:34 05ee52 No.11501

>>11500

>Read it fully, but essentially you'll be manually deleting everything in the install dir except the 'db' directory and its contents (where your db and all your files are) and then extracting the new 335 onto that.

I tried installing it, both the zips and the exe, to a new folder just to be sure, same thing happened.

>you may need to some OS updates

That might be the problem.

>Is it fairly recent, like 330-334,

334

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 01:31:44 5b9262 No.11502

>>11501

Ah, right. I think this is the chain you want: >>11260

Just install the updates seems to be the solution. A couple of guys had that.

If you can't get Win7 updates for now, if you do another clean install and revert back by installing 334, you should be good to use that for now. Since 335 never booted, it never had the opportunity to update your db.

Let me know if you discover anything new.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Post last edited at 01/31/19 (Thu) 01:32:29

Anonymous 01/31/19 (Thu) 01:53:28 05ee52 No.11503

>>11502

334 is working.

I'll try updating though. It's been so fucking long windows updater needed an update.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 01:55:43 fcc3ea No.11504

>>11497

My ex plays this game, it's Assetto Corsa

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 01:58:38 05ee52 No.11505

File: 6a940df213259b6⋯.png (11.12 KB,574x150,287:75,ClipboardImage.png)

>>11503

there's_your_problem.png

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/31/19 (Thu) 18:35:28 05ee52 No.11511

File: e77d77eb7157f4b⋯.png (7.06 KB,622x118,311:59,ClipboardImage.png)

>>11505

Finally got it to boot up, it was a problem with the updates.

I tried installing them bit by bit so I wouldn't end up with useless updates, but in the end I had to install pretty much all important updates.

I'm not sure if there's one update in specific that fixed it, or if all important updates were needed, but here's the last batch of updates I did before it finally ran.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/01/19 (Fri) 04:49:16 c2185b No.11515

>updated a wx-thread call function to more safely and universally deal with instances where the responsible window died before the call could be made

>updated to wxpython 4.0.4 on all platforms

nice, hope this clears up that broken context menus.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/02/19 (Sat) 01:30:50 4c5469 No.11518

File: 0837c57fb8d3480⋯.png (45 KB,692x945,692:945,screenshot.24.png)

Hello. The memory issue when regenerating autocomplete cache still seems to be an issue for me. After about 15 minutes, ram usage constantly increases until it maxes out and forcibly closes. I'm regenerating since I believe my autocomplete was borked in the past. If there's an alternative way to do this, please let me know, thanks.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/02/19 (Sat) 04:43:25 ea0696 No.11519

>>11511

So you have to have wangblows 10 botnet updates to run this thing? Doesn't that defeat the whole purpose of staying on Windows 7? This software is effectively unusable then.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 02/02/19 (Sat) 22:09:12 5b9262 No.11524

>>11505

>>11503

>>11511

Thanks for this. I am glad we got it sorted.

>>11519

As I understand, the new python is built on a new VC++ compiler that has dlls/whatever that Win7 will have to update to get. There is more info here:

https://wiki.python.org/moin/WindowsCompilers

I don't know all the technical details though. I had thought it was just the VCRedist 2015, but it seems there is this update stuff as well. Thankfully Win7 isn't completely written off yet.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 02/02/19 (Sat) 22:10:34 5b9262 No.11525

>>11518

Thank you for this report. I am afraid I have not yet done the 'breaking into chunks' work here to fix your problem. It is in my to-do list.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/03/19 (Sun) 10:53:26 a2627b No.11528

File: 114a4f67e41d3ae⋯.png (14.07 KB,1450x73,1450:73,Untitled.png)

So I'm suddenly getting the occasional FileMissingException error while browsing my collection. I closed Hydrus and check my drive with chkdsk and finding no issues. Then I go and look in the actual client_files folder if the file is really missing, and it's not! Well, it kind of is but not really. It exists as a webm file but Hydrus seems to think it should be a mkv file! It even has a medium:webm tag so I know that's what it's supposed to be. To be clear the file exists as [hash].webm but Hydrus throws an error saying [hash].mkv does not exist. What the hell is going on?

FileMissingException
No file found at path + X:\Hydrus\dbs\db_hentai\client_files\f4f\4fc881551b39b7b9d01d4007ce2d27b584b5f50721a103f2cd73720163bb41ea.mkv!
  File "include\ClientGUICanvas.py", line 415, in EventPaint
    self._video_container = ClientRendering.RasterContainerVideo( self._media, self.GetClientSize(), init_position = self._current_frame_index )
  File "include\ClientRendering.py", line 205, in __init__
    RasterContainer.__init__( self, media, target_resolution )
  File "include\ClientRendering.py", line 188, in __init__
    self._path = client_files_manager.GetFilePath( hash, mime )
  File "include\ClientCaches.py", line 1068, in GetFilePath
    return self.LocklessGetFilePath( hash, mime = mime, check_file_exists = check_file_exists )
  File "include\ClientCaches.py", line 1141, in LocklessGetFilePath
    raise HydrusExceptions.FileMissingException( 'No file found at path + ' + path + '!' )

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/04/19 (Mon) 00:39:56 d54cd3 No.11533

>>11524

Got Hydrus 335 to run by installing all Windows 7 updates released before 2017 and running Ancile to supposedly deactivate the botnet stuff, might want to add that to the instructions.

Here's a link to the script if anyone's interested.

https://bitbucket.org/ancile_development/ancile/downloads/

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/05/19 (Tue) 08:04:01 de0b8d No.11534

>>11533

windows offline updater, and look for a list of suspect updates and hard block them, that way you have all the updates with none of the bullshit. and this is a good 2400% faster then normal windows update if I remember correctly.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 02/05/19 (Tue) 19:46:43 5b9262 No.11536

>>11528

Thank you for this report. This is odd and interesting. My first guess is perhaps that file got reparsed at some point with newer code/ffmpeg, so while the db entry considers it more accurately now an mkv, the file structure does not.

Do you ever do right-click->repare and regen thumbs on your movies?

I had not considered this when I wrote this routine (I was thinking of frame counts and bad thumbs at the time). I will update the routine so it updates the file storage as well, and I'll see if I can get it to auto-heal retroactive extension problems like this too. I may not have time to do this today, but please let me know how you get on with this as I roll it out.

If you would like to fix it immediately, you can just manually rename the file's extension in client_files. Afaik, that's the only problem here.

If you believe the file really should be detected as a webm rather than mkv, and it isn't private, please post it here or email it to me and I'll have another look at my parsing.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 02/05/19 (Tue) 19:47:31 5b9262 No.11537

>>11533

Thanks, I will.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 02/05/19 (Tue) 22:15:09 a2627b No.11540

>>11536

>Do you ever do right-click->repare and regen thumbs on your movies?

Yes, in fact I did this on all my videos because I'm the guy who had Hydrus randomly generate broken green thumbnails for videos (which seems to be fixed now by the way, if not by you then perhaps because I got a new computer and switched from Windows 7 to 10).

An auto-fix would be nice because it has happened to a lot more than just that one video.

Is webm and mkv very close in how the files are structured? Because most of these were downloaded from gelbooru which lists them as webm. But I guess it doesn't really matter if the hash stays the same.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 02/06/19 (Wed) 01:28:35 5b9262 No.11541

>>11540

Yeah, iirc, a webm is just an mkv with VP8/9 video and vorbis audio, I think. All webms are mkvs–they are a subset. I think the idea was to guarantee a limited mkv format that would work on all devices for HTML5 streaming etc…

I could also have some of my ffmpeg parsing wrong here, or had it wrong when you did this reparse. I used to use an external library to figure this out, and now I compare ffmpeg output specifically. If you run the reparse again, maybe it'll flip back to webm!

Anyway, should be fixed for tomorrow. Let me know if you still have any trouble.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.