/hydrus/ -Version 337

Name
Email
Subject	REC STOP
Comment *
File	Select/drop/paste files here
Password	(Randomized for file and post deletion; you may also set your own.)
Archive	Archive [500 char limit]
* = required field	[▶Show post options & limits] Confused? See the FAQ.

Embed	(replaces files and can be used instead)
Options	Do not bump (you can also write sage in the email field)
Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf Max filesize is16 MB. Max image dimensions are15000 x15000. You may upload5 per post.

YouTube embed. Click thumbnail to play.

Version 337 hydrus_dev ## Board Owner 01/24/19 (Thu) 00:18:13 e07052 No.11445

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v337/Hydrus.Network.337.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v337/Hydrus.Network.337.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v337/Hydrus.Network.337.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v337/Hydrus.Network.337.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v337.tar.gz

The recent v335 was an important update. If you are updating from v334 or earlier, please go read that release post for your special one-time update instructions and update to v335 before you try this week. Once you have updated to v335, the process for updating to anything newer is back to normal.

I had a good week. A bunch more bugs are fixed, and I added some little things as well.

all misc this week

I fixed a variety of bugs this week. A unicode log printing bug still hanging over from the py3 update, some unusual webms (mostly ones that tend to be a single frame with music), and some network download file size checking.

I also believe I have completely fixed the shutdown memory explosion some users were seeing. I managed to recreate the bug and figured out some bad shutdown scheduling that was causing an event processing routine to go crazy. I cleaned a bunch of other shutdown code as well, including a couple instances of subscription processing not stopping promptly on a client shutdown. Overall shutdown (particularly the last moments just before the splash screen closes) should be a bit smoother for all users.

I also added some little new things. The duplicate system now merges/copies pending tags as well as 'current' tags (and the advanced service-wide content update routine does as well). The 'lain' image on the downloader easy-import page is now clickable to launch a file selection dialog. And the manual export files dialog has a new experimental checkbox for advanced users that tries out exporting symlinks (which requires running as admin mode in Windows, so I don't really recommend it for that). If you try this symlink export, let me know how it goes!

full list

- fixed another couple of unicode encoding problems with the logging and profiling code

- the logger now sticks a unicode BOM at the top of new log files to help text readers guess the utf-8 encoding

- fixed musical webm import when the video stream has no stated duration but the audio stream does and typically stretches out a 'single frame' video

- fixed some 'max size' download file size testing

- 'waiting on bandwidth' statements on network job controls now show the specific network context (like 'web domain: somesite.com') they are waiting on (you might need to hover over to see the tooltip for this)

- the downloader easy-importer lain image is now clickable to launch a file selection dialog

- if you are in advanced mode, the manual file export dialog now lets you export symlinks with a new checkbox. this is experimental, so if you are interested, give it a brief test and let me know how it works for you

- duplicate content merging now applies to pending as well as current tags

- the duplicate filter now counts pending tags when saying which file has more tags

- advanced content updates now _copy_ both current and pending tags. the other actions now state what they do more clearly

- stopped printing long server error text on 304 and 404, where actual response content is uninteresting

- removed wx import that accidentally came into server space due to 2to3 check

- improved the path-fixing code that helps environment construction when launching external programs from non-windows frozen builds

- fixed a critical pubsub processing bug that kicked in at a certain stage of client shutdown. this should stop the post-shutdown-processing memory explosion certain users were seeing and should stop any ui jank in the last 0.2s of the program for everyone else

- improved some other shutdown memory cleanup that was sometimes leading to double-log-printing of exit statements

- did a full pass over the daemon scheduling code. it now reacts more responsively to various shut down situations

- reduced db disk cache aggression significantly and added more memory maintenance to the cache population process

- fixed an issue where subscriptions were not promptly responding to shutdown events

- fixed an issue where some delayed network jobs (e.g. while all network traffic is paused) were also not responding to shutdown events

- added a 'pubsub report mode' debug mode for simpler pubsub review

- the db is now less redundantly spammy on certain behind the scenes update notifications

- wrote a first version of the client api manager and permissions handling objects

- misc fixes, cleaned some shutdown code

next week

I started the Client API for real this week. The first 'manager' component is basically done, and it wasn't as complicated as I feared. I'll get started on some ui code for service review and authorisation management this coming week and otherwise just do some more small work to keep catching up on things.

____________________________

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/24/19 (Thu) 08:29:34 8d960f No.11447

>>11403

>>11412

Did you get a chance to implement the picking the db path this update? I'm looking around and I don't see it. If not, I know you've got your plate full, but do you know when you'll get around to it? Thanks for the frequent updates

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/24/19 (Thu) 12:45:37 528e39 No.11448

File: 58d9ffa235ce042⋯.mp4 (15.32 MB,1280x720,16:9,15 Sorting Algorithms in 6….mp4)

>>11445

I love that video. Here's a mp4 of it.

>the downloader easy-importer lain image is now clickable to launch a file selection dialog

Thanks mate.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/24/19 (Thu) 17:34:01 735628 No.11449

>>11445

>>11448

This was damn satisfying to listen and watch.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/25/19 (Fri) 01:01:43 c2e77a No.11451

>>11445

bogo best sort

https://www.youtube.com/watch?v=HfdT_uOqbvA

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/25/19 (Fri) 21:27:37 309d0f No.11453

File: 945e1dbfef06adc⋯.webm (1.78 MB,520x292,130:73,sort_visualiser.webm)

wew

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/26/19 (Sat) 02:21:36 c2e77a No.11454

>>11453

link to video?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/26/19 (Sat) 21:56:00 e07052 No.11456

>>11447

Not yet. I think I can wangle it this week. I'll write some help and a text file for it as well. Let me know how it works for you once I have it rolled out!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/26/19 (Sat) 22:39:10 91abf6 No.11461

I'm retarded, send help

I tried reinstalling hydrus by nuking every folder and file except "db" in its installation directory, but the newly installed latest hydrus (337) doesn't know that I have a db

How to unbreak this?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/27/19 (Sun) 01:19:33 c2e77a No.11463

>>11461

That should have worked. Check >>11297

What version were you coming from?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/27/19 (Sun) 22:33:36 53ae0f No.11466

>>11463

Coming from 325, but apparently I should have kept the "client.db", and I didn't, so all that's left is the images

Well, looks like i'll have to redownload 15gb+ of stuff

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/28/19 (Mon) 06:00:48 93198f No.11469

Yay! https://github.com/mikf/gallery-dl/issues/135#issuecomment-457920519

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/29/19 (Tue) 19:59:41 e07052 No.11473

>>11456

>>11447

Update: I got started on this and it was unfortunately a real pain. In order to show different possible db locations in ui, I either have to rejigger my startup so the db-based logfile doesn't report the early parts of the program (missing logging a bunch of startup error states) or I have to have a redirect system where everything switches over (which is complicated enough to keep synced, but an additional pain as the new initial db still needs to be writeable and some other bullshit). I don't think I have the time or expertise to do this well and futureproof against bitrot.

Realising I was walking down a bad road, I looked it up and it looks like you can launch apps with args from the command line after 10.6 or so. I played around with some different ways of launching from the terminal and got a good result with:

open -n -a "Hydrus Network.app" --args -d="/path/to/db"

The -n spawns a new instance of the app, and using 'open -a App' (rather than calling the app's internal exe itself) spawns a console-less process, so it is all neat without logging terminals hanging around everywhere. It also makes multiple hydrus icons on the application taskbar.

I am afraid I don't know anything about the OS X version of a Windows 'shortcut', but if you can make an icon or script on your desktop that you can double-click that will execute that command, I think you are working good like everyone else. It even does the proper 'hydrus is already running: wait a bit/forget it' dialog if that db location instance is already running.

I will incorporate this info into my help docs. Thank you for bringing this whole thing up, and let me know how you get on.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/29/19 (Tue) 20:22:00 e07052 No.11476

>>11466

I am very sorry you have had this problem. Your database is by default stored inside the install_dir/db folder, which is why it should be preserved through updates. If you still mean to recover, please check your recycle bin/undelete program for four files:

client.db

client.caches.db

client.mappings.db

client.master.db

This is your db. The 'client_files' folder in that same directory is where your client's files and thumbnails are stored. If you deleted that, again, please check your recycle bin.

Do you have a backup? If so, this is another source for these files. If not, I know it sucks to hear right now, but this kind of bad experience is a good motivator to start backing up regularly. Please check my help document here, which describes how to back up:

https://hydrusnetwork.github.io/hydrus/help/getting_started_installing.html

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Post last edited at 01/29/19 (Tue) 20:22:24

Anonymous 01/30/19 (Wed) 00:19:56 3ccaed No.11480

>>11466

If you emptied the recycle bin, try file recovery software like Recuva.

Also I think you were supposed to update to 335 first, and then to 337, but not sure if it makes a difference.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 04:11:54 8d960f No.11482

>>11473

Cool. I can open hydurs, but when I try to while specifying the path like this:

open ./Hydrus\ Network.app –args -d="/Users/user/Documents/hydrus/db/client.db"

I get:

LSOpenURLsWithRole() failed with error -10810 for the file /Users/user/Downloads/Hydrus Network.app

I tried looking for the error code but didn't find anything. Any ideas? I tried doing sudo and got the same thing.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 04:51:12 7bb057 No.11483

>>11476

> Your database is by default stored inside the install_dir/db folder

I assumed changing "Default export directory" under "files and trash" would make it store everything there, so I used a different drive, and it did create a bunch of folders and all the downloaded files were there, so I assumed everything works this way. My fault for not reading the manual, and I'll have to start making backups this time.

>>11480

Nah, overwritten already.

> you were supposed to update to 335 first, and then to 337

I don't read the entirety of every single changelog in every update ever, I prefer not updating at all

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 10:25:21 16c66c No.11484

Gelbooru returns 403 on file downloads, but not on page downloads, danbooru and safebooru appear to work fine

Is this normal? Other API gelbooru clients like ahoviewer are working.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 18:54:16 91abf6 No.11486

File: 54245c5342964e6⋯.png (26.31 KB,580x361,580:361,ClipboardImage.png)

Adding to >>11484

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/30/19 (Wed) 19:20:41 e07052 No.11487

>>11482

The -d path should be the directory, not the file. Try

/Users/user/Documents/hydrus/db

Maybe the OS is having trouble trying to read the client.db file as a dir or something. I don't know anything about doing '\ ' rather than using quotes, and I had to do -n and -a to get it to A) not highlight the existing running app, regardless of args given, and B) to just run the Hydrus App I had installed in applications.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/30/19 (Wed) 19:30:37 e07052 No.11488

>>11484

>>11486

Thanks. They changed the access permissions on their main cdn but still link to it in the html meta. I will have a fix rolled into today's release.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 22:16:46 fc3f05 No.11490

File: 6fc19f5aa733633⋯.png (246.93 KB,720x393,240:131,6fc19f5aa733633bb69b12a7df….png)

It's not working for me, even on a clean install. I'm using the zip version for windows, but it just starts and ends the process instantly, there's no error log or anything.

I'm guessing it's some python 3 fuckery since my last install was v334, which is weird since my main python is python 3.6.

I guess I'll try 336 then 335 to see if either of those work.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

Anonymous 01/30/19 (Wed) 22:51:54 fc3f05 No.11492

File: 8cc4317c5c16e64⋯.png (4.21 KB,642x186,107:31,ClipboardImage.png)

>>11490

Same thing happens with 336 and 335, so I'm guessing it's a problem with python 3. When I open python via the terminal it goes straight to 3.6 though, so it can't be a problem with the path.

No crash reports for either of those as well, it just opens and instantly closes without even showing the startup window.

v334 is the last version that works.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

hydrus_dev ## Board Owner 01/31/19 (Thu) 02:33:55 e07052 No.11506

>>11492

Are you on Windows 7? You may need some OS updates and possibly VCRedist 2015, as here:

>>11260

>>11495

https://www.microsoft.com/en-us/download/details.aspx?id=48145

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.