[ / / / / / / / / / / / / / ] [ dir / random / ebon / mde / mu / nanj / ryuken / sonyeon / utd / x ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog   Archive

Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webp, webm, mp4, mov, swf, pdf
Max filesize is 16 MB.
Max image dimensions are 15000 x 15000.
You may upload 5 per post.


This board will be deleted next Wednesday. I am moving to a General on 8chan.moe /t/. This board is archived at 8chan.moe /hydrus/!

YouTube embed. Click thumbnail to play.

6d169b  No.15109 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v425/Hydrus.Network.425.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v425/Hydrus.Network.425.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v425/Hydrus.Network.425.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v425/Hydrus.Network.425.-.Linux.-.Executable.tar.gz

I had a good week. I optimised and fixed several core systems.

faster

I messed up last week with one autocomplete query, and as a result, when searching the PTR in 'all known files', which typically happens in the 'manage tags' dialog, all queries had 2-6 seconds lag! I figured out what went wrong, and now autocomplete should be working fast everywhere. My test situation went from 2.5 seconds to 58ms! Sorry for the trouble here, this was driving me nuts as well.

I also worked on tag processing. Thank you to the users who have sent in profiles and other info since the display cache came in. A great deal of overhead and inefficient is reduced, so tag processing should be faster for almost all situations.

The 'system:number of tags' query now has much better cancelability. It still wasn't great last week, so I gave it another go. If you do a bare 'system:num tags > 4' or something Post too long. Click here to view the full text.

4 posts and 1 image reply omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

482fb8  No.15143

>>15124

The plan to move to Endchan only has changed!

Codexx on 8chan.moe has kindly offered to host me on /t/ over there. As I have never been a comfortable BO, this is a much better solution for me as the primary place to talk Anon about hydrus.

I will be maintaining a Hydrus Network General, the first instance is here: https://8chan.moe/t/res/2219.html

The links in the release tomorrow will reflect this. Endchan will remain as a bunker.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



cce3c4  No.15134 [Open thread]

8kun says they are expecting to lose clearnet support and be TOR only soon. I have been meaning to move away from here for some time, but I put it off due to procrastination. Now seems the time to do it, so on 426, Endchan will be our primary /hydrus/ going forward.

I am catching up with the Q&A and Bug report threads here and archiving them and posting those links to Endchan. On Wednesday 20th, I will delete this board. Please archive anything important to you and migrate over to Endchan if you are comfortable.

All hydrus links are maintained here: https://hydrusnetwork.github.io/hydrus/help/contact.html

Thank you!

The plan to move to Endchan only has changed!

Codexx on 8chan.moe has kindly offered to host me on /t/ over there. As I have never been a comfortable BO, this is a much better solution for me as the primary place to talk Anon about hydrus.

I will be maintaining a Hydrus Network General, the first instance is here: https://8chan.moe/t/res/2219.html

This board has been completely archived at https://8chan.moe/hydrus/

The links in the release tomorrow will reflect this. Endchan will remain as a bunker.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
Post last edited at


File: 7a56ef4350b0bb9⋯.jpg (64.84 KB, 445x488, 445:488, 7a56ef4350b0bb96c5b6a4eb80….jpg)

2b149c  No.11542 [Open thread][Last 50 Posts]

BUGS THREAD

500 posts and 108 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b19c73  No.15138

This thread is now archived at https://archive.is/cq5Tc . I will not post here any more, as the board will be deleted next Wednesday. Please move to the Endchan thread at https://endchan.org/hydrus/res/9.html , thank you!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

55cffe  No.15139

>>14683

>If you do have it, is MPV the player under options->media? If your hydrus does not have libmpv access, or is failing to import it, it will fall back to my native viewer, which has no audio support.

Fixed. Thanks a lot.

I'm new to Hydrus. Using Linux MX.

Before I was using Tagspaces which is a sluggish piece of trash. Looking for a more suitable alternative I bumped into Hydrus; so far I'm very pleased by its performance and rich settings.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a2b734  No.15141

>>15118

Is there a way to get the blacklist back to working? There's usually a cookie for you blacklist on gelbooru but for some reason the downloader doesn't use it and stopped working for me a month or so ago. I can't remember if it was something I did or if the site changed or what.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9e001d  No.15144

The plan to move to Endchan only has changed!

Codexx on 8chan.moe has kindly offered to host me on /t/ over there. As I have never been a comfortable BO, this is a much better solution for me as the primary place to talk Anon about hydrus.

I will be maintaining a Hydrus Network General, the first instance is here: https://8chan.moe/t/res/2219.html

The links in the release tomorrow will reflect this. Endchan will remain as a bunker.

>>15141

If you happen to see this in the next 18 hours or so, I think you want this: https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/tree/master/Downloaders/Gelbooru

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

537d99  No.15146

test

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 274229acf594e5b⋯.png (602.03 KB, 963x720, 107:80, 274229acf594e5b562b593dce3….png)

ff6d52  No.14731 [Open thread][Last 50 Posts]

Here you can ask questions so that the board is not clogged with small threads.

Old thread >>12641

157 posts and 10 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d881be  No.15130

>>15029

I am sorry for the trouble here. The blacklist should work on the tags parsed from the page. So if you tell it to stop 'guro', then any page with that tag should get the 'ignored' status with an appropriate note in a downloader using those 'tag import options'.

One user has been telling me about this not working for him, but I couldn't figure it out. Can you give a search example on danbooru and a blacklisted tag that aren't applying for you?

>>15039

I am sorry, I do not know what is going on here. Sounds like it could be an ssl issue or similar, maybe if your OS is old, although I'd guess that sort of thing would be more likely right on Jan 1st 2021 as some certificate timeout ticked over.

If you can paste the whole error, I can have a closer look. If it is moaning about ssl certificates, one way around it is to uncheck the 'verify regular https traffic' option under options->connection.

>>15071

>>15089

If you mean 8chan.moe, I believe they did some direct linking referral trickery on their spicier boards to make sure direct links from external sites don't work. There may be a solution here with some forced hydrus referral urls on the URL Classes, but I do not know the details and have not looked into it myself. I think you'll have to browse these boards manually for now.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d881be  No.15131

>>15074

Any site that doesn't operate like a normal booru is tricky. Sometimes you just have to babysit them.

I assume you are downloading through nitter, right? I think the twitter API that nitter hooks into does not deliver tweets beyond about 3,000 tweets into the past, so if you are hitting that limit somehow, or if nitter has its own limit, that may explain it.

I have been getting reports recently that nitter has been giving '429 - server rources limited' or similar recently as well. This may be related, I am not sure.

>>15088

I am not sure if the existing pixiv login script works right now, it has always been temperamental. If not, I think you'll have to use Hydrus Companion or similar to log in by copying your browser cookies to hydrus. Then pixiv will think your hydrus is you and it'll have access to private stuff.

>>15095

Support here is not yet great. If you are importing from hard drive, they should import in filename order. If you are importing from a site, it will come in the order the site's parser pulls the URLs, which is usually good, sometimes reversed. The main problem is hydrus currently has integer timestamp for import time, so if two files are imported in the same second, they will sort randomly when you sort by import time. If this is what is hitting you, I apologise. At some point there will be a conversion to sub-second times, although a retroactive fix would likely be impossible.

I am hoping the eventual file alternates work will provide a nicer system than page tags. I agree they are clunky.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d881be  No.15132

>>15115

>>15116

This is some developer bullshit unfortunately. You don't need mpv, but 'libmpv1'. You should be able to get it with apt.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d881be  No.15133

This thread is now archived at https://archive.is/0WoQk . I will not post here any more, as the board will be deleted next Wednesday. Please move to the Endchan thread at https://endchan.org/hydrus/res/10.html , thank you!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d4bbb0  No.15145

The plan to move to Endchan only has changed!

Codexx on 8chan.moe has kindly offered to host me on /t/ over there. As I have never been a comfortable BO, this is a much better solution for me as the primary place to talk Anon about hydrus.

I will be maintaining a Hydrus Network General, the first instance is here: https://8chan.moe/t/res/2219.html

The links in the release tomorrow will reflect this. Endchan will remain as a bunker.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 7a8b5d1b873c584⋯.gif (1.59 MB, 847x860, 847:860, 1425150841112.gif)

c2f342  No.13543 [Open thread]

Hello everybody, I've been wondering how some of other Hydrus Network uses handle backups for their files.

My current setup is like thus: I make weekly local backups of my database, which are then sent to a NAS through UrBackup, From there, I've been using Duplicati with cheap S3-compatible remote object storage.

Now, supposedly Duplicati performs deduplication before uploading, however it still seems like it takes its sweet time on the SQLite database files themselves, so I'm wondering if their format just doesn't lend itself to be deduplicated adequately or if there is some other issue. I don't use password protection (although from what I've seen, it doesn't actually encrypt anything by itself so it shouldn't make much of a difference either way)

So, what other methods do you use to backup your Hydrus files remotely? Ideally it should be with deduplication because although space is not at a premium for me, my upload speeds are very limited.

2 posts omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15081

>>13543

Once a month, I make an encrypted 7zip archive of my entire database while Hydrus is closed. Then I slap it on a blu-ray and store it in an undisclosed safe location. This gives me an incentive to go through my inbox and keep my archive clean, because splitting archives to put them on separate disks is a pain in the ass and waste of money.

I also have an automatic backup that does basically hourly backups, but it's to a drive that's always connected to my PC so I only consider it slight fuck-up protection.

>>15078

If you did it on the backup, I don't see why it would cause problems. It wouldn't be encrypted though, unless the device you're syncing to stores it on an encrypted partition.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b8bc80  No.15085

>>15081

>Then I slap it on a blu-ray

Good luck when it reaches a bigger size.

>t wouldn't be encrypted though, unless the device you're syncing to stores it on an encrypted partition.

Always encrypt your backups in some way. You could even just rSync it to another part of your system locally, then encrypt it alongside anything else you want to backup, then have that encrypted archive be transferred remotely.

I'm sure there's other easy ways, I just haven't dealt with backups much. I just backup to an encrypted drive every now and then locally.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

070f42  No.15112

>what other methods do you use to backup your Hydrus files remotely?

run a hydrus client on a server and set it as a remote file repository, then you can tell your local instance to upload to it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d4ec2e  No.15120

>>15078

I'm the anon from the OP, the main issue with this approach is that without deduplication of some kind, you'll end up having to send your (rather sizable) database file with every update all over again every time you rsync with the remote folder. As I mentioned last year, storage space isn't so much a concern as it is upload speed, as even with a mild recent improvement they still top around 2Mbps.

I had to stop using Duplicati as it was incredibly fragile, I'm now using borg and rclone to send my local repo to a Backblaze B2 bucket (even cheaper than my previous option). Borg handles the deduplication and encryption.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b8bc80  No.15142

>>15120

With something like borgbackup/rsync you can do it in a way that it only updates changed files I believe.

So you're not backing up the entire db over and over, only changes.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: ed3f745dbd39b5d⋯.jpg (4.66 MB, 4000x2715, 800:543, shutterstock_89245327.jpg)

f047d8  No.4475 [Open thread][Last 50 Posts]

How about a thread for discussing/creating/sharing parsing scripts?

I made one for md5 lookup on e621.net (actually I just modified Hydrus_dev's danbooru script). Let me know if I did anything wrong with it, I'm pretty clueless… but it seems to work fine.


[32, "e621 md5", 1, ["http://e621.net/post/show", 0, 1, 1, "md5", {}, [[30, 1, ["we got sent back to main gallery page -- title test", 8, [27, 1, [[["head", {}, 0], ["title", {}, 0]], null]], [true, true, "Image List"]]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-general"}, null], ["a", {}, 1]], null]], ""]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-copyright"}, null], ["a", {}, 1]], null]], "series"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-artist"}, null], ["a", {}, 1]], null]], "creator"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-character"}, null], ["a", {}, 1]], null]], "character"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-species"}, null], ["a", {}, 1]], null]], "species"]], [30, 1, ["we got sent back to main gallery page -- page links exist", 8, [27, 1, [[["div", {}, null]], "class"]], [true, true, "pagination"]]]]]]

84 posts and 27 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6c7e0e  No.14748

File: d0fe48199af88b6⋯.png (8.35 KB, 512x166, 256:83, realbooru.png)

realbooru parser that functions at least

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8c2d2c  No.14782

Sankaku is now hiding lolis. Is there some way to get around this?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4920bd  No.14837

I'm not sure if GUGs can make these, but anyone have a module for setting up Youtube subscriptions?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a382d2  No.14847

>>14782

They're not hiding lolis. I don't understand why I keep hearing this. Did you check the mature content option in settings and clear your account blacklist? Do you have an account in the first place?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

f5d248  No.15140

Can someone help me understand what parsing scripts are for, and how to use them?

Are they to improve the amount of tags that are found for images? Like a reverse search?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



0dfb73  No.14929 [Open thread]

Kemono.party is not working right now and seems to be very unstable. A good idea would be to get patreon/subscribestar downloaders working. Currently hydrus will try to look at patreon pages then get booted out, a possible code reference for how to rip it might be here https://github.com/OpenYiff/Kemono but this is for running a kemono.party service. Any ideas? I got used to using yiff.party as a backup/3rd party ripper to get HD content to hydrus, then deduplicate the shit booru quality versions.

7 posts and 1 image reply omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

512b08  No.15022

>>15020

The site isn't even working yet so why would there be a working downloader?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15023

>>15022

What do you mean? The site is up and there is content on it. I only found out about it very recently and I don't know about the situation except for what I can infer from anons' posts.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15024

>>15022

It was broken for a while but it seems to be working now.

>>15020

The site has changed the URL schemes for posts since that was put on Cuddlebear's repo. I would wait until the site is more stable and/or the API is finished before trying to find/make a downloader.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15025

>>15024

I see, that makes sense. Thanks.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

642a5b  No.15110

I made that WIP kemono parser, its specifically for kemono.party/files and was made when the actual kemono frontend was non-functional. It was meant to do the bare minimum of scraping their bulk file CDN but I don't even think they use the same URLs for file downloads anymore.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

0070e5  No.15072 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v424/Hydrus.Network.424.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v424/Hydrus.Network.424.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v424/Hydrus.Network.424.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v424/Hydrus.Network.424.-.Linux.-.Executable.tar.gz

I had a good week. There are some quality of life improvements and faster tag search across the board.

The update will take some time this week to update a cache. If you do not sync to the PTR, it will be just a few seconds. If you sync to the PTR, expect about 5-15 minutes.

faster tag search

In the second half of 2020, I tried several times to tune the database for different sorts of wildcard tag search, which is used in all autocomplete lookups and many file searches. I was sometimes able to get small clients always running well, or complicated large systems running, well, but I failed to get it good for all situations with code alone–the structure of the database tag lookup cache made the tuning difficult.

So, I have updated how that cache works. Rather than always searching one big master table, the client can now 'zoom' in on the appropriate search context based on the tPost too long. Click here to view the full text.

2 posts omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

52c45d  No.15087

>>15075

The main benefit is everything is shared in one client database. As well as basic simplicities like only one client to backup or have options for, you will also be able to search in more than one local file service at once, store files in more than one services at once (and only need one copy of the file), only have to sync to the PTR or do other large tag/db maintenance for one database. It may open up some interesting new processing workflows as well.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

cab0c2  No.15090

>>15087

Then you should provide a way to import one database into another without losing/resetting any metadata like "time imported" for example. Or else this feature is completely useless to me because I don't want to lose that from my multiple databases. I'm not going to create a new database and spend hours or days setting everything up, then importing all the files from my old databases and lose all of their metadata in the process.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

52c45d  No.15092

>>15090

Yes I agree, I will have some sort of client-to-client transfer as part of this, so users who have been using multiple clients will be able to merge neatly and preserve time and archive metadata. Around that time I'll likely have to introduce rating export/import too, and perhaps URLs as well.

The good news is now we have the Client API, this should be neatly possible as a direct client-to-client connection.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

cab0c2  No.15098

>>15092

Thank you.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a89ea8  No.15108

I had a good week. I was not able to fit much interesting fun stuff in, but I fixed the slow tag autocomplete search in the manage tags dialog, sped up tag processing, fixed some 'ghost' tag bugs, and reduced some wasted CPU in the network engine. Overall, the client should be a bit neater and faster in 425.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 9615483d4b836e0⋯.jpg (94.1 KB, 1024x768, 4:3, 1601788051705.jpg)

ecf9e3  No.14802 [Open thread]

or, "i've got xxxxxxx thousand images in my inbox, what the fuck do i do?"

i'm currently having this problem myself, so i thought it would be nice to have a thread to collect information about various ways to automate sorting/tagging/etc, such as:

* image deduplication scripts:

>https://github.com/knjcode/imgdupes

i'm presently also writing my own as well which should work somewhat better for large datasets, i'll post it here when it's usable

* datasets, useful for running against aforementioned dedupe scripts

>danbooru2019, contains all danbooru pictures + metadata up to early 2019: >https://www.gwern.net/Danbooru2019

i remember there being large dumps of other booru metadata on here years ago, but i can't find them anymore

* AI/neural network software for automated tagging, classifiers and etc:

https://github.com/KichangKim/DeepDanbooru

https://github.com/imamar94/ramrem-classifier

things i couldn't find but would find extremely useful:

>AI anime/photograph classifier

this would be very helpful, especially with deduplicating from danbooru2019

>subject classifier

if there was a NN that could tell me if the subject of a picture was a person or something else, this would be insanely useful, especially for the next item

>SFW/NSFW classifier

about half of my collection is porn. i'm planning on deleting basically all of it, so just being able to get that out of the way quickly would cut my workload in half

2 posts omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15082

>>15077

It already does tag stuff based on the file, see the system tags. There is 'system:has audio' and 'system:no audio', and then there's system:filetype which lets you choose either the type (image, video, etc) or exact MIME (i.e. mp4) of files to seach.

There are plenty of others too, like dimensions, time imported, hashes, filesize, etc.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8c0dfe  No.15084

>>15082

>It already does tag stuff based on the file, see the system tags.

I was suggesting it automatically applies these tags when it detects them.

For example if you import a file that has audio, it knows that so it just applies the tag.

Unless I'm missing something, it does not seem to apply automatically.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15099

>>15084

Is that not what it does? Unless you mean applying a non-system tag like "video with audio" or something, it does do that automatically.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8c0dfe  No.15101

>>15099

Just tried adding a new url with a bunch of videos to the watch, some have audio some don't.

None of them have been autotagged with any tags, except for the few that have a hash matched.

So it does not seem as if it is auto-applying tags for stuff that are videos, and stuff that has audio.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

42c7cc  No.15107

>>15101

do a search for "system:has audio" you absolute retard

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 1426721772716.png (100.78 KB, 1624x1081, 1624:1081, 1327614072601.png)

68f861  No.471 [Open thread][Last 50 Posts]


Drag and drop windows with tag rules. Show two windows side by side and one window can be programmed with the rule "ADD tag foo" and the other one has the rule "REMOVE tag foo, ADD tag bar" and you can drag and drop files to them.

Deriving tags from regex of other tags/namespace tags. A file has the tag "filename:big_ugly_name" and we could regex that namespace for another tag.

Tag sets with hotkeys: save a set of tags under a hotkey so it's quick to add them to a file while filtering

Opaque window behind tag list in the corner so it doesn't get hidden by picture background

Option to default certain mime types to be excluded from slideshow and only open externally, will help with videos with odd codecs that don't preview in the slideshow correctly

Option to specify hamming distance in "find similar images", you can't change the option once it's in the filter window and you have to enter the hash manually in the "system:similar to" option
741 posts and 205 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fc0da3  No.15038

>>15036

You can set tag import options by url class in network>downloaders>manage default tag import options

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0e4d09  No.15091

Unless I'm missing something, this seems to be missing:

I've been trying to figure out, is there no way to have stuff autotag per watched threads? Didn't see anything in the docs about this.

I know you can set tags to be automatically applied on the watcher, but can you not do it PER watched thread?

So if I add a watcher url, and want all files that get fetched from that to be auto-tagged with series:pokemon, then I add a second watcher url, and want all posts from that to only be tagged (automatically) with series:kingdom_hearts is there no way to do this?

If I am correct, I would love to see this. It's a complete PITA to have to do it manually for each thread for basic tags.

I'd also suggest this be done anywhere else it is not possible on the other download tabs, although I rarely use anything besides the watcher so not sure if they are missing this.

My other suggestions are:

Under manage tags, the recently added tags only save about 22, while there's an entire vertical space for it to save around 60. This means you constantly have to keep doing a search as you go through tags. Would be nice for this limit to be bumped up a lot higher.

And lastly, the ability to shift click items, or shift hold and drag to drag highlight items. When dealing with lots of thumbnails, this would save so much time. Currently it seems it's only possible to Ctrl + A to all, or ctrl click each individually.

Thanks

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5cd0f7  No.15094

>>15091

If you set tag import options in the watcher page it is applied to the threads that are queried while those are set, so you could change it to have your tags for that thread then change it again for another thread.

You can change the amount of recent tags in options, options>tag suggestions>recent.

Shift clicking to select a thumbnail range should work already.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0e4d09  No.15096

>>15094

>If you set tag import options in the watcher page it is applied to the threads that are queried while those are set

It would be very nice to have a prompt or option area to add a default tag if the user wishes. Then it just resets after the page is submitted. The user could also right click the watch and edit the tags and it would easily update them for all the previously grabbed files in that watch and any newly tagged files. The way you explain is a bit inefficient imo.

>You can change the amount of recent tags in options

Ah, a bit hidden, thank you.

>Shift clicking to select a thumbnail range

I was behind like 2 Hydrus updates, but just updated and that works now. Maybe it was a bug then. Works now though. Thanks.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15102

Does Hydrus have any support for multiple audio/video streams in one file?

Say I have 4 videos with the same audio, just slightly different video (say different levels of clothing). You can use ffmpeg or what have you to combine them into one file with multiple video streams and one audio stream, which mpv can play (at least externally, cycling with the _ keybind).

You could do similar things for multiple videos which only differ in audio, say language (keybind #). You could even have both multiple video and audio streams in one file, if you really wanted.

I could have each video+audio stored separately in Hydrus, but to me they're the same video, just different variants. Being able to combine them would help reduce clutter in the search and lets you be sure just from the thumbnail that the variant you want is available.

I think it would be cool if Hydrus could switch video/audio streams without having to launch in an external program. Don't know the technical details on whether a keybind or right click menu or both would work, though.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



4280d7  No.15079 [Open thread]

Do you only save 2D to Hydrus, or both 2D and 3D?

How do you go about organizing different file types? For example, 2D Photos, 3D Photos, Books/Doujins, etc.

I've stayed away from archiving any types of Books/Doujins into Hydrus, and keeping that into Calibre.

As for videos, anything full length (stuff you wouldn't find on Boorus) I just run it through Jellyfin.

So I guess personally my biggest thing is 2D and 3D photos/short videos/animations.

Right now, I just have them seperated with a tag. Filetype:2D, Filetype:3D. I have my import folders seperate (3D folder and 2D folder) and they import with that tag automatically if stuff goes in there.

Is there a more organized way?

I can't say I'm entirely a fan of having both 3D and 2D in the same database. 99.9% of my 3D stuff I don't even tag, it's only there so I can view it. So it feels useless to be in hydrus. Opinions?

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

761a9e  No.15093

File: 9b152ab3d51fffd⋯.jpg (Spoiler Image, 688.6 KB, 1280x1024, 5:4, Eternal_descent_Lyra_1280x….jpg)

>>15079

I'm fairly new to Hydrus myself. If your using Hydrus to view your 3D but not tagging it, so what, no big deal if you still like the software and UI for simply browsing images. On the upside, all your images are stored in one repo, not all spread out everywhere, so you have one place to manage them all. I would say that's worth it right there.

My only recommendation would be to maybe find some general tags you could use for your 3D stuff, to be able to sort that easier. As your collection grows, seems like it would be easier to search and sort in the future. Go with what workflow seems to work for you.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15100

I have an extremely small amount of 3D in hydrus, I tag it with "series:real life". I have to manually tag it, but since I can count the amount of 3D I have on one hand it's not too much of a pain.

I manage my anime, manga, and books outside of Hydrus, but I keep doujins in it. I tag doujins differently from images, kind of like how exhentai has different tags than boorus do.

One of the best parts of Hydrus is the archive/delete filter. I regularly go through my archive and trim the fat, there's a ton of images that look good the first time but that you realize you would never actually jerk it to. If you have tons of files that cannot be automatically tagged, I recommend doing so to make it easier on you.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



d69ce5  No.15097 [Open thread]

The quickest professional writing service https://papernow.org/descriptive-essay-help saved my time and nerves. They`re all super smart and super professional essay writers! I received a fabulous paper and got a discount, spent a good time. Fantastic assistance!

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

4a7246  No.15033 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v423/Hydrus.Network.423.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v423/Hydrus.Network.423.-.Linux.-.Executable.tar.gz

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v423/Hydrus.Network.423.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v423/Hydrus.Network.423.-.Linux.-.Executable.tar.gz

𝕸𝖊𝖗𝖗𝖞 𝕮𝖍𝖗𝖎𝖘𝖙𝖒𝖆𝖘!

I had a good week making some small fixes and improvements to finish up the year. This is the last release of the year. There is a large poll on what 'big thing' to work on next:

poll

Here is the poll on what large work to go for next:

https://www.survey-maker.com/poll3310902xA574481e-102

You can vote on multiple items. Please don't worry about the seriousness of it too muchI have a good idea of what is likely to win already, and if there are obviously jank votes, I'll reserve the right to discount a resultbut I am particularly interested to know what is and is not popular further dPost too long. Click here to view the full text.

13 posts and 2 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

e277ed  No.15061

>>15055

The nice thing about it vs tags is it will be a cleaner compartmentalisation, particularly for the nsfw/sfw/'my sister is looking over my shoulder' problem. When a file service only stores sfw files, then, as an example, you can type whatever into a tag autocomplete and you won't get undesired results. This would be true for many other situations where recommendations and 'similar to' and random 'system:limit' searches may provide surprises or just a wave of false positive results on your little art reference collection.

For vs multiple clients, this allows you to sync with the PTR (or have shared tags of any sort) on only one client, which saves a ton of space and CPU. All other stuff like backup routines and bandwidth options etc… are shared too, and you can have files on multiple domains as well without needing more space.

I'll be interested to see what new workflows emerge as well. Maybe in a couple of years we'll be putting all 'inbox' files on their own file service or something.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

e277ed  No.15062

>>15056

That google doc is really interesting. Seems like JPEGXL with the right parameters is great across the board.

The issue of dupes and their metadata propagating to the PTR or other shared resources is a worsening and unavoidable problem. It has only worsened as the big CDNs have yeah started optimising content. I am not sure if there really is a nice solution, and it may just be an architectural problem with the 'tag repository' idea. Perhaps a future version of the repo will also include hash-dupe pairs, but I suspect that would produce its own set of management problems as it would require user agreement on dupes, and not all dupe merges want all tags copied.

My secret dream is that the huge 'corpus' of tag metadata we have built up with the PTR so far lets us train ML in the next five years and the scope of the PTR is greatly reduced. Rather than sharing 'file x has tag y', I'd love to share 'tag x looks like y visual data', and then clients will run ML on their own files for common/simple tags. Whether the tech can ultimately do this to a high enough confidence to apply a certain subset of tags automatically isn't obvious yet, but the feedback from hydrus-dd, which uses the DeepDanbooru ML, is promising.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a39d38  No.15068

I had a good work week. I did a variety of small fixes and quality of life improvements, and I finished redesigning the part of the database that does wildcard tag searches. Autocomplete lookups and file searches that rely on complicated tags are running faster across the board, and the old design's sudden lag spikes (e.g. with namespace:*anything* searches) are entirely eliminated.

The release should be as normal tomorrow. There will be some database work on update. I will have a better idea tomorrow, but I estimate users who sync to the PTR with an SSD can expect it to take 5-15 minutes.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15073

>>15059

I did already try that, however it seems to only accept individual galleries (and at 'browsing' quality, at that). If I had to seek out each gallery and check for new ones myself, it's not really much of an upgrade.

I expect to get something downloading via the archiver would be a pain if for no other reason that there's multiple pages and you would need to check that the user has enough gp/currency (people might also get upset if gp gets wasted). Not to mention the archiver downloader will be in a compressed filed that will need to be extracted.

Still, in principal it should be possible. I and I'm sure other people can help answer questions about exhentai. It would be a big feature IMO.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6ae0a5  No.15083

>>15062

>Seems like JPEGXL with the right parameters is great across the board.

Exactly. Matches my own tests on the current Jpeg XL reference. Exciting times. ImageMagick got jxl in 7.0.10-54

>My secret dream is that the huge 'corpus' of tag metadata we have built up with the PTR so far lets us train ML in the next five years and the scope of the PTR is greatly reduced.

Yea, that would be nice. Still might leave artist name, url and so on.

Plus just imagine how many more images people might produce via AI crunching / pre-producing images. I wonder if the db of known images (plus known tags - future training data?) will be obsolete all that soon.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



a7e83c  No.15042 [Open thread]

Furry.booru.org no longer works

when downloading I get this fun error.

Looks like an unsolvable CloudFlare issue: Detected a Cloudflare version 2 challenge, This feature is not available in the opensource (free) version.… (Copy note to see full error)

Traceback (most recent call last):

cloudscraper.exceptions.CloudflareChallengeError: Detected a Cloudflare version 2 challenge, This feature is not available in the opensource (free) version.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

hydrus.core.HydrusExceptions.CloudFlareException: Looks like an unsolvable CloudFlare issue: Detected a Cloudflare version 2 challenge, This feature is not available in the opensource (free) version.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

88ffc2  No.15014 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v422/Hydrus.Network.422.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v422/Hydrus.Network.422.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v422/Hydrus.Network.422.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v422/Hydrus.Network.422.-.Linux.-.Executable.tar.gz

🎉🎉 It was hydrus's birthday this week! 🎉🎉

I had a great week. I mostly fixed bugs and improved quality of life.

tags

It looks like when I optimised tag autocomplete around v419, I accidentally broke the advanced 'character:*'-style lookups (which you can enable under tags->manage tag display and search. I regret this is not the first time these clever queries have been broken by accident. I have fixed them this week and added several sets of unit tests to ensure I do not repeat this mistake.

These expansive searches should also work faster, cancel faster, and there are a few new neat cache optimisations to check when an expensive search's results for 'char' or 'character:' can quickly provide results for a later 'character:samus'. Overall, these queries should be a bit better all around. Let me know if you have any more trouble.

Post too long. Click here to view the full text.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

88ffc2  No.15015

It looks like 'namespace:*' searches, despite now working, may be running super slow or doing too much database work, in IRL PTR-syncing situations. I will look into it next week! If you are hit by this, please turn them off for now under tags->manage tag display and search.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.15016

>>15014

Two issues I've noticed network-wise so far.

Issue 1 Disclaimer: no idea if this is a regression - first time I've tried this on any version.

On v421 I'm running into an error when querying for IDs with specific filetypes through the API.

I'm trying to get a list of all files of type webm, wav, etc. but I can't figure out the proper way to do that in the "get_files/search_files" endpoint. Stuff like "meta:webm" works in both the client and API but it's missing a lot of files and seems to be manually assigned; on the other hand, using the query "system: filetype is foo" in the client seems to pull directly from the local DB of files and doesn't miss any but when I hit the API with "?tags=%5B%22system%3A+filetype+is+webm%22%5D" I get no results.

I'm not sure if this is user error, by design/wontfix, or you just haven't gotten around to handling/exposing it yet. Is there currently a way to filter on the filetype over all local files? If not, could you add that to the suggestions you're polling on?

Issue 2 Disclaimer: I have a janky workaround for this

I'm working on a browser-based frontend for Hydrus, and one of the problems I've hit is that safari for iOS (and maybe Mac too, I don't have one to test) won't download media like mp4 files because it tries to sample the file with a range download, and if the remote server doesn't support byte ranges then it bails and the file doesn't load. My current workaround is an nginx reverse proxy with the proxy_force_ranges option set, but it's kind of janky and I can't really ask people to run an nginx server to use the webapp if I ever get it to a releasable state. I'm not sure what library you're using to serve the API but if there's an easy way to enable byte ranges that would be great, and if not no worries, it'll be quite a while before it'll matter.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4ad377  No.15030

I had a good week making some small fixes and improvements to finish up the year. Autocomplete works a bit faster, and some quality of life is improved.

The release should be as normal tomorrow. It will have the 'next big job' poll and be the last release for the year.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4ad377  No.15031

>>15016

Hey, unfortunately system predicates do not work on the Client API yet. They aren't text-based in the actual client, so I can't just pull text in the query to accept them (yet). They are top of the list to add for Client API features.

Here's the master job for Client API by the way: https://github.com/hydrusnetwork/hydrus/issues/656

Thank you for the note about file ranges. I have not run into this need yet, so I will research how to do it properly. I use twisted as my main server engine, so I know this is possible, I just think I have to link some things together.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



Delete Post [ ]
[]
Previous [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
| Catalog | Nerve Center | Random
[ / / / / / / / / / / / / / ] [ dir / random / ebon / mde / mu / nanj / ryuken / sonyeon / utd / x ]