[ / / / / / / / / / / / / / ] [ dir / random / abcu / abdl / lewd / pone / r / random / s / warroom ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog   Archive

Name
Email
Subject
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Voice recorder Show voice recorder

(the Stop button will be clickable 5 seconds after you press Record)
Options

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 16 MB.
Max image dimensions are 15000 x 15000.
You may upload 5 per post.


New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Experienced user with a bit of cash who wants to help out? ---> Patreon

Current to-do list has: 2,017 items

Current big job: Catching up on Qt, MPV, tag work, and small jobs. New poll once things have calmed down.


YouTube embed. Click thumbnail to play.

06c97f  No.14838[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v414/Hydrus.Network.414.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v414/Hydrus.Network.414.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v414/Hydrus.Network.414.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v414/Hydrus.Network.414.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v414.tar.gz

This is the first release of a complicated new system. If you are a cautious user, feel free to wait a week for me to iron out any surprise bugs.

I had a good four weeks converting tag parents to the new 'virtual' database cache.

The release does not need to do a big update this week. It will ask you if you have an SSD or an HDD (EDIT: with a special caveat for PTR users, see below), but that is it. All the mandatory heavy work that came in with 407 now happens in the background.

parents

tl;dr: You don't have to do anything. If you haven't heard of a tag parent before, no worries. The database should work better now.

Post too long. Click here to view the full text.
____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a1c9b2  No.14839

Thanks for your hard work hydrus_dev!

Will the button to turn parents/siblings into real tags in the manage tags window return?

And to everyone else: Remember to go to "tags > manage where tags siblings and parents apply" and add the PTR if you want that for your local files.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 386276efca725c8⋯.jpg (192.4 KB, 720x1100, 36:55, ETRXqAKXYAA91g4.jpg)

91fced  No.14228[Reply]

I'm dead serious. $10 for 10 Gb worth of files (Price is non negotiable). Will send them to you via MEGA.

Post your discord ID here if you're interested.

I'll give you more instructions on how to tag them in DMs, like which tags to prioritize etc…

12 posts and 4 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

916009  No.14242

File: f258bb23e7012be⋯.png (290.21 KB, 800x1000, 4:5, f258bb23e7012beebf1a09b724….png)

>>14236

>>10k files

>nigga you crazy. that'd take weeks

quick update: It took me less than an hour to tag 7829 files thanks to deepbooru.

Get fucked, lolifucker

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

971894  No.14664

>>14242

>lolifucker

god i wish

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0ec554  No.14667

>>14233

op can u link the instruction plz?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

65ca8e  No.14759

>>14667

seconding this

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b731d4  No.14848

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: ed3f745dbd39b5d⋯.jpg (4.66 MB, 4000x2715, 800:543, shutterstock_89245327.jpg)

f047d8  No.4475[Reply][Last 50 Posts]

How about a thread for discussing/creating/sharing parsing scripts?

I made one for md5 lookup on e621.net (actually I just modified Hydrus_dev's danbooru script). Let me know if I did anything wrong with it, I'm pretty clueless… but it seems to work fine.


[32, "e621 md5", 1, ["http://e621.net/post/show", 0, 1, 1, "md5", {}, [[30, 1, ["we got sent back to main gallery page -- title test", 8, [27, 1, [[["head", {}, 0], ["title", {}, 0]], null]], [true, true, "Image List"]]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-general"}, null], ["a", {}, 1]], null]], ""]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-copyright"}, null], ["a", {}, 1]], null]], "series"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-artist"}, null], ["a", {}, 1]], null]], "creator"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-character"}, null], ["a", {}, 1]], null]], "character"]], [30, 1, ["", 0, [27, 1, [[["li", {"class": "tag-type-species"}, null], ["a", {}, 1]], null]], "species"]], [30, 1, ["we got sent back to main gallery page -- page links exist", 8, [27, 1, [[["div", {}, null]], "class"]], [true, true, "pagination"]]]]]]

83 posts and 27 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

3fc0bd  No.14739

>>14710

Anything on this anon?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6c7e0e  No.14748

File: d0fe48199af88b6⋯.png (8.35 KB, 512x166, 256:83, realbooru.png)

realbooru parser that functions at least

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8c2d2c  No.14782

Sankaku is now hiding lolis. Is there some way to get around this?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4920bd  No.14837

I'm not sure if GUGs can make these, but anyone have a module for setting up Youtube subscriptions?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a382d2  No.14847

>>14782

They're not hiding lolis. I don't understand why I keep hearing this. Did you check the mature content option in settings and clear your account blacklist? Do you have an account in the first place?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 7a56ef4350b0bb9⋯.jpg (64.84 KB, 445x488, 445:488, 7a56ef4350b0bb96c5b6a4eb80….jpg)

2b149c  No.11542[Reply][Last 50 Posts]

BUGS THREAD

431 posts and 97 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fd03bf  No.14704

>>14685

Sorry for the trouble. I think for a while there, Linux had no MPV support, so when the various updates to media presentation went through, it defaulted to the old renderer and never switched up once you had access.

>>14690

>>14691

Ah, yeah, that option may have moved recently. Damn, that is annoying about the popup and hover windows. Some Window Managers just don't like frameless windows appearing as child windows. I had similar issues in wx, but Qt seemed to be doing much better.

If you would like to chase this up a bit, you can try running help->debug->report modes->hover window report mode and then getting the hover windows to show once and then move your mouse around a bit over where they 'should' be and other locations. It will make a bunch of popups which you can't see )^:, but will also dump that info to your log file at install_dir/db/client(date).log. If you scroll down to there, cut and paste that to a text file or pastebin and email/post the link to me here, I can have a look. It might show something interesting, like the windows are trying to scale to (0,0) or something weird, but since this does generally work well now, I think it might be core to an OS problem, and trickier to figure out.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

da6bee  No.14783

If the default export folder doesn't exist, it is automatically made when you open the export dialog even if you change the folder before exporting.

This isn't a huge bug since you can change the default folder, but I guess it's a bug.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5e49df  No.14789

>>14783

Thank you for this report. I will make it so it only ensures it exists on the export attempt or similar.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.14829

Pixiv seems to have changed something to break the downloaders again. Login script is failing to get a true login (just the fake PHPSESSID that pixiv gives you if you fail a login) and if you import your login cookies from another source, you get a "CloudFlare needed solving" error, ending in a 403.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

da11ae  No.14846

I just updated to v414 from v413 and I immediately ran into a problem. It's a problem I had before, and reported it either here or on the endchan board.

The update seemed to go smoothly, but once I started using the new version, any time the client would do something that involved writing to the database, (e.g. processing PTR updates, or the new "syncing tag relationships" thing added in this update) the client would stop loading anything. Like, if I clicked on the search box to enter tags, the little drop-down menu just says loading, and never actually loads anything.

This is a problem I ran into before, and I think I even reported it here, but when I ran into it last time, it sort of just solved itself and stopped happening, but here it is again, and again right after I updated versions.

Last time, you suggested that I run Hydrus from source to see if that solved the problem, but I didn't need to since it soon just went away on its own. I tried that this time, but I just don't know how to get it to work, since I'm not familiar with Python, or programming itself all that much. I couldn't figure out how to get the right packages to install without it throwing errors at me.

I'm considering just rolling back to v413 and restoring a backup to that, then just hoping that a future version makes the problem go away and updating straight to that. I tried restoring my v413 backup onto a fresh v414 install, and that didn't work, so this is all I can think to do now.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 274229acf594e5b⋯.png (602.03 KB, 963x720, 107:80, 274229acf594e5b562b593dce3….png)

ff6d52  No.14731[Reply][Last 50 Posts]

Here you can ask questions so that the board is not clogged with small threads.

Old thread >>12641

64 posts and 4 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

714b82  No.14841

>>14840

delete the service from manage services then run a database vacuum, you can search for the update files and delete them through hydrus also.

>>14834

>>14825

>>14826

change your pixiv password and reimport your cookies.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ae2c4e  No.14842

Is there a way to "redo" my duplicate sort for all files? I've done some on several levels but i want to redo it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ae2c4e  No.14843

This question might have been asked before, but can i do duplicate search for webm, mp4 and other movie type files?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6c5d37  No.14844

I'm currently running the Linux version of Hydrus on Fedora. Would it be more stable or helpful for me to just run it in Wine, since the Linux builds are only made for Ubuntu? I used to do this, but I moved to the actual Linux version because I figured that would be more stable than running the Windows version through a compatibility layer, but maybe that's not the case.

Running from source isn't an option for me because I'm a low-IQ pleb and don't know how to python.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6c5d37  No.14845

>>14843

No, video de-duping isn't a feature yet, but it's one of the most requested ones.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

21fc98  No.14763[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v413/Hydrus.Network.413.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v413.tar.gz

I had an ok week. I mostly fixed bugs to make a 'clean' release before I go for the tag parents database cache.

It is all misc work this week, no highlights.

full list

- added 'sort by number of files in collection' file sort type. it obviously only does anything interesting if you are collecting by something

- when you enter a tag from a manage tags suggested tags column with a double-click, the tag input box is now immediately focused. entering it with a keyboard action does not move the focus

- wrote a new routine for the 'check and repair' database menu that scans for and fixes invalid tags. this might be some system:tag that snuck in, superfluoPost too long. Click here to view the full text.

3 posts omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d88811  No.14800

File: 9133a7e9e526390⋯.png (525.98 KB, 1200x900, 4:3, calumon.png)

Speaking of proxy. It would be great having the ability to configure a proxy per website/downloader. There are a couple of sites on tor and i2p I would like to scrape. Manually setting the proxy every time is annoying and blocks other downloaders.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a22d76  No.14809

>>14800

Thanks. Yeah, I agree. When I next do big work on the network engine, I will be making some UI for the 'domain manager', and more per-domain tools, so the system will be better able to detect 'ah, this site is down' and not affect the whole system. When I have that up, I could migrate the proxy options to that new system and UI and change depending on domain.

The new 'no_proxy' setting, btw, seems to be ignored due to a bug with the networking library I use (requests), so with luck that should be fixed soon, which may make things easier in the meantime. If there is any way you can set up a system-wide TOR proxy, that hydrus can inherit with no proxy settings or a careful 'no_proxy', it might be possible to figure out multiple proxies for certain sites more quickly than waiting for me to develop it. This might only be reasonable to do on Linux, though, where there is better support for mapping this sort of thing.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a22d76  No.14810

I had another ok week. I am not working as fast as hoped, but the new maintenance system works. The very long wait times to recalculate siblings is gone–it now all happens in the background over time. I am now working on converting parents to the new system.

I am less confident I can get 414 ready and good for October the 14th, but we'll see how it goes.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

39f86f  No.14824

I had a great week. The siblings and parents database code is mostly in place, and I was successful in unifying their application method to a simpler algebra that should result in faster siblings/parents work across the board.

I now have to tie up many database loose ends, cleanse the old UI-side parents system, and polish. About 150 small things and 3 big things left. I think I can be ready for October 21st!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ae7751  No.14836

I had a good four weeks migrating tag parents to the new database cache. Like siblings, parents are now applicable across services and completely undo-able. Furthermore, the large CPU requirements we experienced after the siblings cache are gone–a new maintenance routine cuts all parents and siblings work into pieces and figures it all out quietly in the background.

The release should be as normal tomorrow. It should only take a few seconds to update!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 9615483d4b836e0⋯.jpg (94.1 KB, 1024x768, 4:3, 1601788051705.jpg)

ecf9e3  No.14802[Reply]

or, "i've got xxxxxxx thousand images in my inbox, what the fuck do i do?"

i'm currently having this problem myself, so i thought it would be nice to have a thread to collect information about various ways to automate sorting/tagging/etc, such as:

* image deduplication scripts:

>https://github.com/knjcode/imgdupes

i'm presently also writing my own as well which should work somewhat better for large datasets, i'll post it here when it's usable

* datasets, useful for running against aforementioned dedupe scripts

>danbooru2019, contains all danbooru pictures + metadata up to early 2019: >https://www.gwern.net/Danbooru2019

i remember there being large dumps of other booru metadata on here years ago, but i can't find them anymore

* AI/neural network software for automated tagging, classifiers and etc:

https://github.com/KichangKim/DeepDanbooru

https://github.com/imamar94/ramrem-classifier

things i couldn't find but would find extremely useful:

>AI anime/photograph classifier

this would be very helpful, especially with deduplicating from danbooru2019

>subject classifier

if there was a NN that could tell me if the subject of a picture was a person or something else, this would be insanely useful, especially for the next item

>SFW/NSFW classifier

about half of my collection is porn. i'm planning on deleting basically all of it, so just being able to get that out of the way quickly would cut my workload in half

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

e9829a  No.14806

Looks kind of like a ML-general so I'll treat it as such. Got a bunch of stuff an Anon asked me to dump somewhere. No general order, some of it will be more useful than others. I'll try put the actually useful stuff first. It sounded like the OP requested an image comparison tool based on heat-mapping. I forward that request, having forgotten the name of the tool(s). EDIT: Forgot some stuff, formatting.

>http://www.visipics.info/index.php?title=Main_Page

Still probably the best and easiest GUI deduper. Works fine even with Hydrus folders, Hydrus might not like externally deleting pics.

>https://gitgud.io/koto/hydrus-dd/ see https://github.com/KichangKim/DeepDanbooru/

If you want automatic tagging, get it. Latest model is greatly improved. DD site seems even more accurate. Might have to do with model conversion. Run

hydrus-dd evaluate-api-search --service myTagService
in CLI to automatically tag everything in that tag service (default is my tags).

>https://github.com/imbaguanxin/Recognize-Your-Waifu & https://github.com/swrd1337/waifu-recognition & https://github.com/bakwc/PornDetector & https://github.com/hhatto/nude.py & https://github.com/notAI-tech/NudeNet

Classifiers. I personally don't care about these. Nudenet is the easiest to include in a project.

>https://thisxdoesnotexist.com & https://github.com/justinpinkney/awesome-pretrained-styleganPost too long. Click here to view the full text.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



bafb40  No.14719[Reply]

>"The hydrus releases are 64-bit only."

That was really bad news after my half-day reading about and planning a future, and how I will co-develop the hydros engine or a fork of it…. :-(

Why???….

The Python is a multiplatform and hi-level language (even a script language).

Why you all gaming maniacs make 64bit-only software?..

Of course, I will not change my tuned computer for one of 64bit-only apps. Several months of work to tune up Windows again, to test some app?.. No, thanks.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

ff0e19  No.14734

Sorry Chris, I hope you find some 32-bit software that will do what you want!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d45267  No.14747

>>14719

Gaming? It has been something like 13 years since I switched my non-gaming Linux to 64bit.

Very few maintain the 32bit x86 side of things anymore. Not just Windows software, even most Linux distos partly or fully dropped support. It just doesn't make sense to run x86 processors in 32bit with fewer less capable registers and many other downsides.

> Several months of work to tune up Windows again

Maybe you'll switch over too at some point. Copying configs or running ansible scripts or whatever you do is not quite as hard.

Or you pick something else, but I expect almost everything to eventually drop 32bit x86 on Windows, and it mostly already happened, even for things as popular as web browsers. It's definitely not just Hydrus. I believe it won't be fun going forward on that.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

c3794a  No.14774

>>14719

Hydrus wouldn't be able to shine with the limitations of a 32 bit environment. It's just not meant for the types of use-cases that a 32 bit machine is capable of. Believe it or not, managing hundreds of thousands of files requires a lot of memory.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a212dc  No.14778

just install a 64 bits OS lole

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

14df85  No.14801

It's time to leave 2004, neetboi

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



d5ac67  No.14786[Reply]

Ok so without this, the process of adding tags is kinda lengthy.

When adding new tags I want to be able to switch from "recent" tags, to seeing all of my tags. Doesn't seem like a difficult feature to add, and it would make adding new tags a lot easier since I keep forgetting the tags I have available.

The autocomplete feature does not compensate for this, as remembering the exact spelling isnt the problem, its remembering that the tag exists in the first place.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


File: 095f753aa32d06a⋯.png (156.5 KB, 640x507, 640:507, ClipboardImage.png)

f83b19  No.10277[Reply]

I don't know about you guys, but wouldn't it be nice to have a mobile client for this shit? Or at least a mobile-friendly UI for the discerning user who is gonna buy a Librem 5 from Purism or roll their own portable device running on linux (or some kind of BSD?)

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

14918f  No.10279

>>10277

Once the Hydrus mobile API is released, many mobile booru clients will have Hydrus support.

List of apps that will support it: BooruNav (android), Mignori (iOS), AnimeBoxes (android or iOS), Nori (Android and FOSS) and MBooru (android).

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4b501a  No.10332

>>10279

is there any info on what the calls will be? wondering if it's read only, because it would be nice to sort on mobile too

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

26fab0  No.10347

>>10332

Read-only would be easy, for writes, the things are 1. These apps willing to make a write function 2. Hydrus can handle write functions

BooruNav - discord.gg/4Sb5YrV (Android exclusive)

Animeboxes - discord.gg/kYgGJhF (Android or iOS)

Mignori - discord.gg/zf3SANY (iOS exclusive)

Nori - discord.gg/3DTNcHu and https://github.com/tjg1/nori

MBooru is on Telegram only https://github.com/onlymash/moebooru-android

Chinese: https://t.me/joinchat/BYcr90XsQO6188i597Qe7w

English: https://t.me/joinchat/BYcr9xAeSpDoEDf9swQw1g

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

e30c13  No.14760

>>10279

any updates on the progress of this?

Yes im aware I necro'd the hell out of this thread

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9bb4cf  No.14765

>>14760

check ver412 dev post.

He said that we can browse via phone by animeboxes

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

46605e  No.14743[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v412/Hydrus.Network.412.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v412.tar.gz

I had a great week catching up on smaller jobs, improving search speeds, and adding a 'lite' 407->408 update mode for HDD users who sync with the PTR. There are also a couple of new applications for the Client API.

Update this week will take a few seconds to a few minutes as new database indices are created.

sibling and search speeds

Thanks to feedback from some PTR-syncing HDD users, the new siblings update code, most importantly in step 407->408, takes way too long for them - perhaps more than 24 hours. I have written a little yes/no dialog popup into the update step that talks about this and optionally activates a 'lite' mode that does not apply siblings. This still requires some Post too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

69fa4c  No.14744

As always, thanks for the update.

It seems to have some problem though. On the Linux version, I'm getting this error for the url downloader, for apparently any website I try:

TypeError

PendURLs() got an unexpected keyword argument 'filterable_tags'

File "hydrus/hydrus/client/gui/ClientGUICommon.py", line 1794, in eventFilter

File "hydrus/hydrus/core/HydrusData.py", line 1542, in call

File "hydrus/hydrus/client/gui/ClientGUIControls.py", line 732, in EnterText

File "hydrus/hydrus/client/gui/ClientGUIManagement.py", line 3780, in _PendURLs

Also I think hydrus companion doesn't work alright, but I haven't found a good error to copy for that yet.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8088cd  No.14752

>>14744

Hey, I am sorry for the trouble. I messed something up here at the last minute last week and I did not catch it in testing. Top priority this week is to write a better test suite for the downloader pages and the client api so this does not happen again.

I have made a new hotfix today and replaced the files the download links above point to. Please download again and let me know if you have any more trouble.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

69fa4c  No.14757

File: 22c5cc7c2d343a6⋯.jpg (322.32 KB, 1400x1376, 175:172, 22c5cc7c2d343a6700e71154b8….jpg)

>>14752

That fixed it. Thanks for the effort!

> Top priority this week is to write a better test suite for the downloader pages and the client api so this does not happen again.

Sounds like a great idea.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8088cd  No.14762

I had an ok week. I mostly fixed bugs, aiming for a nice 'clean' release before I go for the parents database cache.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

f9a318  No.14714[Reply]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Windows.-.Installer.exe

macOS

app: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.macOS.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v411/Hydrus.Network.411.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v411.tar.gz

I had a good week. The siblings work is complete.

siblings

The last areas that used the old siblings systems are now migrated to the new fast cache. The 'loading tag siblings' step of client boot, which for PTR users could be several seconds of work, is no longer needed!

These last parts are all user-facing UI code. Mostly tag autocomplete behaviour and the 'will display as' labels you see in tag edit contexts. Everything now goes through the database, and all in a nice asynchronous way, so (fingers crossed) it will not add noticeable lag.

As I unified code here and moved to nicer logic, I was able to clean up some behaviour. Matching siblings baPost too long. Click here to view the full text.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4c6717  No.14738

I had a great week. I was able to catch up on smaller work, optimised a variety of db functions, including the new sometimes-slow tag and wildcard queries, and added a 'lite' mode for the big 407->408 update so PTR-syncing users on HDDs can update in less time.

The release should be as normal tomorrow.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2cac8d  No.14741

Just updated from v374, I made a backup just in case but it went smoothly. Thanks dev!

Also finally polished off the last of my duplicates just before the update, my high watermark was in the high 70ks, so I think I sorted out at least 200k duplicates overall since whenever I started using Hydrus, probably late 2015 or sometime 2016?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4c6717  No.14742

>>14741

That is pretty killer mate, well done. I am confident a big update to dupes is coming in 2021, including filter workflow and beginning of filter automation, so if you have thougthts on the current system's strengths and weaknesses, I would be really interested to know.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2cac8d  No.14749

>>14742

I went over 8k characters and notepad++ doesn't count spaces but 8ch does, so rather than try and figure out where to split it I just pastebinned

https://pastebin.com/mBZLa7tk

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 1426721772716.png (100.78 KB, 1624x1081, 1624:1081, 1327614072601.png)

68f861  No.471[Reply][Last 50 Posts]


Drag and drop windows with tag rules. Show two windows side by side and one window can be programmed with the rule "ADD tag foo" and the other one has the rule "REMOVE tag foo, ADD tag bar" and you can drag and drop files to them.

Deriving tags from regex of other tags/namespace tags. A file has the tag "filename:big_ugly_name" and we could regex that namespace for another tag.

Tag sets with hotkeys: save a set of tags under a hotkey so it's quick to add them to a file while filtering

Opaque window behind tag list in the corner so it doesn't get hidden by picture background

Option to default certain mime types to be excluded from slideshow and only open externally, will help with videos with odd codecs that don't preview in the slideshow correctly

Option to specify hamming distance in "find similar images", you can't change the option once it's in the filter window and you have to enter the hash manually in the "system:similar to" option
731 posts and 205 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0115cd  No.14547

I want to be able to export transcode to 4chan compatible webms

Ideally I don't want to keep multiple encodes of files depending on where I'd like to post it. I'd just like to keep original mp4s and have a simple menu to export to board friendly formats.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fbb3f7  No.14619

It would be good to have a better deduplication assistance, e.g. letting this evaluate image quality and only just confirming that it did correctly identify the worse images:

https://github.com/idealo/image-quality-assessment

It might also be good to have more powerful image similarity detection:

https://github.com/mkettune/elpips

Also the lossless JPEG recompressor ( https://brunsli.dev/ - code at https://github.com/google/brunsli ) that will also be part of the JPEG XL standard is so great that likely I will want to re-compress all JPEG with it. I assume hosters will see it the same way.

Is there some way to transmigrate checksums from the PTR so they can still apply to the recompressed files?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

311fa6  No.14652

>>14619

>lossless JPEG recompressor

That's a converter, it turns jpg into jxl. It has the same problem as FLIF, HEIF, etc. in that literally nothing uses it. Webp barely has a presence and that's only because Google shilled the fuck out of it after making it. If you want a true JPEG recompressor, check out mozjpeg ( https://github.com/mozilla/mozjpeg ). That being said, JPEG XL is better at compression than even mozjpeg, so if Hydrus had JPEG XL support I would be interested.

I would also like some sort of way to take a file in the Hydrus database, compress or otherwise modify it, and move the metadata from the old file to the new one. How that is done is the problem, though. Maybe we could just have whatever external compressor output a tsv file of old to new hash pairs, then import that into Hydrus and have it migrate metadata. This would work well for local collections; no clue about PTR though, I don't use it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

000000  No.14688

>>14521

>It doesn't make sense for hydrus to suddenly give up everything it takes as granted for files and add clutter just because you're too lazy to move tags.

It doesn't have to give up anything, it just has to alias the file metadata. If you move the metadata to a modified file then you won't be able to receive any updates on it because it only applies to the original. Likewise, you wouldn't be able to update the original if you only touch the modified file. (e.g. PTR)

>If you want to convert files there are already safe alternatives like FFMPEG.

What do you think hydrus uses under the hood?

>Even if you only convert it once now everything is considerably slower

Would be O(1).

>Having to test whether they have alternative hashes of other files

Would take a trivial amount of time because it's a hash table.

>having to test whether that one hash is the current hash

Would be unnecessary if the file is addressed correctly.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b04b20  No.14735

Related to this sort of issue:

>>13431

I have files I download through other means, so I'm not using the Hydrus downloaders, but instead am using the "try to load tags from neighboring txt files" option to have my other download scripts fill in all the meta about the files. I can add a "url" into that TXT file as a tag, but that gets imported as a "tag" on the file, not a "url" object on the file. Some means to have those side-by-side TXT files also indicate the source URL(s) would be nice, or a "magic" tag that setting it actually sets a "url" object for the file.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: b28babaa13b7dbf⋯.png (765.02 KB, 1278x720, 71:40, b28babaa13b7dbfb92d271ee0a….png)

2f807c  No.12641[Reply][Last 50 Posts]

Here you can ask questions so that the board is not clogged with small threads.

Old thread >>9327

746 posts and 114 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2  No.14726

>>14700

Do you have help->advanced mode turned on? I think I hide some of those clever commands behind that.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2  No.14727

>>14702

Ah, do you mean for 'export folders'? I experimented with this with manual export (I think you need help->advanced mode turned on), and I did have a plan to try this out for export folders. I'll bump this up and take a proper look.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2  No.14728

>>14703

It is not a pipe dream, but it is such a big job that it'll have to win a 'big job' poll. I expect to get through three or four big jobs a year once I am back to normal schedule, and the next poll should be up by Christmas. Let's see how it does there, and we'll see when we can expect it.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2  No.14729

>>14709

>>14712

>>14713

I plan to have nice support for traditional zip/cbz/cbr files in future. It is sufficiently popular that I expect it to win a 'big job' poll pretty soon. I'll have proper thumbs, browsing of internal pages, and support for conversion back and forth between individual files and compiled 'chapters' or 'volumes' or whatever. This will be a part of my attempt to solve the problem of handling awkward 'page' tags.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7f99a2  No.14730

>>14715

>>14721

Thank you for this information. I will attempt to detect WAL and networking gubbins in future. I generally do not recommend running the db itself across a network share due to latency issues, but I hope I can at least detect the situation and throw up a warning, and ideally recover and set WAL off.

NEW THREAD

>>14731

>>14731

>>14731

>>14731

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
Post last edited at



File: 5734ceedfcc53a4⋯.png (219.04 KB, 373x323, 373:323, Tzs0oi5.png)

51fa6a  No.10443[Reply]

Make my day showing me your boners, lads.

I hope i'm not a degenerate by this board's standards.

19 posts and 17 image replies omitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fbd825  No.12879

>>12874

You dont. You just hope that the techno-jew doesnt care about whatever it is you're hoarding.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1b4a70  No.12892

>>12872

>60 bucks per year

It's not expensive, but it's still 60 dollars more than my current backup expenses.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

51fa6a  No.12898

>>12874

I don't give a fuck that some NSA employee can look at my patreon content.

>>12872

I like knowing that all my kino tiddies are saved somewhere in Buttfuc, Tennessee.

It's 3h of my job for a year of peace of mind.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

1b4a70  No.12908

File: 57e2c6b71dc3d74⋯.png (225.39 KB, 376x394, 188:197, ClipboardImage.png)

Finally reached 7% in regards to filesize by sorting the bigger files first.

There's still shit to import, but freeing 20GB up is pretty nice.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8de9b4  No.14717

File: ac4be9f8729f6b6⋯.png (479.1 KB, 559x790, 559:790, Bone.png)

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



Delete Post [ ]
[]
Previous [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
| Catalog | Nerve Center | Random
[ / / / / / / / / / / / / / ] [ dir / random / abcu / abdl / lewd / pone / r / random / s / warroom ]