[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Catalog  Archive

Name
Email
Subject
REC
STOP
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Options

Allowed file types:jpg, jpeg, gif, png, webp,webm, mp4, mov, swf, pdf
Max filesize is16 MB.
Max image dimensions are15000 x15000.
You may upload5 per post.


This board will be deleted next Wednesday. I am moving to a General on 8chan.moe /t/. This board is archived at 8chan.moe /hydrus/!

YouTube embed. Click thumbnail to play.

4e1764 No.12361 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v349/Hydrus.Network.349.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v349/Hydrus.Network.349.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v349/Hydrus.Network.349.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v349/Hydrus.Network.349.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v349.tar.gz

I had a great week. The duplicate filter work went really well, and the manage tags dialog has a neat new button for fixing siblings and parents.

The poll for the next 'big job' is live here >>12358 ! The direct link is https://www.poll-maker.com/poll2331269x9ae447d5-67

duplicate filter

The duplicate filter page has its old 'file domain' button swapped for a full file search context. This allows you to see 'potential pair' counts, show some random pairPost too long. Click here to view the full text.

21 postsand5 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4e1764 No.12429

>>12421

Yeah, at the bottom of that page, there is a 'Forced system:limit for all searches'. You might like to turn this back on just to speed up some things if you occasionally accidentally hit a bare 'system:inbox' search and the client tries to build a multi-million file result. The default is 10,000.

For the damaged dupe detection bug, I am not sure if there is (still) a problem here. I am afraid I cannot remember the exact details of what you encountered, so I cannot speak cleverly about it. If your dupe filter is lining up pairs that seem correct, I think you are good. If you are worried that 2.4M < 3.8M, you can feel better–the duplicate filter only works for still images like jpgs and pngs right now, so if you have a whole bunch of webms and so on, these will not be processed by the duplicate system (yet) and aren't counted.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

05b5ca No.12430

>>12404

> I think it locks zoom and position right now if the files have the same resolution ratio.

Seems like I have a lot of images that aren't. But that explains what is happening.

> I can't think of a clever solution off the top of my head for when the files have different ratio–maybe just match same width size, or the same (smaller dimension), and offset position from the top-left?

Hm, not exactly sure what you meant.

I believe centering on the same relative percentage of distance from the side and top and equal zoom level is the best simple (not image content aware) method?

As in, if the user zoomed in and scrolled vertically to a third from the top of the image, you do the same on the other image - a third from the top of that image, same zoom level. Basically, you assume they're probably scaled images

I'm pretty sure this needs to have a toggle button for this that is defaulted to on but can be turned off as-needed for images that happen to not be just scaled.

That's the most needed change IMO. There are a bunch of options that might be interesting to have on top of that, like having two buttons to only fix zoom or scrolling individually, or to have a setting that disables this toggle button the first time after you picked an area to focus on [at the time where you first switch to the other image in the group, after having zoomed/scrolled - this is for collections with a lot of duplicates with borders and stuff where it only approximately works and to actually compare the features you zoomed in on you need to scroll and zoom the other image manually].

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5f127f No.12436

>>12428

Strange, now it's working fine. I must've screwed something up during creation. When I last tried it, it insta-404'd

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fc0939 No.12438

KILL URSELF NIGGER BABY

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

fc0939 No.12439

HYRDUR SSUCKS BAN ME

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



3d3d4e No.12345 [Open thread]

hydrus is shit nigga just use folders and subfolders

my 12345 says i'm right

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

93678f No.12374

Imagine being a folderlet

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

6c81d0 No.12387

Subfolders are ok, I use them too since hydrus is (currently) shit and crashes for no reason, but tags are objectively superior.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 3711d0607c5673e⋯.mp4 (3.38 MB,1024x576,16:9,3711d0607c5673ea2d3f398a9a….mp4)

187563 No.12152 [Open thread][Last50 Posts]

Ok lads, as I am now finishing up OR search, I am soon going to be free to work on a new 'big job'. I am pleased that I was able to make simple Client API and OR search in much faster iterations than previously. I hope to continue like this, keeping the next big job 8-12 weeks at the most before running a new poll.

The current list is:

Just catch up on small work for a couple of months

Reduce crashes and ui jitter and hanging by improving ui-db async code

Clean up code and add unit tests

Improve tag siblings/parents and tag 'censorship'

Add ways to display files in ways other than thumbnails (like 'details' view in file explorers)

Add text and html support

Add Ugoira support (including optional mp4/webm conversion)

Add CBZ/CBR support (including framework for multi-page format)

Add import any file support (giving it 'unknown' mime but preserving file extension)

Improve 'known urls' searching and management

Explore a prototype for neural net auto-tagging

Add support for playing audio for audio and video files

Add ui for waifu2x and other file converters/processors

Write some ui to allow selecting thumbnails with a dragged bounding box

Add popular/favourite tag cloud controls for better 'browsing' search

Improve the client's local booru (this likely now means a backend migration to the Client API)

Improve duplicate db storage and filter workflow (need this first before alternate files support)

Improve shortcut customisation, including mouse shortcuts

Add ratings import/export, and add 'rating import options' to auto-rate imports

Add more commands to the undo system

Improve display of very large/zoomed files in the media viewer

Set thumbnail border colours on user-editable rating and namespace conditions

Post too long. Click here to view the full text.
99 postsand8 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.
Post last edited at

e607d6 No.12333

>>12325

Yes, thank you very much!

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

dc31c6 No.12334

File: 9dc5ac8dddd8c16⋯.jpg (76.44 KB,488x623,488:623,9dc5ac8dddd8c16707e697b06d….jpg)

>>12152

Hydrus is already pretty great, when it's stable.

The main 'feature's i'd like to see worked on next are getting pixiv scrape working again and more login manager support for big sites like Fur Affinity and Ink Bunny. Having hydrus scrape a largely nsfw site and miss all that is kind of pointless because of no login.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

8dee28 No.12335

>>12316

sadly the only program that you would be up against is comic rack and acdsee in terms of full featured program and in terms of comic rack, nearly every feature they have, you also have, and in terms of acdsee you either use crash prone versions from 10+ years ago (version 8/first pro to version 9) or you use the recent versions which are pure bloat for unicode support, there is very little middle ground with acdsee due to so many of the in between versions fucking with features.

>>12319

I honestly never want an automatic sort, as much as it would be good for going though my cluster fuck, I am still getting images that are full featured images going against 23 byte black boxes. running into this makes a pure auto system unacceptable to me, I would accept an auto system that looks at two images, and then has me spot check

lets say it finds a better worse pair,

it presents me the better and it presents me the wrose

green border is better, red border is worse

I scroll though like normal, but left click confirms green, right click confirms red.

Confirmed green acts like better worse does currently,

confirmed red takes it out of the auto figure it out area and into a manual pick.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b8262d No.12348

Are there any plans at all to (at least have the option to) keep metadata of individual tag mappings, like a file's tag history or keeping track of which process added this tag to this file?

Like was it typed manually, was it imported while scraping, etc.

I assume this would bloat the DB by a big factor but at least for my personal use I think that might be worth it down the line

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

187563 No.12359

Poll >>12358 !

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 972cb2ae2c3070c⋯.jpg (455.6 KB,1300x940,65:47,972cb2ae2c3070cf66e79c4cfd….jpg)

b92914 No.12354 [Open thread]

I had a great week. The new search system for the duplicate filter went really well and is ready for everyone to use. I also improved and sped up some video import and thumbnail generation code, and I added a neat button to the manage tags dialog that lets you automatically fix siblings and missing parents.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

57efa0 No.12289 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v348/Hydrus.Network.348.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v348/Hydrus.Network.348.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v348/Hydrus.Network.348.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v348/Hydrus.Network.348.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v348.tar.gz

I had a good week. It is mostly small updates and fixes.

all misc this week

After the recent weeks' thumbnail work, I became frustrated with how laggy the client's file system could get under heavy load. This week I have written a new file access locking system that has less latency under heavy simultaneous use and is also safer for certain edge cases. Multiple import queues and thumbnail fading and regular media browsing will all interact with less lag now.

The Client API has several improvements: the /add_tags/add_tags call has its 'hashes' parameter fixed and now does sibling-collapse and parent-expansion on its 'add' tags (which caPost too long. Click here to view the full text.

15 postsand3 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

468b1e No.12337

>>12332

>Was there maybe some other program using heavy disk work, like a defragger?

No. My database is on an M.2 NVMe SSD so usually stuff like disk cache initialization takes two seconds and PTR processing takes a minute at most. What happened here is that both the downloader and the disk cache initialization froze for several minutes. I don't know why, I didn't notice anything else. Either way I solved it by turning off idle maintenance so I'll just have it run on exit since it's really fast anyway.

That new maintenance option would be a good idea to add still though.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

26e8ff No.12339

>>12305

You can change this under network > downloader definitions > manage parsers

First, I'd suggest cloning the existing parser before tampering with it.

Look for the Danbooru page parser and go to "content parsers" and you'll see the namespaces hydrus uses such as "creator" and "series".

Just change those namespaces to "artist" and "copyright", and it should add the data found from danbooru into those namespaces.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

93f068 No.12340

>>12339

tried it and what happens is it doesn't fetched the edited parsers at all until I change it back to normal

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

93f068 No.12341

File: ecff8ed9b1a042b⋯.jpg (31.28 KB,619x239,619:239,Capture.JPG)

>>12340

here I changed the namespace from "creator" to artist. When I enter the URL, Hydrus no longer fetches the artist at all.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

c14cd8 No.12351

>>12341

Hmm, I'm not sure why that's happening since it should be the same part of the html getting parsed.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

0028ea No.12153 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v347/Hydrus.Network.347.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v347/Hydrus.Network.347.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v347/Hydrus.Network.347.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v347/Hydrus.Network.347.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v347.tar.gz

I had a good week. OR search is essentially finished, and I cleaned up and fixed a variety of other things.

A new 'big thing to work on next' poll will be going up soon. If you are interested, please check out the discussion thread here:

>>12152

or search

As previously discussed, I have moved OR predicate construction to the standard dropdown list below the tag input. It now appears as the top result, where you can hit enter on it to submit it as-is. Also, while under construction, a 'cPost too long. Click here to view the full text.

18 postsand3 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0028ea No.12208

>>12164

Oh yeah, your odds of getting the same image in a row are fairly high, as my current 'get some dupes to process' job batches decisions together into various similar types. You'll likely get several pairs in a row that feature the same file as A or B.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0028ea No.12209

>>12190

Yeah, it'll say the action as well. In the filter it will be something like:

"Deleted in Duplicate Filter (better/worse): worse file deleted."

If you do a mass action from thumbnail right-click, it says this variant:

"Deleted from duplicate action on Media Page (action): one/both deleted."

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2aa25c No.12238

Just did another clean up as hydrus was eating 6gb on launch and dups were starting to lag the program to much, its now starting sub 1gb with next to nothing changed since the last time I did this which got it down to 2.3~gb

still honestly see no reason for the watchers once they 404 to eat that much space, but good to see the program is getting even better with ram management.

>>12205

as far as the images themselves go, yea, they are likely changing 1 pixel and re saving it, my shotgun approach to downloading has managed to seemingly sweep up everyone ever made but there are a few times where I knew the image was never getting posted again I just straight deleted the shitposts, but this time…

I thought I got rid of all of them, but apparently it's somehow finding more.

>>12208

after a while I thought this too as I was getting somewhere of 455k images, it was really odd that there would be 3 or 4 images that were dups of the same image that would come in.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2aa25c No.12239

>>12204

I have to ask, is it possible to have a custom sup finding thing? sadly I went though these a number of weeks ago, but I was checking an import archive, and apparently what I used to download corrupted images, it's more or less the standard at some point the image below this line is no longer loaded and its solid grey lines.

with images like this, would it be possible to have a 'corrupt dup' setting where you either point out where the image is good, or where the image is bad (a fill tool may deal with bad better then good making it easier to do) and have it discount that section from a dup search? my logic here is if I have a large enough archive, or the interests see me downloading similar images regularly, there is a good chance I have the un corrupt version somewhere else already

and just to head this off, these are images that have gone from a 120gb maxtor, to a 1.5tb seagate and survived 3 hdd failures there, to be moved to a 4tb and finally to am 8tb hdd, and finally to a currently 3tb image archive drive. odds are one of the drives fucked with the files in some way, or it was my horrendous method of acquisition all those years ago so the issue isnt my hdd corrupting images, its more I have corrupt images that may have to much corruption to be dup found

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0028ea No.12328

>>12239

No, I am afraid sectioning off good and bad areas of images is way too complicated for my current system to deal with. I encourage you to delete all corrupt files.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: ea31ab670c8dee7⋯.png (12.55 KB,340x175,68:35,mariadb-usa-inc.png)

1e8781 No.9068 [Open thread][Last50 Posts]

ITT: create proposals for making Hydrus more optimized.

Proposal: Why can't Hydrus switch to MariaDB?

If it is faster, then it should be better. The only trouble is having the need to rewrite the queries, which from an SQL standpoint should be a non-issue, right?

List of Databases with Open Source License and Open Source APIs:

SQLite - Currently used in Hydrus, has minimal features

MySQL - A more well-rounded SQL Database with user management

PostgreSQL - An SQL with complex features with less performance

MariaDB - SQL/NoSQL database with heavy optimizations

ElasticSearch - A literal search engine instead of a normal Database

Teradata - IDK

https://www.digitalocean.com/community/tutorials/sqlite-vs-mysql-vs-postgresql-a-comparison-of-relational-database-management-systems

https://www.infoworld.com/article/2611812/mysql/mysql-face-off--mysql-or-mariadb-.html

49 postsand3 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d46cda No.11586

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

f06e36 No.11927

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0a99e5 No.12295

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0b5902 No.12302

>>12295

Why don't you actually develop something on your own instead of endlessly shitting out github links

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0a99e5 No.12307

>>12302

Nah that is for >>12277

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: b2474c1d0a864f1⋯.jpg (193.25 KB,1280x853,1280:853,b2474c1d0a864f1d89b2622611….jpg)

c0461a No.12279 [Open thread]

I had a good week, mostly working on small jobs and fixes. File and thumbnail access should be less laggy, some drawing code should be more resource efficient and stable, and the client api has a bit of work as well.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

b5cff5 No.12084 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v346/Hydrus.Network.346.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v346/Hydrus.Network.346.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v346/Hydrus.Network.346.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v346/Hydrus.Network.346.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v346.tar.gz

I had a great week. There's a bunch of fixes and thumbnail improvements, a more powerful manage urls dialog, and a prototype OR search to try out.

thumbnails

Last week's big thumbnail change seems to have gone fairly well overall. There do not seem to be any huge errors anywhere, and the simpler file system and code is great, but I was annoyed by how slow certain regeneration scenarios turned out to be, and how some thumbnail resizes were a bit blurry.

To address this, this week I have cleaned and improved a bunch of thumbnail loading code. It was much nicer to do now I only have one thumbnail file to juggle. Thumbnails should now be aPost too long. Click here to view the full text.

21 postsomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

bd5835 No.12145

> Can you give a concrete example of an export search that is failing for you? Is it by chance a 'system:rating' only search?

I have two exports, both are a simple search for one tag.

One to sync tag "bg", another to sync the tag "potential bg".

Both export folders have been left empty or incomplete when I use hydrus. I have to poke around the export settings to make sure they actually worked before closing hydrus.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b06aa4 No.12146

>>12135

>In 347, the 'evangelion' search will be run first, so the potential search domain of '-rei' is cut down from your entire collection to your x eva files.

Oh nice, especially with various system tags in place to limit the search, that'll cut down the time quite a lot for me.

On another topic, for the list of next big things, was the booru something you had in mind for working on? I had an idea about how it could be integrated more directly into the main UI, which I could write more about provided that there's interest in the booru right now.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b5cff5 No.12250

>>12136

I would like to have that, particularly for my own use, but unfortunately this functionality does not seem to be built in to my ui library, and furthermore my thumbnail panel is all my own custom code. I will have to write both ends of a system like this, so I have it as a 'big job' for now. It is currently "Write some ui to allow selecting thumbnails with a dragged bounding box" here: >>12152

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b5cff5 No.12251

>>12145

Thank you, the 'delete after export run' bug should be fixed in 347 for export folders that make filenames that include subdirectories. Please let me know if you still get it in the new version.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b5cff5 No.12252

>>12146

Yeah, now here as a new 'big job' to work on: >>12152 . However, I am not totally sure what to do with the current booru. It was always a prototype that then never got revisited. I think next step is probably to convert it to the nicer new Client API code just so it is all operating on the same system, and then work on templating so users have more CSS/HTML customisation options.

Then again, I do know of some users working on booru wrappers for the Client API as-is, so if they can do a better job than I can fit in, it may be better ultimately for me to abandon it. If the booru does not prove all that popular in the poll and some other users can fill in the gap, perhaps we can revisit the whole idea and instead I give more power to them via the Client API.

If you have particular ideas on integrating the booru into the actual client ui, I am interested to know what you are thinking of. Please post in that big poll thread if you would like.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 7ece33b770e9701⋯.gif (565.95 KB,300x166,150:83,7ece33b770e9701da946ffa95c….gif)

5c86dd No.12143 [Open thread]

I had a good week. I fixed some bugs, extended thumbnail resizing into a much smoother two-stage system, and fleshed out the OR search workflow as I had hoped.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b0d7cf No.12148

What 'bout wildcards in parent tags?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

5c86dd No.12244

>>12148

That is an interesting idea. It might be dangerous if I were not careful, but I like it. Unfortunately, the tag siblings and parents system needs significant overhaul at the database level before I can do anything clever and new with it. If you are interested in new sibling and parent tools, please vote for "Improve tag siblings/parents and tag 'censorship'" here >>12152 .

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: d49758fd3e9ccfe⋯.png (54.11 KB,2105x826,2105:826,logo.png)

258636 No.11035 [Open thread]

I was thinking since Pixiv has such a weird, complicated, and sometimes awfully designed site, us Pixiv bros should help each other out on figuring out ways to make it easier to use with Hrdrus. Post any tips, scripts, regexes, setups, etc.

7 postsand2 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

740aef No.11786

>>11059

>>11054

>>11041

Not just that, but "artists' favorite tags" and "tags' main users", from that we can create a network graph for better tag and artist discovery

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

258636 No.11787

>>11760

Those are nice scripts but my main issue is I need to keep turning new Japaneses tags into English using sibling. It just seems like such a clutter to keep turning Japaneses tags into English when they are already translated in that >>11759 2nd pic, unless there's a better way to deal with this and I'm going something wrong.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

06e856 No.12060

>>11759

sauce for the first image?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

53c5cd No.12127

>>12060

>>11759

able to post all images visible? I like what im seeing

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

302465 No.12131

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



YouTube embed. Click thumbnail to play.

b920fe No.12021 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v345/Hydrus.Network.345.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v345/Hydrus.Network.345.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v345/Hydrus.Network.345.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v345/Hydrus.Network.345.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v345.tar.gz

I had a good week. The big thumbnail update is done, which means for an important update. Users with smaller databases have less to think about, but anyone with 1,000,000+ files should definitely read all of the following:

thumbnails

This is a great week to make a backup before you update!

Until now, the hydrus client has used two simple thumbnails–one 'full-size', one 'resized'–for each file. Hardware has moved on since then, and so has my code, so it is now feasible to have a single smarter thumbnail that will resize itself on demand. The work for this was done this week. This makes for a simpler and lessPost too long. Click here to view the full text.

21 postsand4 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

19b270 No.12079

>no next release announcement thread

is hydrus dev okay?

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

19b270 No.12080

forget it

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

335f6d No.12081

is it possible to add in a option for color managment just to point to an ICC Profile? Would help greatly for people using an ICC profile on Windows color managment or or programs like displaycal.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b920fe No.12082

>>12076

>>12077

>>12081

Hey, I apologise, this ICC profile tech is completely new to me. I will make a job to look into this, specifically how much control I have over it with wx or OpenCV/PIL, for next week.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

b920fe No.12083

>>12079

>>12080

I took some extra time yesterday evening (and just now) to finish some bugs and cleaning up thumbnail code. Going to test it a bit more, so release might be delayed a little bit. I feel good about it though, so no chance of anything going wrong™.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: 4156de3f899388a⋯.jpg (285.02 KB,1402x1865,1402:1865,4156de3f899388aeb0cfbb298e….jpg)

f97f07 No.12078 [Open thread]

I had a great week. With the new simpler thumbnails, I improved how thumbnails load and added some new thumbnail maintenance actions. I also extended the 'manage urls' dialog to work for multiple files and got the very first simple version of OR search working and ready for user testing!

I also fixed the unusual 'include current tags' and white-frame animation bugs.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


YouTube embed. Click thumbnail to play.

4bd52a No.11975 [Open thread]

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v344/Hydrus.Network.344.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v344/Hydrus.Network.344.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v344/Hydrus.Network.344.-.OS.X.-.App.dmg

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v344/Hydrus.Network.344.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v344.tar.gz

I had a mixed week, but I got some good hydrus work done. It is basically all misc this week.

highlights

The Client API v1.0 got its last polish this week. I fixed some bugs and added a new parameter to control page selection to the /add_urls/add_url command. Future Client API work will be entirely in regular weekly work. I'd like to add wildcard and namespace tag searching, more system predicates, autocomplete tag searches, optional https to encrypt communication outside a LAN, cookie.txt import, and I am sure many other things. The basic bones are decent now though–I now need only hang new things off it.

Animation scanbars (thePost too long. Click here to view the full text.

17 postsand2 image repliesomitted. Click reply to view. ____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4bd52a No.12013

>>12005

I have very little experience with p2p, and I am not sure what good python options I have available. I'd like to integrate any client-to-client talking into the client ui and have some sort of 'trust' network so users have more control over who they are talking to (whether that is 'I am happy to help share the bandwidth load, I am on 24/7 and will talk to anyone' vs 'I want to share my private collection of dbz kino with my two friends') rather than linking users together automatically.

In any case, I haven't thought about it seriously yet. The bandwidth crush is not a big deal for me yet, but it will be if I trigger any sort of update regeneration.

>>12006

The problem I am concerned for is more clientside. A full PTR sync now takes ~14GB total in local hard disk space. Since most users only ever use a small fraction of those tags, I'd like to cut it down for technical reasons like processing speed and also convenience.

The server db, which stores a bit more info like account_id and so on with each content row, is now 28GB. I don't mind that bloating up to 100-200GB in future as the collection grows, but I don't want to say 'hey new user, if you sync with the PTR, prepare your expensive SSD angus for 64GB of random shit tags you'll never see'.

For me, this is all ultimately a series of stopgaps for the next ten years or whatever until auto-tagging tech takes over the easy stuff. The 'every client gets everything the server has' idea of tag repos has worked overall really great, but it is not sustainable at the current pace. It could be sustainable as >>12004 suggests, making a certain tag repo devoted to a limited set of files and rules that will grow slower than new hard drives are, but my PTR's free-for-all is too unmanaged to last forever.

That said, it seems that training databases for neural nePost too long. Click here to view the full text.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

4bd52a No.12014

>>12011

That might be slightly more tricky because I think an SVG is really an xml document, right? There isn't therefore a neat reliable file header, but I'll make a job to look into it. Adding 'document' handling to hydrus is a long-term objective, so extending initial file parsing to say 'ok, it wasn't a video, let's see if it loads as xml and if it has any good file metadata tags' will come one of these days in any case.

A quick search suggests there are a couple python svg libraries around, but I don't know how good they are. If there's a great one out there, I can add support for this much quicker (and add native rendering) as I can offload the difficult stuff to that.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

56c807 No.12017

>>12014

Yeah, svgs are basically XMLs with a specially defined namespace at the beginning. If you ever get to document/xml handling, namespaces are probably the way to go to differentiate them from say, html files.

The mozilla developer network has a surprisingly good primer on the stuff imo: https://developer.mozilla.org/en-US/docs/Web/SVG/Namespaces_Crash_Course

I'm not versed enough in python to recommend a library, but considering how often python is used in math and how often svg is used to make charts, I'd wager there's a great one you can probably use.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

bcbace No.12018

>>12014

For initial parsing, have you considered libmagic from the "file" unix utility?

It doesn't do much to extract metadata, but if it's just a matter of finding the proper MIME type it should do a good job.

https://github.com/file/file/tree/master/python

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

295623 No.12019

>>12013

>have some sort of 'trust' network so users have more control over who they are talking to

Wouldn't it be easier to start with some "all of this is shared" type bittorrent or such integration? There are good libs for that that are easy to use.

You can define what is shared, but you'd omit the "with who" part for now.

Sharing in a web of trust or with friends requires a good bit of UI work to make any sense, and security flaws will also upset people a lot more.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.



File: c8960a1f894c5dd⋯.png (252.53 KB,400x450,8:9,c8960a1f894c5dd3b9d4da1a68….png)

fef43d No.12016 [Open thread]

I had a good week. The big thumbnail improvement is done, making for smarter thumbnail access and storage across the program. Also the max possible size of thumbs, previously 200x200, is now uncapped! The update tomorrow will take a little while, as the now-surplus half of your thumbnails will have to be deleted.

The release should be as normal tomorrow.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


Delete Post [ ]
[]
[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
| Catalog | Nerve Center | Random
[ / / / / / / / / / / / / / ] [ dir / random / 93 / biohzrd / hkacade / hkpnd / tct / utd / uy / yebalnia ]