[ / / / / / / / / / / / / / ] [ dir / animu / animus / htg / kind / lit / pdfs / sapphic / sl ]

/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.
Name
Email
Subject
Comment *
File
Password (Randomized for file and post deletion; you may also set your own.)
Archive
* = required field[▶ Show post options & limits]
Confused? See the FAQ.
Embed
(replaces files and can be used instead)
Voice recorder Show voice recorder

(the Stop button will be clickable 5 seconds after you press Record)
Options

Allowed file types:jpg, jpeg, gif, png, webm, mp4, swf, pdf
Max filesize is 16 MB.
Max image dimensions are 15000 x 15000.
You may upload 5 per post.

New user? Start here ---> http://hydrusnetwork.github.io/hydrus/

Experienced user with a bit of cash who wants to help out? ---> Patreon

Current to-do list has: 2,017 items

Current big job: Catching up on Qt, MPV, tag work, and small jobs. New poll once things have calmed down.

YouTube embed. Click thumbnail to play.

a62918  No.8302

windows

zip: https://github.com/hydrusnetwork/hydrus/releases/download/v297/Hydrus.Network.297.-.Windows.-.Extract.only.zip

exe: https://github.com/hydrusnetwork/hydrus/releases/download/v297/Hydrus.Network.297.-.Windows.-.Installer.exe

os x

app: https://github.com/hydrusnetwork/hydrus/releases/download/v297/Hydrus.Network.297.-.OS.X.-.App.dmg

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v297/Hydrus.Network.297.-.OS.X.-.Extract.only.tar.gz

linux

tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v297/Hydrus.Network.297.-.Linux.-.Executable.tar.gz

source

tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v297.tar.gz

I had a great week. I fixed some things and added a bunch of new ui stuff, including a basic new 'file notes' system.

dead subscriptions and bandwidth review

Several users have reported that their subscriptions were receiving DEAD status despite seeming to be healthy. Moreover, attempts to revive their dead subs were not working. I have put some time into improving the logic here all around and I hope this is mostly if not all fixed. On update, all your dead subscriptions will be revived automatically just to check if they were hit by this, so I hope everything will all be cleared up here for everyone. Please let me know if you still have problems.

Furthermore, the manage subscriptions and edit subscription panels will now note any subs or queries that are currently blocked due to bandwidth rules (this will come under the 'recent delays/errors' columns). This should make it a bit clearer to see when a sub is just pausing for a bit vs experiencing a real error.

I have also cleaned up the network->review bandwidth usage frame. It shows more data (including bandwidth used during the current search distance) and cuts out some anomalous rows.

missing tags and the wrong images

A long-time patch to get Deviant Art, tumblr, and thread watcher tags working correctly has been replaced by a more formal solution in the new downloader engine. The old patch stored the tags in volatile memory and would forget outstanding tags through a program restart, but this new one will save them as soon as they come in (in these cases, tags are parsed in the initial gallery page parsing step).

This improvement will affect all new URLs, so if you have an existing DA sub that lost a bunch of tags, you might like to run its query text in a manual DA downloader page again to fetch the tags retroactively. If you try this, you would previously have had to click a quiet 'cog' icon to force the page to fetch tags for files where the URL was already known and the file was already in the db, but I have moved this obscure option to the much more appropriate 'tag import options'.

The tag import options panel has received its own cleanup. The lists of namespaces are more cleanly aligned and delineated, and I've added select all/none buttons for quicker editing.

I also fixed an issue with Hentai Foundry sometimes pulling a picture embedded in an artist's image description area rather than the actual art. This affected 'teku' artist searches particularly. If you were hit by this and want to fix it, I think you want to find the gif that was being substituted (try system:hash=e3e8979cf9b736b479597ce03982d33e2a9be3a949f0e005ec8c236b7d7198d4), clear out its 'manage->known urls' to instruct hydrus to forget which file is supposed to go with those URLs, and then retry 'teku' in a HF download page or reset your teku sub.

EDIT: Reading this back, that HF teku fix is a bit convoluted. If you understand what is going on there, feel free to do it, but I'll see about writing a 'fetch URL even if URL known and file is deleted/already in db' option that'll make this 'get it again even though you think you know what it is' action easier to do in the next few weeks.

file notes

After several discussions with users, I have written a very basic 'file notes' system that lets you attach longer multi-line text data to any file. Please check it out under media right-click->manage->file notes.

This is a prototype, so you'll just get a very simple dialog for now, but I expect to write mass import/export for this stuff and am interested in your thoughts as well. I might print the text file in the media viewer background, but I would like to hear about some use-cases before I do anything particularly clever here.

You can bind the new 'manage_file_notes' shortcut action to the 'media' shortcut set to quick open this dialog.

tag summary colours and alpha

The new tag summary generators (under the new options->tag summaries) have a couple of extra options on their panels. You can turn them quickly off with a simple checkbox and also (for the thumbnail ones) set the background and text colour and opacity!

sash positions

This is mostly only something that advanced users will want to interact with.

There are new options to control the width and height of the main gui pages' management and preview panels (the management panel is the bit on the left of any regular media page–the bit without thumbs but with all the controls for what the page does). It is under the new pages->management and preview panels submenu. You can now turn off 'save sash positions on exit' and make manual size saves/restores as well. So, if you accidentally resize your client to be tiny and the preview windows of all your pages go tiny as well, you can now just go pages->mapp->restore and they'll all be restored to the size they were on boot.

I may do more here, so feedback would be appreciated.

full list

- finished a prototype 'file notes' system. thumbnails and media viewer canvas now support 'manage->file notes' in their right-click menus. this launches a simple text box which will save its contents to db

- added 'manage_file_notes' shortcut to the 'media' shortcut set

- tag summary generators now have a simple show/hide checkbox and (for thumbnails) custom colours for background and text including alpha channel!

- fixed a variety of timing and display logic related to subscription query DEAD vs next check time calculation

- all currently dead subscription queries will be revived on update, just in case they were formerly set dead by accident

- the 'fetch tags even if url known and file already in db' option is moved from the download/subscription panel's cog icon to tag import options

- cleaned up tag import options layout, controls, internal workflow, and help button

- added 'select all/none' buttons to tag import options panels with multiple namespaces

- if a subscription is blocked by bandwidth, the manage subscriptions dialog will display that in its 'recent error/delay' column

- the edit subscription dialog will show similar bandwidth blocking info on a per-query basis, under a new 'recent delays' column

- the review bandwidth usage panel will no longer show some unusual results by default that you can see with 'show all' hit anyway

- the review bandwidth usage panel will show the usage at the current search distance in a new column

- the review bandiwdth usage panel will show number of requests after data usage. this might be info-overload, so I might alter the syntax or roll it back entirely

- fixed an issue with hentai foundry parser pulling images placed in the image description area instead of main image. this particularly affected the artist 'teku'

- tags for deviant art and tumblr and thread watchers, which were formerly stored in volatile session memory–meaning half-completed import queues were losing their tags through a program restart–are now saved to the new import object directly

- removed all the old volatile session memory patch code

- added the new import object through a larger part of the parsing pipeline

- deleted the old remains of the giphy parser–if it comes back, it'll all be rewritten in the new system

- harmonised some other import pipeline code to the new system

- added a new 'management and preview panels' submenu to the 'pages' menu

- added an option to control 'save sash positions on close' to this menu

- added an entry to force-save the current sash positions to this menu

- added an entry to 'restore' the currently saved sash positions to all pages to this menu (this is useful if your window resizes real small and all your pages get crushed up)

- rejiggered how URL Classes are matched with URLs to make sure some Post URLs are not lost (this was affecting Hentai Foundry Post URLs, which were sometimes not displaying in the media viewer despite matching)

- fixed an issue where the duplicate filter page's jobs would not trigger an update after a job finished

- fixed an outside chance of a crash after running a duplicate filter page job

- improved how strings are coerced to unicode–now the preferred system encoding will be tried before utf-16, which should improve support for é-type characters in various non-unicode sources (like neighbouring .txt files)

- fixed an issue with the client's local booru and flash files (and some other file fetching and mime reporting is a bit faster and neater overall)

- the options should be more reliable about redrawing all thumbnail banner summaries on an option ok now

- the options->media->media zooms option will now remove any <=0.0 values when it saves

- fixed up some old test code

- improved how some thread-to-gui update reporting code works

- deleted some old network object code

- converted manage subscriptions panel to an edit panel–a decoupling refactor I will likely ultimately make across the program

- wrote a help page for content parsers

- did the first half of a help page for page parsers

- misc refactoring

- misc cleanup

next week

I did a bunch more parsing help this week and some misc downloader overhaul work while fixing other things, but I would like to get back into the meat of the overhaul work for a bit. I might write some ui to inspect the current 'session' status, so you can see, clear, and manually edit your network contexts' cookies.

Otherwise I have a ton of smaller things still to be catching up on.

____________________________
Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

d64028  No.8303

>>8302

>file notes

>I would like to hear about some use-cases before I do anything particularly clever here.

A way to embed the notes into the media viewer/onto images like how some boorus have boxes that display text when moused over. Of course, you could go even further and implement something a kin to ASS subtitle support with text styles, transformations, and vector images for optimal soft translations.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8305

File: f8b73d8851f96cd⋯.png (652.59 KB, 2278x1625, 2278:1625, chrome_2018-03-07_20-44-47.png)

File: 93bf3943bffc827⋯.png (2.09 MB, 2258x1627, 2258:1627, chrome_2018-03-07_20-45-41.png)

I think you nailed the sash positions

However, an improvement I can suggest would be put the save on exit and save current position now should be in a arrow menu over, as its a bit easy to miss click save now instead of restore, other than that, it's about as good as you can get without having it automatically set oppositions to the saved target.

Now with image notes, this is fairly easy for me to say use cases.

image 1 is me testing out my major use case, deleting images

so the middle text is after I downloaded the image and changed its note to image macro

The bottom text is after I sent to the the trash and re imported the thread

the top one is after I deleted it from the trash

and the second image and top dialogue is after force reimport of the image, and downloading the thread again, checking the image note.

My use case for this is very simple.

On the image notes page, I want to put in a note

On a download status, I want to see the note, for the image

If I delete it I want the note first then currently in trash and what follows

and when I fully get rid of it I want the note to still show.

this allows me to start removing images from my archive fully.

I also want to see notes auto apply, such as with duplicate finder where it would tag the file with 'duplicate - low quality'

this would allow me to fully start using the program rather then just dumping images into it

There will be future things I would like, such as with how images import works, there are 4 things it can currently do, one of which is 'if previously deleted' if an option could be put in place 'move to folder X and place in folder based on notes' so

you import a file

you deleted it

it move it to

c:\deleted

and with based on notes

c:\deleted\low quality image

c:\deleted\duplicate - lower quality

c:\deleted\shit image

so on so forth, this would pretty much make every use case I have for the program work.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

0ed415  No.8308

Using this version, added three new HF subscriptions. Hydrus tells me they're all dead immediately!? What is going on…

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8315

Ok, so doing a bit of cleaning on old threads I was waiting to 404, ended up with 400~ threads

Put them in page of images, and had a thought

would it be possible to have a parse log for imported links? like there is for image downloads? It would be nice to see things actually got pulled from the links and how much.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

da7ae4  No.8317

Thank you for the new sash-function, now I don't have to resize the GUI every boot.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

003c40  No.8325

>>8303

This

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8326

Im sure someone will find this funny

I wanted to download an artist gallery, but I wanted to avoid torrenting their shit or directly downloading it from exhentai, so I go to their tumblr

bungee-gumu.tumblr.com/

I put their name in hydrus and go on with my buisness

2 hours 30 minutes later I go back to the page, I check in, will it have enough of their work to justify not downloading the 443 image gallery

im on image 6025 of 39467

this person didn't post massive fucking galleries of images

Most of the posts are 1-3 images big, with more text posts then images

what the fuck breaks in someone to do this?

I mean I see it more on twitter where people will have tweet counts well over 60,000 but jesus christ man.

i'm on 5gb downloaded so far, just because I wanted to avoid a torrent.

at the very least, its not importing a fuckload of shitty images yet, though I think it is importing images I already have/very similar to ones I have…

Oh, and hdev, got an idea because of these download pages

either i'm not seeing it or it isn't there, is there a way to see how many mb of images is on a page without highlighting everything? I don't think it would be useful, but more a nice thing to know.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9d5d53  No.8327

>>8326

it seems to me that what you have is a "re-blog" collector.

one of those persons that, instead of saving the pictures he likes, he has to autistically reblog everysingle post he sees, so you're probably downloading more shit from other people that aren't even related to him than you are downloading art of his own creation

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

9d5d53  No.8328

File: 2d717ff41954586⋯.png (233.36 KB, 752x758, 376:379, 『Bright Side Dark Side』.png)

hydev, i have a question.

when you petition a tag for removal in a picture, does that apply to the rest of the network clients? or is there an approval process? im concerned about the fact that anyone could just spam tag removal and/or purposeful mistagging to ruin the network for everyone else

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8335

>>8327

thankfully the person has some level of taste, 23gb though… and I have no idea if their art all downloaded so I have to get the torrent anyway.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8338

ran into something, not sure what the hangup is

So I have a 4k tv as my monitor

I and looking at webm's and gifs.

its a little hard to tell with gifs, as they can be timed weird, but it seems that when they are made to fill the screen, they significantly slow down, webm's its a bit more straightforward that they are slowing down when made to fill the screen

i'm not sure what can be done

this could also be my hydrus that currently has a stupid amount of pages/images open but im also use to the program hanging when this is the case, not slowing down like this.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a62918  No.8340

File: d5bf29c2519e332⋯.jpg (27.48 KB, 500x333, 500:333, d5bf29c2519e3324c5fea5df6e….jpg)

>>8325

>>8303

You know I had actually considered this to be a pain in the neck and kept putting the idea of supporting it off, but I just looked and danbooru actually offer an API call for this:

https://danbooru.donmai.us/posts/3049394

https://danbooru.donmai.us/notes.json?group_by=note&search[post_id]=3049394

This is very parsable. It wouldn't be a gigantic stretch to support this as a new importable/exportable data type for hydrus.

I don't think I can fold this into this first file notes iteration, but I will keep it in mind.

>>8305

Thanks, I will separate those menu items to reduce misclicks.

I will see about displaying file notes in the import status area as well. I quite like this idea.

Setting notes automatically based on other decisions is also neat.

I can't do this cleverer stuff so quick, but I have written it down.

>>8308

I had another report like this last week, for HF as well. I think HF is logging out early or something, so sometimes hydrus thinks it is logged in but isn't, so when it tries to load the gallery page, it is getting the 'adults only, click here to enter' page and hence not parsing any files. If you tell your dead subs to 'check now', they'll probably just work.

Atm I use a 45 minute timeout for the hydrus HF 'login' (which does the click-through and then sets the filter to 'allow all'), but I guess that is still too large.

My login engine will get better about reporting and recovering from these problems as I work on it, and eventually you'll just be able to login with a real user/pass which'll have a much longer timeout obviously. I hope the 'let's look at your current cookies' ui that I want to add this week (but I might not have time this week, we'll see) will give us another tool to figure these problems out.

>>8315

Yeah, before this downloader overhaul is done, I would like to have another icon button on download import contexts like the file import status button that'll list gallery pages hit and what it found. Something like:

https://gelbooru.com/index.php?page=post&s=list&tags=samus_aran&pid=0 | 15s ago | 42 files found

https://gelbooru.com/index.php?page=post&s=list&tags=samus_aran&pid=42 | 10s ago | 42 files found

https://gelbooru.com/index.php?page=post&s=list&tags=samus_aran&pid=84 | 5s ago | 20 files found, 22 already in cache

That sort of thing. Once we have a proper log being saved, we'll be able to diagnose problems easier and I can start hanging actions like 'try this page again' on it.

>>8326

>>8327

>>8335

I find the more I discover about this stuff, the more I wonder about the devs on the other end. Just thinking about the tumblr/twitter/whoever devs looking at their statistics and seeing these users dumping gigs and gigs into the void. The unbelievable amount of CPU and storage they have had to spend of these users, and then having to serve it all when someone like us crawls it all.

I would be interested in seeing a distribution of user storage, to see how many users are at this level, whether it is a fanatical 0.2%–and are they talking to each other or is there one person like that in every group of 100 people? Or if 40,000 posts on tumblr is so small in the grand scheme that the devs never think about it–that the real problem they deal with is pirates hosting chopped up rars or whatever.

I remember some old article saying that like 40% of twitter accounts had never tweeted. That may be a bad number, but the more I learn about CDNs in general, the more ignorant I realise I am.

>>8326 Thanks–I'll add the total size to the 'none selected' summary of a regular page.

>>8328

The petition goes up to the repository with your given reason where the repository's janitor can check it out to approve/deny. I'm the janitor for the PTR and deal with a few dozen petitions every day. I've got the workflow working admin-side to separate large/significant changes, so if someone tried to delete all the touhou tags or something, I'd notice and deny it. I've made a couple of mistakes with siblings before, either clicking something stupid ('shadow->character:shadow the hedgehog') or not realising that people will have subjective objections (stuff like pussy vs vagina), so I am generally a bit more hesitant about these.

If the petition is approved, the change is made and sent to all users on the next sync (which normally happens every 100,000 seconds). If it is denied, the change is discarded and only the original uploader will see the change (which happens as soon as you upload, btw, for tags or siblings or parents).

To my great surprise, so far, the incidences of 'things going wrong' with the PTR have been almost entirely misatkes and confusions and mangled parsing. But everything is timestamped in hydrus repos, so if we ever do get a massive problem–for whatever reason–there is always the option that I shut the PTR down for a week and write some new code that'll let admins revert back a couple of days or whatever. I can recover anything deleted, even as a clientside patch–it would just take work.

>>8338

The video pipeline still uses some software scaling code, so it doesn't zoom fast, particularly when the zoom isn't a nice multiple of 100%. I would like to update the whole pipeline to use the same hardware-accelerated (i.e. using your GPU) code that the static rendering system uses, which will also allow some faster or slower zoom quality options for videos.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8342

>>8340

on the tumblr bit you have a few ways you could handle it.

1) you have everything link. this way if you have a long text post, instead of just embedding it completely it links to the post, granted this could be turned on or off depending on post length.

2) with every image, you hash and store it. when someone uploads an image, you cross reference the hash. shit like this doesn't make sense when your site is small or like 4chan where the content will only stay around for so long, but when shit can get used a lot, it starts making sense so you don't have several thousand 3mb gifs

I think the interesting portion who uploads new content more so people who reblog/upload a lot.

~~~~

As for the notes part, I have one major bottleneck with the program and that is not knowing why shit got deleted, because I would check every fucking link that says 'deleted' I have not done that, and because dup detector will delete without explanation it's a curiosity that I like playing with, but cant use.

when my archive was undamaged, I had 180,000 duplicates, or at least things that dup detector thought were duplicates, because of this I held off also going though and fully rating/tagging everything, because that would be 180k images of wasted effort.

I honestly view a system where you can comprehensively notate everything to be vital for using the programfully

as it stands right now I use it to download threads, and generally store images because lets be honest, its better than my download folder and if the program ever does go tits up, its not like the images would be any less disorganized than they otherwise would have been.

you already have notes attach to files hashes, and they persist after deletion, the bulk of the hard part is over. you already have dup detector in the program, and if it works correctly (with my limited testing im not sure if it does) it can copy what one image has for its tags and ratings, applying it to the other, also adding a note to it to say why dup did what it did

lets say it was a lower quality image

You keep the high quality one, tags and ratings added to it, and the low quality one get tags and ratings applied to it along with being garbaged and a note added 'low quality dup'

also with dup I think you need to have a button to remove files even if they aren't low/high quality pairs

an example would be an image set where they have a good base image, but then to pander to every fetish they add shit like gas, scat, pee, a dick, skin color changes, ect ect

now images like gas and scat I would likely just delete them without a thought as to being specific in their note

pee I may keep depending on how well its done

but dick or skin color changes, this area I may want to keep an anturnatie version only, so a button that acts like the lower/higher version, but tags the outgoing image as 'prefers alternate version' would be helpful

also on the note of deleting/trashing files, would it be possible to have two buttons for it going forward once applying note to the download notes? One would act the same way as delete currently does, the other would bring up a menu like new page does with user assignable notes.

I cant think of many reasons to remove images that would need 9 reasons, but it would be nice to have them and a 'custom' note for its removal.

with all that said, cant wait for future implementations of this, as this is probably going to be the solution to the biggest thing holding me back from fully using the program.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

affa1f  No.8349

File: 32a3f4e02da733f⋯.gif (589.77 KB, 1920x1080, 16:9, 2018-03-13_23-51-09.gif)

There seems to be a problem with the downloading of very old 8chan threads, most if not al of these images do actually exists but don't get downloaded.

thread in question : https://8ch.net/stockings/res/274.html

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8350

>>8349

try downloading it as a page of images, just tried and im picking up every images you are having issues with.

worse case get an extension called link klipper and harvest all the links yourself and go raw url import

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

2b5a8d  No.8353

got a question on the pixiv downloader, does this pick up every image?

I ask because I have no fucking idea how that retarded website works, japanese internet always seems so unintuitive and backwards in how it functions, but I have been noticing that its not downloading things Im pretty sure are there.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

7018ef  No.8354

>>8353

I think that the pixiv downloader in Hydrus only gets single images, not albums. This might get fixed with the downloader overhaul.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

92da6c  No.8359

>alpha file notes implemented

I deeply respect you, chief.

Thanks for the feature, will try it as soon as I can.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

affa1f  No.8360

>>8350

This works, kinda a pain with tagging and sorting the images but at least it works. Thanks

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.

a62918  No.8412

File: 7f8182bee17e313⋯.jpg (524.36 KB, 2257x1645, 2257:1645, 7f8182bee17e31361c9647ebb7….jpg)

>>8350

>>8349

>>8360

Yeah, this an issue with the 8chan API not providing direct links to files, so files that use the old storage system aren't pointed to correctly. Page of images works ok for now (doesn't do non-images right, though), but I will have other, proper fixes for this stuff out as I roll out more of the downloader overhaul.

>>8353

Tell me about it–every time I get into it, I find nip software and file format decisions are reliably bonkers.

Afaik, my pixiv parser does still images ok. Manga (multi-image) pages don't work, ugoira doesn't work, but I expect to have a fix for both in the new downloader engine.

Pixiv also have some mickey-mouse new layout that they are intermittently rolling out that uses dynamic element loading (i.e. the page is just a blank canvas, and then some javascript makes an API call for thumb/whatever info and draws the page with your CPU cycles), which is what broke the tag search. Also, they had some 'whiteapple' or something new layout that I think was eventually abandoned, but it was a site-wide thing that would sometimes kick in for users randomly as a beta. They do some page-referral shit as well that blocks image loading if you don't say you are coming from the post URL.

Once I have better parsing solutions in place, I would like to look up if they have an API, or if I can just cheat their unofficial internal API calls myself and skip all this shit.

Disclaimer: this post and the subject matter and contents thereof - text, media, or otherwise - do not necessarily reflect the views of the 8kun administration.


[Return][Go to top][Catalog][Nerve Center][Post a Reply]
Delete Post [ ]
[]
[ / / / / / / / / / / / / / ] [ dir / animu / animus / htg / kind / lit / pdfs / sapphic / sl ]