Hitomi: urls with japanese characters skipped

[Poikalehto]

There might have been current changes on hitomi.la that makes doujindownloader miss and skip the urls with japanese characters.

[Poikalehto]

Care to fix this?

[Squidy]

Indeed I do! I'm sorry for leaving you waiting.

That said, I'm so far unable to reproduce the issue; galleries with Japanese characters in the URL are working fine from my end. Could you share some example galleries for which the issue occurs?

[Poikalehto]

For example when pasting the Hitomi tag search page link, it should parse the link as a search result and return 25 results. For me it returned less results and skipped some results.

For the example links below I pasted links https://hitomi.la/tag/female:bikini-all-1.html and https://hitomi.la/tag/female:bikini-all-2.html directly to the downloader.

The following links are NSFW and were skipped.

https://hitomi.la/doujinshi/kasen-chan- ... 44191.html
https://hitomi.la/doujinshi/iza-mankai! ... 43805.html
https://hitomi.la/doujinshi/iza-mankai! ... 43597.html
https://hitomi.la/doujinshi/%E3%81%86%E ... 43303.html
https://hitomi.la/gamecg/%E5%AF%BE%E9%A ... 43106.html
https://hitomi.la/gamecg/%E5%AF%BE%E9%A ... 43061.html
https://hitomi.la/doujinshi/joshi-%E3%8 ... 41714.html

Sorry for the link monsters... hope those are enough to troubleshoot why they aren't caught in the search results. They do seem to be working fine when pasting them individually.

Their original format in korean or japanese format are visible in the url area of the browser.

[Poikalehto]

Can confirm this is still happening. Paste any tag search result to the downloader and it will skip some of the results.

[Poikalehto]

Seems to be 90% fixed with the latest releases, still skipping very very few search results.