33 releases 33 tags

RSS feed

• v0.13.1 4f25da8900

  Compare

  v0.13.1 Stable

  dawid released this 2026-11-03 20:34:36 +00:00 | 123 commits to main since this release

  Signed by dawid

  GPG key ID: 4131A40E8F612CB0

  Added

  • Watching a page: a website recipe's "watch": {} (or {"selector": "…"}) saves no file but
    compares the start page's text (or the selector's) with the last run's, whitespace aside; a
    change is a line in the log and a notification with an excerpt of the lines gone and come (at
    most 300 characters), and the run's outcome says whether the page changed.
  • ZIP files unpacked: Unpack ZIP files (every job, off by default) puts a downloaded .zip
    file's files into a folder of its name beside it, tagged; Keep the ZIP files (on by default)
    keeps the archive too. A suspect archive is saved as it is, the log saying why: a path out of
    its folder or an absolute one, a symbolic link, an encrypted file, two files of one name, more
    than 1000 files, more than the job's largest file in all, more than 100 times its packed size
    (counted as it unpacks). No nested unpacking; .epub, .docx and other ZIPs of another name
    stay files.
  • Duplicates by content: a job keeps the SHA-256 of each file it saves; a file whose content one
    of its files from another address has is not saved again, and the log and the run's outcome
    say so (A duplicate of …, 1 duplicate (not saved again)).
  • Versions: Check known files for changes (website and feed jobs; on for new jobs, off for
    those saved before) asks the addresses of the files a job saved again, each at most once in 20
    hours: over HTTP with If-None-Match and If-Modified-Since (304: no download), else by the
    downloaded file's hash. A changed file is saved over its own, so that Nextcloud keeps the one
    before among its versions; a deleted file is not brought back, a failed check fails nothing.

  Fixed

  • Gallery jobs: urllib3 is held at 2.7.0, since 2.8.0 no longer has the function gallery-dl
    calls (every gallery job failed with AttributeError: module 'urllib3.connection' has no attribute 'create_urllib3_context').

  Downloads

  • harvester-0.13.1.tar.gz
    0 downloads · 2026-11-03 20:47:28 +00:00 · 1.1 MiB
  • signature.txt
    0 downloads · 2026-11-03 20:47:29 +00:00 · 684 B

  ---

  • Source code (ZIP)
    0 downloads
  • Source code (TAR.GZ)
    0 downloads