ci: integration matrix, release behind it, check of the maintained Checkmk versions #2

Merged
dawid merged 3 commits from ci-matrix into main 2026-11-19 13:10:56 +00:00
Owner

Follows #1, which was merged before these two commits reached it.

  • Matrix: the integration tests run as one job per Checkmk version (2.4, 2.5) plus one for the update from 2.4 to 2.5. Each job builds an image with only its versions (BI_PIE_VERSIONS).
  • Release behind the tests: a v* tag runs the whole pipeline. Its release job publishes the MKP and SHA256SUMS only once every job has passed. release.yml is gone; a failed release is retried with "re-run failed jobs". The Checkmk Exchange upload stays manual.
  • Maintained versions: the unit job compares Checkmk's current versions in stable_downloads.json with the matrix and the manifest's version range. So the weekly run fails when Checkmk releases a version the package isn't tested with.
  • README: links Checkmk's documentation of the custom URL element (2.4) and the Embed URL widget (2.5).
Follows #1, which was merged before these two commits reached it. - **Matrix:** the integration tests run as one job per Checkmk version (2.4, 2.5) plus one for the update from 2.4 to 2.5. Each job builds an image with only its versions (`BI_PIE_VERSIONS`). - **Release behind the tests:** a `v*` tag runs the whole pipeline. Its `release` job publishes the MKP and SHA256SUMS only once every job has passed. `release.yml` is gone; a failed release is retried with "re-run failed jobs". The Checkmk Exchange upload stays manual. - **Maintained versions:** the unit job compares Checkmk's current versions in `stable_downloads.json` with the matrix and the manifest's version range. So the weekly run fails when Checkmk releases a version the package isn't tested with. - Today that's 2.4 and 2.5, which matches [Checkmk's lifecycle table](https://docs.checkmk.com/latest/en/cmk_versions.html): 2.3 left maintenance on 2026-10-29. - **README:** links Checkmk's documentation of the custom URL element (2.4) and the Embed URL widget (2.5).
One integration job per Checkmk version and one for the update from 2.4 to
2.5; each builds an image with only its versions (BI_PIE_VERSIONS). A tag runs
the same pipeline, and its release job publishes the MKP only once every job
passed; release.yml is gone. The README links Checkmk's documentation of the
custom URL element (2.4) and the Embed URL widget (2.5).
ci: fail when Checkmk maintains a version the package is not tested with
All checks were successful
CI / unit (pull_request) Successful in 4m12s
CI / integration (Checkmk 2.4) (pull_request) Successful in 5m4s
CI / integration (Checkmk 2.5) (pull_request) Successful in 5m7s
CI / integration (update 2.4 to 2.5) (pull_request) Successful in 7m47s
CI / release (pull_request) Has been skipped
7eb556cec7
The unit job compares Checkmk's current versions (stable_downloads.json) with
the integration matrix and the manifest's version range; the weekly run then
fails when a new version comes out. Today that is 2.4 and 2.5, as Checkmk's
lifecycle table says (2.3 left maintenance on 2026-10-29).

Tests of CI / unit: passed

34 passed, 0 failed, 0 skipped (34 tests, 16.2 s)

Of 9f0c30f898, the run, updated by every run.

<!-- ci-report tests: CI-unit --> ### Tests of CI / unit: passed **34 passed, 0 failed, 0 skipped** (34 tests, 16.2 s) <sub>Of 9f0c30f898, [the run](https://git.ciepiela.org/dawid/checkmk-bi-charts/actions/runs/6), updated by every run.</sub>
ci: three tries for the browser's libraries, as Ubuntu's mirrors fail at times
All checks were successful
CI / integration (Checkmk 2.5) (pull_request) Has been skipped
CI / integration (update 2.4 to 2.5) (pull_request) Has been skipped
CI / unit (pull_request) Successful in 6m50s
CI / integration (Checkmk 2.4) (pull_request) Successful in 5m2s
CI / release (pull_request) Has been skipped
9f0c30f898
Every integration job of #2's first run failed in playwright install
--with-deps: apt could not reach archive.ubuntu.com.
dawid merged commit 0dbd91e52f into main 2026-11-19 13:10:56 +00:00
dawid deleted branch ci-matrix 2026-11-19 13:10:56 +00:00

Tests of CI / integration (Checkmk 2.4): passed

12 passed, 0 failed, 0 skipped (12 tests, 252.8 s)

Of 9f0c30f898, the run, updated by every run.

<!-- ci-report tests: CI-integration-Checkmk-2.4- --> ### Tests of CI / integration (Checkmk 2.4): passed **12 passed, 0 failed, 0 skipped** (12 tests, 252.8 s) <sub>Of 9f0c30f898, [the run](https://git.ciepiela.org/dawid/checkmk-bi-charts/actions/runs/6), updated by every run.</sub>

Tests of CI / integration (Checkmk 2.5): passed

12 passed, 0 failed, 0 skipped (12 tests, 255.4 s)

Of 7eb556cec7, the run, updated by every run.

<!-- ci-report tests: CI-integration-Checkmk-2.5- --> ### Tests of CI / integration (Checkmk 2.5): passed **12 passed, 0 failed, 0 skipped** (12 tests, 255.4 s) <sub>Of 7eb556cec7, [the run](https://git.ciepiela.org/dawid/checkmk-bi-charts/actions/runs/4), updated by every run.</sub>

Tests of CI / integration (update 2.4 to 2.5): passed

6 passed, 0 failed, 0 skipped (6 tests, 409.8 s)

Of 7eb556cec7, the run, updated by every run.

<!-- ci-report tests: CI-integration-update-2.4-to-2.5- --> ### Tests of CI / integration (update 2.4 to 2.5): passed **6 passed, 0 failed, 0 skipped** (6 tests, 409.8 s) <sub>Of 7eb556cec7, [the run](https://git.ciepiela.org/dawid/checkmk-bi-charts/actions/runs/4), updated by every run.</sub>
Sign in to join this conversation.
No description provided.