Issue Details

Number

27284

Title

Continuous benchmark tracking

Description

It would be beneficial to have continuous tracking of our benchmark tests, because regressions (or unexpected improvements) otherwise go undetected (at least for a while). Afaict currently, the only benefit of our benchmarking tests is to evaluate changes as they are being proposed but imo that only gives us ~50% of the benefit that benchmarks can provide. I am imagining this to be a separate service (maybe integrated with @DrahtBot) that regularly runs the benchmarks in an environment configured for benchmarking. Regressions could be reported by the service through opening issues or sending emails. Additionally, a website that presents the benchmark data with some pretty graphs would be nice ([example from firefox's infra](https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&series=mozilla-central,3405208,1,13&timerange=31536000)). Setting this up in a way that it is easy to replicate would be very beneficial.

URL

https://github.com/bitcoin/bitcoin/issue/27284

Closed by

Notes seems like https://codespeed.bitcoinperf.com/ is back up and running, but on a bad SSL cert? Do we want something more robust/maintained?

Attention of

Kill Factor (1-10)

Save

Back to List