Re: Tests and randomness

On Thu, Dec 19, 2019 at 10:27:21AM +0100, Daniel Stenberg via curl-library wrote:
> The monthly seed thing is just the best way I've come up with that makes the
> random order semi-stable during development and testing of something but
> still changes it every now and then. I'm interested to learn if someone can
> come up with a better idea that perhaps can make it change slightly more
> frequently than each month...

Is there any way to keep state between runs? If so, and assuming test
failures tend to be fixed reasonably quicly, maybe only change the seed
if there are no failures? You'd probably still not want to change it at
every run even when no tests fail (test success can be as intermittent
as test failure), so maybe change it weekly or monthly whenever there
are no failures?

Frank

-- 
"Debugging is twice as hard as writing the code in the first place.
Therefore, if you write the code as cleverly as possible, you are,
by definition, not smart enough to debug it." - Brian W. Kernighan
-------------------------------------------------------------------
Unsubscribe: https://cool.haxx.se/list/listinfo/curl-library
Etiquette:   https://curl.haxx.se/mail/etiquette.html