Is it time to start regression testing yet?

[Jordan K. Hubbard]

On Jun 6, 2009, at 2:09 PM, Jeremy Huddleston wrote:

> This part feels a bit tricky to me.  There are many ports which  
> expect, "if I have variant X, then all my dependencies were built  
> with variant X as well."  Should we actually put in test code to  
> sanity check these configurations?  I argue that effort would be  
> better spent developing variant-based dependencies (yes, this is my  
> Gentoo background speaking here...)
>
> Furthermore, this 'n' tends to grow quite quickly when you consider  
> that a port should be tested not only with all permutations of its  
> variants but all permutations of its dependencies variants as well!   
> This testing is something that I believe is completely infeasible at  
> this moment.

Agreed.  You've talked me out of even wanting to grapple with the  
problem of variants for now.  OK, so, how about we just focus on  
getting some reasonable percentage of the default builds checked?

- Jordan