as seen in , the buildbots don't complain about build failures in extensions. it would be nice to have a mode, where the build fails when an extension doesn't build, but is expected to build. exceptions to this set of expected builds should be configurable.
One reasonably easy possibility would be to add an option to regrtest to exit with a non-zero return code if there are unexpected skips. This might not cover 100% of Mathias's cases (but it might), and the configurability would be limited to changing the expected skip lists in regrtest. But it would be pretty easy to do, if all of the buildbots can be required to build all of the expected extensions. I'm not sure that this last requirement is currently met by all the buidbots.
This would be nice. Too often when hacking on an extension, test pass just because I don't notice there was a compile error and so I'm testing an older version.