Author jeff.allen
Recipients adamburke, fwierzbicki, jeff.allen, stefan.richthofer, zyasoft
Date 2015-10-30.08:56:32
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <>
We'd like to have clean-running regression tests but have never (?) managed it.

We like using CPython tests by default, with necessary exclusions and variations. With those aims, we have added to a 'java' platform, extending the catalogue (_expectations) of tests it expects to raise unittest.SkipTest, and adding a catalogue (_failures) of tests it expects to fail.

But, the catalogues tagged simply 'java' in do not capture the variation in test success amongst OS platforms. In this scheme, if we want clean-running regression tests for everyone, we have to add to _failures, every test that fails on any OS platform. A recent shot in issue #2393 at getting clean regression tests on Windows ended by making these lists only correct for Windows (maybe just Cygwin). Some code in tries to accommodate OS variation, but it is hard to read and may be CPython-specific. This cannot be maintained reliably from any one OS.

I propose we add optional sections with keys like 'java.nt', where after the dot is taken from os._name, to catalogue those things applicable to that OS (taken from os._name). The key 'java' contains those things applicable to all Jython OSs. It is perhaps only necessary to do this to _failures. The OS-specific sections ought to be short, or something is wrong.

Good idea?
Date User Action Args
2015-10-30 08:56:34jeff.allensetrecipients: + jeff.allen, fwierzbicki, zyasoft, stefan.richthofer, adamburke
2015-10-30 08:56:33jeff.allensetmessageid: <>
2015-10-30 08:56:33jeff.allenlinkissue2419 messages
2015-10-30 08:56:32jeff.allencreate