Hi, In our build process, we push out all of our Junit tests to 3 different platforms (Windows, Linux, and Mac), run all of our tests, then pull them back to a central directory. Then we enabled the Junit results to be displayed in Hudson. The problem is that Hudson doesn't handle multiple identical junit tests correctly. For example, if the test failed only on windows, it will show that the same test was run 3 times, and that only one test failed, but the URL to show the results of the test is the same for all three. To give a concrete example: we have a test testCreateInModulegroup. It is currently failing only on Windows. If I go down into all of the tests run, I can see it listed in the tables three times. But, the URL to see the results for all 3 is: http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup If I go to that link, it is showing the wrong test (it always shows the first one in the list) I believe this is a bug -- but is there someway to work around it for now? Thanks, Greg |
Hi,
We use jboss-test.jar to overwrite test names (actually simply using a custom junit result formatter). But after 1.202 hudson broke compatibility with that. https://hudson.dev.java.net/issues/show_bug.cgi?id=183 gregsmit wrote, On 12/23/-28158 09:59 PM (EEST): > > Hi, > > In our build process, we push out all of our Junit tests to 3 different > platforms (Windows, Linux, and Mac), run all of our tests, then pull them > back to a central directory. > > Then we enabled the Junit results to be displayed in Hudson. > > The problem is that Hudson doesn't handle multiple identical junit tests > correctly. For example, if the test failed only on windows, it will show > that the same test was run 3 times, and that only one test failed, but the > URL to show the results of the test is the same for all three. > > To give a concrete example: we have a test testCreateInModulegroup. It is > currently failing only on Windows. If I go down into all of the tests run, > I can see it listed in the tables three times. But, the URL to see the > results for all 3 is: > http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup > > If I go to that link, it is showing the wrong test (it always shows the > first one in the list) > > I believe this is a bug -- but is there someway to work around it for now? > > Thanks, > Greg > --------------------------------------------------------------------- To unsubscribe, e-mail: [hidden email] For additional commands, e-mail: [hidden email] |
Administrator
|
In reply to this post by smithgcovert
I think an issue in the bug tracker with a test case would be greatly appreciated. gregsmit wrote: > > Hi, > > In our build process, we push out all of our Junit tests to 3 different > platforms (Windows, Linux, and Mac), run all of our tests, then pull them > back to a central directory. > > Then we enabled the Junit results to be displayed in Hudson. > > The problem is that Hudson doesn't handle multiple identical junit tests > correctly. For example, if the test failed only on windows, it will show > that the same test was run 3 times, and that only one test failed, but the > URL to show the results of the test is the same for all three. > > To give a concrete example: we have a test testCreateInModulegroup. It is > currently failing only on Windows. If I go down into all of the tests run, > I can see it listed in the tables three times. But, the URL to see the > results for all 3 is: > http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup > > If I go to that link, it is showing the wrong test (it always shows the > first one in the list) > > I believe this is a bug -- but is there someway to work around it for now? > > Thanks, > Greg > -- Kohsuke Kawaguchi Sun Microsystems http://weblogs.java.net/blog/kohsuke/ |
Hi, I have entered this in the bug tracker, and it was assigned #2184. https://hudson.dev.java.net/issues/show_bug.cgi?id=2184 Thanks, Greg
|
Free forum by Nabble | Edit this page |