Problem with Junit tests with same name

[smithgcovert]

Hi,

In our build process, we push out all of our Junit tests to 3 different platforms (Windows, Linux, and Mac), run all of our tests, then pull them back to a central directory.

Then we enabled the Junit results to be displayed in Hudson.

The problem is that Hudson doesn't handle multiple identical junit tests correctly.  For example, if the test failed only on windows, it will show that the same test was run 3 times, and that only one test failed, but the URL to show the results of the test is the same for all three.

To give a concrete example:  we have a test testCreateInModulegroup.  It is currently failing only on Windows.  If I go down into all of the tests run, I can see it listed in the tables three times.  But, the URL to see the results for all 3 is:
http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup

If I go to that link, it is showing the wrong test (it always shows the first one in the list)

I believe this is a bug -- but is there someway to work around it for now?

Thanks,
Greg

[Aleksandar Kostadinov]

Hi,

We use jboss-test.jar to overwrite test names (actually simply using a
custom junit result formatter). But after 1.202 hudson broke
compatibility with that.

https://hudson.dev.java.net/issues/show_bug.cgi?id=183

gregsmit wrote, On 12/23/-28158 09:59 PM (EEST):

>
> Hi,
>
> In our build process, we push out all of our Junit tests to 3 different
> platforms (Windows, Linux, and Mac), run all of our tests, then pull them
> back to a central directory.
>
> Then we enabled the Junit results to be displayed in Hudson.
>
> The problem is that Hudson doesn't handle multiple identical junit tests
> correctly.  For example, if the test failed only on windows, it will show
> that the same test was run 3 times, and that only one test failed, but the
> URL to show the results of the test is the same for all three.
>
> To give a concrete example:  we have a test testCreateInModulegroup.  It is
> currently failing only on Windows.  If I go down into all of the tests run,
> I can see it listed in the tables three times.  But, the URL to see the
> results for all 3 is:
> http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup
>
> If I go to that link, it is showing the wrong test (it always shows the
> first one in the list)
>
> I believe this is a bug -- but is there someway to work around it for now?
>
> Thanks,
> Greg
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

[Kohsuke Kawaguchi]

I think an issue in the bug tracker with a test case would be greatly
appreciated.

gregsmit wrote:

>
> Hi,
>
> In our build process, we push out all of our Junit tests to 3 different
> platforms (Windows, Linux, and Mac), run all of our tests, then pull them
> back to a central directory.
>
> Then we enabled the Junit results to be displayed in Hudson.
>
> The problem is that Hudson doesn't handle multiple identical junit tests
> correctly.  For example, if the test failed only on windows, it will show
> that the same test was run 3 times, and that only one test failed, but the
> URL to show the results of the test is the same for all three.
>
> To give a concrete example:  we have a test testCreateInModulegroup.  It is
> currently failing only on Windows.  If I go down into all of the tests run,
> I can see it listed in the tables three times.  But, the URL to see the
> results for all 3 is:
> http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup
>
> If I go to that link, it is showing the wrong test (it always shows the
> first one in the list)
>
> I believe this is a bug -- but is there someway to work around it for now?
>
> Thanks,
> Greg
>

--
Kohsuke Kawaguchi
Sun Microsystems                   http://weblogs.java.net/blog/kohsuke/

[smithgcovert]

Hi,

I have entered this in the bug tracker, and it was assigned #2184.

https://hudson.dev.java.net/issues/show_bug.cgi?id=2184

Thanks,
Greg

kohsuke wrote

I think an issue in the bug tracker with a test case would be greatly
appreciated.