Problem with Junit tests with same name

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Problem with Junit tests with same name

smithgcovert

Hi,

In our build process, we push out all of our Junit tests to 3 different platforms (Windows, Linux, and Mac), run all of our tests, then pull them back to a central directory.

Then we enabled the Junit results to be displayed in Hudson.

The problem is that Hudson doesn't handle multiple identical junit tests correctly.  For example, if the test failed only on windows, it will show that the same test was run 3 times, and that only one test failed, but the URL to show the results of the test is the same for all three.

To give a concrete example:  we have a test testCreateInModulegroup.  It is currently failing only on Windows.  If I go down into all of the tests run, I can see it listed in the tables three times.  But, the URL to see the results for all 3 is:
http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup

If I go to that link, it is showing the wrong test (it always shows the first one in the list)

I believe this is a bug -- but is there someway to work around it for now?

Thanks,
Greg
Reply | Threaded
Open this post in threaded view
|

Re: Problem with Junit tests with same name

Aleksandar Kostadinov
Hi,

We use jboss-test.jar to overwrite test names (actually simply using a
custom junit result formatter). But after 1.202 hudson broke
compatibility with that.

https://hudson.dev.java.net/issues/show_bug.cgi?id=183

gregsmit wrote, On 12/23/-28158 09:59 PM (EEST):

>
> Hi,
>
> In our build process, we push out all of our Junit tests to 3 different
> platforms (Windows, Linux, and Mac), run all of our tests, then pull them
> back to a central directory.
>
> Then we enabled the Junit results to be displayed in Hudson.
>
> The problem is that Hudson doesn't handle multiple identical junit tests
> correctly.  For example, if the test failed only on windows, it will show
> that the same test was run 3 times, and that only one test failed, but the
> URL to show the results of the test is the same for all three.
>
> To give a concrete example:  we have a test testCreateInModulegroup.  It is
> currently failing only on Windows.  If I go down into all of the tests run,
> I can see it listed in the tables three times.  But, the URL to see the
> results for all 3 is:
> http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup
>
> If I go to that link, it is showing the wrong test (it always shows the
> first one in the list)
>
> I believe this is a bug -- but is there someway to work around it for now?
>
> Thanks,
> Greg
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Problem with Junit tests with same name

Kohsuke Kawaguchi
Administrator
In reply to this post by smithgcovert

I think an issue in the bug tracker with a test case would be greatly
appreciated.

gregsmit wrote:

>
> Hi,
>
> In our build process, we push out all of our Junit tests to 3 different
> platforms (Windows, Linux, and Mac), run all of our tests, then pull them
> back to a central directory.
>
> Then we enabled the Junit results to be displayed in Hudson.
>
> The problem is that Hudson doesn't handle multiple identical junit tests
> correctly.  For example, if the test failed only on windows, it will show
> that the same test was run 3 times, and that only one test failed, but the
> URL to show the results of the test is the same for all three.
>
> To give a concrete example:  we have a test testCreateInModulegroup.  It is
> currently failing only on Windows.  If I go down into all of the tests run,
> I can see it listed in the tables three times.  But, the URL to see the
> results for all 3 is:
> http://aeneis.raleigh.ibm.com/builds/job/Zero-Build/102/testReport/zero.ide.bvt/ApplicationTest/testCreateInModulegroup
>
> If I go to that link, it is showing the wrong test (it always shows the
> first one in the list)
>
> I believe this is a bug -- but is there someway to work around it for now?
>
> Thanks,
> Greg
>

--
Kohsuke Kawaguchi
Sun Microsystems                   http://weblogs.java.net/blog/kohsuke/

smime.p7s (4K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Problem with Junit tests with same name

smithgcovert

Hi,

I have entered this in the bug tracker, and it was assigned #2184.

https://hudson.dev.java.net/issues/show_bug.cgi?id=2184

Thanks,
Greg



kohsuke wrote
I think an issue in the bug tracker with a test case would be greatly
appreciated.