Quantcast

Is it possible to show @Ignore JUnit tests?

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Is it possible to show @Ignore JUnit tests?

Charles Chan-2
I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

Thanks,
Charles



      __________________________________________________________________
Looking for the perfect gift? Give the gift of Flickr!

http://www.flickr.com/gift/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

Kohsuke Kawaguchi
Administrator
Does JUnit report ignored tests in the XML file? If you have a sample
JUnit report file, please send it to us.

2010/2/22 Charles Chan <[hidden email]>:
> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Is it possible to show @Ignore JUnit tests?

Nord, James
It works in the m2 job type so Hudson does support this.

You need to drill down a fair way in m2 job to find the actual skipped test but the bar colour is red=failed blue=passed yellow=skipped.

However our freestyle Ant builds doesn't populate the xml report with the skipped data - and so Hudson never displays this info (how could it...)

/James

-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Kohsuke Kawaguchi
Sent: 23 February 2010 16:15
To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

Does JUnit report ignored tests in the XML file? If you have a sample
JUnit report file, please send it to us.

2010/2/22 Charles Chan <[hidden email]>:
> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]



**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************

This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

stormcloud-3
Ok I'm curious - how to you get the freestyle ANT project to report @Ignore annotations? I didn't know that was possible

On 23 February 2010 16:40, Nord, James <[hidden email]> wrote:
It works in the m2 job type so Hudson does support this.

You need to drill down a fair way in m2 job to find the actual skipped test but the bar colour is red=failed blue=passed yellow=skipped.

However our freestyle Ant builds doesn't populate the xml report with the skipped data - and so Hudson never displays this info (how could it...)

/James

-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Kohsuke Kawaguchi
Sent: 23 February 2010 16:15
To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

Does JUnit report ignored tests in the XML file? If you have a sample
JUnit report file, please send it to us.

2010/2/22 Charles Chan <[hidden email]>:
> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]



**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************

This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

RE: Is it possible to show @Ignore JUnit tests?

Nord, James

I didn’t say it was possible – I said Hudson looks like it should support it (the JUnit parsing is shared across m2 and freestyle jobs).

 

If you’re using ant you may want to look at https://issues.apache.org/bugzilla/show_bug.cgi?id=43969

 

Also http://jira.codehaus.org/browse/SUREFIRE-303 for how this was worked around in Maven.

 

/James

 

From: stormcloud [mailto:[hidden email]]
Sent: 23 February 2010 16:53
To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

 

Ok I'm curious - how to you get the freestyle ANT project to report @Ignore annotations? I didn't know that was possible

On 23 February 2010 16:40, Nord, James <[hidden email]> wrote:

It works in the m2 job type so Hudson does support this.

You need to drill down a fair way in m2 job to find the actual skipped test but the bar colour is red=failed blue=passed yellow=skipped.

However our freestyle Ant builds doesn't populate the xml report with the skipped data - and so Hudson never displays this info (how could it...)

/James


-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Kohsuke Kawaguchi
Sent: 23 February 2010 16:15
To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

Does JUnit report ignored tests in the XML file? If you have a sample
JUnit report file, please send it to us.

2010/2/22 Charles Chan <[hidden email]>:
> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]


**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************

This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

 




**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************


This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

Andreas Jöcker
In reply to this post by Kohsuke Kawaguchi
In the TESTS-Testsuite.xml you can find

<testsuite id='9' timestamp='2010-02-24T08:00:08' failures='0'
ignored='1' time='1.805' errors='0' tests='2' name='TheTest'
package='com.funny.bar.test' hostname='the.server.de'>

so there is the information about all possible outcomes of a test

Cheers
A

Am 23.02.2010 17:15, Kohsuke Kawaguchi schrieb:
> Does JUnit report ignored tests in the XML file? If you have a sample
> JUnit report file, please send it to us.
>
> 2010/2/22 Charles Chan <[hidden email]>:
>  
>> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?
>>    
>
>  


--

Andreas Jöcker
GiS - Gesellschaft für integrierte Systemplanung mbH
Junkersstr. 2
69469 Weinheim

E-Mail   [hidden email]
Telefon +49 6201 503-59
Fax     +49 6201 503-66

Gesellschaft für integrierte Systemplanung mbH
Geschäftsführer: Eckhard Haffmann, Alfred Gai, Bernd Heselmann
Sitz der Gesellschaft: Zeppelinstr. 11 - 91052 Erlangen
Amtsgericht Fürth/Bayern - Handelsregister-Nr. HRB 3435


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

stephenconnolly
In reply to this post by Charles Chan-2
Ehhh...

I see the attached trend graph... the blue tests are the tests which pass... the yellow tests are the tests which are skipped (i.e. @Ignored) and the red tests are the tests which failed (i.e. error or failure)

?ui=2&view=att&th=126ff0a8fcef8970&attid=0.1&disp=attd&realattid=ii_126ff0a8fcef8970&zw

-Stephen

On 22 February 2010 23:02, Charles Chan <[hidden email]> wrote:
I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

Thanks,
Charles



     __________________________________________________________________
Looking for the perfect gift? Give the gift of Flickr!

http://www.flickr.com/gift/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

stormcloud-3
In reply to this post by Nord, James
Will do. Thanks

On 23 February 2010 17:44, Nord, James <[hidden email]> wrote:

I didn’t say it was possible – I said Hudson looks like it should support it (the JUnit parsing is shared across m2 and freestyle jobs).

 

If you’re using ant you may want to look at https://issues.apache.org/bugzilla/show_bug.cgi?id=43969

 

Also http://jira.codehaus.org/browse/SUREFIRE-303 for how this was worked around in Maven.

 

/James

 

From: stormcloud [mailto:[hidden email]]
Sent: 23 February 2010 16:53


To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

 

Ok I'm curious - how to you get the freestyle ANT project to report @Ignore annotations? I didn't know that was possible

On 23 February 2010 16:40, Nord, James <[hidden email]> wrote:

It works in the m2 job type so Hudson does support this.

You need to drill down a fair way in m2 job to find the actual skipped test but the bar colour is red=failed blue=passed yellow=skipped.

However our freestyle Ant builds doesn't populate the xml report with the skipped data - and so Hudson never displays this info (how could it...)

/James


-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Kohsuke Kawaguchi
Sent: 23 February 2010 16:15
To: [hidden email]
Subject: Re: Is it possible to show @Ignore JUnit tests?

Does JUnit report ignored tests in the XML file? If you have a sample
JUnit report file, please send it to us.

2010/2/22 Charles Chan <[hidden email]>:
> I noticed when JUnit tests are marked as @Ignore, they are not executed nor reported in Hudson's graph. Is there any way to get an indication of which tests are disabled from Hudson?

--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]


**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************

This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com


---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

 




**************************************************************************************
This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes. To protect the environment please do not print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, United Kingdom. A company registered in England and Wales. Registered no. 3080780. VAT no. GB 603 8808 40-00
**************************************************************************************


This message is confidential and intended only for the addressee. If you have received this message in error, please immediately notify the [hidden email] and delete it from your system as well as any copies. The content of e-mails as well as traffic data may be monitored by NDS for employment and security purposes.
To protect the environment please do not print this e-mail unless necessary.

An NDS Group Limited company. www.nds.com

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

Kohsuke Kawaguchi
Administrator
OK, so to summarize, JUnit run in Maven reports ignored tests because
Surefire puts that extra information into the report file (so Hudson
can see them.)

OTOH, reports produced by the <junit> task in Ant don't have any
ignored test information, so Hudson cannot report them. This issue is
tracked in https://issues.apache.org/bugzilla/show_bug.cgi?id=43969

So at this point there's nothing Hudson can do to improve this
situation. We are blocked by #43969.

2010/2/24 stormcloud <[hidden email]>:

> Will do. Thanks
>
> On 23 February 2010 17:44, Nord, James <[hidden email]> wrote:
>>
>> I didn’t say it was possible – I said Hudson looks like it should support
>> it (the JUnit parsing is shared across m2 and freestyle jobs).
>>
>>
>>
>> If you’re using ant you may want to look at
>> https://issues.apache.org/bugzilla/show_bug.cgi?id=43969
>>
>>
>>
>> Also http://jira.codehaus.org/browse/SUREFIRE-303 for how this was worked
>> around in Maven.
>>
>>
>>
>> /James
>>
>>
>>
>> From: stormcloud [mailto:[hidden email]]
>> Sent: 23 February 2010 16:53
>>
>> To: [hidden email]
>> Subject: Re: Is it possible to show @Ignore JUnit tests?
>>
>>
>>
>> Ok I'm curious - how to you get the freestyle ANT project to report
>> @Ignore annotations? I didn't know that was possible
>>
>> On 23 February 2010 16:40, Nord, James <[hidden email]> wrote:
>>
>> It works in the m2 job type so Hudson does support this.
>>
>> You need to drill down a fair way in m2 job to find the actual skipped
>> test but the bar colour is red=failed blue=passed yellow=skipped.
>>
>> However our freestyle Ant builds doesn't populate the xml report with the
>> skipped data - and so Hudson never displays this info (how could it...)
>>
>> /James
>>
>> -----Original Message-----
>> From: [hidden email] [mailto:[hidden email]] On
>> Behalf Of Kohsuke Kawaguchi
>> Sent: 23 February 2010 16:15
>> To: [hidden email]
>> Subject: Re: Is it possible to show @Ignore JUnit tests?
>>
>> Does JUnit report ignored tests in the XML file? If you have a sample
>> JUnit report file, please send it to us.
>>
>> 2010/2/22 Charles Chan <[hidden email]>:
>> > I noticed when JUnit tests are marked as @Ignore, they are not executed
>> > nor reported in Hudson's graph. Is there any way to get an indication of
>> > which tests are disabled from Hudson?
>>
>> --
>> Kohsuke Kawaguchi
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [hidden email]
>> For additional commands, e-mail: [hidden email]
>>
>>
>>
>> **************************************************************************************
>> This message is confidential and intended only for the addressee. If you
>> have received this message in error, please immediately notify the
>> [hidden email] and delete it from your system as well as any copies. The
>> content of e-mails as well as traffic data may be monitored by NDS for
>> employment and security purposes. To protect the environment please do not
>> print this e-mail unless necessary.
>>
>> NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18
>> 4EX, United Kingdom. A company registered in England and Wales. Registered
>> no. 3080780. VAT no. GB 603 8808 40-00
>>
>> **************************************************************************************
>>
>> This message is confidential and intended only for the addressee. If you
>> have received this message in error, please immediately notify the
>> [hidden email] and delete it from your system as well as any copies. The
>> content of e-mails as well as traffic data may be monitored by NDS for
>> employment and security purposes.
>> To protect the environment please do not print this e-mail unless
>> necessary.
>>
>> An NDS Group Limited company. www.nds.com
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [hidden email]
>> For additional commands, e-mail: [hidden email]
>>
>>
>>
>> ________________________________
>>
>> **************************************************************************************
>> This message is confidential and intended only for the addressee. If you
>> have received this message in error, please immediately notify the
>> [hidden email] and delete it from your system as well as any copies. The
>> content of e-mails as well as traffic data may be monitored by NDS for
>> employment and security purposes. To protect the environment please do not
>> print this e-mail unless necessary.
>>
>> NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18
>> 4EX, United Kingdom. A company registered in England and Wales. Registered
>> no. 3080780. VAT no. GB 603 8808 40-00
>>
>> **************************************************************************************
>>
>> ________________________________
>> This message is confidential and intended only for the addressee. If you
>> have received this message in error, please immediately notify the
>> [hidden email] and delete it from your system as well as any copies. The
>> content of e-mails as well as traffic data may be monitored by NDS for
>> employment and security purposes.
>> To protect the environment please do not print this e-mail unless
>> necessary.
>>
>> An NDS Group Limited company. www.nds.com
>
>



--
Kohsuke Kawaguchi

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Is it possible to show @Ignore JUnit tests?

Charles Chan-2
In reply to this post by Charles Chan-2
Thanks for all the answers. Too bad it doesn't work right now. I hope the <junit> tasks gets fixed soon.

Regards,
Charles



      __________________________________________________________________
The new Internet Explorer® 8 - Faster, safer, easier.  Optimized for Yahoo!  Get it Now for Free! at http://downloads.yahoo.com/ca/internetexplorer/

---------------------------------------------------------------------
To unsubscribe, e-mail: [hidden email]
For additional commands, e-mail: [hidden email]

Loading...