Performance plugin how use Absolute constraints ?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Performance plugin how use Absolute constraints ?

Vincent Daburon
Hi,

Some requests have response time very short (6ms) and relative comparison give difference to high (6ms compare to 7ms => 16% diff).

For example :
===================================================================================

Performance: Recording JMeter reports 'resultat/res_filtred.jtl'
Performance: Parsing JMeter report file '/home/jenkins/.jenkins/jobs/PERF_publish_compare_loadtesting/builds/41/performance-reports/JMeter/res_filtred.jtl'.
Performance: Percentage of relative difference outside -11.0 to +100.0 % sets the build as failure
Performance: Percentage of relative difference outside -0.0 to +10.0 % sets the build as unstable



Performance: Recording JMeter reports 'resultat/res_filtred.jtl'

Comparison build no. - 37 and 41 using Average response time


====================================================================================================================================
PrevBuildURI	CurrentBuildURI		PrevBuildURIAvg		CurrentBuildURIAvg	RelativeDiff	RelativeDiffPercentage 
====================================================================================================================================
P1_01_ACCUEIL	P1_01_ACCUEIL		6			6			0.0		0.0
P1_02_DMD_FORM_LOGIN	P1_02_DMD_FORM_LOGIN		6			7			1.0		16.67
P1_03_LOGIN	P1_03_LOGIN		10			13			3.0		30.0
P1_04_STATS	P1_04_STATS		53			78			25.0		47.17
P1_05_RETOUR_MENU	P1_05_RETOUR_MENU		2			2			0.0		0.0
P1_06_LOGOUT	P1_06_LOGOUT		6			7			1.0		16.67
------------------------------------------------------------------------------------------------------------------------------------

The label "P1_06_LOGOUT" made the build unstable
Build step 'Publish Performance test result report' changed build result to UNSTABLE
===================================================================================

How can i configure the Performance Plugin with absolute response time constraints like :
 
P1_01_ACCUEIL must be less than 20 ms
P1_02_DMD_FORM_LOGIN must be less than 20 ms
P1_03_LOGIN must be less than 100 ms
P1_04_STATS must be less than 200 ms
P1_05_RETOUR_MENU must be less than 20ms
P1_06_LOGOUT must be less than 20 ms

With the "Expert Mode" i can see Constraints but i don't understand how it's work and how configure the SLA values (likes P1_06_LOGOUT:20 ? => must be less than 20 ms)

Regards.
Vincent D.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/18b036b3-69b8-4bd4-89da-6bce5c4dc1e3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

jenkins_performance_plugin.png (31K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Performance plugin how use Absolute constraints ?

Vishnu Vardhan
Hi any resolution on this ? please share.

On Wednesday, January 4, 2017 at 6:54:15 PM UTC+5:30 [hidden email] wrote:
Hi,

Some requests have response time very short (6ms) and relative comparison give difference to high (6ms compare to 7ms => 16% diff).

For example :
===================================================================================

Performance: Recording JMeter reports 'resultat/res_filtred.jtl'
Performance: Parsing JMeter report file '/home/jenkins/.jenkins/jobs/PERF_publish_compare_loadtesting/builds/41/performance-reports/JMeter/res_filtred.jtl'.
Performance: Percentage of relative difference outside -11.0 to +100.0 % sets the build as failure
Performance: Percentage of relative difference outside -0.0 to +10.0 % sets the build as unstable



Performance: Recording JMeter reports 'resultat/res_filtred.jtl'

Comparison build no. - 37 and 41 using Average response time


====================================================================================================================================
PrevBuildURI	CurrentBuildURI		PrevBuildURIAvg		CurrentBuildURIAvg	RelativeDiff	RelativeDiffPercentage 
====================================================================================================================================
P1_01_ACCUEIL	P1_01_ACCUEIL		6			6			0.0		0.0
P1_02_DMD_FORM_LOGIN	P1_02_DMD_FORM_LOGIN		6			7			1.0		16.67
P1_03_LOGIN	P1_03_LOGIN		10			13			3.0		30.0
P1_04_STATS	P1_04_STATS		53			78			25.0		47.17
P1_05_RETOUR_MENU	P1_05_RETOUR_MENU		2			2			0.0		0.0
P1_06_LOGOUT	P1_06_LOGOUT		6			7			1.0		16.67
------------------------------------------------------------------------------------------------------------------------------------

The label "P1_06_LOGOUT" made the build unstable
Build step 'Publish Performance test result report' changed build result to UNSTABLE
===================================================================================

How can i configure the Performance Plugin with absolute response time constraints like :
 
P1_01_ACCUEIL must be less than 20 ms
P1_02_DMD_FORM_LOGIN must be less than 20 ms
P1_03_LOGIN must be less than 100 ms
P1_04_STATS must be less than 200 ms
P1_05_RETOUR_MENU must be less than 20ms
P1_06_LOGOUT must be less than 20 ms

With the "Expert Mode" i can see Constraints but i don't understand how it's work and how configure the SLA values (likes P1_06_LOGOUT:20 ? => must be less than 20 ms)

Regards.
Vincent D.

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/3a97eaca-cbfe-42d0-b997-828094c1b8f2n%40googlegroups.com.