Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

Adding Chetan and Hema.

Regards,

Apurba

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test
is expecting 6.

Thanks,
JamO

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

Hi Srinivas,

I have noticed one inconsistency between the robot log(html) file and robot log(txt) file. The DPNs and tunnels are not matching even though they are for the same build(e.g. build 20).

I can see the CSIT started failing from build 17 where the change was done for “Initial tests for odlmicro netconf functionality”.       

Regards,

Apurba

Hi Apurba,

The scripts are failing with all tunnels not coming up.

This issue is seen from Oct 1^st.

Please look into this.

Adding Chetan and Hema.

Regards,

Apurba

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test
is expecting 6.

Thanks,
JamO

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

On Oct 15, 2020, at 11:06 PM, Srinivas via lists.opendaylight.org <srinivas.rachakonda=altencalsoftlabs.com@...> wrote:

++Venkat.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 11:26
To: Srinivas Rachakonda <srinivas.rachakonda@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Srinivas,

 

I have noticed one inconsistency between the robot log(html) file and robot log(txt) file. The DPNs and tunnels are not matching even though they are for the same build(e.g. build 20).

 

I can see the CSIT started failing from build 17 where the change was done for “Initial tests for odlmicro netconf functionality”.        

 

Regards,

Apurba

 

From: srinivas.rachakonda@... <srinivas.rachakonda@...> 
Sent: Friday, October 16, 2020 11:13 AM
To: Apurba Mukherjee <apurba.mukherjee@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

 

The scripts are failing with all tunnels not coming up.

 

This issue is seen from Oct 1^st.

 

Please look into this.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 10:47
To: Jamo Luhrsen <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Adding Chetan and Hema.

 

Regards,

Apurba

 

From: Jamo Luhrsen <jluhrsen@...> 
Sent: Thursday, October 15, 2020 11:16 PM
To: Apurba Mukherjee <apurba.mukherjee@...>; integration-dev@...
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: Re: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test 
is expecting 6.

Thanks,
JamO

On 10/15/20 3:10 AM, Apurba Mukherjee via lists.opendaylight.org wrote:

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar. 

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

On Oct 16, 2020, at 12:58 AM, Luis Gomez via lists.opendaylight.org <ecelgp=gmail.com@...> wrote:

Test runs 2 times because this new parameter [1] is not present in genius and maybe other jobs:

Venkat, can you take a look?

BR/Luis

[1] https://git.opendaylight.org/gerrit/c/releng/builder/+/92588/14/jjb/integration/integration-templates.yaml#201

On Oct 15, 2020, at 11:06 PM, Srinivas via lists.opendaylight.org <srinivas.rachakonda=altencalsoftlabs.com@...> wrote:

++Venkat.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 11:26
To: Srinivas Rachakonda <srinivas.rachakonda@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Srinivas,

 

I have noticed one inconsistency between the robot log(html) file and robot log(txt) file. The DPNs and tunnels are not matching even though they are for the same build(e.g. build 20).

 

I can see the CSIT started failing from build 17 where the change was done for “Initial tests for odlmicro netconf functionality”.        

 

Regards,

Apurba

 

From: srinivas.rachakonda@... <srinivas.rachakonda@...> 
Sent: Friday, October 16, 2020 11:13 AM
To: Apurba Mukherjee <apurba.mukherjee@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

 

The scripts are failing with all tunnels not coming up.

 

This issue is seen from Oct 1^st.

 

Please look into this.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 10:47
To: Jamo Luhrsen <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Adding Chetan and Hema.

 

Regards,

Apurba

 

From: Jamo Luhrsen <jluhrsen@...> 
Sent: Thursday, October 15, 2020 11:16 PM
To: Apurba Mukherjee <apurba.mukherjee@...>; integration-dev@...
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: Re: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test 
is expecting 6.

Thanks,
JamO

On 10/15/20 3:10 AM, Apurba Mukherjee via lists.opendaylight.org wrote:

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar. 

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

Luis,

 Will check your patch and this issue today,

On Fri, Oct 16, 2020 at 11:08 PM Luis Gomez <ecelgp@...> wrote:

This should fix: https://git.opendaylight.org/gerrit/c/releng/builder/+/93100

On Oct 16, 2020, at 12:58 AM, Luis Gomez via lists.opendaylight.org <ecelgp=gmail.com@...> wrote:

Test runs 2 times because this new parameter [1] is not present in genius and maybe other jobs:

Venkat, can you take a look?

BR/Luis

[1] https://git.opendaylight.org/gerrit/c/releng/builder/+/92588/14/jjb/integration/integration-templates.yaml#201

On Oct 15, 2020, at 11:06 PM, Srinivas via lists.opendaylight.org <srinivas.rachakonda=altencalsoftlabs.com@...> wrote:

++Venkat.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 11:26
To: Srinivas Rachakonda <srinivas.rachakonda@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Srinivas,

 

I have noticed one inconsistency between the robot log(html) file and robot log(txt) file. The DPNs and tunnels are not matching even though they are for the same build(e.g. build 20).

 

I can see the CSIT started failing from build 17 where the change was done for “Initial tests for odlmicro netconf functionality”.        

 

Regards,

Apurba

 

From: srinivas.rachakonda@... <srinivas.rachakonda@...> 
Sent: Friday, October 16, 2020 11:13 AM
To: Apurba Mukherjee <apurba.mukherjee@...>; 'Jamo Luhrsen' <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

 

The scripts are failing with all tunnels not coming up.

 

This issue is seen from Oct 1^st.

 

Please look into this.

 

Thanks,

Srinivas

+91-9243478719

 

From: Apurba Mukherjee <apurba.mukherjee@...> 
Sent: 16 October 2020 10:47
To: Jamo Luhrsen <jluhrsen@...>; integration-dev@...; Chetan Arakere Gowdru <chetan.arakere@...>; Hema Gopalkrishnan <hema.gopalkrishnan@...>
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: RE: [integration-dev] CSIT is failing in silicon

 

Adding Chetan and Hema.

 

Regards,

Apurba

 

From: Jamo Luhrsen <jluhrsen@...> 
Sent: Thursday, October 15, 2020 11:16 PM
To: Apurba Mukherjee <apurba.mukherjee@...>; integration-dev@...
Cc: Srinivas Rachakonda <srinivas.rachakonda@...>; Robert Varga <nite@...>
Subject: Re: [integration-dev] CSIT is failing in silicon

 

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test 
is expecting 6.

Thanks,
JamO

On 10/15/20 3:10 AM, Apurba Mukherjee via lists.opendaylight.org wrote:

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar. 

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

--

Venkatrangan Govindarajan
( When there is no wind...Row )

Hi Apurba,

The scripts are failing with all tunnels not coming up.

This issue is seen from Oct 1^st.

Please look into this.

Adding Chetan and Hema.

Regards,

Apurba

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test
is expecting 6.

Thanks,
JamO

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

 

Hi Apurba,

I don't have time to dig in to it, but clearly something has broken
this job starting around Oct 1st:
https://jenkins.opendaylight.org/releng/job/genius-csit-1node-upstream-only-silicon/71/robot/

I would look at what patches might have been merged around that
time (int/test as well) that might have affected it. The main
failure is that only 5 tunnels are found to be up, and the test
is expecting 6.

Thanks,
JamO

Hi,

 

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

 

Can someone check if there is any setup issue due to which CSIT started failing?

 

Regards,

Apurba

Hi,

Recently I can see there are CSIT failures in genius(test-genius-genius) for the patch https://git.opendaylight.org/gerrit/c/genius/+/92759 . When I analyzed further I can see that for other patch too(https://git.opendaylight.org/gerrit/c/genius/+/92429 ) CSIT was passing before but started failing now. The failures look similar.

Can someone check if there is any setup issue due to which CSIT started failing?

Regards,

Apurba