[netvirt-dev] COE and Netvirt CSIT red


Faseela K
 

Jamo,
For netvirt, Jaya is investigating the issue, and she is suspecting a releng/builder patch for the issue of stack failure.
She will soon update.
Thanks,
Faseela

-----Original Message-----
From: netvirt-dev <netvirt-dev-bounces@...> On Behalf Of Jamo Luhrsen
Sent: Saturday, August 17, 2019 4:11 AM
To: netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: [netvirt-dev] COE and Netvirt CSIT red

Hi Netvirt,

I was scanning through the csit results we need to vet for the Neon
SR2 release [0] and see that COE csit is 100% failing for a while now. And looks like netvirt jobs are failng to stack.

we don't want to release with a regression. Can you see what's really wrong and update the sheet?

Thanks,
JamO

[0]
https://protect2.fireeye.com/url?k=6781bf13-3b08109e-6781ff88-0cc47ad93de2-604a936d3d641e03&q=1&u=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1sIoApv2fFp0wJcPK7m6lQDtjbUonRANrs5upSeD_DyI%2Fedit%3Fpli%3D1%23gid%3D698183592
_______________________________________________
netvirt-dev mailing list
netvirt-dev@...
https://protect2.fireeye.com/url?k=7be0a208-27690d85-7be0e293-0cc47ad93de2-d638cf0f47074d58&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fnetvirt-dev


JayaPr
 

Jamo, Faseela,

Netvirt csit is failing since Aug8 and I see that on Aug8 , a lot of patches have gone in builder.
I have doubt on this patch,
https://git.opendaylight.org/gerrit/c/releng/builder/+/83508
Resolve ShellCheck for deploy-controller-run-test

Trying some workarounds, will update you asap.
Its failing in stack but stack is not completed even and it says stack failed and exits.
Some checks to wait for stack is missing is what I am suspecting.

Also Aug 8 , branch cut had happened so many patches have gone in.
And also not every jobs of rocky and queens are failing (including sodium, neon and fluorine) but a lot of them are
So it is tricky to find the solution.

Regards
Jaya

-----Original Message-----
From: integration-dev <integration-dev-bounces@...> On Behalf Of Faseela K
Sent: Tuesday, August 20, 2019 10:48 AM
To: Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: Re: [integration-dev] [netvirt-dev] COE and Netvirt CSIT red

Jamo,
For netvirt, Jaya is investigating the issue, and she is suspecting a releng/builder patch for the issue of stack failure.
She will soon update.
Thanks,
Faseela

-----Original Message-----
From: netvirt-dev <netvirt-dev-bounces@...> On Behalf Of Jamo Luhrsen
Sent: Saturday, August 17, 2019 4:11 AM
To: netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: [netvirt-dev] COE and Netvirt CSIT red

Hi Netvirt,

I was scanning through the csit results we need to vet for the Neon
SR2 release [0] and see that COE csit is 100% failing for a while now. And looks like netvirt jobs are failng to stack.

we don't want to release with a regression. Can you see what's really wrong and update the sheet?

Thanks,
JamO

[0]
https://protect2.fireeye.com/url?k=6781bf13-3b08109e-6781ff88-0cc47ad93de2-604a936d3d641e03&q=1&u=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1sIoApv2fFp0wJcPK7m6lQDtjbUonRANrs5upSeD_DyI%2Fedit%3Fpli%3D1%23gid%3D698183592
_______________________________________________
netvirt-dev mailing list
netvirt-dev@...
https://protect2.fireeye.com/url?k=7be0a208-27690d85-7be0e293-0cc47ad93de2-d638cf0f47074d58&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fnetvirt-dev
_______________________________________________
integration-dev mailing list
integration-dev@...
https://protect2.fireeye.com/url?k=50417800-0c9574f1-5041389b-864685b2085c-7469fa861fd2871b&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fintegration-dev


JayaPr
 

Hi Faseela,

What I suspected was right, I reverted many patches and it works
https://jenkins.opendaylight.org/sandbox/job/JP-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-dcgw-sodium/1/console
Hence it was not stack issue, stack was not even completing and job hitting exit.

Need to figure out exactly which patch was causing failure, will update asap.

Regards
Jaya

-----Original Message-----
From: Jaya Priyadarshini
Sent: Tuesday, August 20, 2019 11:20 AM
To: Faseela K <faseela.k@...>; Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: RE: [netvirt-dev] COE and Netvirt CSIT red

Jamo, Faseela,

Netvirt csit is failing since Aug8 and I see that on Aug8 , a lot of patches have gone in builder.
I have doubt on this patch,
https://git.opendaylight.org/gerrit/c/releng/builder/+/83508
Resolve ShellCheck for deploy-controller-run-test

Trying some workarounds, will update you asap.
Its failing in stack but stack is not completed even and it says stack failed and exits.
Some checks to wait for stack is missing is what I am suspecting.

Also Aug 8 , branch cut had happened so many patches have gone in.
And also not every jobs of rocky and queens are failing (including sodium, neon and fluorine) but a lot of them are So it is tricky to find the solution.

Regards
Jaya


-----Original Message-----
From: integration-dev <integration-dev-bounces@...> On Behalf Of Faseela K
Sent: Tuesday, August 20, 2019 10:48 AM
To: Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: Re: [integration-dev] [netvirt-dev] COE and Netvirt CSIT red

Jamo,
For netvirt, Jaya is investigating the issue, and she is suspecting a releng/builder patch for the issue of stack failure.
She will soon update.
Thanks,
Faseela

-----Original Message-----
From: netvirt-dev <netvirt-dev-bounces@...> On Behalf Of Jamo Luhrsen
Sent: Saturday, August 17, 2019 4:11 AM
To: netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: [netvirt-dev] COE and Netvirt CSIT red

Hi Netvirt,

I was scanning through the csit results we need to vet for the Neon
SR2 release [0] and see that COE csit is 100% failing for a while now. And looks like netvirt jobs are failng to stack.

we don't want to release with a regression. Can you see what's really wrong and update the sheet?

Thanks,
JamO

[0]
https://protect2.fireeye.com/url?k=6781bf13-3b08109e-6781ff88-0cc47ad93de2-604a936d3d641e03&q=1&u=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1sIoApv2fFp0wJcPK7m6lQDtjbUonRANrs5upSeD_DyI%2Fedit%3Fpli%3D1%23gid%3D698183592
_______________________________________________
netvirt-dev mailing list
netvirt-dev@...
https://protect2.fireeye.com/url?k=7be0a208-27690d85-7be0e293-0cc47ad93de2-d638cf0f47074d58&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fnetvirt-dev
_______________________________________________
integration-dev mailing list
integration-dev@...
https://protect2.fireeye.com/url?k=50417800-0c9574f1-5041389b-864685b2085c-7469fa861fd2871b&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fintegration-dev


JayaPr
 

Hi Faseela/Jamo,

I have tried multiple fixes but I m still stuck since many patches have gone in.
, I think I will one more day to fix it
but in the meantime can we just run the distribution build mentioned in the NEON SR release excel sheet with the older builder repo.
Our goal is to check distro rather than repo.
Let me know, then I will run all the jobs mentioned and will verify the distribution in sandbox.

Regards
Jaya

-----Original Message-----
From: Jaya Priyadarshini
Sent: Tuesday, August 20, 2019 12:09 PM
To: Faseela K <faseela.k@...>; Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: RE: [netvirt-dev] COE and Netvirt CSIT red

Hi Faseela,

What I suspected was right, I reverted many patches and it works https://jenkins.opendaylight.org/sandbox/job/JP-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-dcgw-sodium/1/console
Hence it was not stack issue, stack was not even completing and job hitting exit.

Need to figure out exactly which patch was causing failure, will update asap.

Regards
Jaya
-----Original Message-----
From: Jaya Priyadarshini
Sent: Tuesday, August 20, 2019 11:20 AM
To: Faseela K <faseela.k@...>; Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: RE: [netvirt-dev] COE and Netvirt CSIT red

Jamo, Faseela,

Netvirt csit is failing since Aug8 and I see that on Aug8 , a lot of patches have gone in builder.
I have doubt on this patch,
https://git.opendaylight.org/gerrit/c/releng/builder/+/83508
Resolve ShellCheck for deploy-controller-run-test

Trying some workarounds, will update you asap.
Its failing in stack but stack is not completed even and it says stack failed and exits.
Some checks to wait for stack is missing is what I am suspecting.

Also Aug 8 , branch cut had happened so many patches have gone in.
And also not every jobs of rocky and queens are failing (including sodium, neon and fluorine) but a lot of them are So it is tricky to find the solution.

Regards
Jaya


-----Original Message-----
From: integration-dev <integration-dev-bounces@...> On Behalf Of Faseela K
Sent: Tuesday, August 20, 2019 10:48 AM
To: Jamo Luhrsen <jluhrsen@...>; netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: Re: [integration-dev] [netvirt-dev] COE and Netvirt CSIT red

Jamo,
For netvirt, Jaya is investigating the issue, and she is suspecting a releng/builder patch for the issue of stack failure.
She will soon update.
Thanks,
Faseela

-----Original Message-----
From: netvirt-dev <netvirt-dev-bounces@...> On Behalf Of Jamo Luhrsen
Sent: Saturday, August 17, 2019 4:11 AM
To: netvirt-dev@...; integration-dev@...; Release <release@...>
Subject: [netvirt-dev] COE and Netvirt CSIT red

Hi Netvirt,

I was scanning through the csit results we need to vet for the Neon
SR2 release [0] and see that COE csit is 100% failing for a while now. And looks like netvirt jobs are failng to stack.

we don't want to release with a regression. Can you see what's really wrong and update the sheet?

Thanks,
JamO

[0]
https://protect2.fireeye.com/url?k=6781bf13-3b08109e-6781ff88-0cc47ad93de2-604a936d3d641e03&q=1&u=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1sIoApv2fFp0wJcPK7m6lQDtjbUonRANrs5upSeD_DyI%2Fedit%3Fpli%3D1%23gid%3D698183592
_______________________________________________
netvirt-dev mailing list
netvirt-dev@...
https://protect2.fireeye.com/url?k=7be0a208-27690d85-7be0e293-0cc47ad93de2-d638cf0f47074d58&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fnetvirt-dev
_______________________________________________
integration-dev mailing list
integration-dev@...
https://protect2.fireeye.com/url?k=50417800-0c9574f1-5041389b-864685b2085c-7469fa861fd2871b&q=1&u=https%3A%2F%2Flists.opendaylight.org%2Fmailman%2Flistinfo%2Fintegration-dev