[release] [OpenDaylight TSC] Magnesium CSIT check for SR3
Thanh ha <zxiiro@...>
On Wed, Dec 2, 2020 at 5:48 PM Anil Belur <abelur@...> wrote:
I can see there's some orphaned servers that don't appear to be getting deleted, from the Jenkins UI:
Online since Nov 10th 2020 https://jenkins.opendaylight.org/releng/computer/prd-centos7-builder-8c-8g-48685/
Also if we look at the OpenStack Cron job that's supposed to be cleaning up orphaned systems (https://jenkins.opendaylight.org/releng/view/builder/job/builder-openstack-cron/) there appears to be 3 systems that keep appearing in the logs if we look at a few different jenkins runs:
Deleting orphaned server: prd-centos7-builder-4c-16g-53684 Deleting orphaned server: prd-centos7-robot-2c-8g-53683 Deleting orphaned server: prd-centos7-builder-4c-16g-53675
We can see this log going back as far as build #31902 (https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/31902/console.log.gz) which looks like Nov 26th.
Looks like these have been failing to delete for some time now but the openstack-cron job is not reporting the failure to delete. Makes me wonder if there are other resources not seen here that need to be cleaned up in Vexxhost.
Hope this helps,
OK, it seems like this has to be fixed in order:toggle quoted messageShow quoted text
- First we need to fix any issue with vexhost not cleaning images.
- Second, if the CSIT still fails, we can look at reducing the robot minions even if CSIT takes longer to complete.