New Functest Kubernetes tags +release engineering insights


Cedric Ollivier
 

Hi,

 

In addition to the classical river names, Functest Kubernetes now delivers Docker tags per Kubernetes release.

(Thank you for all the feedbacks, especially the last one from OOM PTL which convinced me to prioritize this idea)

 

The new tags simply match all Kubernetes versions from v1.13 : https://build.opnfv.org/ci/view/functest-kubernetes-ng-docker/

For your information, there is no known CVE in all the Docker images (that should be a very key topic especially in OPNFV/Anuket deliverables) : https://build.opnfv.org/ci/view/functest-kubernetes-ng-trivy/

 

Badly they aren’t yet continuously verified via daily jobs as the classical docker images due to a lack of hardware resources.

This email is also a call for hardware resources ; 2 servers should be enough to install all 8 clusters required for a true gating.

 

This new Docker builds have been generated thanks to lots of new features in Xtesting CI published in 2021 about Continuous Development.

I proudly announce that all the 3000 Jenkins jobs needed by Functest are now fully generated from a single yml file mostly focusing on docker image, test case and src dir lists.

See all jjbs generated in the releng src dir: https://git.opnfv.org/releng/tree/jjb/functest

 

As good example, here is the part which generates all Xtesting jjbs for Continuous Development and for Continuous Integration including:

-          patchset verification (test case verification vs compliant SUTs + tox: unit tests, linters, bandit, spell and link checks in docs, etc.)

-          deliverable verification (test case verification vs compliant SUTs)

-          CVE detection

 

(The Functest ones are just bigger due to the number of testcases and all the changes in test case names across the 6 active branches and it’s multiplied by the number of architectures supported: arm, arm64 and amd64)

 

- hosts: 127.0.0.1

  vars_files:

    - vars/opnfv.yml

  roles:

    - role: collivier.xtesting

      use_gerrit: true

      git_url: https://gerrit.opnfv.org/gerrit/functest-xtesting

      gerrit_project: functest-xtesting

      jenkins_view_trivy_regex:

        (?!{{ project }}-pi)^{{ project }}-[a-z-0-9.]+-trivy$

      suites:

        - container: xtesting

          tests:

            - first

            - second

            - third

            - fourth

            - fifth

            - sixth

        - container: xtesting-mts

          tests:

            - seventh

      docker_tags:

        - latest:

            branch: master

            slave: lf-virtual1

            dependency: '3.13'

        - leguer:

            branch: stable/leguer

            slave: lf-virtual1

            dependency: '3.12'

        - kali:

            branch: stable/kali

            slave: lf-virtual1

            dependency: '3.11'

        - jerma:

            branch: stable/jerma

            slave: lf-virtual1

            dependency: '3.10'

        - iruya:

            branch: stable/iruya

            slave: lf-virtual1

            dependency: '3.9'

        - hunter:

            branch: stable/hunter

            slave: lf-virtual1

            dependency: '3.9'

 

We could infinitely debate between Jenkins and Gitlab CI/CD and falsy claim Jenkins Job Builder is too difficult (Hoping we will quickly stop assigning all LFN Releng design issues to Jenkins Job builder).

When we focus on the right abstractions for the project deliverables (all OPNFV test projects could leverage all this work as my company does), the release engineering becomes very simple and maintainable by all.

Hoping to see this kind of discussions in a Dev event rather than the previous marketing lead discussions quickly failing in the different tools and their targets.

 

To conclude, switching 3000 Functest Jobs to ONAP Releng is now as simple as changing OPNFV to ONAP in git url in this yaml file.

Same if you want to reuse all that work in your company (everything is in place to add bots from your lab if you’re interested to vote on reviews).

 

I’m now working on the CD part for Kubernetes runners in Jenkins which asks for a few small enhancements (hoping we would update our obsolete shell runners for common builds – that would be a cost saving simply by breaking the LFN project silos which falsy duplicate everything).

And then I would finish the full support of Gitlab CI/CD (only the CI part is currently supported which is already enough for CNTT RC1 and RC2).

 

Stay tune. Any help is welcome.

 

Cédric

_________________________________________________________________________________________________________________________

Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified.
Thank you.

Join TSC@lists.opendaylight.org to automatically receive all group messages.