1. Integration-Dev
  2. Messages

Re: Logs not getting compressed

Anil Belur
 



On Fri, May 31, 2019 at 7:51 AM Anil Belur <abelur@...> wrote:


On Fri, May 31, 2019 at 7:05 AM Robert Varga <nite@...> wrote:
Hello,

it seems our captured logz are no longer getting compressed with .gz:

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/controller-csit-3node-clustering-ask-all-neon/247/robot-plugin/

Given the size of files involved, it does not make for good experience
:( Also FF seems to have liked .gz very much.

Can we get compression back? Also, would it make sense to compress them
with 'xz -T 0 -0'?

That should prove faster in builds and lower on Nexus storage footprint
(i.e. page cache pressure).

Thanks,
Robert


Robert, I'll look into it and get back. 

- Anil 
 

I agree some of the .xml files output into the logs are pretty large (1GiB) in other projects like FD.io
and we should be compressing these files too. I've looked up lftools code [2.], and it's compressing only *.{txt,log} and
not '*.{xml,html}' files.
  
This change [1.] should fix the issue which adds file types and also uses lzma instead of gzip.

[1.] https://gerrit.linuxfoundation.org/infra/c/releng/lftools/+/15793
[2.] https://github.com/lfit/releng-lftools/blob/master/lftools/deploy.py#L40-L42

Thanks,
Anil
Join integration-dev@lists.opendaylight.org to automatically receive all group messages.