Message-ID: <1612435351.8173.1711625466553.JavaMail.confluence@host3.pipelinefx.com> Subject: Exported From Confluence MIME-Version: 1.0 Content-Type: multipart/related; boundary="----=_Part_8172_1870950675.1711625466553" ------=_Part_8172_1870950675.1711625466553 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Content-Location: file:///C:/exported.html Log Rotation

Log Rotation

The Qube! supervisor and workers communicate between themselves = in order to coordinate the dispatch and running of jobs, and log this commu= nication in the supelog and workerlog files respectively.  Over time, = these logs may become very large, can consume an inordinate amount of disk = space, and can be unwieldy to should they need to be read for troubleshooti= ng purposes.

Automated log rotation on the supervisor and workers is available via a = Windows Scheduled Task, launchctl on OS X, and a cron job on Linux.

Setup and configuration

Linux

Setup
No additional tasks are necessary for log rotation on linux.  
Configu= ration
The log rotation on Linux is managed by the linux daemon=20 logrotated=20 , and is specified in =20 /etc/logrotate.d/supervisor=20 .  See the man pages for =20 logrotated=20 if you wish to customize the rotation policies.
Rotati= on Policy
Rotate out the logs weekly, keeping 4 copies.

OS X

Setup
No additional tasks are necessary for log rotation on OS X.   
Rota= tion Policy
Rotate out the logs when they exceed 100MB in size (the default size in the= =20 logrotate.py script).
Confi= guration
The log rotation on OS X is managed by launchctl/launchd, and the associate= d .plist files are:
    /Library/LaunchDaemons/com.pipelinefx.logrotate.supervis= or.plist=20
    /Library/LaunchDaemons/com.pipelinefx.logrotate.wo= rker.plist

Both of these plists call /App= lications/pfx/qube/utils/logrotate.py; see The logrotate.py script

Windows

Setup
Enabling log rotation on Windows requires that the Python programming langu= age be installed and in the System SEARCH PATH.  The easiest way to ac= complish this is to download and install a free Community Edition version o= f Python from  http://www.python.org. Download and run one of these installers, and a= llow it to add Python to the System Search Path.  You should see the l= ogs rotate out within the hour. If you're unsure which version to install, = choose the 64-bit installer.
Confi= guration
All Scheduled Tasks call  %QBDIR%/pfx/qube/utils/logrotate.py, with only the = path to the log as an argument.  
Rota= tion Policy
Rotate out the logs when they exceed 100MB in size (the default size in the=   logrotate.py &nb= sp;script).

Verifying that l= og rotation is occurring

Locate the log directory:

You will see at least on workerlog or supelog file.  When rotation = occurs, these logs are renamed and/or zipped/compressed.

You will only see supelog and supelog.1 the first time the rotation occu= rs.  The other files will appear when additional log rotation cycles o= ccur as time passes.


------=_Part_8172_1870950675.1711625466553--