Nginx, Django and uwsgi logging in /opt/django/media

[flawmop]

In-container /opt/django/media/ doesn't seem to be the best place to be writing the Nginx and uwsgi log files, even though it's convenient if that location is being used as a docker volume.

For in-container development it may be a bit misleading that /var/log/nginx/ and /var/log/uwsgi/ exist but are not written to by default.

[flawmop]

At the time of writing, uwsgi.log is 205Mb, which is getting too big to be useful, so we need a way of setting the appropriate log level according to runtime environment, e.g. at least info when running in the "production" environment, or perhaps have log rotation if possible.

This will also be true of forthcoming Nginx logs, so need to consider how can docker/client_nginx.conf and docker/client_uwsgi.ini respond to their operating environment?

Finally, also consider security implications if changing the log file permissions for uwsgi.log so we can avoid using sudo by setting it readable by other.

[flawmop]

Info: https://www.bloomberg.com/company/stories/configuring-uwsgi-production-deployment/

[flawmop]

Discovered the following for Django logging although it only has down to DEBUG level logging unfortunately.

Can be appended to, for example, client/config/develop_settings.py.

LOGGING = {
    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'verbose': {
            'format': '%(levelname)s %(asctime)s %(module)s %(process)d %(thread)d %(message)s'
        },
	'simple': {
            'format': '%(levelname)s %(message)s'
        },
    },
    'handlers': {
        'file': {
            'level': os.environ.get('LOGGING_LEVEL_DJANGO', 'DEBUG'),
            'class': 'logging.FileHandler',
            'filename': '/opt/django/media/django.log',
            'formatter': 'verbose'
        },
    },
    'root': {
        'handlers': ['file'],
        'level': os.environ.get('LOGGING_LEVEL_DJANGO', 'DEBUG'),
    },
}

https://www.freecodecamp.org/news/logging-in-python-debug-your-django-projects/
https://waltercruz.github.io/django-l10n-portuguese/topics/logging.html

[flawmop]

Could also avoid logging in uwsgi/apache/etc of any requests arriving from 10.0.0.0/8 (especially 10.159.186.6) because it's probably the Nottingham Uni intranet crapfinder.

[flawmop]

New branches :
https://github.com/CardiacModelling/ap-nimbus-client/tree/logging
https://github.com/CardiacModelling/ap-nimbus/tree/logging

[MauriceHendrix]

@flawmop what's the purpose of the ap-nimbus branch? Wouldn't it make more sense to will thill the cahnges make it to master in the client and then just catch up?
Either way let me know when you're redy for a PR. The approch seems good.

[flawmop]

@flawmop what's the purpose of the ap-nimbus branch? Wouldn't it make more sense to will thill the cahnges make it to master in the client and then just catch up?

Gotta keep the documentation up-to-date! :)

[MauriceHendrix]

@flawmop what's the purpose of the ap-nimbus branch? Wouldn't it make more sense to will thill the cahnges make it to master in the client and then just catch up?

Gotta keep the documentation up-to-date! :)

aah yes of course there is that :)