Question about some performance tweaks
Hello Benjamin, Happy new year to you!
I have a simple question, but proably with no solution or possible change as it is now.
I'm using:
Normally on:
https://github.com/pablodav/burp_server_reports/blob/master/burp_reports/backends/burpui_api.py#L174
I'm use it to provide 'totsize' to the reports.
Se then when available, it is compared and if totsize is 0, it is marked with never as status:
During hourly reports on 4 servers and one with more than 100 clients on backups, I have noticed poor performance and breaks, so it not always get the report due to "timeouts", it also could take 10 minutes to complete (but this is not an issue really, it is ok if takes time, problem if it doesn't complete).
So my questions here:
-
I haven't noticed any other better way to get the totsize from API, is there any other possibility to get the totsize only? or with less data from the client backup? (thinking in possibility to affect less the performance of burp-ui/burp servers.
-
I'm using only database=sqlite:////var/spool/burpui/celery.db, mysql or postgres helps on it? what is the best setup to have better performance to get the report backup?
My setup has all the defaults in https://github.com/CoffeeITWorks/ansible_burpui_server/blob/master/defaults/main.yml#L37
The challenge here: if I don't get the totsize: I'm not sure if all clients really have backups, because the standard last date backup could be today, but with a backup that is not finished, only something in progress that maybe never ends because burp doesn't complete for some reason but the backup date is always updated because the client tries again every day.
So other possibility: have the date provided by http://burp-ui.readthedocs.io/en/latest/api.html#get--api-clients-(server)-stats with "last":
only for a completed backup in last? (probably much more complicated behaviour, or probably needs to be reported to burp itself?).
I use it here: https://github.com/pablodav/burp_server_reports/blob/master/burp_reports/backends/burpui_api.py#L92
Sorry to report an a so complicated issue :)