Date | App Effected | Cause | Result | Notes |
---|---|---|---|---|
March 10, 2020 | Cacti Unavailable | the rrd sync script needed to be recovered. | lost data collection | March 17 SWD recommended to use our database cluster in place of the local MySQL databases on each cacti server. Procedure detailed here Cacti - DB migration |
July 22, 2020 | Cacti unavailable | Certificate used between cacti and crowd was no longer accepted by Crowd. Not expired but somehow not accepted. | Data lose and down time | Certificate was repaired by PSNC. At this time the recommendation to move the database to the SWD Galera MySql cluster was accepted and the database was moved. There was so adjustments needed to get this to work which required further downtime. Unfortunately we have no really test environments for cacti so it was not possible to test before hand. |
July 29, 2020 | Cacti - unavailable | IT decommissioned a server that was required by Crowd. | Server was brought back up | Application was unavailable. |
July 29, 2020 | Cacti - not collecting poller data | Max had altered the polling time interval which resulting in no data collection | missing data | Max had tried to adjust the polling times to address a complaint about database speed. Unfortunately this is not possible because the polling program checks for intervals of polling and quits if they don't fall in a preset manner. |