The Issue Report
The Controller Bot TeamThis report describes the causes and consequences of the issue related to Controller Bot, Livegram Bot, Comments Bot and occurred between 6:16 am and 11:45 am UTC on March 8.
What happened?
A retrosprective of what happened will be presented below in chronological order.
0:00-6:15 am UTC — The firewall was automatically disabled after the scheduled by Digital Ocean reboot of servers.
6:15 am UTC — Someone has remotely connected to our servers and made requests to detect and drop databases of Controller Bot, Livegram Bot and Comments Bot.
6:15-6:58 UTC — The bots continued to work, but no previously saved user data was available.
6:58 UTC — Our team has found the issue and disabled bots to investigate it.
7:02-11:45 UTC — Restore of databases from backups with data saved on 1:17 am UTC.
11:45 UTC — Backups were loaded, and all systems returned to operation normally.
What does it mean?
In other words, it means that all data recorded between 1:17 am and 6:58 am UTC was lost. If you have connected bots, added channel or group chat, created scheduled posts as well as posts with reactions or comments in that period of time, you need to do this again in order to make things work.
Is our data safe?
All user data including bot tokens, channel names and admin lists was not accessed by 3rd party. This conclusion is made by our Security Specialist based on the analysis of information about unauthorized access such as the duration time of connections, their activity and other aspects. Your data is fully safe now, and we'll take actions to prevent such incidents in the future.