Date: 2023-11-11
Time: 05:36 UTC
System: One of Mars subsystems called “mars3”.
Issues: Some device-reported data were not processed. Device and group status might be out of date.
Update: The issue was resolved on 2023-11-12 at 23:40 UTC. It was due to a database connection pool being exhausted. However, the issue was not identified promptly.
Issue avoidance: A monitor on database connection pool errors has been implemented. When the same error occurs, the pool will be reset automatically. Peplink engineers will be notified at the same time.
We apologize for any inconveniences caused.
Please set this forum post “Watching” to receive notifications.
Date: 2024-01-02
Time: 06:20 UTC
System: Entire InControl system.
Issue: A lot of devices have been falsely marked as offline.
Update:
A system component was generating a high CPU load to a memory database. The database was overloaded.
The component stopped generating the load at about 07:12. Devices started to appear online gradually since then. The system was totally recovered at 07:48 UTC.
Please set this forum post “Watching” to receive the notification.
Issue:
When users visit their organization, an error message “This organization requires users to enable two factor authentication.” even though the users have been two-factor authenticated during sign-in.
Impact:
For organizations that require their users to be two-factor authenticated, their users were unable to open the organization. Organizations with the option disabled were not affected.
Another extremely useful tool would be a secondary site like status.incontrol2.peplink.com where known issues and planned interruptions could be shared with users. This would help all those that aren’t part of the forums to know if/when there are any incidents and that Peplink is working on things keeping network managers from worrying and channel support teams from creating tickets for known issues.
Having issues for several hours now on both Mars and Venus where the only data available from the device right side of the page is:
Status:
InControl Detected IP
Usage
Clients
Location
The worst issue however is that RWA is also not working. This is only for select units, while majority of units are working fine. They are showing online, and they are working. Another side effect is also when AP’s are controlled from a Balance router, they will also still work but show offline in IC2.
I"m not sure if this is even related but I was experiencing multiple incontrol issues most of yesterday. 3 of my vessels configured to reflect their locations by utilizing the new starlink gps feature stopped working.
Other minor issues of no response of the incontrol pages loading or taking a long time (i’m on a 5gb fiber link and everything tested fine on my end)
Strange thing is one of my vessels with the same 380x router was updating its location as usual from starlink antennas.
I should add that the gps values from the antenna’s showed properly locally on in the router