It can be a routine network problem. In the morning or at night, count the connected devices. Most likely, other devices are consuming the network at this time. Your router stays active while there are many of devices connected, which speeds up ping answers.