This probably needs troubleshooting. However you can check few things:
1: Latency is the impact and the data shows high CPU usage during the issue. Need to confirm if CPU spikes are causing latency or something else.
2: Try decreasing the load from the device during the issue state, clear session , clear arp, flap the interfaces. and check the CPU utilization and the performance. If still high then unplug the network cable and check if CPU is going down or not to confirm the CPU is not getting stuck.
3: If high CPU is the reason then need to make sure all the traffic are legitimate.
4: If CPU stuck then probably hardware behaving weird when reaching to the limit.
Thanks,
Vikas