Might this be caused by memory leaks?
Some games tend to accumulate unused data when run for a long time without closing (sleep mode doesnt count), which causes performance issues over time.
Maybe turning of the switch completely might help to 'clear the cache' if thats the case.