The lag is inherent to the app and is present on all devices, it's less of an issue when using touch because it's not loading media for every game as you scroll through. When using a controller scrolling through the list completely tanks performance. Most notable on the Shield TV, one of the most powerful Android devices out there.
My pixel 6 is running Android 12, the shield is running Android 11.