That’s a shame.
What I noticed it is when I activate “Do not skip empty groups” in Group by options that the loading time increases.