From the manual:
Caution: Privacy rules do not update automatically on the page if the privacy rules impacting a user change while the user is on that page.
For example, if a user has a page open where they can see a Thing, then they click a button on that page that changes which privacy rules apply to them such that they can no longer see that Thing, this new privacy rule outcome will not reflect on the page until the page is refreshed.