Yeah I was planning to do something like this for my use case.
Ideally I would like a matrix that Account Admins can use to provision data access to each user on a granular level.