You can add “isRead?” field to your message table. If a user has a message that isRead=false:count>0, then you can change the color or make something visible. You can review the chat examples available in the marketplace.
Here is an example for you. Let me know if that helps. I will upload the video that I recorded creating this as well so you can follow along if need be.