Problem displaying unicode characters

I have a string stored in a json object that correctly renders unicode both in my SQL viewer and in the python console:

image

But turns into ? marks when displayed in bubble:
image

Looking around for similar issues in stackexchange, it seems like there is a bug with whatever DB driver bubble is using. Any ideas?

Update, even when taking it out of the JSON and just making a VARCHAR, bubble still drops the unicode characters.

More info: I am pretty sure the issue is Bubble’s API connector not supporting 4-byte encoding. According to this Bubble used UTF-8 for character encoding, but doesnt specify how many bytes.

I experimented with my database and saw similar results when only using 3-byte encoding:

select CONVERT(temp USING utf8mb4) from temp where id=3 limit 1
Yields:
"The stunning collection of 🔥10,000 AINightbirds🔥\nTech is the future, and NFT is the future of art!"

But select CONVERT(temp USING utf8mb3) from temp where id=3 limit 1

Yields: "The stunning collection of ?10,000 AINightbirds?\nTech is the future, and NFT is the future of art!"

Bubble folks - any ideas how to support fetching 4-byte characters??

UPDATE The very helpful Bubble support acknowledged this is indeed a bug (possibly with the DB connector), and are looking into it.

However, there is an easy fix: Add a query parameter to the end of your connection string: “?charset=UTF8MB4_BIN”

Works beautifully!

2 Likes

This topic was automatically closed after 70 days. New replies are no longer allowed.