saving emoji in string type

rubens · February 13, 2016, 4:46pm

Hi,

I have a chat in my APP and works fine bu when I use emoji char i have a problem.

‘Server.Processing’ [java.lang.RuntimeException: java.lang.RuntimeException: com.mysql.jdbc.MysqlDataTruncation: Data truncation: Incorrect string value: ‘\xF0\x9F\x98\xAC\xF0\x9F…’

My code is

    if (messageTextView.text == "") {
        print("no text")
    }
    else {
        messages.publish = userName
        messages.subscribe = otherName
        messages.message = self.messageTextView.text
        
        dataStore.save(messages, fault: &error) as? Messages
        if (error == nil) {
            self.messageTextView.text = ""
            self.refreshResults()
        }
        else {
            print("Server reported an error: \(error)")
















        }

mark-piller · February 13, 2016, 6:58pm

Hi Rubens,

I scheduled an internal ticket to investigate this problem.

Regards,
Mark

arthur-dzidzoiev · February 15, 2016, 8:20am

Hi, Rubens,

The issue is linked to support topic. “Our database charset is utf8_general_ci and emojis cannot be properly saved for this encoding.”

As a workaround we can suggest you to:

Create custom event handlers on before create item to encode it from utf-16 to utf-8 like this:

String stringField  = new String( stringField.toBytes("UTF-16") , "UTF-8")

So when you retrieve item you create custom event handlers on after find to encode it back from utf-8 to utf-16.

Let us know if this approach made a trick.

Cheers,
Artur.

rubens · February 19, 2016, 12:37pm

Thanks Artur,

I created a custom event handlers and works fine except when i get a remote notification in background (IOS) because i can´t treat it

mark-piller · February 19, 2016, 2:20pm

Are the emoji characters included into the notification?

rubens · February 19, 2016, 3:31pm

Yes

mark-piller · February 19, 2016, 7:04pm

Can you do the UTF-8 to UTF-16 conversion on the device? Here’s a thread discussion this topic: http://stackoverflow.com/questions/13058325/how-to-convert-nsdata-utf8-encoded-data-to-utf16

rubens · February 19, 2016, 7:14pm

Thanks Mark,

But … as I said earlier the encode/decode works fine for me because I process in my code.
(UTF-8 to UTF-16) and (UTF-16 to UTF-8) it´s ok.
The only problem is when the message comes to me by notification (in background in IOS) because I can´t handle the message)

kate-maksimenko · May 25, 2016, 8:18am

Hi!

FYI: we added new data type (EXTENDED_STRING) to support emoji in data service: example1 and example2

Regards,
Kate.

allen-luo · June 3, 2016, 6:43pm

I just ran into this problem and almost had a heart attack until I saw this fix. You are awesome!

rubens · June 3, 2016, 8:05pm

This is great news … especially those who work with chat.

Very very good

allen-luo · June 5, 2016, 4:52am

Spoke too soon. Kate, have you tested the extended strings with the mobile SDK’s? In my iOS app all strings that have emojis are coming back as nil in the app. I can see the emojis in the dashboard. Maybe the respective SDK’s aren’t updated yet?

kate-maksimenko · June 5, 2016, 9:18pm

Hi Allen!

We are working on this issue (task id is BKNDLSS-12698).
IOS dev will notify you about changes.

gagan-kumarMB · June 8, 2016, 8:35pm

Hello Rubens
I am also facing the same problem, need to send notification with emojis
Please share your experience and how to use this EXTENDED STRING type for sending the notification

sergey-kukurudzyak · June 9, 2016, 10:57am

This thread is about emojis in persistence, to use it just change type of your data to EXTENDED STRING https://monosnap.com/file/ESlwQdp7iG68C4LlPrhtMP1zFTwhox . But as I understand you have problem with sending push notifications ? Please provide more information about your issue

gagan-kumarMB · June 9, 2016, 11:59am

Hello Sergey thanks for reply

My problem is when I am integrating chat functionality in my app using message sub/pub and push notifications. when I am sending emojis in messages it is converting to ‘??’. But I managed to encode and decode using unicode in pub/sub messaging but in push notification i cannot do that as we cannot alter the banner text of notification, even when I am sending the notification from backendless console then also its not working fine. please find the attached screenshots

sergey-kukurudzyak · June 9, 2016, 12:31pm

I have created internal ticket BKNDLSS-12797

gagan-kumarMB · June 9, 2016, 12:38pm

Thanks for the favour.

vyacheslav-vdovichenko · June 10, 2016, 3:32pm

Please update the libs from github (CoomLibiOs & backendless), and try again

narek-simonyan · September 28, 2016, 10:08am

Hi,do you fix this issue

I am still getting null