[zanata-bugs] [Bug 702205] New: Multibyte characters in a po cannot be processed by Zanata properly

[bugzilla at redhat.com]

Please do not reply directly to this email. All additional
comments should be made in the comments box of this bug.

Summary: Multibyte characters in a po cannot be processed by Zanata properly

https://bugzilla.redhat.com/show_bug.cgi?id=702205

           Summary: Multibyte characters in a po cannot be processed by
                    Zanata properly
           Product: Zanata
           Version: 1.3-alpha-1
          Platform: All
        OS/Version: Linux
            Status: NEW
          Severity: medium
          Priority: medium
         Component: Component-Logic
        AssignedTo: zanata-dev-internal at redhat.com
        ReportedBy: ktakemur at redhat.com
         QAContact: dchen at redhat.com
                CC: zanata-bugs at redhat.com, zanata-dev-internal at redhat.com
   Estimated Hours: 0.0
    Classification: Other
      Story Points: ---


Description of problem:

Accidentally I was trying to import a pot file that contains a single multibyte
character and mvn zanata:publican-push produces Embedded error: operation
returned 500 (Internal Server Error).

As a client user this looks like a zanata system error but in fact from the
server.log zanata cannot deal with multibyte character.

This should be rectified in either way

- More appropriate error message in order for user to fix the book.
- Zanata supports multibyte characters

Caused by: java.sql.SQLException: Incorrect string value: '\xE2\x88\x97, B...'
for column 'content' at row 1
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1055)

The msgstr of the po looks

msgid "Xen and the Art of Virtualization, Paul Barham∗, Boris Dragovic.
University of Cambridge SOSP'03 paper"
msgstr ""

$ xxd RHEL_5-7/ja-JP/Chapters/Test_design/Block_device_model.po | grep e288
0002e80: 2050 6175 6c20 4261 7268 616d e288 972c   Paul Barham...,

'∗' is a multibyte character.

Version-Release number of selected component (if applicable):
Zanata version 1.3-alpha-1 (20110330-1649)

How reproducible:
always

Steps to Reproduce:
1.
2.
3.

Actual results:
import ends up with internal error

Expected results:
- More appropriate error message in order for user to fix the book.
- Zanata supports multibyte characters

Additional info:

-- 
Configure bugmail: https://bugzilla.redhat.com/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.