Redmine

Check your MySQL encoding.
Refer http://www.redmine.org/issues/4455#note-31 .

So I checked the table 'changesets' in the redmine database, and yes, the characters are missing. I deleted the repository (from the redmine settings) and flushed the 'changes' and 'changesets' tables. Then I did:

ALTER TABLE changes CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci
ALTER TABLE changesets CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci
ALTER TABLE comments CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci

The 'changesets' table is where the commit messages are stored. I then added the repository again and still the special-characters are missing.

Mind that the Bazaar data is not stored in a DB, it's in plain text files under the .bzr folder. Upon loading the repository for the first time, the commit messages are transferred to the redmine DB and somewhere along the way the special-characters are omitted.

I probably should change the character set for the rest of the tables (which is 'latin1_general_ci') to utf8 but Peter Fern's convert command in Issue #4455 doesn't work as expected on Cyqwin.

What can I do to debug this issue? Any help is appreciated.

Check your database "encoding" in REDMINE_DIR/config/database.yml.

'encoding' for production in database.yml defaults to 'utf8'

Chris G wrote:

What can I do to debug this issue? Any help is appreciated.

Redmine executes "bzr log" at source:tags/0.9.4/lib/redmine/scm/adapters/bazaar_adapter.rb#L80 .

Doing 'bzr log -v --show-ids' on the command line shows the characters correctly. If I look at ~/.bzr.log I can see that the output encoding is set to 'cp1252'

encoding stdout as osutils.get_user_encoding() 'cp1252'

This seems to be causing issues for other people as well, see https://bugs.launchpad.net/bzr/+bug/340394

There they are trying to change the command so that you can do 'bzr log --encoding_type "utf-8"' and thus get the right encoding format.

Would it be possible to have Redmine convert the encoding from cp1252 to utf8 and thus overcome the problem?

Chris G wrote:

Would it be possible to have Redmine convert the encoding from cp1252 to utf8 and thus overcome the problem?

That would be the commit messages encoding setting.

Setting 'Commit messages encoding' in Admin -> Settings to windows-1252 and re-adding the repository fixes the problem. I'm pretty sure I tried this before, though it may have been before I converted the MySQL tables to utf8. The issue has been resolved.

Bazaar issue want an option to set the output encoding, especially on win32 has a file name encoding problem too.
Now I post a message at #2664.