Redmine

As files in the repository may be encoded to anything, I don't
see any solution that would work in any cases.
Do you have a proposition for this ?

Unfortunately I don't :(
Maybe there should have some sort of auto-detecting feature
to say what is the encoding of the files, but I don't know
how it is implemented for example in Firefox's
View->Encoding.

Thanks,
Nikolay

Hi.

It should use iconv.

I wrote patch for svn viewer.
It is optimized for Japanese now. However, there is not influence
towards the English zone.
And It can cope with other character codes zone if you change
CharSets.

Index: app/models/svn_repos.rb =================================================================

--- app/models/svn_repos.rb (revision 537)
+++ app/models/svn_repos.rb (working copy)
@ -17,7 +17,23 @

require 'rexml/document'
 require 'cgi'
+require 'iconv'

class Iconv
CharSets = ['iso-2022-jp', 'euc-jp', 'utf-8', 'shift_jis',
'windows-31j']

def self.to_utf8(str)
+ return str if /\A[\r\n\t\x20-\x7e]*\Z/n.match(str) # for
us-ascii
+ CharSets.each do |char|
+ begin
+ return Iconv.conv("UTF-8", char, str)
+ rescue Iconv::IllegalSequence
+ end
+ end
+ str
+ end
end

module SvnRepos

class CommandFailed < StandardError #:nodoc:
@ -178,7 +194,7 @
         cat = io.read
       end
       return nil if $? && $?.exitstatus != 0
-      cat
+      Iconv.to_utf8(cat)
     rescue Errno::ENOENT => e
       raise CommandFailed    
     end

• for Cyrillic support.
  CharSets = ['windows-1251', 'utf-8']

Thank you.

Hi,
It's not working for me. I put the
CharSets = ['windows-1251', 'utf-8']
instead of
CharSets = ['iso-2022-jp', 'euc-jp', 'utf-8', 'shift_jis',
'windows-31j']
The result is the same. :(

Thanks,
Nikolay

It does work only in FILE view.
But does not work in DIFF view.

Probably, in the case of DIFF, it is so..

Index: app/models/svn_repos.rb =================================================================
--- app/models/svn_repos.rb (revision 538)
+++ app/models/svn_repos.rb (working copy)
@ -310,7 +326,7 @
self << diff_table if diff_table.length

1

Thanks,
I can now see the cyrillic chars.

Hope Jean-Philippe integrate it soon.

Nikolay.

Thanks for your help.

I propose to add the list of possible charsets in lang files,
so that they can be set for each language.
The charsets defined for the default language of your redmine
installation would be used for iconv convertion.

One more thing.
It should be ok for diffs, but trying to convert files to utf-8
(in cat method) in any case may cause some problems (eg. binary
files). It should be done only for text files.
I'll have to add a check.

Hi,
Is this bug-feature implemented?
When I updated my redMine recently the incorrect characters
appeared again :(

Thank,
Nikolay

Forgot to say that I was applied the Kyosuke Takayama's
patch on my Redmine. But now it's gone due to the repository
support rewrite from JP.

It's not implemented in current trunk (otherwise this ticket
would be closed).
I'll have a look at it.

Hi,

This fix was finally committed in r814.
You can set the list of encodings in Admin -> Settings
(Repositories encodings).

Thanks.

Thanks, again and again.

Nikolay