https://www.redmine.org/https://www.redmine.org/favicon.ico?16793021292009-02-10T17:20:22ZRedmineRedmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=72432009-02-10T17:20:22ZJérémie Delaitre
<ul></ul><p>I just noticed something weird with Mercurial.</p>
<p>When I try to remove the file mentionned above, mercurial did not success...<br />So the problem is maybe from Mercurial instead of Redmine.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=80052009-03-13T08:44:06ZWei Li
<ul></ul><p>I have the same issue with Bazaar.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=112702009-10-05T16:38:25ZDaniel Lima
<ul></ul><p>I have the same issue too. My environment is a Redmine 0.8.4 in a Windows 2003 Server. My repo is Mercurial with some special character in file path, like 'ç', 'ã', 'õ'.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=155072010-03-28T13:23:59ZYuya Nishihara
<ul></ul><p>That's because Mercurial (and also Git) treats file names as <em>byte string</em>.<br />Here we need to convert them to UTF-8, but, there's no reliable info about file name encoding.</p>
<p>Wei Li wrote:</p>
<blockquote>
<p>I have the same issue with Bazaar.</p>
</blockquote>
<p>I'm not sure about Bazaar, but it must handle paths as UTF-8, so it seems strange.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=155722010-03-31T13:30:22ZRui Tang
<ul></ul><p>I'm using redmine 0.9.3 on Windows Server 2003, has the same problem.</p>
<p>C:\redmine-0.9>ruby script/runner "Repository.fetch_changesets" -e production<br />c:/ruby/lib/ruby/gems/1.8/gems/rails-2.3.5/lib/commands/runner.rb:48: c:/ruby/li<br />b/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record/connection_adapters/ab<br />stract_adapter.rb:219:in `log': Mysql::Error: Incorrect string value: '\xB2\xE2\<br />xCA\xD4\xB9\xDC...' for column 'path' at row 1: INSERT INTO `changes` (`changese<br />t_id`, `action`, `revision`, `branch`, `from_path`, `path`, `from_revision`) VAL<br /><abbr title="279, 'A', NULL, NULL, NULL, '/doc/测试管理系统-详细设计说明书.docx', NULL">UES</abbr> (<br />ActiveRecord::StatementInvalid)<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/connection_adapters/mysql_adapter.rb:323:in `execute'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/connection_adapters/abstract/database_statements.rb:259:in `insert_sql'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/connection_adapters/mysql_adapter.rb:333:in `insert_sql'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/connection_adapters/abstract/database_statements.rb:44:in `insert_without_query<br />_dirty'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/connection_adapters/abstract/query_cache.rb:18:in `insert'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/base.rb:2908:in `create_without_timestamps'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/timestamp.rb:53:in `create_without_callbacks'<br /> from c:/ruby/lib/ruby/gems/1.8/gems/activerecord-2.3.5/lib/active_record<br />/callbacks.rb:266:in `create'<br /> ... 30 levels...<br /> from c:/ruby/lib/ruby/gems/1.8/gems/rails-2.3.5/lib/commands/runner.rb:4<br />8<br /> from c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `ge<br />m_original_require'<br /> from c:/ruby/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:31:in `re<br />quire'<br /> from script/runner:3</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=157552010-04-11T02:39:06ZYuya Nishihara
<ul><li><strong>File</strong> <a href="/attachments/3544">issue-2664-0.9-stable-2010-04-11.patch</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/3544/issue-2664-0.9-stable-2010-04-11.patch">issue-2664-0.9-stable-2010-04-11.patch</a> added</li></ul><p>Yuya Nishihara wrote:</p>
<blockquote>
<p>That's because Mercurial (and also Git) treats file names as <em>byte string</em>.<br />Here we need to convert them to UTF-8, but, there's no reliable info about file name encoding.</p>
</blockquote>
<p>Hi, I made a patch to fix the issue.<br />It adds <code>repositories.path_encoding</code> column, which can be configured via Settings -> Repository tab.<br />Since it changes database schema, <code>rake db:migrate</code> is necessary. Please try it with care.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=171582010-06-05T11:20:15ZToshi MARUYAMA
<ul></ul><p>Yuya Nishihara wrote:</p>
<blockquote>
<p>That's because Mercurial (and also Git) treats file names as <em>byte string</em>.<br />Here we need to convert them to UTF-8, but, there's no reliable info about file name encoding.</p>
<p>Wei Li wrote:</p>
<blockquote>
<p>I have the same issue with Bazaar.</p>
</blockquote>
<p>I'm not sure about Bazaar, but it must handle paths as UTF-8, so it seems strange.</p>
</blockquote>
<p>I asked this Bazaar problem and <a class="issue tracker-1 status-5 priority-4 priority-default closed" title="Defect: Bazaar: Missing characters from repository comments (Closed)" href="https://www.redmine.org/issues/5578">#5578</a> at <a href="http://groups.google.com/group/mercurial-ja/browse_thread/thread/c05134036f40207f/1d13de12bef5c7f7?#1d13de12bef5c7f7" class="external">Mercurial-ja google group</a> (in Japanese).<br />The reason is same with <a class="issue tracker-1 status-5 priority-4 priority-default closed" title="Defect: Bazaar: Missing characters from repository comments (Closed)" href="https://www.redmine.org/issues/5578">#5578</a>.<br />Bazaar issue: <a href="https://bugs.launchpad.net/bzr/+bug/340394" class="external">want an option to set the output encoding, especially on win32</a> .<br />And I got a suggestion that <a href="http://wiki.bazaar.canonical.com/XMLOutput" class="external">XMLOutput plugin</a> is better than "bzr log".</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=171832010-06-07T13:03:04ZToshi MARUYAMA
<ul><li><strong>File</strong> <a href="/attachments/3923">git-bzr.patch</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/3923/git-bzr.patch">git-bzr.patch</a> added</li></ul><p>Git problem is reported at <a class="issue tracker-1 status-5 priority-3 priority-lowest closed" title="Defect: Git: Repository path encoding of non UTF-8 characters (Closed)" href="https://www.redmine.org/issues/5251">#5251</a>.<br />I tried git and Bazaar and I could display multi-bytes characters path.<br />This patch is for git and Bazaar.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=171862010-06-07T13:45:06ZYuya Nishihara
<ul></ul><p>Toshi Maruyama wrote:</p>
<blockquote>
<p>Git problem is reported at <a class="issue tracker-1 status-5 priority-3 priority-lowest closed" title="Defect: Git: Repository path encoding of non UTF-8 characters (Closed)" href="https://www.redmine.org/issues/5251">#5251</a>.<br />I tried git and Bazaar and I could display multi-bytes characters path.<br />This patch is for git and Bazaar.</p>
</blockquote>
<p>Git and Mercurial have absolutely the same problem, they treat filename as bytes, so the patch about Git seems reasonable.</p>
<p>But Bazaar's problem sounds different to me. It lies on the communication layer between Redmine and Bazaar. They should talk in UTF-8 but currently not.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=172402010-06-09T09:02:15Zxiaoyu yin
<ul></ul><p>To share my experence:<br />My system is Windows XP SP3, and Windows Server 2003.<br />My steps are: <br /> 1.Uninstall the redmine and reinstall it. <br /> 2.Creat hg repository in redmine folder. <br /> 3.Import the patch. <br /> 4.run "rake db:migrate RAILS_ENV=production" command<br /> 5.Restart the redmine service.</p>
<p>The path_encoding column was added successfully.</p>
<p>And I test the coding type in the list one by one, the "GBK" is correct for me.</p>
<p>Good luck for you!</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=172412010-06-09T09:03:53Zxiaoyu yin
<ul></ul><p>By the way: if you have data in database, please backup it first and restore it after that the path_encoding column was added successfully.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=172432010-06-09T09:23:51ZToshi MARUYAMA
<ul></ul><p>Additionally, you need to delete repository setting created before patch applied and recreate the same repository from Redmine settings tab.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=236092011-01-01T23:09:09ZToshi MARUYAMA
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Closed</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=236112011-01-01T23:10:18ZToshi MARUYAMA
<ul><li><strong>Status</strong> changed from <i>Closed</i> to <i>Reopened</i></li><li><strong>Assignee</strong> set to <i>Toshi MARUYAMA</i></li><li><strong>Priority</strong> changed from <i>High</i> to <i>Low</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=236122011-01-01T23:11:14ZToshi MARUYAMA
<ul><li><strong>Status</strong> changed from <i>Reopened</i> to <i>7</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=236372011-01-03T05:53:14ZToshi MARUYAMA
<ul><li><strong>Target version</strong> set to <i>Unplanned backlogs</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=247252011-02-01T04:00:20Zbo ye
<ul></ul><p>please fix this first in later version of redmine(like 1.1.2?) if <a class="issue tracker-2 status-5 priority-4 priority-default closed" title="Feature: Mercurial overhaul (Closed)" href="https://www.redmine.org/issues/4455">#4455</a> Mercurial overhaul could not be done soon. <br />this problem stopped us from using hg for redmine completely.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=247262011-02-01T04:47:30ZToshi MARUYAMA
<ul><li><strong>Subject</strong> changed from <i>Redmine+Mercurial+PostgreSQL: path encoding and multi-bytes characters</i> to <i>Repository path encoding of non UTF-8 characters (Mercurial, Git and CVS)</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=248912011-02-07T09:39:45ZToshi MARUYAMA
<ul><li><strong>File</strong> <a href="/attachments/5302">20110207-db.diff</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5302/20110207-db.diff">20110207-db.diff</a> added</li><li><strong>File</strong> <a href="/attachments/5303">20110207-git-cvs-fs.diff</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5303/20110207-git-cvs-fs.diff">20110207-git-cvs-fs.diff</a> added</li><li><strong>File</strong> <a href="/attachments/5304">20110207-impl.diff</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5304/20110207-impl.diff">20110207-impl.diff</a> added</li></ul><p>These are patches for svn trunk <a class="changeset" title="Fixed various typos in french locale" href="https://www.redmine.org/projects/redmine/repository/svn/revisions/4799">r4799</a> and 1.1 stable <a class="changeset" title="Merged r4799 from trunk." href="https://www.redmine.org/projects/redmine/repository/svn/revisions/4800">r4800</a>.</p>
<ul>
<li><a class="attachment" href="https://www.redmine.org/attachments/5304">20110207-impl.diff</a> is main patch.</li>
<li><a class="attachment" href="https://www.redmine.org/attachments/5302">20110207-db.diff</a> is DB migration. If you have applied Yuya's <a class="attachment" href="https://www.redmine.org/attachments/3544">issue-2664-0.9-stable-2010-04-11.patch</a>, you don't need to apply this patch or you don't need to run "rake db:migrate". If you have not applied Yuya's patch, you need to apply this patch, and run "rake db:migrate". </li>
<li><a class="attachment" href="https://www.redmine.org/attachments/5303">20110207-git-cvs-fs.diff</a> is for Git, CVS and Filesystem.</li>
</ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=248932011-02-07T09:47:15ZToshi MARUYAMA
<ul><li><strong>Subject</strong> changed from <i>Repository path encoding of non UTF-8 characters (Mercurial, Git and CVS)</i> to <i>Repository path encoding of non UTF-8 characters (Mercurial, Git, CVS and Filesystem)</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=249012011-02-07T11:15:15ZToshi MARUYAMA
<ul><li><strong>File</strong> <a href="/attachments/5306">hg-ruby-1.9.diff</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5306/hg-ruby-1.9.diff">hg-ruby-1.9.diff</a> added</li></ul><p>This is ad hoc Mercurial adapter patch for Redmine SVN trunk and Ruby 1.9.<br />I confirmed to run on my Japanese Windows Vista and Mingw Ruby 1.9.2.</p>
<p>There is another "IO.popen" issue <a class="issue tracker-1 status-5 priority-4 priority-default closed" title="Defect: Most binary files become corrupted when downloading from CVS repository browser when Redmine is r... (Closed)" href="https://www.redmine.org/issues/6090">#6090</a>.<br /><a class="source" href="https://www.redmine.org/projects/redmine/repository/svn/entry/tags/1.1.1/lib/redmine/scm/adapters/abstract_adapter.rb#L184">source:tags/1.1.1/lib/redmine/scm/adapters/abstract_adapter.rb#L184</a></p>
<p>I think we need to refactor "IO.popen" such as <a href="https://bitbucket.org/redmine/redmine-issue4455-snapshot/src/5b5447f4ae4b/lib/redmine/scm/adapters/mercurial_adapter.rb#cl-235" class="external">Yuya's Mercurial overhaul</a></p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=249612011-02-08T13:23:22ZPaolo Losi
<ul></ul><p>I can confirm that the patches (see note 19) solve the problem for us.<br />Since the issue is blocking, we would like to know if<br />the is a method to backout the patches and undo the schema<br />migration when there will be an official release that addresses this issue.</p>
<p>Thanks</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=249622011-02-08T13:50:54ZPaolo Losi
<ul></ul><p>Paolo Losi wrote:</p>
<blockquote>
<p>I can confirm that the patches (see note 19) solve the problem for us.<br />Since the issue is blocking, we would like to know if<br />the is a method to backout the patches and undo the schema<br />migration when there will be an official release that addresses this issue.</p>
</blockquote>
<p>Answering myself:</p>
<p>rake db:migrate:down</p>
<p>Sorry for the noise</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=250002011-02-09T08:57:30Zbo ye
<ul></ul><p>wow, these patches work great!!<br />it seems even better than before, at least now issues can be linked with r####<br />please make this to the next minor version 1.1.2. you have my vote. :)</p>
<p>there is a minor problem with the patches though. it doesn't work with codeview plugin. the error on the repository page:<br /><pre>
NoMethodError in Code_review#update_revisions_view
Showing vendor/plugins/redmine_code_review/app/views/code_review/_update_revisions.html.erb where line #6 raised:
undefined method `review_count' for #<Changeset:0x63e7320>
Extracted source (around line #6):
3: # and open the template in the editor.
4: %>
5:
6: <script type="text/javascript">
7: <% @changesets.each do |changeset| %>
8: <%
9: if changeset.review_count > 0
</pre></p>
<p>Toshi MARUYAMA wrote:</p>
<blockquote>
<p>These are patches for svn trunk <a class="changeset" title="Fixed various typos in french locale" href="https://www.redmine.org/projects/redmine/repository/svn/revisions/4799">r4799</a> and 1.1 stable <a class="changeset" title="Merged r4799 from trunk." href="https://www.redmine.org/projects/redmine/repository/svn/revisions/4800">r4800</a>.</p>
<ul>
<li><a class="attachment" href="https://www.redmine.org/attachments/5304">20110207-impl.diff</a> is main patch.</li>
<li><a class="attachment" href="https://www.redmine.org/attachments/5302">20110207-db.diff</a> is DB migration. If you have applied Yuya's <a class="attachment" href="https://www.redmine.org/attachments/3544">issue-2664-0.9-stable-2010-04-11.patch</a>, you don't need to apply this patch or you don't need to run "rake db:migrate". If you have not applied Yuya's patch, you need to apply this patch, and run "rake db:migrate". </li>
<li><a class="attachment" href="https://www.redmine.org/attachments/5303">20110207-git-cvs-fs.diff</a> is for Git, CVS and Filesystem.</li>
</ul>
</blockquote> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=250042011-02-09T10:04:25ZToshi MARUYAMA
<ul></ul><p>bo ye wrote:</p>
<blockquote>
<p>please make this to the next minor version 1.1.2. you have my vote. :)</p>
</blockquote>
<p>This feature has big behaviour change and has a db migrate.<br />So, I think it is difficult to apply 1.1 stable.<br />But, we need to consider to apply 1.2.</p>
<p>Yuya, what do you think?</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=251152011-02-11T17:39:32ZYuya Nishihara
<ul></ul><p>Toshi MARUYAMA wrote:</p>
<blockquote>
<p>bo ye wrote:</p>
<blockquote>
<p>please make this to the next minor version 1.1.2. you have my vote. :)</p>
</blockquote>
<p>This feature has big behaviour change and has a db migrate.<br />So, I think it is difficult to apply 1.1 stable.<br />But, we need to consider to apply 1.2.</p>
<p>Yuya, what do you think?</p>
</blockquote>
<p>Same idea. For now, you can work around the issue by:</p>
<ol>
<li>put lib/redmine/scm/adapters/path_encodable_wrapper.rb</li>
<li>apply the patch only for app/models/repository.rb</li>
<li>and replace the content of <code>def new_scm</code> method in place of <code>db:migrate</code>:<br /> <pre>
scm = Redmine::Scm::Adapters::PathEncodableWrapper.new(scm, path_encoding) unless path_encoding.blank?
</pre><br /> by<br /> <pre>
scm = Redmine::Scm::Adapters::PathEncodableWrapper.new(scm, 'encoding-name-of-your-repo')
</pre></li>
</ol> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=251272011-02-12T00:22:56ZToshi MARUYAMA
<ul></ul><p>Ruby 1.9 compatibility and tests are very serious.<br />Please see <a class="source" href="https://www.redmine.org/projects/redmine/repository/svn/revisions/4810/entry/trunk/test/unit/lib/redmine/scm/adapters/git_adapter_test.rb#L77">source:trunk/test/unit/lib/redmine/scm/adapters/git_adapter_test.rb@4810#L77</a> .</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=251292011-02-12T00:51:15ZToshi MARUYAMA
<ul></ul><p>Japanese Shift_JIS and Traditional Chinese Big5 have 0x5c(backslash) problem and these are incompatible with ASCII.<br />Japanese EUC-JP is compatible with ASCII.</p>
<p>Ruby uses ANSI api to fork a process on Windows.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=251302011-02-12T01:15:57ZToshi MARUYAMA
<ul></ul><p>Subversion supports URL encoding for path and Redmine uses it.<br />I think Redmine Mercurial adapter need to wrap command line path of cat, diff and annotate such as Yuya's Mercurial overhaul helper extension.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=253562011-02-20T14:59:44ZToshi MARUYAMA
<ul><li><strong>File</strong> <a href="/attachments/5442">for-trunk-r4893-20110220.patch</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5442/for-trunk-r4893-20110220.patch">for-trunk-r4893-20110220.patch</a> added</li></ul><p>I start implementing in new way.<br />Ruby 1.9 compatibility is very serious.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=253672011-02-21T00:47:02ZToshi MARUYAMA
<ul><li><strong>Subject</strong> changed from <i>Repository path encoding of non UTF-8 characters (Mercurial, Git, CVS and Filesystem)</i> to <i>Repository path encoding of non UTF-8 characters (Mercurial and Filesystem)</i></li><li><strong>Priority</strong> changed from <i>Low</i> to <i>Normal</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>20</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=255602011-02-24T06:04:32ZToshi MARUYAMA
<ul><li><strong>Subject</strong> changed from <i>Repository path encoding of non UTF-8 characters (Mercurial and Filesystem)</i> to <i>Mercurial: Repository path encoding of non UTF-8 characters</i></li><li><strong>% Done</strong> changed from <i>20</i> to <i>60</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=258992011-03-04T05:43:02ZToshi MARUYAMA
<ul><li><strong>% Done</strong> changed from <i>60</i> to <i>90</i></li></ul> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=259142011-03-04T12:07:42ZToshi MARUYAMA
<ul><li><strong>File</strong> <a href="/attachments/5502">ruby-1.9.2-japanese-windows.png</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/5502/ruby-1.9.2-japanese-windows.png">ruby-1.9.2-japanese-windows.png</a> added</li><li><strong>Target version</strong> changed from <i>Unplanned backlogs</i> to <i>1.2.0</i></li></ul><p>I can't run on my Japanese Windows Ruby 1.9.2 without <a class="issue tracker-2 status-5 priority-4 priority-default closed" title="Feature: Ruby 1.9 support (Closed)" href="https://www.redmine.org/issues/4050">#4050</a> <a href="http://www.redmine.org/attachments/5498/Ruby-1.9-Encoding.default_external.diff" class="external">Ruby-1.9-Encoding.default_external.diff</a> .<br />Despite applying this patch, I got following error.</p>
<pre>
[2011-03-04 20:51:58] ERROR Encoding::InvalidByteSequenceError: "\x9C" followed by "-" on Windows-31J
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rails-2.3.11/lib/rails/rack/static.rb:37:in `file?'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rails-2.3.11/lib/rails/rack/static.rb:37:in `file_exist?'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rails-2.3.11/lib/rails/rack/static.rb:18:in `call'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rack-1.1.0/lib/rack/urlmap.rb:47:in `block in call'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rack-1.1.0/lib/rack/urlmap.rb:41:in `each'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rack-1.1.0/lib/rack/urlmap.rb:41:in `call'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rails-2.3.11/lib/rails/rack/log_tailer.rb:17:in `call'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rack-1.1.0/lib/rack/content_length.rb:13:in `call'
r:/Ruby192/lib/ruby/gems/1.9.1/gems/rack-1.1.0/lib/rack/handler/webrick.rb:48:in `service'
r:/Ruby192/lib/ruby/1.9.1/webrick/httpserver.rb:111:in `service'
r:/Ruby192/lib/ruby/1.9.1/webrick/httpserver.rb:70:in `run'
r:/Ruby192/lib/ruby/1.9.1/webrick/server.rb:183:in `block in start_thread'
</pre> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=259152011-03-04T13:14:33ZToshi MARUYAMA
<ul></ul><p>"Files" module has similar strange behavior on my Japanese Windows Ruby 1.9.2.<br />I give up fix it.</p> Redmine - Defect #2664: Mercurial: Repository path encoding of non UTF-8 charactershttps://www.redmine.org/issues/2664?journal_id=259192011-03-04T14:37:59ZToshi MARUYAMA
<ul><li><strong>Status</strong> changed from <i>7</i> to <i>Closed</i></li><li><strong>% Done</strong> changed from <i>90</i> to <i>100</i></li><li><strong>Resolution</strong> set to <i>Fixed</i></li></ul><p>I finished implementing this feature until <a class="changeset" title="scm: mercurial: add path encoding select box at setting (#2664)." href="https://www.redmine.org/projects/redmine/repository/svn/revisions/5001">r5001</a>.<br />And I confirmed to run on my Japanese Windows Ruby 1.8 and Linux Ruby 1.8.</p>
<p>On Linux with <a class="issue tracker-2 status-5 priority-4 priority-default closed" title="Feature: Ruby 1.9 support (Closed)" href="https://www.redmine.org/issues/4050">#4050</a> <a href="http://www.redmine.org/attachments/5498/Ruby-1.9-Encoding.default_external.diff" class="external">Ruby-1.9-Encoding.default_external.diff</a> , I confirmed to run in ISO-8859-1 locale.</p>