Redmine

Redmine first loads the file into memory before beginning to send the file to the client, that probably explains what you are seeing.

Wow, is it possible some kind of streaming?

So is there anything I can do to speed up the process? Two minutes waiting is killing group members patient

I tried downloading a 40M file from File area and it respond really fast. So why is this just happened with svn?

I tried to turn off stream in "actionpack-2.3.14\lib\action_controller\streaming.rb" or increase the cache size. But it took the same 145946ms to respond. Please help me~

Ivan Cenov wrote:

Wow, is it possible some kind of streaming?

Not with the current implementation, I'm afraid.

Andy Sun wrote:

I tried to turn off stream in "actionpack-2.3.14libaction_controllerstreaming.rb" or increase the cache size. But it took the same 145946ms to respond. Please help me~

This is not a problem with ActionController, it does only the sending part, the reading part isn't streamed but waits for the whole file to be in memory before releasing it for sending.

Andy Sun wrote:

So is there anything I can do to speed up the process? Two minutes waiting is killing group members patient

Download the files from svn directly or from the web/dav-frontend provided by svn for apache.

Felix Schäfer wrote:

Andy Sun wrote:

I tried to turn off stream in "actionpack-2.3.14libaction_controllerstreaming.rb" or increase the cache size. But it took the same 145946ms to respond. Please help me~

This is not a problem with ActionController, it does only the sending part, the reading part isn't streamed but waits for the whole file to be in memory before releasing it for sending.

I tried using Filesystem in redmine 1.2.2, and it respond in no time after I clicked "download" button( Pop-up a menu asking if you want to download). Can the svn part be modified just like this?

Andy Sun wrote:

Can the svn part be modified just like this?

Probably, but it won't be easy as the response from the SCM shell-outs will have to be streamed to the client.

Felix Schäfer wrote:

Andy Sun wrote:

Can the svn part be modified just like this?

Probably, but it won't be easy as the response from the SCM shell-outs will have to be streamed to the client.

I really like the Redmine way to handle SVN. If this slowness can't be fixed, probably I have to find another SVN web server to handle repositories viewings. But the apache itself is so simple...

Andy Sun wrote:

Felix Schäfer wrote:

Andy Sun wrote:

Can the svn part be modified just like this?

Probably, but it won't be easy as the response from the SCM shell-outs will have to be streamed to the client.

I really like the Redmine way to handle SVN. If this slowness can't be fixed, probably I have to find another SVN web server to handle repositories viewings. But the apache itself is so simple...

What is your system? If it is Windows you may use TortoiseSVN for interacting with SVN repositories. Try to download the same file by the command-line client svn (svn.exe) and compare the speeds. This could give some hint about the issue.

My OS is win7 x64. I tried using apache weblink to download the same file and it respond in no time. Sorry I'm not familiar with svn command line. But is the apache using the same command as redmine do? What's the command for svn to download a given file?

The command for downloading a file -- without making a work copy:

svn export path_to_file [local file name] --username ARG -- password ARG

Ivan Cenov wrote:

The command for downloading a file -- without making a work copy:
[...]
I don't know if Redmine uses this command to do the download operation.

I used the command you mentioned. My test doc-0.8.24.doc file is 42.4MB.If I just use "svn export file:///E:/test/doc-0.8.24.doc" it finished in a blink. If I use "svn export file:///E:/test/doc-0.8.24.doc E:/2" it showed in 2 second with an error saying

svn: can't move “E:svn-F90B340C” to “E:\2”: access denied.

And I got a 42.4MB file "svn-F90B340C" in my E:/ .
I mean, it seems the command line works fine (quickly). How dose redmine handle the same quest?

Andy Sun wrote:

Ivan Cenov wrote:

The command for downloading a file -- without making a work copy:
[...]
I don't know if Redmine uses this command to do the download operation.

I used the command you mentioned. My test doc-0.8.24.doc file is 42.4MB.If I just use "svn export file:///E:/test/doc-0.8.24.doc" it finished in a blink. If I use "svn export file:///E:/test/doc-0.8.24.doc E:/2" it showed in 2 second with an error saying

svn: can't move “E:svn-F90B340C” to “E:”: access denied.

And I got a 42.4MB file "svn-F90B340C" in my E:/ .
I mean, it seems the command line works fine (quickly). How dose redmine handle the same quest?

I'm sorry, I don't know how Redmine deals with downloading files from SVN. May be the implementation is in redmine\lib\redmine\scm\adapters\subversion_adapter.rb but I am not sure. Someone involved in writing the Redmine core could help.

Ivan

Andy Sun wrote:

I used the command you mentioned. My test doc-0.8.24.doc file is 42.4MB.If I just use "svn export file:///E:/test/doc-0.8.24.doc" it finished in a blink. If I use "svn export file:///E:/test/doc-0.8.24.doc E:/2" it showed in 2 second with an error saying

svn: can't move “E:svn-F90B340C” to “E:”: access denied.

What if you try the following instead:

svn export file:///E:/test/doc-0.8.24.doc E:/2/doc-0.8.24.doc (I assume that '2' is a folder.).

Ivan Cenov wrote:

Andy Sun wrote:

Ivan Cenov wrote:

The command for downloading a file -- without making a work copy:
[...]
I don't know if Redmine uses this command to do the download operation.

I used the command you mentioned. My test doc-0.8.24.doc file is 42.4MB.If I just use "svn export file:///E:/test/doc-0.8.24.doc" it finished in a blink. If I use "svn export file:///E:/test/doc-0.8.24.doc E:/2" it showed in 2 second with an error saying

svn: can't move “E:svn-F90B340C” to “E:”: access denied.

And I got a 42.4MB file "svn-F90B340C" in my E:/ .
I mean, it seems the command line works fine (quickly). How dose redmine handle the same quest?

I'm sorry, I don't know how Redmine deals with downloading files from SVN. May be the implementation is in *redminelib

edminescmadapterssubversion_adapter.rb* but I am not sure. Someone involved in writing the Redmine core could help.

Ivan

Thank you~ I'll try to look at the file. By the way, have you encountered the same problem in your redmine with any big files? Or changing the OS to linux will solve the problem?

Is Jean-Philippe Lang working on the subversion_adapter.rb? I can't find any way to contact him...

Just for information, I can't reproduce your problem: I have a subversion repository with a 210MB file and it just take 2 seconds for the download to start (from redmine with https protocol)...
My subversion repository is hosted on the redmine server and I'm using an url like 'file:///folder/of/my/repository' in the repository tab (in my project settings). Is it the same for you ???

We have the same settings. (eg. redmine and subersion installed on the same server, using file protocol).
What is your OS exactly? My server is win server 2008 R2, subversion 1.6.17, redmine 1.2.1(tried 1.2.2 and it's the same). Maybe it is because of the OS?

I always got the spam error so I use another account post this

We have the same settings. (eg. redmine and subersion installed on the same server, using file protocol).

What is your OS exactly? My server is win server 2008 R2, subversion 1.6.17, redmine 1.2.1(tried 1.2.2 and it's the same). Maybe it is because of the OS?

My server has 8 cores, 16 GB of RAM, and I installed Linux CentOS x86_64, with subversion 1.6.16 and redmine 1.2.1

Arnaud Martel wrote:

My server has 8 cores, 16 GB of RAM, and I installed Linux CentOS x86_64, with subversion 1.6.16 and redmine 1.2.1

I tried downloading 140M files on Linux Ubuntu, and it took 8s to start downloading. My server is not as powerful as yours. But it's still faster than working under Windows.

So I think it is because of Windows. Thank you Arnaud. Maybe before this is solved, I'll turn to Linux server.