Redmine

I successfully installed Redmine, I specified the hostname like myserver:12321 in the settings and it works.

But when I get e-mail notifications, I cannot follow the links in them, because they look like this: myserver/issues/43 but they should look like this: myserver:12321/issues/43 - so everithing after colon and colon itself disappeared, like it was escaped or something.

Why is this? What should I do to make links in e-mail notifications be correct?

Environment:
Redmine version 3.0.0.stable
Ruby version 2.0.0-p594 (2014-10-27) [i386-mingw32]
Rails version 4.2.0
Environment production
Database adapter Mysql2