You are an unregistered user, you can register here
Navigation

Information

Site

Donations
If you wish to make a donation you can by clicking the image below.


BeyondUnreal News

 
Go Back   The Unreal Admins Page > Forums > Unreal Admins > Unreal Tournament > UT Server - General Chat

Reply
Thread Tools Display Modes
  #1  
Unread 12th April, 2013, 02:45 AM
ShaiHulud ShaiHulud is offline
Dominating
 
Join Date: Mar 2012
Posts: 157
Default Server redirect downloads issue - 1st attempt slow, 2nd fast

Hi -

So, having set up a new private redirect server an issue has arisen. When you connect, and must download a map or other resource, the download speed is appalling - the same as it would be if no redirect were in operation.

If you reconnect after this first connect attempt has begun, the download restarts at a much faster rate.

I think I've read something about this before, but I can't find any references now. Can someone explain why this is happening and suggest ways of working around it?

Thank you again in advance
Reply With Quote
  #2  
Unread 12th April, 2013, 07:12 AM
back4more's Avatar
back4more back4more is offline
Holy Shit!!
 
Join Date: Oct 2008
Location: NextDoor
Posts: 1,907
Default

your redirect is fine. you need to check all your files are on there. If your server is windows based then use rsc222a to check whats missing.

for linux there is also a script .. but I have forgotten what it is called. also.. you can find what files are not redirected through ucc.log.. look for sending... filename.uxx then compress and upload it.. one day i may get around to writing a new server setup tutorial.. seems the same questions arr being asked here over and over and over.

Last edited by back4more : 12th April, 2013 at 07:17 AM.
Reply With Quote
  #3  
Unread 12th April, 2013, 04:28 PM
ShaiHulud ShaiHulud is offline
Dominating
 
Join Date: Mar 2012
Posts: 157
Default

Thank you for your reply. Unfortunately I know this not to be so, I downloaded every file on the server to my PC, compressed each one, then uploaded them all to the redirect server. It took almost a week.

Every file on our UT server is mirrored by a corresponding .uz copy on the redirect server, so I know with absolute certainty that there are no missing files. I cannot explain the behaviour.

It's as if the web server is too slow to respond to client requests initially, but begins transmitting files in a more timely fashion on the second attempt.

It's very annoying.
Reply With Quote
  #4  
Unread 12th April, 2013, 06:13 PM
qwerty's Avatar
qwerty qwerty is offline
Holy Shit!!
 
Join Date: Jan 2006
Posts: 676
Default

I always turn allow downloads off, and make sure every file needed is on the redirect.
__________________
https://www.vulpinemission.com
ROCKET-X8 Server
MONSTERHUNT w/ NALI WEAPONS 3 + RX8
BUNNYTRACK NY
Reply With Quote
  #5  
Unread 12th April, 2013, 07:31 PM
~{kRiD}~'s Avatar
~{kRiD}~ ~{kRiD}~ is offline
Unstoppable
 
Join Date: Aug 2009
Posts: 185
Default

Qwerty is correct. When you set.allow downloads to false it forces all files to be redirected.
Reply With Quote
  #6  
Unread 12th April, 2013, 08:57 PM
ShaiHulud ShaiHulud is offline
Dominating
 
Join Date: Mar 2012
Posts: 157
Default

Thanks guys, I'll consider giving that a try.

The only reason I'm a bit dubious about whether this is at the root of the issue is that I was previously using ut-files.com as our redirect with AllowDownloads=True, and this problem never occurred.

I'm only switching away from ut-files.com because:

1) We have some maps that I've customised a bit which probably won't be of interest to a wider audience (I've removed pornographic images from several, creating "clean" versions of maps for example)

2) I encountered quite a few corrupt files on ut-files.com: I realise I could do my bit to help the community by reporting all of these. The thing is, I didn't note which files this applied to as I came across them, so it would be a major exercise to go back and do that, and I just don't have the time at present.

And updates to the file base there can take a while.

I mean no disrespect to skillz with that, it's an amazing resource that's been incredibly helpful to us, and my donation is still the most recent on the donation bar on the forum - so it's not that I don't care. I did try to report one in particular which was crashing clients whenever they tried to download it, but it wasn't changed (as far as I can tell - it's BT-LostSecrets.unr.uz incidentally - or it might be BT-LostSecrets_v1.unr.uz but it's something along those lines).

3) All of our maps are BT-* and not CTF-BT-*, and quite a lot of the maps on ut-files.com are CTF-BT-*. Again, I could upload all of the duplicates, but this would be quite a job with documenting them all on the forum too, and again, it's a time thing.

And a few other reasons, we have some files that are ONLY used on our server, so there'd be little point in taking up space there. OK, the latter part of this post was a complete tangent.
Reply With Quote
  #7  
Unread 13th April, 2013, 09:22 AM
2399Skillz 2399Skillz is offline
Super Moderator
 
Join Date: Jan 2004
Location: North Carolina
Posts: 2,241
Default

Uploading redirect files don't need to be documented or reported. They all go to the same place so its pointless. Other files do need to be, because its time consuming to check out each one. Speaking of time consuming, so is deleting files off the redirect. Maybe I might just give a couple people the login so they can maintain it.
__________________

UT-FILES.COM
Get your files
Reply With Quote
  #8  
Unread 13th April, 2013, 12:25 PM
back4more's Avatar
back4more back4more is offline
Holy Shit!!
 
Join Date: Oct 2008
Location: NextDoor
Posts: 1,907
Default

^ Does your File repository also have the ability to display , number of downloads etc Skills?
perhaps:

Quote:
AutoIndex already has a download counter built into it. You can enable it in the config by specifying a file name...
Perhaps one of the boys could go through and do some arranging etc.. be especially useful if there was a Screen-Shot facility esp for maps etc.. that could be integrated into it. Perhaps something like this ;
http://autoindex.sourceforge.net/for...pic.php?t=1388

as for ftp ..

perhaps something like this ;

http://www.finalwebsites.com/forums/...tp-file-upload

Last edited by back4more : 13th April, 2013 at 12:31 PM.
Reply With Quote
  #9  
Unread 13th April, 2013, 09:58 PM
2399Skillz 2399Skillz is offline
Super Moderator
 
Join Date: Jan 2004
Location: North Carolina
Posts: 2,241
Default

Yes it does, but it is buggy. Sometimes double entries will be entered into the text file it stores the information in, when this happens it breaks the site entirely. You have to go and manually delete the duplicate line before it will load again.

As for screen shots, it's time consuming. Do you want to go in and take screen shots of a few thousand maps, upload them to the server, assign them to the correct location? It would take many, many man hours to accomplish that. Anyone can do that with any number of sites, then use ut-files.com as a mirror if they can/wont want to handle the bandwidth that such a service will generate. Also that download you linked to, doesn't work. Additionally, ut-files was never intended to be a replacement for sites such as BeyondUnreal's NaliCity, SkinCity and the VoiceShrine. It's purpose is to be a mirror for such sites. Since sites like that no long exist, I simply made it a little easier to navigate the site with a navigation bar at the top.

No idea what any of this has to do with the redirect though.
__________________

UT-FILES.COM
Get your files

Last edited by 2399Skillz : 13th April, 2013 at 10:01 PM.
Reply With Quote
  #10  
Unread 14th April, 2013, 06:24 AM
back4more's Avatar
back4more back4more is offline
Holy Shit!!
 
Join Date: Oct 2008
Location: NextDoor
Posts: 1,907
Default

^ahh yep ok.

you are right , many man hours..

as for other bits 'n' pieces .. no big deal , good to have a repository

and soz for going off topic.. there are a 1001 queries here about redirect's and the issues therein.. can't figgure for the life of me why someone hasn't just hacked the native files to fix this problem already.

there are a number of competent ppl around who could do so.
Reply With Quote
  #11  
Unread 14th April, 2013, 09:07 AM
2399Skillz 2399Skillz is offline
Super Moderator
 
Join Date: Jan 2004
Location: North Carolina
Posts: 2,241
Default

The only thing I need to fix on the redirect is how the files are transferred from the FTP to the redirect directory. Right now I just have a cron job that runs every 5 minutes that transfers the files; however the problem with this is if the user is still uploading the file, then it will get transferred anyway, thus you end up with broken/corrupt files on the redirect.

I need to change the interval to something higher, but then people end up transferring the file over and over and over thinking it's broken. Bandwidth isn't free.

What I was working on, was checking the status of the file. If it's opened by another program (in this case the ftp) then it will skip the file and go to the next one. Sadly, I just have better things to spend my time on these days than to worry about it.
__________________

UT-FILES.COM
Get your files
Reply With Quote
  #12  
Unread 14th April, 2013, 11:40 AM
medor medor is offline
Holy Shit!!
 
Join Date: Nov 2006
Location: France
Posts: 1,818
Default

Quote:
Originally Posted by 2399Skillz View Post
The only thing I need to fix on the redirect is how the files are transferred from the FTP to the redirect directory. Right now I just have a cron job that runs every 5 minutes that transfers the files; however the problem with this is if the user is still uploading the file, then it will get transferred anyway, thus you end up with broken/corrupt files on the redirect.

I need to change the interval to something higher, but then people end up transferring the file over and over and over thinking it's broken. Bandwidth isn't free.

What I was working on, was checking the status of the file. If it's opened by another program (in this case the ftp) then it will skip the file and go to the next one. Sadly, I just have better things to spend my time on these days than to worry about it.

It's 3 time for me i upload big files on your uz service
my filezilla say the file is full upload but appear not full at check.
http://forums.ut-files.com/ctf-xc-sn...-uz-t2021.html
http://forums.ut-files.com/facepalmt-utx-uz-t2077.html

Quote:
that runs every 5 minutes
is it do the work during transfer files during my upload ?
__________________
Files for UT99 utfiles All new releases and updates are listed here All news
Most popular is UnrealTournament-V3 With over 14000 visits to date.It is an optimized UT99 to download.
Reply With Quote
  #13  
Unread 14th April, 2013, 08:00 PM
2399Skillz 2399Skillz is offline
Super Moderator
 
Join Date: Jan 2004
Location: North Carolina
Posts: 2,241
Default

I will get those files deleted in a minute, unless I forget.

Yes, it will transfer files in the middle of the download if it's still uploading after 5 minutes.
__________________

UT-FILES.COM
Get your files
Reply With Quote
  #14  
Unread 14th April, 2013, 08:06 PM
2399Skillz 2399Skillz is offline
Super Moderator
 
Join Date: Jan 2004
Location: North Carolina
Posts: 2,241
Default

Files removed.

I also edited the cronjob, transfers occur every hour, on the hour. So it's wise to not transfer files on or just before the hour.
__________________

UT-FILES.COM
Get your files
Reply With Quote
  #15  
Unread 14th April, 2013, 08:08 PM
medor medor is offline
Holy Shit!!
 
Join Date: Nov 2006
Location: France
Posts: 1,818
Default

THX
__________________
Files for UT99 utfiles All new releases and updates are listed here All news
Most popular is UnrealTournament-V3 With over 14000 visits to date.It is an optimized UT99 to download.
Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT +1. The time now is 05:48 PM.


 

All pages are copyright The Unreal Admins Page.
You may not copy any pages without our express permission.