helpSavannah Administration - Support: sr #109544, Intermittent 502 Bad Gateway from...

 
 

sr #109544: Intermittent 502 Bad Gateway from gitweb resource

Submitted by:  None
Submitted on:  Tue 21 Aug 2018 07:41:14 PM UTC  
 
Category:  Source code repositories - anonymous access Priority:  5 - Normal
Severity:  3 - Normal Status:  None
Assigned to:  None Originator Email:  -email is unavailable-
Operating System:  None Open/Closed:  Open

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Sat 25 Aug 2018 09:30:47 PM UTC, comment #1:

For about a week there starting around the 14th and continuing through the 19th we were experiencing about a 10,000 botnet DDOS attacking the vcs system browsing every web accessible URL. This has caused a big stress on the system. Lots of cpu use, lots of data bandwidth consumed, but mostly lots of processes queued. Users have made reports of timeouts and 502 Bad Gateway proxy failures and other brown-outs while browsing the web or checking out project source. No hard failures. Retrying the action would usually work. But also the failure would occur again too.

Unfortunately mitigating against a large botnet attacker with a large collection of systems to do the attack is quite difficult. Even very large and well funded sites have been brought down by these attacks. For us on the community funded FSF hosted Savannah these can be overpowering and there isn't much we can do about it. We took what mitigations we could.

The current attack subsided around the 19th. For the moment everything seems to be normal. Let's hope that continues.

Are you subscribed to the savannah-users mailing list? Please consider subscribing to it. It is low traffic volume.

Bob Proulx <rwp>
Site Administrator
Tue 21 Aug 2018 07:41:14 PM UTC, original submission:

We run a matrix build on Travis CI (https://travis-ci.org/GlobalArrays/ga) that downloads the config.sub and config.guess resources via wget.

For example:

wget -O config.guess 'http://git.savannah.gnu.org/gitweb/?p=config.git;a=blob_plain;f=config.guess;hb=HEAD'

We're getting intermittent 502 Bad Gateway HTTP codes that cause our builds to fail.

I'm trying to find out if you may have a suggestion on a better & more reliable way to download these resources?

Since the build periodically passes and fails without changing the scripts, I suspect our build combined with the rest of the requests your servers receive is overloading the system? This is just a guess, so there may be a better explanation.

Thanks for the help!

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by rwp (Posted a comment)
  • -email is unavailable- added by rwp
  •  

    Do you think this task is very important?
    If so, you can add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

     

     

    Follows 1 latest change.

    Date Changed by Updated Field Previous Value => Replaced by
    2018-08-25 rwp Carbon-Copy- => Added -email is unavailable-

    Back to the top


    Powered by Savane 3.3