mainSavannah Administration - Support: sr #108855, Website update not synchronizing...

 
 

sr #108855: Website update not synchronizing correctly. Project web pages not updated correctly.

Submitter:  Carlos O'Donell <codonell>
Submitted:  Fri 24 Jul 2015 05:19:50 PM UTC
   
 
Category:  Project webpages Priority:  5 - Normal
Severity:  5 - Blocker Status:  Done
Privacy:  Public Assigned to:  agn
Operating System:  GNU/Linux Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Jump to the original submission

Fri 19 Feb 2016 11:59:52 PM UTC, comment #9: 

Hi Carlos,

> Can we help fix the sync scripts?

Only the FSF sysadmins can actually change them.  No one else has access to www.gnu.org (or ftp.gnu.org or ...).
 

> What do they look like?

I believe, though I'm not sure, that the top-level script can be seen here:
fencepost.gnu.org:/srv/data/www-mirror/new-savannah-project/new.py

However, it seems to me that other things are doing the "real work" via some cron mechanism.  I don't know anything about what those are.

This directory (/src/data/www-mirrror) is a mirror of the actual www.gnu.org web directory.

> How are they triggered?

From Savannah's point of view, we (either in the code or by hand) invoke that new.py script over the web.  See the invocation at the end http://savannah.gnu.org/maintenance/HomepageUpload.  I presume it will not do anything unless invoked from a Savannah machine, but I have not tried it.

Best,
Karl



Karl Berry <karl>
Site Administrator
Fri 19 Feb 2016 05:56:50 AM UTC, comment #8: 

Can we help fix the sync scripts? What do they look like? How are they triggered?

Carlos O'Donell <codonell>
Sun 07 Feb 2016 12:34:25 AM UTC, comment #7: 

in the future, opening a new ticket is probably better, so carlos does not have see reports about other packages.

i retriggered the update (same as what assaf did for libc; for the record, curl http://www.gnu.org/new-savannah-project/new.py -s -F type=gnu -F project=texinfo) and the Command-Details page shows up for me now.  Let me know if others are still failing.

Evidently the web page sync mechanism is not up for dealing with large commits ... -k

Karl Berry <karl>
Site Administrator
Sat 06 Feb 2016 03:46:34 PM UTC, comment #6: 
Gavin D. Smith <gavin>
Mon 17 Aug 2015 04:42:42 AM UTC, comment #5: 

Hello,

I was able to trigger a web-pages refresh,
I hope this is fixed now (at least the problematic URL now shows the index of libc 2.22).

I'm closing this issue, but feel free to re-open if there are still problems.

regards,
 - assaf

Assaf Gordon <agn>
Site Administrator
Sat 15 Aug 2015 09:42:12 PM UTC, comment #4: 

yes, cvs commit of just index.html is what i was suggesting.

i can't report any facts about the scripts on the back end. the fsf sysadmins (sysadmin@fsf.org) supposedly maintain them.  they are the only ones with access to the scripts (and the servers).

good luck.

Karl Berry <karl>
Site Administrator
Sat 15 Aug 2015 04:41:33 AM UTC, comment #3: 

There is nothing error prone about removing the old set and adding the new set.

What is a "manual" upload of index.html? You commit it to CVS and the server kicks off a website update?

If the gnu.org website update process is not robust, then that's a distinct issue.

What do the scripts do?

Carlos O'Donell <codonell>
Fri 24 Jul 2015 09:44:20 PM UTC, comment #2: 

hi carlos - i suggest trying to do a manual upload of just index.html.  (the gnupload script in gnulib may simplify doing so, if need be.) perhaps the error message, if nothing else, may shed some light.

fwiw, removing everything and re-adding seems like a stressful and error-prone thing to do. especially when it requires fsf sysadmin time, always in short supply, to debug and fix anything about the www server.  that's why i didn't write the script to do it that way in the first place ...

best,
karl

Karl Berry <karl>
Site Administrator
Fri 24 Jul 2015 05:28:25 PM UTC, comment #1: 

Hello,

Technically, gnu savannah administrators do not have access to the web server at www.gnu.org.
But I will forward this to the GNU Webmasters and ask them to talk a look (and CC you).

regards,
 - assaf

Assaf Gordon <agn>
Site Administrator
Fri 24 Jul 2015 05:19:50 PM UTC, original submission:  

The glibc website update does not complete. This is a critical issue for glibc. We need our documentation online to be live and updated for our 2.22 release at the end of the month.

After the final commit that triggers the site update the html_node directory is still incomplete hours after the commit. The last test showed that after a full day the directory was still not synchronized.

See:
http://www.gnu.org/software/libc/manual/html_node/

There is no index.html, as there should be given the CVS layout here:
http://web.cvs.savannah.gnu.org/viewvc/libc/manual/html_node/?root=libc

The automation script we are using can be seen here:
http://web.cvs.savannah.gnu.org/viewvc/libc/manual/update-glibc-manual.sh?revision=1.6&root=libc&view=markup

There is nothing special about our automation except that it trigers a removal of all the site html and then 30 minutes later the addition of the generated new documents. The 30 minute delay was to test if perhaps gnu.org couldn't handle a delete followed by a new manual push in quick succession.

Please help!

Carlos O'Donell <codonell>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by gavin (Posted a comment)
  • -email is unavailable- added by karl (Posted a comment)
  • -email is unavailable- added by agn (Posted a comment)
  • -email is unavailable- added by codonell (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2015-08-17 agn StatusIn Progress Done
        Open/ClosedOpen Closed
    2015-07-24 agn StatusNone In Progress
        Assigned toNone agn

    Back to the top

    Powered by Savane 3.13-02a9.
    Corresponding source code