bugGNU Wget - Bugs: bug #49226, Add possibility to append to...

 
 

bug #49226: Add possibility to append to existing WARC file

Submitted by:  None
Submitted on:  Thu 29 Sep 2016 07:40:36 PM UTC  
 
Category: Feature RequestSeverity: 3 - Normal
Priority: 5 - NormalStatus: None
Privacy: PublicAssigned to: None
Originator Name: sirexOriginator Email: -unavailable-
Open/Closed: OpenRelease: None
Operating System: NoneReproducibility: None
Fixed Release: NonePlanned Release: None
Regression: NoneWork Required: None
Patch Included: None

Add a New Comment(Rich Markup)
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Mon 19 Dec 2016 09:44:05 PM UTC, comment #1:

I'm new to the wget community, and I'm starting to contribute and would like to work on this bug, so here are a few things I understand -

As of I can see in warc_start_new_file(bool meta) function in warc.c,

--> existing warc_current_file is closed.

--> warc_current_file_number is incremented.

--> a NEW warc file (with wb+ rights) is created to which warcinfo_record is added with all the headers and other relevant things.

Instead of this, (Possible solutio?)

--> open the warc_current_file with a rights ( append ) ?

--> OR just don't close it, and keep the file pointer ?

My doubt is I think there will be multiple WARC files, each of them having headers and other stuff same except the metadata.

Will it actually get overwritten? That's why the above function is there right? ( to open a NEW file, not to overwrite it? )

Thank you so much for your patience!
Vijeth

Vijeth Aradhya <varadhya>
Thu 29 Sep 2016 07:40:36 PM UTC, original submission:

Currently wget always overwrites WARC file even if one already exists.

It would be great if wget could append to existing WARC file instead of overwriting it.

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by varadhya (Posted a comment)
  • -unavailable- added by None (Submitted the item)
  •  

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    No Changes Have Been Made to This Item

    Back to the top


    Powered by Savane 3.1-cleanup1