bugGNU Parallel - Bugs: bug #53706, CSV for input

 
 

bug #53706: CSV for input

Submitter:  None
Submitted:  Fri 20 Apr 2018 07:49:11 AM UTC
   
 
Category:  None Severity:  3 - Normal
Item Group:  None Status:  Fixed
Privacy:  Public Assigned to:  tange
Open/Closed:  Closed
* Mandatory Fields

Add a New Comment Rich Markup
   

Sun 06 Nov 2022 09:26:43 PM UTC, comment #3: 

Fixed in parallel-20180422

Ole Tange <tange>
Group administrator
Sun 22 Apr 2018 08:39:50 AM UTC, comment #2: 

It is impossible to split correctly without reading every line, if we allow newlines:

a,b,c
a,"
a,b,c
",c

Here a,b,c is first a full record and then substring of a single field.

Thus --pipe-part cannot be guaranteed to work reliably.

But it ought to be doable with --pipe.

Ole Tange <tange>
Group administrator
Fri 20 Apr 2018 08:35:23 AM UTC, comment #1: 

Parsing:

^ = start of record

if uneven number of " (y/"/"/) => quoted newline. Read lines until hitting an uneven number of ".

--pipe-part: Warning if quoted args (y/"/"/ > 0). Error if quoted newline (y/"/"/ odd).

Anonymous
Fri 20 Apr 2018 07:49:11 AM UTC, original submission:  

https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf

If input is CSV, it should be unquoted. Can we deal correctly with quoted newlines?

Maybe --csv. If the file has quoted \n then --pipepart may fail.

Anonymous

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by tange (Posted a comment)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2022-11-06 tange StatusIn Progress Fixed
        Open/ClosedOpen Closed
    2018-04-22 tange StatusNone In Progress
        Assigned toNone tange

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code