bugPSPP - Bugs: bug #61078, Import of LibreCalc sheets with...

 
 

bug #61078: Import of LibreCalc sheets with repeating data incorrect

Submitter:  elias tsolis <estatistics>
Submitted:  Tue 24 Aug 2021 05:28:16 PM UTC
   
 
Category:  Other Severity:  5 - Average
Status:  Fixed Assigned to:  None
Open/Closed:  Closed Release:  None
Effort:  0.00
* Mandatory Fields

Add a New Comment Rich Markup
   

Jump to the original submission

Sat 28 Aug 2021 07:12:40 AM UTC, comment #7: 

I have pushed a fix for this.

John Darrington <jmd>
Group administrator
Thu 26 Aug 2021 05:24:15 AM UTC, comment #6: 

This particular issue seems to occur when a row has repeated data.

I have changed the title of this bug accordingly.

The other issues are most probably unrelated, so please isolate the problems as clearly as you can, and open new bug reports for them if appropriate.

John Darrington <jmd>
Group administrator
Wed 25 Aug 2021 01:09:21 PM UTC, comment #5: 

I made a much shorter data file.

Use to import ODS file from PSPP syntax:

GET DATA /TYPE=ODS
   /FILE="/data_sample2.ods"
   /SHEET=INDEX 1
   /CELLRANGE=FULL
   /READNAMES=on.
  


1) Vars s4 and s9 -first values- imported as empty which is not. Not checked other.

2) S4 and S9 are imported as string. No obvious reason.





GNU pspp 1.5.2-g8d41c0

Version: 7.3.0.0.alpha0+ / LibreOffice Community
Build ID: ac0db5736a53a4887cebbacc59026cecb7c44c66
CPU threads: 4; OS: Linux 5.4; UI render: default; VCL: kf5 (cairo+xcb)
Locale: el-GR (el_GR.UTF-8); UI: en-US
TinderBox: Linux-rpm_deb-x86_64@86-TDF, Branch:master, Time: 2021-08-08_02:51:24
Calc: threaded



(file #51815)

elias tsolis <estatistics>
Wed 25 Aug 2021 12:53:10 PM UTC, comment #4: 

Hello Elias,

Thanks for the information. 

It is not a question of proof, but rather providing enough (but not too much!) information to make an assessment of the issue. 

There are several things to consider here (in no particular order):

  • Please report one issue per bug.  Cut-and-paste is unlikely to be related to data import.  Similarly if pasting using the keyboard works, but using the mouse does not, then this suggests that the problem is simply with a mouse callback.  Please report it as such.


  • Please cut down your test cases to the minimum necessary to reproduce the issue.  Your data_sample.ods file is fairly large.


  • If possible generate a test case that can be demonstrated without using the GUI.


  • As always, please say which version of pspp and which OS you are using.



I had a look at your data_sample.ods file and there is (at least) one reason why some data might be imported as strings instead of numeric:  If you look at cell E4, it contains a single upper case 'O' (not a zero).  This will obviously cause data to be imported as string.  There is a similar issue in cell AT114.

One must also bear in mind that importing numeric data is to some extent an AI exercise.  The computer must guess what the person who typed the data meant.  It cannot always get this 100% right.  If you can make some concrete suggestions how to improve the algorithm, then we can consider them.




John Darrington <jmd>
Group administrator
Wed 25 Aug 2021 12:01:36 PM UTC, comment #3: 

Check copy paste here! https://streamable.com/45daxi

1) It is impossible to paste from menu using mouse.
2) I can copy / paste using the shortcut: Ctrl + V
3) When I copy / paste from ods files, empty cells appear.
4) When I copy / Paste from csv files, data are pasted very normally.

If you require further proofs, please tell me what to do.
This behavior existed in many previous PSPP versions.


sincerely,
Elias Tsolis
Statistican

elias tsolis <estatistics>
Wed 25 Aug 2021 11:51:08 AM UTC, comment #2: 

comment #1:

> So far as I can see, there is no bug here.


I uploaded video whcih showing the buggy parts of importing ods files...
A second video will show the buggy copy paste. 

1) Nonmissing values are passed as missing values.
2) PSPP is in greek, but you can see easily, (mouse pointer) which vars were passed as "strings" (the big name), while all these vars either are integers or contain "empty cells".
-- Believe me, I experimented a lot (empty cells as ".",, saving file as CSV in order to be sure "no weird characters exist or formats, etc.

Nothing worked!

Please check it!

https://streamable.com/2swo8d






elias tsolis <estatistics>
Tue 24 Aug 2021 06:06:22 PM UTC, comment #1: 

So far as I can see, there is no bug here.

Some of your cells contain non-numeric data, so they will be imported as strings.

The cut-and-paste issue I don't see.  It works okay for me.

John Darrington <jmd>
Group administrator
Tue 24 Aug 2021 05:28:16 PM UTC, original submission:  

Copy paste of data from Libre Calc to PSPP impossible

1) Import of ods file from pspp is buggy - data are imported very wrongly
2) I tried to copy data from libre calc ods file to pspp through copy/paste. - Very buggy too.

See ods file in attachment:

Try:
@ To import this file into PSPP
   - Check that not all fields goes to numerical / some goes into strings
   - Some decimals goes into "2" and others into "0" without a clear logic.

@ To Copy paste data into PSPP
   - Impossible - they are copied with empty cells

sincerely,
Elias Tsolis
Statistician

elias tsolis <estatistics>

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #51815:  data_sample2.ods added by estatistics (22KiB - application/vnd.oasis.opendocument.spreadsheet - shorter data file)
file #51813:  data_sample.ods added by estatistics (42KiB - application/vnd.oasis.opendocument.spreadsheet - data in libre calc ods format)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by jmd (Posted a comment)
  • -email is unavailable- added by estatistics (Submitted the item)
  • -email is unavailable- added by estatistics
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 9 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2021-08-28 jmd StatusConfirmed Fixed
        Open/ClosedOpen Closed
    2021-08-26 jmd CategoryGraphical User Interface Other
        StatusCannot Reproduce Confirmed
        SummaryCopy paste of data from Libre Calc to PSPP impossible Import of LibreCalc sheets with repeating data incorrect
    2021-08-25 estatistics Attached File- Added data_sample2.ods, #51815
    2021-08-24 jmd StatusNone Cannot Reproduce
    2021-08-24 estatistics Attached File- Added data_sample.ods, #51813
        Carbon-Copy- Added -email is unavailable-

    Back to the top

    Powered by Savane 3.13-4b48.
    Corresponding source code