bugVarnamproject - Bugs: bug #40714, [libvarnam] Update patterns...

 
 

bug #40714: [libvarnam] Update patterns content and see if WITHOUT_ROWID is helpful

Submitter:  Navaneeth <navaneethkn>
Submitted:  Wed 27 Nov 2013 05:20:42 AM UTC
   
 
Category:  libvarnam Severity:  3 - Normal
Item Group:  * Bug Status:  In Progress
Privacy:  Public Assigned to:  None
Open/Closed:  Open
* Mandatory Fields

Add a New Comment Rich Markup
   

Sat 22 Mar 2014 08:42:57 AM UTC, comment #2: 

Learning time has decreased by a minute, and there is no change in the query plan. Results attached (time_analysis.txt)

(file #30999)

Kevin Martin Jose <lonesword>
Thu 20 Mar 2014 08:22:43 PM UTC, comment #1: 

I have used sqlite_analyzer on ml.vst.learnings before and after using 'without rowid' on patterns_content. There is a significant improvement in storage size. The db used to be about 500 mb after learning the word corpus. 'without rowid' shrinked it to 294mb! See the attachments. withoutrowid.txt specifies the stats after using 'without rowid' on patterns_content.

(file #30975, file #30976)

Kevin Martin Jose <lonesword>
Wed 27 Nov 2013 05:20:42 AM UTC, original submission:  

Recent version of SQLIte introduced WITHOUT_ROW_ID tables which can improve the storage size and query speed. Try this will patterns_content table and see if it leads to improved query plan.

Navaneeth <navaneethkn>
Group administrator

 

(Note: upload size limit is set to 16384 kB, after insertion of the required escape characters.)

Attach Files:
   
   
Comment:
   

Attached Files
file #30999:  time_analysis added by lonesword (431B - application/octet-stream)
file #30975:  withoutrowid.txt added by lonesword (20KiB - text/plain)
file #30976:  withrowid.txt added by lonesword (26KiB - text/plain)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -email is unavailable- added by lonesword (Updated the item)
  • -email is unavailable- added by navaneethkn (Submitted the item)
  •  

    There are 0 votes so far. Votes easily highlight which items people would like to see resolved in priority, independently of the priority of the item set by tracker managers.

    Only logged-in users can vote.

     

    Follow 4 latest changes.

    Date Changed by Updated Field Previous Value => Replaced by
    2014-05-31 navaneethkn StatusNone In Progress
    2014-03-22 lonesword Attached File- Added time_analysis, #30999
    2014-03-20 lonesword Attached File- Added withoutrowid.txt, #30975
        Attached File- Added withrowid.txt, #30976

    Back to the top

    Powered by Savane 3.13-f8d8.
    Corresponding source code