#3979 BLOC Trial-3: Datastore performance sucks

[Zarro Boogs per Child]

#3979: Datastore performance sucks
------------------------+---------------------------------------------------
  Reporter:  marco      |       Owner:  bcsaller
      Type:  defect     |      Status:  new     
  Priority:  blocker    |   Milestone:  Trial-3 
 Component:  datastore  |     Version:          
Resolution:             |    Keywords:  relnote 
  Verified:  0          |  
------------------------+---------------------------------------------------

Comment(by tomeu):

 For Trial-3 we have decided to leave previews out, as couldn't get the
 minimum acceptable performance without too invasive changes.

 These are the current numbers _without previews_:

 {{{
 Creating 50 documents
 Created 50 documents in 2.19909501076 seconds. 22.7366256371/sec
 Indexing
 Indexed 50 documents in 0.00445795059204 seconds. 11215.9161408/sec
 Find returned 50/50 elements in 0.385206 seconds.
 Find returned 50/50 elements in 0.359663 seconds.
 Creating 50 documents
 Created 50 documents in 2.08947587013 seconds. 23.9294459987/sec
 Indexing
 Indexed 50 documents in 0.00374507904053 seconds. 13350.8530685/sec
 Find returned 80/100 elements in 0.597350 seconds.
 Find returned 80/100 elements in 0.568118 seconds.
 Creating 50 documents
 Created 50 documents in 2.60336399078 seconds. 19.2059197934/sec
 Indexing
 Indexed 50 documents in 0.00384616851807 seconds. 12999.9504091/sec
 Find returned 80/150 elements in 0.639023 seconds.
 Find returned 80/150 elements in 0.587031 seconds.
 Creating 50 documents
 Created 50 documents in 2.07784891129 seconds. 24.0633473052/sec
 Indexing
 Indexed 50 documents in 0.00375509262085 seconds. 13315.2507937/sec
 Find returned 80/200 elements in 0.620397 seconds.
 Find returned 80/200 elements in 0.590173 seconds.
 Creating 50 documents
 Created 50 documents in 2.07887887955 seconds. 24.0514252619/sec
 Indexing
 Indexed 50 documents in 0.00447201728821 seconds. 11180.6365624/sec
 Find returned 80/250 elements in 0.615477 seconds.
 Find returned 80/250 elements in 0.592026 seconds.
 Creating 50 documents
 Created 50 documents in 2.6480910778 seconds. 18.8815257976/sec
 Indexing
 Indexed 50 documents in 0.00385499000549 seconds. 12970.2022389/sec
 Find returned 80/300 elements in 0.638184 seconds.
 Find returned 80/300 elements in 0.613425 seconds.
 Creating 50 documents
 Created 50 documents in 2.08416390419 seconds. 23.9904356368/sec
 Indexing
 Indexed 50 documents in 0.0037989616394 seconds. 13161.491151/sec
 Find returned 80/350 elements in 0.651770 seconds.
 Find returned 80/350 elements in 0.614675 seconds.
 Creating 50 documents
 Created 50 documents in 2.9880490303 seconds. 16.7333264926/sec
 Indexing
 Indexed 50 documents in 0.00390815734863 seconds. 12793.7530503/sec
 Find returned 80/400 elements in 0.664905 seconds.
 Find returned 80/400 elements in 0.634965 seconds.
 Creating 50 documents
 Created 50 documents in 2.14043402672 seconds. 23.3597482454/sec
 Indexing
 Indexed 50 documents in 0.00482106208801 seconds. 10371.1586964/sec
 Find returned 80/450 elements in 0.667942 seconds.
 Find returned 80/450 elements in 0.635852 seconds.
 Creating 50 documents
 Created 50 documents in 2.07025098801 seconds. 24.1516609772/sec
 Indexing
 Indexed 50 documents in 0.00453209877014 seconds. 11032.4162239/sec
 Find returned 80/500 elements in 0.671125 seconds.
 Find returned 80/500 elements in 0.643577 seconds.
 Creating 50 documents
 Created 50 documents in 2.82645606995 seconds. 17.689997213/sec
 Indexing
 Indexed 50 documents in 0.00406408309937 seconds. 12302.8980406/sec
 Find returned 80/550 elements in 0.685097 seconds.
 Find returned 80/550 elements in 0.673142 seconds.
 Creating 50 documents
 Created 50 documents in 2.08129715919 seconds. 24.0234796743/sec
 Indexing
 Indexed 50 documents in 0.00381398200989 seconds. 13109.6580609/sec
 Find returned 80/600 elements in 0.689869 seconds.
 Find returned 80/600 elements in 0.661342 seconds.
 Creating 50 documents
 Created 50 documents in 3.08161497116 seconds. 16.2252586608/sec
 Indexing
 Indexed 50 documents in 0.00398302078247 seconds. 12553.2862445/sec
 Find returned 80/650 elements in 0.757101 seconds.
 Find returned 80/650 elements in 0.680977 seconds.
 Creating 50 documents
 Created 50 documents in 2.14672923088 seconds. 23.2912466466/sec
 Indexing
 Indexed 50 documents in 0.00384116172791 seconds. 13016.8952889/sec
 Find returned 80/700 elements in 0.705996 seconds.
 Find returned 80/700 elements in 0.683404 seconds.
 Creating 50 documents
 Created 50 documents in 2.13749694824 seconds. 23.3918462626/sec
 Indexing
 Indexed 50 documents in 0.00375008583069 seconds. 13333.0281645/sec
 Find returned 80/750 elements in 0.719826 seconds.
 Find returned 80/750 elements in 0.730185 seconds.
 Creating 50 documents
 Created 50 documents in 3.08673906326 seconds. 16.1983241781/sec
 Indexing
 Indexed 50 documents in 0.00375604629517 seconds. 13311.8700013/sec
 Find returned 80/800 elements in 0.728543 seconds.
 Find returned 80/800 elements in 0.705755 seconds.
 Creating 50 documents
 Created 50 documents in 2.12505698204 seconds. 23.5287808386/sec
 Indexing
 Indexed 50 documents in 0.00407099723816 seconds. 12282.0029283/sec
 Find returned 80/850 elements in 0.733574 seconds.
 Find returned 80/850 elements in 0.757373 seconds.
 Creating 50 documents
 Created 50 documents in 3.00387310982 seconds. 16.6451771337/sec
 Indexing
 Indexed 50 documents in 0.00410103797913 seconds. 12192.0353468/sec
 Find returned 80/900 elements in 0.796959 seconds.
 Find returned 80/900 elements in 0.726484 seconds.
 Creating 50 documents
 Created 50 documents in 2.14579796791 seconds. 23.3013549028/sec
 Indexing
 Indexed 50 documents in 0.00412011146545 seconds. 12135.594005/sec
 Find returned 80/950 elements in 0.804931 seconds.
 Find returned 80/950 elements in 0.726351 seconds.
 Creating 50 documents
 Created 50 documents in 2.1237449646 seconds. 23.5433165627/sec
 Indexing
 Indexed 50 documents in 0.00426697731018 seconds. 11717.8968542/sec
 Find returned 80/1000 elements in 0.756288 seconds.
 Find returned 80/1000 elements in 0.730593 seconds.
 }}}

 We are still far from the goal stated at the ticket description, but we
 are certainly making good progresses.

-- 
Ticket URL: <https://dev.laptop.org/ticket/3979#comment:14>
One Laptop Per Child <https://dev.laptop.org>
OLPC bug tracking system