[sword-devel] clucene indexing time issue

Костя Маслюк kostyamaslyuk at gmail.com
Thu Aug 15 04:43:18 MST 2013


If it is just compatibility issue, then i need to just ifdef it in Mini
code (it been not synced since initial commit in April 2011 indeed).


I did not found such setup for clucene writer in Sword code, so i suppose
that Sword based frontends have more slow index building than it could be,
at least for mobile devices.

Blessings.


2013/8/14 Greg Hellings <greg.hellings �� gmail.com>

> And here's the documentation for the method
>
>
> http://lucenenet.apache.org/docs/2.9.4/html/3b1c494d-9376-8fe5-9582-dd09f22a7584.htm
>
>
> On Wed, Aug 14, 2013 at 12:20 PM, Jaak Ristioja <jaak �� ristioja.ee> wrote:
>
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Hi!
>>
>> The line was removed in 2011 by commit 3e7c91:
>>
>>   commit 3e7c91810726ca5632371410f587ee05a3b5364a
>>   Author: Gregory Hellings <greg.hellings �� gmail.com>
>>   Date:   Sun Oct 23 13:17:51 2011 -0500
>>
>>       Compatibility with CLucene 2.
>>
>>       Patch adapted from Jonathan Dieter and Deji Akingunola.
>>       Supports both CLucene 2 and CLucene 0.
>>
>> Maybe they can help you.
>>
>> Blessings,
>> Jaak
>>
>> On 14.08.2013 17:04, Костя Маслюк wrote:
>> > Post it here because PocketSword team potentially would be
>> > interested too.
>> >
>> > Some time ago i got strange issue when indexing time in BibleTime
>> > Mini increased from 9 minutes to several hours. Investigating this
>> > i found that one line been removed from BibleTime code, it have
>> > following setup for clucene writer:
>> >
>> > // Always create a new index: typedef lucene::index::IndexWriter
>> > IW; QSharedPointer<IW> writer(new IW(index.toLatin1().constData(),
>> > &an, true));
>> > writer->setMaxFieldLength(BT_MAX_LUCENE_FIELD_LENGTH);
>> > writer->setUseCompoundFile(true); // Merge segments into a single
>> > file
>> >
>> > and following line was removed, when i restored it, index building
>> > time returned to 9 minutes on all mobile targets:
>> > writer->setMinMergeDocs(1000);
>> >
>> > Let me know if this removal was related with any bugfix.
>> >
>> >
>> > _______________________________________________ sword-devel mailing
>> > list: sword-devel �� crosswire.org
>> > http://www.crosswire.org/mailman/listinfo/sword-devel Instructions
>> > to unsubscribe/change your settings at above page
>> >
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v2.0.20 (GNU/Linux)
>>
>> iQgcBAEBAgAGBQJSC7xlAAoJEEqsYmEt1rCO4R4//2IXO2JZEsSyJ1OAbFG5hFaJ
>> Jr48Lflatot58+GLnv+3dIg4bcZl9ZsxPoAHLMJesCcL88It+yZaxspXKRTZQ32I
>> NNYi35KtrPnYxgEKd4rdcLrP9PV5QOO+5nACfLNJ+sVtqgL9nEWzWtN0ve6hfQRg
>> OdUf0V8gwpvnapwIv5gHRN9lPcDM+PjgFIWRafvUe4zmfO8LppiuiSpoUGZiJuou
>> tB2QM6anzPvno/4trlErZ5xie5BJxtQqjShpSbCS4VloTNlenDmYw0tGf7PL/DgT
>> laOMJ99hqdsY3klnJm7afGE9qGsvS7vT4fU7Sn8u5VrJybHTUVYqzGX/+ubAta0p
>> 1xIZ+MK8rTxLpbsZzLJXU0oEfHiRQCqP0x7xZGWPmIlYKq50PtldThXEWe/QIEQJ
>> TMfKdJoaa6LX8otkyoMudG5fifO3E9EtRp65k55vJuFC952ldla3cogH6SrS0Gcr
>> pD1vJHAus9/yD1xF/TYqiis6YyYx/yVjmh6PAFCu42QPGpBv0v2P//Q48E9ytw+s
>> UBUPZncxLoodjMVh6+ULxrUMuAv2pqXCb840xbw8XVBkrEGGyICPw/mhVq7PgH4t
>> KlW3J8cRB9d14g4vZsI+/J7pjqz6PeVphLlJXGhJr9bIcIVhC3TeMqItdNlmfFzR
>> ubrha8SNjNfAp+JVjtdmt68JnG748ixMBwfVbHbH+PMCF0nC/G4AeQBEfGdkgIfc
>> YXkAKf5fF/znETR1aWQpmC/xqSTrB81VWP7n+DC6IqQuSMbBud457IykPulMNDjV
>> W3kWTbVXFLDrZrJr7eaXXop+34cNH5gIw8sYUTrMA0lAUkfTBAPJ/RQWUr17toFy
>> On/9wLUvKJhlUqmcJ/ULZgeeBSR6whVozaKQI8Xt3iSoya0cjXWmzKge64A9rvUD
>> 8+SftlVm3ArJ2jhDqqdnK2iGXlQqSkiF6U1eHh//vXIPw1GVrPS0yM4tsDD3dEhg
>> 1yNjiCt4Fqc/o0Wb1Ht2aAlAOye2tCtCMd2KCu2aTaue2NZc1PUH2fGSslC3csk5
>> or3w9IE9fiH5Dmxrh9ei/FY6HaeZQIVXrkgD4topG8kEO32me5Vn1SRnzaqaKTxC
>> yzF/CPKHcDgDl6cjZ7BAbPcquP87tNbPUKsBBLrDKfKgb8JOqd+/DTxYzc3lFTmp
>> pnhDwl6jN3omRmQwUsndCq4ujyXqbYTbI+47/wiPd5/lPi0dtzzOsIDVPqLzVuwJ
>> Lbt5cJSDeL7TlCxUHDSpLJPrDGEZ9+Ljf8ubdGdpnewZHUIeY4H6c781Zuv+xDHS
>> Lz5ird6CnH6JRhHvNExRJxf+kV7XIvi62O/ma44DoqA6cTXgZTrOhpmSTD1+gsSn
>> j6hknIrsXMXyGJaw0FKKa0zcI9NSC4wlzWVBnlelwlas7tzIxEAeJbiO19SFQjs6
>> r+ndkRbQwl/d5gHnY70Thc4gFhx/n1EejkG8vrlWDUILJrndzMMIIaT/9c/nsN3A
>> /V7XMSdfaKSNkzZVBQFEmVl1Xa0XS/vsMgI61y9PrBtEwnwP0tVYyAxxo4ND8wjt
>> DbT+Yht1RmX0hrntUI6U3m+91t3HZxi1ZOuWAQ3qZiomXSwMSTfaZYM36zoiiTWU
>> 5zv54uxgYYnxvb7c3gT+8At7tbHbom2NIb9kuxKEOF0PZIVyezPf3eTA8SktZo+J
>> uYSF9QR3mMV8r46gOm5OPi2m+vh2oxIFhYOjcQvWQMaA+Tm60b7GtVX8EsIweC7h
>> vvddZ7GAAAgUdKnPFiA95u8cN5GLqkXMq8cNFrcht5bSYamKoikxQ3j69UOgmZ3N
>> O+t+YJndyn3oyn4ShwnIsPMwR/TbnYZkWc7nmVM/AiANpqPRacVQvJAbYYcx36v0
>> HjAj9lE2CtG5/1k1TemUr6OkntHw7+1KV5keq3MjID+SujbuKXrSrODZ2Y1NrQW8
>> fDdUJGmBPH6nAST+UlG++//5VKGVeMUh0RoIQbKXwFkBLusvqLRmUNgu7KzDd4Sb
>> aRvrgu2BHwnqb/rtX4890WDvcGxjef1BAN4fsbqY/zo6Dq6LDWFRGO3SHPgRhZau
>> XM4gSF0Soqe6JTYyAULLiYRocEpAIQSdntTgpyNRgaHZA4gcEmxhBq9/X0y8oy+o
>> GMObX/+9EMPWmB+/xlY7BopmcQlXENU7PYHUdB6Io1lqj76sIVGiOgtK6O430G8x
>> B76DdqyGZoRq9CyZ4EYkS5pT20NSA5XK3VAelik49aA5Dykz+cWVGkxfw4gsZKFv
>> OMReI0jO4tCW03lWLkrouItCcmnpEHIAvXawPRrrl47Hg/qPLDNWrN+fzB+VE6Ts
>> 0pPehU99YbSwHJgQeuY84G8jrufgPaN+HNG8UlyyucG/zs0BGN/otJO1UCpHjw0O
>> JokTg5qe/OgdmY8fgtIpBScklq1mg0sJjmmtJp3ZHtlyjnvYbP5LUeup8aFV8XeJ
>> yM3QdiwTrHDngCsrAiwca6POPR4eb8wklcU1MQEeUCZUcmuC7JKr/QoB+60rblS0
>> PlmV++kymNp3dXPGOvZU1XRQYwOHK5hyUNv+H5LOAnUsKmCW561zHYflbkhNCX+m
>> yWMKMySBIRpE2HQrsgatA7o4PvN2xBsmZWcfzSdc3Eir7Z6nPjEopVkNToe/8vxY
>> o95j3dnvygCe1anNiZB5Nuq+hQZChKl3JZmg1OpgfknBxDwwcqhowPINNdVED3hJ
>> CkgGHtZ6OU+TWcQJ3vSI
>> =j/yB
>> -----END PGP SIGNATURE-----
>>
>> _______________________________________________
>> sword-devel mailing list: sword-devel �� crosswire.org
>> http://www.crosswire.org/mailman/listinfo/sword-devel
>> Instructions to unsubscribe/change your settings at above page
>
>
>
> _______________________________________________
> sword-devel mailing list: sword-devel �� crosswire.org
> http://www.crosswire.org/mailman/listinfo/sword-devel
> Instructions to unsubscribe/change your settings at above page
>
----------- ???????? ????? -----------
???????? ? ??????? HTML ???? ?????????&hellip;
URL: <http://www.crosswire.org/pipermail/sword-devel/attachments/20130815/c6eda06b/attachment.html>


More information about the sword-devel mailing list