[sword-devel] Search up to 5.8 times faster now :)
junkmail at joachim.ansorgs.de
Wed Jun 2 15:25:56 MST 2004
-----BEGIN PGP SIGNED MESSAGE-----
the standard search function is now up to 5 times faster than before.
Let me explain.
A search in a module did the following:
1. Get the text of a key by calling all the strip filters ()
2. Search the search words in the stripped down text
3. If it was found add it to the result
We assume a module with 6 strip filters.
This means the expensive StripText() function got called 30000*6=180000 times.
Now we check for the words in the raw text and only check keys which had a
valid match in the raw text if they match in the stripped down text.
If we assume a normal query returns 100 results the StripText function gets
called 100*6=600 times which saves a lot of time.
time ./old/examples/cmdline/search KJV Revelation
time ./new/examples/cmdline/search KJV Revelation
Which is an improvement factor of 5.6 :)
./new/examples/cmdline/search WEB God
only takes 2.1 secs now.
time ./old/examples/cmdline/search KJV God
time ./new/examples/cmdline/search KJV God
This is "only" 3.7 times faster, because searching in the raw text gives more
hits which means more calls to StripText(). I tested it with a search for " "
which means all verses and it's as slow as the old one. Which ones usual
search queries are a lot faster than before.
The fix is in CVS now.
<>< Re: deemed!
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)
-----END PGP SIGNATURE-----
More information about the sword-devel