Skip to content

support support for ngram indexer #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 241 commits into
base: dev
Choose a base branch
from
Open

support support for ngram indexer #197

wants to merge 241 commits into from

Conversation

jomart1985
Copy link

i hope if you support support for ngram indexer

alanw and others added 30 commits July 27, 2011 08:18
Passes -DLPP_HAVE_DLL to the compiler to actually enable LPP_BUILDING_LIB and
LPPAPI which make symbols visible.
This is to allow testing with shadow builds, like done by Debian Helper.
This basically is to support proper packaging.
Otherwise (not only) dpkg-shlibdeps will complain about unresolved symbols.
Fix compilation under FreeBSD
- Should close all but the first SkipBuffer.
Also added a note regarding the current incompatibility with
Boost 1.50 and newer (issue #30).

See: #30
Improved the README file's build instructions
alanw and others added 30 commits May 26, 2021 20:04
Fix headers install, contrib headers should be installed.
Fix src/contrib/CMakeLists.txt
weakptr 2 raw pointer

move shared_ptr

move shared_ptr

weak_ptr 2 raw pointer

shared_ptr 2 raw pointer

ref, space for time

shared_ptr 2 raw pointer

opt query

opt query

fix bug: set freq value
 Search performance optimization
Fix race conditions when initializing static variables. (Fix for issue #181)
Add LPPAPI to Exception Template to fix it's visibility on mac
Make contrib library configurable
Fix non symlink so issue with contrib library
Fix install path for liblucene++.pc
boost::filesystem::wpath has been deprecated (and typedef-ed to
boost::filesystem::path) for a long time; it is removed from boost
starting with 1.85.0-beta1.

Use boost::filesystem::path instead.

boost/filesystem/convenience.hpp has been removed (and was being
included without being used anyway - its only use was indirectly
pulling in boost/filesystem/directory.hpp, which is actually used).

Include boost/filesystem/directory.hpp directly instead.
The code previously used the deprecated (and with bost 1.87.0 removed)
`boost::asio::io_service`, which used to be an alias to `io_context`.
The new version heavily changes the `io_context` API and therefore is no
the old interface was removed.

Fixes #208

Signed-off-by: Christian Heusel <[email protected]>
…o_context

Migrate to boost::asio::io_context
Fix typos in Set<T>::swap() and Collection<T>::swap().

Apparently, no compiler ever tried to compile these methods before.
This commit addresses critical crashes that occur when trying to read certain
Lucene index files where field data may be corrupted or have incompatible format.

Root causes:
1. Assertion failures in FieldsReader::doc() when bits flag or compressed field
   format is incompatible with expected values
2. Null pointer dereference in boost::shared_ptr when trying to add fields to a
   document with potentially corrupted data

The fixes include:
- Replace assertions with safe handling for invalid bit flags and format incompatibilities
- Add null checks before dereferencing shared pointers in critical paths
- Create field objects separately before adding them to documents
- Add proper error handling for decompression failures
- Ensure uncompress and string conversion methods never return null values

These minimal changes maintain the original logic but make the code more robust
when dealing with unexpected or corrupt index data. Instead of crashing, the code
now gracefully handles these edge cases and continues processing where possible.
Fix crash when reading corrupted or incompatible Lucene index files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.