Граф коммитов

1 Коммитов

Автор SHA1 Сообщение Дата
Guoxin f0579d4cc8
support data compression & delta-encoding of posting lists (#297)
* MVP version of Data compress (#1)

* Support delta-encoding (#2)

* support config of compress level (#3)

* integrate zstd with cmake (#4)

* Bug Fix: wrong listPageCount when listTotalBytes % pageSize==0 (#5)

* train & share dictionary (#6)

* rearrange posting list (#7)

* config minDictTraingBufferSize and dictBufferCapacity (#8)

* cmake with local installed zstd (#9)

* refine visual studio config (#10)

* parallel for get compressed size (#11)

* fix check truth bug (#12)

* change zstd branch (#13)

* remove verbose log in truth analysis; refine dockerfile

* check rvalue in Compressor.h

* resolve back compatibility by add a search option: WithDataCompressionFeatures

* remove redundant configs, change head info format only when compression enabled

* reuse buffer when decompression

* remove exit(1) from search index

* bug fix: reuse compression buffer in workspace

 # with '#' will be ignored, and an empty message aborts the commit.

* code refine

* optimize mem usage

* replace vcpkg zstd with nuget

* config issue

* fix solution build issue

Co-authored-by: Philip Adams <35666630+PhilipBAdams@users.noreply.github.com>
2022-06-09 10:36:47 -07:00