releases-comm-central/mailnews/extensions/fts3
..
data
Normalize.c
README.mozilla
components.conf
fts3_porter.c
fts3_tokenizer.h
moz.build
nsFts3Tokenizer.cpp
nsFts3Tokenizer.h
nsGlodaRankerFunction.cpp
nsGlodaRankerFunction.h
nsIFts3Tokenizer.idl

README.mozilla

fts3_porter.c code is from SQLite3.

This customized tokenizer "mozporter" by Mozilla supports CJK indexing using bi-gram. So you have to use bi-gram search string if you wanto to search CJK character.