Release: SeekStorm v2.3.0 introduces FieldType::Binary for embedded binary data

The FieldType::Binary enables binary data (images, audio, video, PDFs ...) to be stored as base64 directly in JSON or CSV documents—no external URLs required.
#Search #LexicalSearch #Rust #OSS
github.com/SeekStorm/Se...

Release: SeekStorm v2.2.0 adds multiple document compression methods and `FieldType::Json` that supports hierarchical JSON Objects.
#Search #LexicalSearch #Rust #OSS
github.com/SeekStorm/Se...

Release: SeekStorm v2.1.0 supports 𝐬𝐞𝐚𝐫𝐜𝐡 with an 𝐞𝐦𝐩𝐭𝐲 𝐪𝐮𝐞𝐫𝐲 𝐬𝐭𝐫𝐢𝐧𝐠, but facet, filter, and sort parameters.

#Search #LexicalSearch #Rust #OSS
github.com/SeekStorm/Se...

Release: SeekStorm v1.2.0 adds Query Auto-Completion (QAC) and Instant Search.

Release notes
github.com/SeekStorm/Se...

Blog post
seekstorm.com/blog/query-a...

#Search #LexicalSearch #Rust #OSS

Working on: 𝗦𝘆𝗺𝗦𝗽𝗲𝗹𝗹𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲, a typo-tolerant autocomplete library
🔷Misspelled terms: 𝗯𝗹𝘂 𝗸𝘂𝗿𝗮 ➔ 𝗯𝗹𝘂𝗲 𝗰𝘂𝗿𝗮𝗰𝗮𝗼
🔷Missing spaces: 𝗺𝗼𝗱𝗲𝗿𝗻𝗮𝗿𝘁 ➔ 𝗺𝗼𝗱𝗲𝗿𝗻 𝗮𝗿𝘁
🔷Differing order of query and completion: 𝘂𝗻𝗶𝘃𝗲𝗿𝘀𝗶𝘁𝘆 𝗱𝗿𝗲 ➔ 𝗱𝗿𝗲𝘀𝗱𝗲𝗻 𝘂𝗻𝗶𝘃𝗲𝗿𝘀𝗶𝘁𝘆 𝗼𝗳 𝘁𝗲𝗰𝗵𝗻𝗼𝗹𝗼𝗴𝘆
🔷Out-of-vocabulary: 𝘁𝗲𝗮𝗹 𝗺𝗲𝗿𝗶𝗻𝗼 𝗰𝗮𝗿𝗱𝗶 ➔ 𝗺𝗲𝗿𝗶𝗻𝗼 𝗰𝗮𝗿𝗱𝗶𝗴𝗮𝗻

Release: SeekStorm v1.1.0 adds typo tolerance / query spelling correction.

#Search #LexicalSearch #Rust #OSS

SeekStorm v1.0.0 introduces index sharding for faster indexing & search.

Updated benchmarks with popular alternatives show 7x faster query latency & 17x faster tail latency (P99).
github.com/SeekStorm/Se...

SeekStorm v0.13.0 adds N-gram indexing for faster phrase search

N-Gram indexing improved avg. phrase query latency by a factor of 2.18 (118%),
p99.9 tail latency by a factor of 7.63 (663%),
and some phrase queries up to 3 orders of magnitude.
seekstorm.com/blog/n-gram-...
github.com/SeekStorm/Se...

The mystery of an 85% performance drop, lost in translation between CPU and OS.

TLDR: 𝟖𝟓% 𝐩𝐞𝐫𝐟𝐨𝐫𝐦𝐚𝐧𝐜𝐞 𝐝𝐫𝐨𝐩 caused by a 𝐟𝐚𝐮𝐥𝐭𝐲 𝐖𝐢𝐧𝐝𝐨𝐰𝐬 𝟏𝟏 𝟐𝟒𝐇𝟐 𝐬𝐨𝐟𝐭𝐰𝐚𝐫𝐞 𝐮𝐩𝐝𝐚𝐭𝐞, that changed the 𝐭𝐚𝐬𝐤 𝐬𝐜𝐡𝐞𝐝𝐮𝐥𝐞𝐫 behavior into 𝐮𝐧𝐝𝐞𝐫-𝐮𝐭𝐢𝐥𝐢𝐳𝐢𝐧𝐠 𝐭𝐡𝐞 𝐏-𝐂𝐨𝐫𝐞𝐬 over E-cores of 𝐈𝐧𝐭𝐞𝐥 𝐡𝐲𝐛𝐫𝐢𝐝 𝐂𝐏𝐔𝐬.
seekstorm.com/blog/80-perc...

SeekStorm v0.12.23 adds CSV ingestion, stopwords & frequent words parameters for create_index, and more tokenizers.
github.com/SeekStorm/Se...
#Search #LexicalSearch #Rust #OSS

Challenges of BM25 ranking in a sharded index
www.linkedin.com/posts/wolfga...
#search #bm25

The 𝐒𝐞𝐞𝐤𝐒𝐭𝐨𝐫𝐦 𝐬𝐞𝐚𝐫𝐜𝐡 𝐬𝐞𝐫𝐯𝐞𝐫 v0.12.3 is now also available as a 𝐜𝐨𝐧𝐭𝐚𝐢𝐧𝐞𝐫 𝐢𝐦𝐚𝐠𝐞 𝐚𝐭 𝐃𝐨𝐜𝐤𝐞𝐫 𝐇𝐮𝐛.
hub.docker.com/r/wolfgarbe/...
#search #LexicalSearch #OpenSource #Rust #Docker

𝐒𝐞𝐞𝐤𝐒𝐭𝐨𝐫𝐦 𝐯𝟎.𝟏𝟐.𝟎 𝐢𝐧𝐭𝐞𝐠𝐫𝐚𝐭𝐞𝐬 𝐎𝐩𝐞𝐧𝐀𝐏𝐈 for rich and consistent 𝐑𝐄𝐒𝐓 𝐀𝐏𝐈 𝐝𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧, enabling you to utilize the OpenAPI ecosystem.
seekstorm.apidocumentation.com
#Search #LexicalSearch #Rust #OpenSource

SeekStorm v0.11.0 implements Chinese word segmentation
github.com/SeekStorm/Se...
#Search #WordSegmentation #LexicalSearch #Rust #OSS

SeekStorm v0.10.0 adds one-way & multi-way synonyms
github.com/SeekStorm/Se...
#Search #FacetedSearch #LexicalSearch #Rust #OSS

SeekStorm v0.9.0 adds 𝐏𝐃𝐅 𝐢𝐧𝐠𝐞𝐬𝐭𝐢𝐨𝐧
github.com/SeekStorm/Se...
#Search #LexicalSearch #OpenSource #Rust