Experimental · Unreleased

Vector search over object storage.

Blob-Oriented Retrieval with Segmental Unified KNN

BORSUK is a Rust library that runs search in your process. The current native path opens a small authenticated semantic directory, reads selected centroid leaves, shortlists two-bit SOURCE candidates, and scores SQ8 vector ranges.

APIs, defaults, and stored formats can change. Local synthetic fixtures and S3 measurements cover specific operations. Python and TypeScript bindings have separate experimental API surfaces.

Illustration of grouped vectors. The native reader fetches selected centroid, SOURCE, and SQ8 ranges.

Read selected data, then score the shortlist.

  1. 1

    Select centroid leaves

    A small authenticated semantic directory identifies leaves to read for the query.

  2. 2

    Shortlist candidates

    Two-bit SOURCE records nominate candidates under explicit read and scratch limits.

  3. 3

    Score SQ8 ranges

    Generation-pinned ranges supply quantized vectors for candidate scoring and logical-ID results.

This is approximate retrieval. SQ8 scoring does not guarantee the exact nearest neighbors in the original vectors.

Read the native API guide →

Authenticated generations

Native APIs construct metadata, publish immutable objects before a conditional head, and open a pinned generation. Fixtures check identity, corruption, and resource admission.

Mutations and recovery

Durable snapshots preserve updates and tombstones. Logical-ID search includes the supplied snapshot and suppresses replaced or deleted base IDs before top-k.

Callable maintenance

Compaction and garbage collection have lifecycle fixtures. Reader coordination covers cooperating callers on one host or shared local filesystem.

Explicit resource limits

Callers set modeled memory, active queries, scratch, and separate SOURCE and SQ8 I/O limits. Whole-process memory needs separate measurement.

Start with the native code and fixtures.

Use a pinned source checkout. Read the API composition and failure checks before adapting them to your application.

Experimental bindings

The Python and TypeScript create/add/search APIs use a separate code surface. These examples do not exercise the current native generation route.

Publication and maintenance

The caller supplies credentials, trusted-head delivery, and maintenance coordination.

One workload, with reviewable evidence.

The latest development measurement uses CoHere FIRST1M, 768 dimensions, cosine, top 10, and 64 sealed queries. It records its source, resource limits, cold-call protocol, and finite offered load.

This result does not establish sustained capacity, broad scale, lifecycle cost, or a matched vendor win.

Inspect the experiment.

Read the current APIs, fixtures, and measurement scope.