291 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
dimgigov	1b3c26123a	feat(raft): expose raft metrics on /metrics and /health ... - RaftMetrics counters: elections, term changes, appends, commit waits/ms, timeouts, lost leadership, forwards, applies, compactions - Gauges via prometheusText: is_leader, term, log size, commit/applied, apply lag, snapshot index - Wire httpServer.raftNode; extend GET /metrics and GET /health	2026-07-30 21:38:44 +03:00
dimgigov	53704e1036	feat(raft): safe log compaction with snapshot metadata ... - lastSnapshotIndex/Term bound the compacted prefix; lastLogIndex/Term and AppendEntries prevLog checks respect the snapshot base - compactLog drops entries only through min(matchIndex, lastApplied) on the leader so lagging peers can still catch up via AppendEntries - Persist snapshot fields in raft_state.bin; BARADB_RAFT_LOG_MAX_ENTRIES - Fix commit-index scan to use findLogEntryByIndex (works after compact)	2026-07-30 21:35:41 +03:00
dimgigov	9df8316305	feat(raft): transparent leader write/DDL forwarding ... - BARADB_RAFT_CLIENT_PEERS maps node id → SQL client host:port - Followers proxy DML/DDL to the known leader over the wire protocol (falls back to "not leader" when the map is missing) - E2E: follower CREATE/INSERT succeed via forward; docs updated	2026-07-30 21:31:05 +03:00
dimgigov	095698ba82	feat(raft): replicate schema DDL through the raft log ... - isRaftDdl + leader-only gate for CREATE/DROP/ALTER (not DATABASE) - appendDdlToRaft ships original SQL; applyCommand re-executes via applyReplicatedDdl (idempotent on leader double-apply) - Mixed DDL+DML batches use the DDL path so order is preserved - Fix secondary-index point lookup to use entry.lsmKey (not filter col) - E2E: CREATE only on leader, schema + index SELECT on follower	2026-07-30 21:25:58 +03:00
dimgigov	50f827f8cf	fix(raft): graph apply + reject non-default DB writes ... - applyReplicatedPut/Delete keep in-memory graphs in sync with node/edge table rows (idempotent edges via addEdgeWithIdIfAbsent). - When Raft is enabled, DML is refused on any database other than 'default' (the only DB the state machine is wired to). - Docs updated (en/bg); unit test for graph apply.	2026-07-30 21:19:01 +03:00
dimgigov	0d51497f57	fix(raft): multi-stmt write gate, rich apply, delete kv convention ... - Reject follower writes if any statement in the batch is DML/COMMIT (not only stmts[0]). - COMMIT always emits empty-valued kvPairs for isDelete entries. - applyCommand updates LSM plus secondary B-tree/FTS/HNSW indexes (applyReplicatedPut/Delete) so follower index scans see replicated rows. - Tests: not-leader append, commit timeout, index apply unit, E2E index-backed SELECT on follower.	2026-07-30 21:14:46 +03:00
dimgigov	a462d21b25	docs: SQL writes through raft (C3b) done ... Mark the C3b design done; document leader-only DML, env vars, and default-DB apply limits in en/bg distributed docs; refresh the README raft status line.	2026-07-30 21:07:14 +03:00
dimgigov	44060701b7	test(raft): E2E replicated writes; wire SQL path to raft node ... - Fix runTcpServer to run the already-wired Server (raftNode was assigned on a different instance that never accepted clients). - Cap raft peer connect at 200ms and fan out heartbeats in parallel so a dead peer cannot stall AppendEntries to the live majority. - Add raft_writes_e2e_test: 3-node write replication, follower rejection, and post-failover writes; wire into nimble test + gitignore.	2026-07-30 21:06:49 +03:00
dimgigov	333941ab65	feat(raft): leader appends writes to raft log and waits for commit	2026-07-30 19:36:16 +03:00
dimgigov	38c1c01841	feat(raft): classify writes, reject them on follower nodes	2026-07-30 19:07:58 +03:00
dimgigov	8a35a838d0	docs: SQL writes through raft (C3b) spec + plan	2026-07-30 18:58:47 +03:00
dimgigov	f9cc68d4e6	chore(raft): ignore e2e test binary, stop raft network on shutdown	2026-07-30 18:46:09 +03:00
dimgigov	b6eccf284e	test(raft): end-to-end 3-node cluster election and failover	2026-07-30 18:35:18 +03:00
dimgigov	f01586354a	fix(raft): partial-read-safe frame reassembly	2026-07-30 18:01:53 +03:00
dimgigov	3f8537eaad	feat(raft): run election timer in production, reset on AppendEntries	2026-07-30 17:47:05 +03:00
dimgigov	853ec7dd3b	feat(raft): parse id@host:port peers, enable raft state persistence	2026-07-30 17:34:39 +03:00
dimgigov	b5f9c1e798	docs: networked Raft bootstrap (C3a) spec + plan	2026-07-30 17:29:28 +03:00
dimgigov	e8f9cbc5bb	fix: CREATE UNIQUE INDEX actually enforces uniqueness (and persists)	2026-07-30 17:13:29 +03:00
dimgigov	5858a9da17	docs: UNIQUE index enforcement plan	2026-07-30 16:59:26 +03:00
dimgigov	8d2d97ad94	feat(persist): standalone B-tree indexes survive restart	2026-07-30 16:53:25 +03:00
dimgigov	fcb6237caf	docs: B-tree index persistence plan	2026-07-30 16:46:04 +03:00
dimgigov	8df0e02d3f	docs: engine persistence (C1) done	2026-07-30 16:36:49 +03:00
dimgigov	821b668d87	fix(persist): unnamed FTS/HNSW indexes survive restart (nameless replay DDL)	2026-07-30 16:27:36 +03:00
dimgigov	214b9cf346	fix: DROP INDEX/TABLE clean up FTS/HNSW indexes and their schema keys	2026-07-30 16:20:23 +03:00
dimgigov	ce6e7aa707	feat(persist): graphs survive restart (rebuild from backing tables)	2026-07-30 16:11:52 +03:00
dimgigov	214e44abd7	feat(persist): HNSW vector indexes survive restart	2026-07-30 16:05:25 +03:00
dimgigov	6703ca2b29	feat(persist): FTS indexes survive restart (schema key + restore replay)	2026-07-30 15:56:48 +03:00
dimgigov	9088dc1381	docs: engine persistence (C1) spec + implementation plan	2026-07-30 15:47:03 +03:00
dimgigov	ba7cf195c6	chore: stop tracking compiled test binaries (bugfix_test, nimforum_smoke_test)	2026-07-30 15:36:41 +03:00
dimgigov	62504aa348	docs(exec): document module layering after executor split	2026-07-30 15:17:31 +03:00
dimgigov	b282a59fb5	refactor(exec): slim executor.nim to dispatcher + hook wiring	2026-07-30 15:12:41 +03:00
dimgigov	a5976f648a	refactor(exec): extract IR plan execution into exec/plan_exec.nim	2026-07-30 15:02:34 +03:00
dimgigov	a147d4b620	refactor(exec): extract window functions into exec/window.nim	2026-07-30 14:52:17 +03:00
dimgigov	e618266325	refactor(exec): extract triggers/constraints into exec/triggers.nim	2026-07-30 14:43:49 +03:00
dimgigov	70c7297e33	refactor(exec): extract FK enforcement into exec/fk.nim	2026-07-30 14:35:15 +03:00
dimgigov	70b7ec7f08	refactor(exec): extract DML row operations into exec/dml.nim	2026-07-30 14:28:33 +03:00
dimgigov	e28c1f4896	refactor(exec): extract table scans into exec/scan.nim	2026-07-30 14:19:11 +03:00
dimgigov	f97e72314f	refactor(exec): extract RLS/privileges into exec/rls.nim	2026-07-30 14:11:08 +03:00
dimgigov	26475058bf	refactor(exec): extract AST->IR lowering into exec/lower.nim	2026-07-30 14:05:16 +03:00
dimgigov	b5e9636fd2	refactor(exec): extract expression evaluation + hybrid search into exec/eval.nim	2026-07-30 13:52:56 +03:00
dimgigov	2b8cc98348	refactor(exec): extract migration storage into exec/migrations.nim	2026-07-30 13:41:52 +03:00
dimgigov	2efcddba19	refactor(exec): extract param binding into exec/params.nim	2026-07-30 13:36:39 +03:00
dimgigov	46e3d7f51e	refactor(exec): extract join/vector helpers into exec/helpers.nim	2026-07-30 13:27:17 +03:00
dimgigov	08fb391ac1	refactor(exec): extract context management into exec/context.nim	2026-07-30 13:18:10 +03:00
dimgigov	2d09edd9f7	fix+refactor: soft keywords as identifiers, full test wiring, ORC crash docs ... - parser: clause keywords (header, format, status, user, csv, ...) now work as identifiers everywhere; IMPORT/EXPORT accept FORMAT csv/HEADER true - nimble test + CI run all 13 test suites (650 checks green) - ExecutionContext.registry is now {.cursor.} (breaks registry<->ctx cycle) - ORC crash reproduced and bisected (tests/orc_repro.py); ARC stays the MM	2026-07-30 13:11:28 +03:00
dimgigov	ed5a71913c	fix: harden exception handling, break ARC cycles, sync license/client ... Replace bare except: with CatchableError across storage, query, Raft, backup, and protocol code so Defects are not swallowed. Break uncollectable ARC cycles in server shard/gossip callbacks via Server-owned refs and cursor locals. Align package license with LICENSE (BSD-3-Clause), sync README version, and point test_all at the canonical clients/nim baradb client (parseConnectionString + aliases).	2026-07-23 01:07:51 +03:00
dimgigov	8db5cfe7e1	feat: harden storage, schema persistence, fair benches, fix wire crash ... Core storage: hash MemTable, WAL group commit, L0 compaction rebuild, reader-writer lock, and a global StorageGate so HTTP workers and TCP share the LSM safely under multi-thread access. Schema: durable CREATE/ALTER/DROP under _schema:tables:* with full LSM restore on open. Executor types/values/schema split into query/exec/. Wire protocol: switch default MM to ARC — ORC cycle collector segfaulted after ~20 async INSERTs. Fair multi-tier benchmarks (SQLite/HTTP/wire/PG) and honesty docs for mixed-tier comparisons.	2026-07-18 16:55:50 +03:00
dimgigov	aa4ab11210	feat: canonical Nim client refactor with typed rows, pool, and allographer wrapper ... - Extract wire protocol into clients/nim/src/baradb/wire.nim - Add BaraError exception hierarchy - Refactor BaraClient/SyncClient with typedRows, AsyncLock request queue, timeouts, TLS config - Add BaraPool and optional HTTP fallback - Add mock-server wire and pool unit tests - Bump baradb nimble package to 1.2.0 - Make nim-allographer depend on canonical baradb client - Use typed rows in allographer toJson - Deprecate src/barabadb/client/client.nim - Update docs/en/clients.md and clients/nim/README.md	2026-06-18 21:29:55 +03:00
dimgigov	1c42eff7ef	fix(vector): use float64 accumulators for distance functions ... Vector distance functions (cosine, euclidean, dot, manhattan) returned float64 but accumulated sums in float32, causing precision loss in SQL results (e.g. sqrt(2) truncated to float32). Use float64 accumulators and casts throughout. docs(bugs): mark BUG-023 and BUG-024 as fixed The code already cleans up pendingAcks and passes oldAssignments from rebalance to migrateData; update BUGS.md to match the implementation.	2026-06-12 23:06:19 +03:00
dimgigov	ef264d7d69	feat: add unified search engine — HNSW heap-opt, segment index, boolean/phrase/ngram/facet ... New src/barabadb/search/ module with 9 components: - priority_queue.nim: BoundedHeap for O(log n) search - hnsw_opt.nim: heap-based searchLayer (2.4x faster, 92-99% recall@10) - inverted.nim: segment-based index with soft-delete and compaction - phrase.nim: positional phrase + proximity search - boolean.nim: recursive descent parser (AND/OR/NOT/ranges/wildcards) - ngram.nim: trigram index for O(1) fuzzy/prefix/wildcard - stemmer.nim: Porter2 stemmers (EN/BG/DE/FR/RU) - facet.nim: faceted search with filter pushdown - engine.nim: UnifiedSearchEngine combining all search types Performance (dim=128, efConstruction=200): N=1K: 0.30ms search, 99.6% recall@10 N=10K: 1.09ms search, 92.6% recall@10 N=50K: 2.26ms search, 75.5% recall@10 Includes search benchmarks (benchmarks/search_bench.nim), updated docs (en/bg fts.md, en/bg search.md), and crossmodal engine integration.	2026-05-30 13:42:08 +03:00