20 Commits

Author	SHA1	Message	Date
dimgigov	965ed2f675	perf: optimize FTS and HNSW engines + real PostgreSQL benchmarks ... FTS Engine (src/barabadb/fts/engine.nim): - Fix bm25Score doing O(n) linear scan per document - Cache IDF per token instead of recomputing for each doc - Use entry.termFreq directly instead of searching postings again - Result: FTS search +438% (249 -> 1360 queries/s) HNSW Vector Engine (src/barabadb/vector/engine.nim): - Optimize distance functions with float32 + 4x loop unrolling - Rewrite searchLayer: swap+pop instead of O(n) del, track worst-nearest instead of sorting nearest on every iteration - Result: HNSW insert +117% (245 -> 543 ops/s), search 2.2x faster Benchmarks: - Add real PostgreSQL comparison script (benchmarks/pg_bench.py) - Add report generator (benchmarks/generate_report.py) - Fix compare.nim cpuTime() bug (was dividing by 1M incorrectly) - Add nimble tasks: bench_pg, bench_report Docs: - Update README.md and docs/en/performance.md with real measured numbers - Add benchmarks/REAL_COMPARISON.md Version bump: 1.1.7 -> 1.1.8	2026-05-29 17:11:22 +03:00
dimgigov	42043f3946	v1.1.7: deep security & reliability audit — 33 bugs fixed ... Critical (5): - Reject empty JWT secret when authEnabled (server.nim) - Fix 2PC marking uncontacted participants as prepared/committed (disttxn.nim) - Fix Raft commit index calculation for even-sized clusters (raft.nim) - Fix REP/DISTTXN protocol auth bypass (server.nim) - Fix HTTP backup/restore path traversal (httpserver.nim) High (11): - Fix WAL write race with flush (lsm.nim) - Fix MVCC savepoint/rollback deep-copy writeSet (mvcc.nim) - Fix table mutation during deadlock iteration (mvcc.nim) - Fix LIMIT 0 returning all rows (executor.nim) - Fix COUNT(col) counting NULL values — 3 locations (executor.nim) - Fix EXISTS subquery lowering missing subqueryPlan (executor.nim) - Fix Raft appendEntries/applyCommitted array vs logical index (raft.nim) - Fix timing attacks on constantTimeCompare and SCRAM (auth.nim, scram.nim) - Fix B-tree leaf merge phantom separator key (btree.nim) - Fix SSL verifyPeer not applied to newContext (ssl.nim) - Fix sharding connectWithTimeout missing SO_ERROR check (sharding.nim) - Fix sync replication returning success on partial ack (replication.nim) - Fix WebSocket JWT expiration not validated (websocket.nim) Medium (13): - Fix writeSSTable partial file → tmp + atomic rename (lsm.nim) - Fix multi-CTE table loss (executor.nim) - Fix nl_to_sql DML restricted to superuser (executor.nim) - Fix unbounded plan cache — max 10000 (adaptive.nim) - Fix migration lock crash persistence — timestamp + stale detection (executor.nim) - Fix admin panel auth (httpserver.nim) - Fix MVCC unbounded txn tracking — prune in compactVersions (mvcc.nim) - Fix connection pool maxLifetime check (pool.nim) - Fix JWT JSON parser backslash escapes (auth.nim) - Fix substr(s, start) returning single char (udf.nim) - Fix loadSSTable minimum file-size check (lsm.nim) - Fix compaction mmap leak (compaction.nim) - Fix JSON injection in hybrid_search_filtered (executor.nim) Low (4): - Raft loadState logs error instead of silent discard - Replication healthCheck double-close fixed - Lexer readIdent double column counting fixed - WebSocket frame 32-bit overflow guard All 448 tests passing, 0 failures. Bump version to 1.1.7.	2026-05-29 14:17:41 +03:00
dimgigov	37a8ed52ba	deps: bump jwt-nim-baraba to v2.1.2 (security fixes & Nim 2.2 compat)	2026-05-26 13:23:54 +03:00
dimgigov	eb62b381a1	feat: multi-database backup, HTTP API endpoints, admin panel UI ... - backup CLI: add --all-databases, --database, --data-root flags - backup format: tar.gz with databases/<name>/ + backup.json metadata - HTTP API: new endpoints /databases, /backup, /backups, /restore - HTTP API: database switching via X-Database header - Admin panel: database selector dropdown, Databases tab, Backups tab - Admin panel: backup/restore UI with fetch() to new endpoints - Update deps: hunos 1.3.0, jwt-nim-baraba 2.1.0 - Docker: backup cron uses --all-databases --data-root=/data/databases - Docs: update api-http.md, protocol.md with correct endpoints - OpenAPI spec updated to v1.1.6 Known limitation: DELETE /databases disabled due to ORC SIGSEGV in LSMTree.close(). Use SQL DROP DATABASE instead.	2026-05-25 18:46:07 +03:00
dimgigov	cd46edcb67	Bump version to 1.1.6; fix storage bugs, tests, CI pipeline and Docker config ... Storage fixes: - Fix bloom filter hash2 OverflowDefect (uint64 instead of int Hash) - Fix MemTable.put size calculation on overwrite (was leaking size) - Fix fuzz_test duplicate-key issues in LSM delete and SSTable tests Test fixes: - Fix stress_test.nim: replace deprecated threadpool with std/threads - Fix fuzz_test.nim: add missing imports (tables, algorithm, sets) - Fix fuzz_test.nim: var sst for close() compatibility - Remove unused imports from test_all.nim and bench_all.nim Docker / CI fixes: - Fix Dockerfile.source: invalid nimlang/nim:2.2.10-alpine tag → 2.2.10 + ubuntu:24.04 runtime - Fix Dockerfile.source healthcheck (--spider → -qO- for 200 OK) - Fix Dockerfile run comment ports (9470/9471 → 9912/9913) - Fix scripts/docker-run.sh healthcheck port (9470 → 9912) - Add ARG BUILD_DATE/VCS_REF to Dockerfile for docker-build.sh - Update all version strings 1.1.4 → 1.1.6 across nimble/docker/source/docs	2026-05-19 12:13:33 +03:00
dimgigov	a28c845476	Bump version to 1.1.4 across all components	2026-05-17 20:57:19 +03:00
dimgigov	8a395225c0	feat: Session 10.3 MCP Server + Session 11 Graph Engine Deep Integration ... MCP Server (10.3): - STDIO JSON-RPC 2.0 transport with 3 AI tools: query, vector_search, schema_inspect - Multi-tenant session vars (tenant_id, user_id) with RLS support - Standalone binary: build/baramcp - Tested with all 3 tools + parameterized queries + vector search + schema inspect Graph Engine Deep Integration (Session 11): - CREATE GRAPH / DROP GRAPH DDL support - Graph engine wired to SQL executor via GRAPH_TABLE() function - 7 algorithms: BFS, DFS, PageRank, ShortestPath, Dijkstra, Louvain, Community - INSERT into _nodes/_edges tables auto-syncs with native Graph adjacency lists - Optional MATCH pattern, ALGORITHM, START, END, MAXDEPTH in GRAPH_TABLE syntax - All 340+ existing tests pass	2026-05-17 15:18:31 +03:00
dimgigov	58b7598155	fix(dev): streamline build config for new contributors ... - Add --path:src and --threads:on to nim.cfg so tests compile without manual flags - Add tests/config.nims for automatic path resolution in test directory - Simplify nimble task definitions (remove redundant flags now in nim.cfg) - Fix Dockerfile.source comment: remove obsolete nimmax reference This makes 'nim c tests/test_all.nim' and 'nimble test' work out of the box.	2026-05-16 03:20:43 +03:00
dimgigov	2e945c1dcb	release: bump version to 1.1.2 (forum-tested, nested SQL fixes)	2026-05-15 18:34:47 +03:00
dimgigov	4e7e568525	release: v1.1.0 — bug fixes, Docker, clients, SCRAM auth ... - Bump version to 1.1.0 across all components - Remove debug CI artifacts (debug.yml, test_all.nim.bak, test_lock) - Update CHANGELOG with v1.1.0 release notes - Bug fixes: irNeg, distributed txn, sharding, Raft majority, MVCC, LSM-Tree, auth (JWT + SCRAM-SHA-256), wire protocol, SQL injection, ReDoS, graph, vector, FTS, build warnings - Client SDKs: JS/TS, Python, Nim, Rust with tests and examples - Docker: production + source + test compose configs - TLA+: crossmodal, backup, recovery specs with symmetry reduction	2026-05-13 15:05:59 +03:00
dimgigov	f6781c107e	fix(ci): add --threads:on to all nim c commands ... Commit 6aaabb5 added std/locks usage in vector/engine.nim (HNSW thread-safety). std/locks requires --threads:on. Local builds worked because /etc/nim/nim.cfg had threads:on, but GitHub Actions runners (setup-nim-action) compile without threads by default, causing the test job to fail silently at runtime. Also updated baradadb.nimble tasks for consistency. Fixes GitHub Actions CI failure on test / clients-ci workflows.	2026-05-13 11:57:09 +03:00
dimgigov	131541a0e5	fix: критични бъгове в storage, MVCC, auth, Raft, query executor ... Поправени проблеми: - MVCC: aborted транзакции вече не стават видими (добавено abortedTxns множество) - LSM-Tree: поправена загуба на данни при immutable memtable overwrite - LSM-Tree: поправена SSTable search order (сортиране по id вместо minKey) - WAL: sync()/close() вече извикват posix.fsync() - Auth: simpleHash (djb2) заменен с HMAC-SHA256 - Recovery: summary() вече не мутира базата данни - Raft: поправена majority calculation за четен брой нодове - Query: EXISTS subqueries вече изпълняват подзаявката - Nimble: поправен build (-d:ssl) и bench task Добавен BUG_AUDIT.md с пълен доклад и план за подобрения. 292 теста, 0 failure-а.	2026-05-12 22:45:50 +03:00
dimgigov	157775794d	Release v1.0.0 ... - 7 TLA+ specs formally verified (~69M states, 0 errors) - 283+ Nim tests, all passing - Raft: leader election + log replication + step-down on partition - 2PC: coordinator crash/recovery + participant timeout - MVCC: snapshot isolation + write skew detection - Gossip: SWIM-like membership with strength-based gossip - Replication: async/sync/semi-sync LSN tracking - Sharding: consistent hashing with virtual nodes - Deadlock detection: cycle detection in wait-for graph - TLA+ faithfulness tests bridging specs to Nim code - CI: GitHub Actions with automated TLC verification	2026-05-07 22:01:43 +03:00
dimgigov	c8633b9589	fix: non-blocking replication/disttxn timeouts, OTLP epoch time, test paths, compiler warnings	2026-05-07 15:41:33 +03:00
dimgigov	d3b38251c3	update core modules and project config	2026-05-07 15:16:40 +03:00
dimgigov	f45f6b7127	fix(ci): add hunos git url to nimble deps, install libpcre3-dev for runtime	2026-05-07 11:27:43 +03:00
dimgigov	a1aad227c1	fix(ci): lower jwt requirement to >= 0.3.0 to match upstream repo version	2026-05-07 11:10:45 +03:00
dimgigov	f9f77b3a18	feat: production blockers — JOINs, deadlock detection, TLS, parameterized queries ... - JOIN execution: INNER/LEFT/RIGHT/FULL/CROSS with column disambiguation - Deadlock detection: wait-for graph wired into TxnManager.write() - TLS/SSL: OpenSSL via std/net for TCP wire protocol, auto self-signed certs - Parameterized queries: ? placeholders with WireValue binding - Wire protocol: mkQueryParams message support - HTTP /query endpoint accepts JSON params array - Nim client: query(sql, params) overload - Tests: 262 passing (15 new) All PLAN.md production blockers resolved.	2026-05-06 16:42:53 +03:00
dimgigov	1fb715a1d4	feat: integrate hunos web server + jwt-nim-baraba + real WAL recovery + compaction ... HTTP Server: - Replaced asynchttpserver with hunos (multi-threaded, trie router, CORS middleware) - JWT authentication via jwt-nim-baraba (HS256 with BearSSL crypto) - POST /query, GET /health, GET /metrics, POST /auth, GET /api (OpenAPI spec) - Proper CORS headers via hunos corsMiddleware WAL Recovery: - recover() now actually applies committed entries (REDO) - Skips uncommitted entries (UNDO) - Takes optional LSMTree parameter to apply recovery SSTable Compaction: - Real compaction: reads SSTable entries, merges by key (newest wins), writes merged file - Deduplication: keeps only newest version per key - Tombstone cleanup: removes deleted entries - Old SSTable files deleted after merge Dependencies: - Added hunos >= 1.2.0 and jwt >= 2.1.0 to nimble SSTable fields exported for compaction access. All 216 tests pass	2026-05-06 13:42:37 +03:00
dimgigov	6935889877	feat: initial BaraDB — multimodal database engine in Nim ... - LSM-Tree storage engine with WAL, bloom filter, MemTable - BaraQL query language: lexer (80+ tokens), recursive descent parser, AST - Vector engine: HNSW + IVF-PQ indexes, 4 distance metrics - Graph engine: adjacency list, BFS/DFS, Dijkstra, PageRank - Full-Text Search: inverted index, BM25 ranking, stemming, stop words - Type system: 17 types (int/float/string/uuid/json/vector/...) - Async TCP server - 21 passing tests	2026-05-06 00:22:12 +03:00