27 Commits

Author	SHA1	Message	Date
dimgigov	965ed2f675	perf: optimize FTS and HNSW engines + real PostgreSQL benchmarks ... FTS Engine (src/barabadb/fts/engine.nim): - Fix bm25Score doing O(n) linear scan per document - Cache IDF per token instead of recomputing for each doc - Use entry.termFreq directly instead of searching postings again - Result: FTS search +438% (249 -> 1360 queries/s) HNSW Vector Engine (src/barabadb/vector/engine.nim): - Optimize distance functions with float32 + 4x loop unrolling - Rewrite searchLayer: swap+pop instead of O(n) del, track worst-nearest instead of sorting nearest on every iteration - Result: HNSW insert +117% (245 -> 543 ops/s), search 2.2x faster Benchmarks: - Add real PostgreSQL comparison script (benchmarks/pg_bench.py) - Add report generator (benchmarks/generate_report.py) - Fix compare.nim cpuTime() bug (was dividing by 1M incorrectly) - Add nimble tasks: bench_pg, bench_report Docs: - Update README.md and docs/en/performance.md with real measured numbers - Add benchmarks/REAL_COMPARISON.md Version bump: 1.1.7 -> 1.1.8	2026-05-29 17:11:22 +03:00
dimgigov	42043f3946	v1.1.7: deep security & reliability audit — 33 bugs fixed ... Critical (5): - Reject empty JWT secret when authEnabled (server.nim) - Fix 2PC marking uncontacted participants as prepared/committed (disttxn.nim) - Fix Raft commit index calculation for even-sized clusters (raft.nim) - Fix REP/DISTTXN protocol auth bypass (server.nim) - Fix HTTP backup/restore path traversal (httpserver.nim) High (11): - Fix WAL write race with flush (lsm.nim) - Fix MVCC savepoint/rollback deep-copy writeSet (mvcc.nim) - Fix table mutation during deadlock iteration (mvcc.nim) - Fix LIMIT 0 returning all rows (executor.nim) - Fix COUNT(col) counting NULL values — 3 locations (executor.nim) - Fix EXISTS subquery lowering missing subqueryPlan (executor.nim) - Fix Raft appendEntries/applyCommitted array vs logical index (raft.nim) - Fix timing attacks on constantTimeCompare and SCRAM (auth.nim, scram.nim) - Fix B-tree leaf merge phantom separator key (btree.nim) - Fix SSL verifyPeer not applied to newContext (ssl.nim) - Fix sharding connectWithTimeout missing SO_ERROR check (sharding.nim) - Fix sync replication returning success on partial ack (replication.nim) - Fix WebSocket JWT expiration not validated (websocket.nim) Medium (13): - Fix writeSSTable partial file → tmp + atomic rename (lsm.nim) - Fix multi-CTE table loss (executor.nim) - Fix nl_to_sql DML restricted to superuser (executor.nim) - Fix unbounded plan cache — max 10000 (adaptive.nim) - Fix migration lock crash persistence — timestamp + stale detection (executor.nim) - Fix admin panel auth (httpserver.nim) - Fix MVCC unbounded txn tracking — prune in compactVersions (mvcc.nim) - Fix connection pool maxLifetime check (pool.nim) - Fix JWT JSON parser backslash escapes (auth.nim) - Fix substr(s, start) returning single char (udf.nim) - Fix loadSSTable minimum file-size check (lsm.nim) - Fix compaction mmap leak (compaction.nim) - Fix JSON injection in hybrid_search_filtered (executor.nim) Low (4): - Raft loadState logs error instead of silent discard - Replication healthCheck double-close fixed - Lexer readIdent double column counting fixed - WebSocket frame 32-bit overflow guard All 448 tests passing, 0 failures. Bump version to 1.1.7.	2026-05-29 14:17:41 +03:00
dimgigov	a526a3aef9	docs: remove non-English/Bulgarian language docs, fix links ... Remove ar, de, fa, ru, tr, zh documentation folders. Update docs/index.md and docs/bg/index.md to only list en/bg. Update README badge from 7 to 2 languages. Update changelog entry for Bulgarian docs.	2026-05-21 09:44:17 +03:00
dimgigov	cd46edcb67	Bump version to 1.1.6; fix storage bugs, tests, CI pipeline and Docker config ... Storage fixes: - Fix bloom filter hash2 OverflowDefect (uint64 instead of int Hash) - Fix MemTable.put size calculation on overwrite (was leaking size) - Fix fuzz_test duplicate-key issues in LSM delete and SSTable tests Test fixes: - Fix stress_test.nim: replace deprecated threadpool with std/threads - Fix fuzz_test.nim: add missing imports (tables, algorithm, sets) - Fix fuzz_test.nim: var sst for close() compatibility - Remove unused imports from test_all.nim and bench_all.nim Docker / CI fixes: - Fix Dockerfile.source: invalid nimlang/nim:2.2.10-alpine tag → 2.2.10 + ubuntu:24.04 runtime - Fix Dockerfile.source healthcheck (--spider → -qO- for 200 OK) - Fix Dockerfile run comment ports (9470/9471 → 9912/9913) - Fix scripts/docker-run.sh healthcheck port (9470 → 9912) - Add ARG BUILD_DATE/VCS_REF to Dockerfile for docker-build.sh - Update all version strings 1.1.4 → 1.1.6 across nimble/docker/source/docs	2026-05-19 12:13:33 +03:00
dimgigov	a28c845476	Bump version to 1.1.4 across all components	2026-05-17 20:57:19 +03:00
dimgigov	3ac53ecda2	docs(readme): add AI-Native Data Platform features (Sessions 10-12) ... - Update Why BaraDB comparison table with Hybrid RAG, AI Agents, MCP Server, LangChain integration, Graph SQL, Cypher - Add Hybrid RAG Search section under Vector Engine - Add Graph SQL Integration section with CREATE GRAPH, GRAPH_TABLE, Cypher translation, and similarity/node2vec algorithms - Add new AI-Native Data Platform section covering: - Natural Language → SQL (nl_to_sql, schema_prompt) - Text Chunking & Auto-Embedding (chunk, embed_text) - MCP Server (Model Context Protocol over STDIO) - LangChain Vector Store (Python + JS) - Chat Message History with RLS - Update Project Structure with ai/ and mcp/ directories - Update Roadmap Progress with v1.1.2 features	2026-05-17 17:05:47 +03:00
dimgigov	2e945c1dcb	release: bump version to 1.1.2 (forum-tested, nested SQL fixes)	2026-05-15 18:34:47 +03:00
dimgigov	2fbafb11bd	docs: add GitHub stars badge and thank you note	2026-05-15 18:30:10 +03:00
dimgigov	b0978812cb	docs(en): Update English docs for Vector SQL Integration ... - docs/en/vector.md — add SQL usage section (CREATE TABLE VECTOR, distance functions, <-> operator, CREATE INDEX USING hnsw) - docs/en/baraql.md — update vector search section with real SQL syntax, add VECTOR(n) to data types, update keyword table - docs/en/changelog.md — add Vector SQL Integration and bugfixes to [Unreleased] - docs/ARCHITECTURE.md — add SQL Integration bullet to Vector Engine - README.md — update vector engine section with SQL examples, add Vector SQL to roadmap, bump test count to 340+	2026-05-14 14:20:57 +03:00
dimgigov	e2a526df6f	feat(sql): Window Functions + MERGE statement + REST bridge plan ... - Add Window Functions: ROW_NUMBER, RANK, DENSE_RANK, LEAD, LAG, FIRST_VALUE, LAST_VALUE, NTILE with PARTITION BY, ORDER BY, ROWS/RANGE frame specifications - Add MERGE/UPSERT statement with WHEN MATCHED UPDATE and WHEN NOT MATCHED INSERT - Add SQL/PGQ Property Graph long-term plan in PLAN_SQL_ADVANCED.md - Add 7 new tests for Window Functions and MERGE - Update baraql.md documentation	2026-05-14 11:02:09 +03:00
dimgigov	4e7e568525	release: v1.1.0 — bug fixes, Docker, clients, SCRAM auth ... - Bump version to 1.1.0 across all components - Remove debug CI artifacts (debug.yml, test_all.nim.bak, test_lock) - Update CHANGELOG with v1.1.0 release notes - Bug fixes: irNeg, distributed txn, sharding, Raft majority, MVCC, LSM-Tree, auth (JWT + SCRAM-SHA-256), wire protocol, SQL injection, ReDoS, graph, vector, FTS, build warnings - Client SDKs: JS/TS, Python, Nim, Rust with tests and examples - Docker: production + source + test compose configs - TLA+: crossmodal, backup, recovery specs with symmetry reduction	2026-05-13 15:05:59 +03:00
dimgigov	e9d3c7e9de	docs: add multi-language documentation (ru, fa, zh, tr, ar)	2026-05-07 23:42:55 +03:00
dimgigov	09247ffcad	docs: add version badge at the top of README	2026-05-07 22:18:26 +03:00
dimgigov	157775794d	Release v1.0.0 ... - 7 TLA+ specs formally verified (~69M states, 0 errors) - 283+ Nim tests, all passing - Raft: leader election + log replication + step-down on partition - 2PC: coordinator crash/recovery + participant timeout - MVCC: snapshot isolation + write skew detection - Gossip: SWIM-like membership with strength-based gossip - Replication: async/sync/semi-sync LSN tracking - Sharding: consistent hashing with virtual nodes - Deadlock detection: cycle detection in wait-for graph - TLA+ faithfulness tests bridging specs to Nim code - CI: GitHub Actions with automated TLC verification	2026-05-07 22:01:43 +03:00
dimgigov	4791434cea	FV-2: Raft leader step-down on partition loss ... - Add heartbeatReceived variable tracking last term with heartbeat - Add Heartbeat action: leader sends keep-alive; recipient steps down on higher term - Add HeartbeatTimeout: follower starts election if no heartbeat in current term - Add LeaderLeaseExpired: leader steps down if it loses quorum connectivity - Add LeaderHasSelfHeartbeat invariant: every leader must have valid heartbeat - raft.tla now models realistic partition behavior (38M states verified) - Update CHANGELOG -> v1.2.0, VERSION -> 1.2.0, PLAN.md, README.md	2026-05-07 21:48:03 +03:00
dimgigov	181e7d7019	docs: update README with FV v1.1.0 stats and all 7 specs	2026-05-07 21:22:06 +03:00
dimgigov	215df1cdf3	docs: update README and all docs with formal verification, new BaraQL features, OpenTelemetry tracing ... - Add Formal Verification section to README and architecture docs - Document TLA+ specs for Raft, 2PC, MVCC, Replication - Add new BaraQL features: JSON path (->, ->>), FTS @@, CREATE INDEX USING FTS, RECOVER TO TIMESTAMP, UNION/INTERSECT/EXCEPT - Add OpenTelemetry tracing example to README - Update Quick Start to use nimble test/bench - Update EN and BG documentation	2026-05-07 16:06:13 +03:00
dimgigov	b6cdf8c88e	Add Docker deployment support with compose, entrypoint and docs ... - Add Dockerfile (pre-built binary) and Dockerfile.source - Add docker-compose.yml, docker-compose.prod.yml, docker-compose.override.yml - Add docker-entrypoint.sh with non-root user support - Add .dockerignore and helper scripts (scripts/docker-build.sh, scripts/docker-run.sh) - Add docs/en/docker.md with full Docker guide - Update docs/en/deployment.md and README.md - Fix src/barabadb/core/config.nim to read BARADB_ADDRESS, BARADB_PORT, BARADB_DATA_DIR from env - Fix src/barabadb/core/httpserver.nim missing wire import	2026-05-06 23:58:43 +03:00
dimgigov	9b7ed1fca8	chore: change default ports to non-standard ones (9472, 9470, 9471)	2026-05-06 23:23:29 +03:00
dimgigov	be370fb76b	feat(backup): add dry-run, force, history log, auto-verify, rollback, disk check	2026-05-06 23:20:08 +03:00
dimgigov	7f2f5664fa	feat(backup): improve backup manager with detailed CLI, verification, retention	2026-05-06 23:16:00 +03:00
dimgigov	c3c14d64df	docs: update README logo to new PNG image	2026-05-06 23:09:27 +03:00
dimgigov	db7515b338	Add logo image to README	2026-05-06 17:45:27 +03:00
dimgigov	8993cdc6f3	docs: expand README and documentation for production release ... - Update README.md status from 'educational proof-of-concept' to 'production-ready' - Fix binary size: 286KB -> 3.3MB - Update test count: 162/35 -> 262/56 - Add sections: benchmarks, Docker, clients, security, config, monitoring, backup, cross-modal queries, troubleshooting - Expand project structure with all 49 modules and ~14,100 LOC - Add 10 new docs: performance, deployment, configuration, clients, security, monitoring, backup, crossmodal, troubleshooting, changelog - Expand docs/en: architecture, baraql, installation, protocol - Update docs/bg: architecture, installation - Update docs/index.md with new links - Update .gitignore for __pycache__, rust/target, nim binaries	2026-05-06 17:19:16 +03:00
dimgigov	e1bae0c7a0	Add comprehensive documentation with i18n support (EN/BG) ... - Add docs/ folder with English (en/) and Bulgarian (bg/) documentation - Create index.md with language switching and links - English docs: installation, quickstart, architecture, baraql, storage, schema, lsm, btree, vector, graph, fts, columnar, transactions, distributed, protocol, udf, api-binary, api-http, api-websocket - Bulgarian docs: installation, quickstart, architecture, baraql, schema, lsm, btree, vector, graph, fts, transactions, distributed - Update README license to BSD 3-Clause - Add LICENSE file with BSD 3-Clause text	2026-05-06 16:51:14 +03:00
dimgigov	5dba7b5699	feat: Phase 1 — SSTable persistence, README honesty, benchmark fix ... - Add Current Status / Limitations section to README - Fix benchmark compilation (Duration.ticks → inNanoseconds) - Implement real SSTable binary format with write/read/mmap support - Add BloomFilter serialize/deserialize for disk storage - Fix mmap.nim to use posix.open instead of system.open - New PLAN.md with improvement roadmap - All 214 tests pass	2026-05-06 03:16:39 +03:00
dimgigov	2e7d81a4e1	docs: complete English README with architecture, API examples, project structure ... - Architecture diagram showing all layers - BaraQL syntax guide (SELECT, JOIN, CTE, aggregates, CASE, schema) - Code examples for every engine (storage, vector, graph, FTS, columnar) - Transaction, protocol, auth, rate limiting examples - Schema inheritance and migration examples - Distributed: Raft, sharding, replication - UDF registration and stdlib - Full project structure tree - Roadmap progress table	2026-05-06 01:35:45 +03:00