29 Commits

Author	SHA1	Message	Date
dimgigov	d303cc5658	docs: v1.3.0 raft-supported docs, limitations, runbook updates	2026-07-31 04:16:11 +03:00
dimgigov	09f462f467	release: v1.2.0 Production GA (single-node) ... - known-limitations, deployment runbook, release checklist - prod compose requires JWT secret; BARADB_ENV=production fail-closed - scripts/backup-restore-drill.sh (backup → wipe → restore → verify) - version bump 1.2.0 (nimble, Dockerfile, health, CHANGELOG dated)	2026-07-30 21:52:21 +03:00
dimgigov	16ec8b5dc4	docs: raft cluster status, plans closed, CHANGELOG/README/monitoring ... - Add raft-cluster-status overview (C3a/C3b/post-C3b shipped on main) - Mark C3a/C3b design+plans done; refresh operator docs en/bg - CHANGELOG 1.2.0 Raft section; README cluster example and status line - monitoring.md health/metrics match real HTTP port+440 and raft series	2026-07-30 21:41:15 +03:00
dimgigov	1b3c26123a	feat(raft): expose raft metrics on /metrics and /health ... - RaftMetrics counters: elections, term changes, appends, commit waits/ms, timeouts, lost leadership, forwards, applies, compactions - Gauges via prometheusText: is_leader, term, log size, commit/applied, apply lag, snapshot index - Wire httpServer.raftNode; extend GET /metrics and GET /health	2026-07-30 21:38:44 +03:00
dimgigov	53704e1036	feat(raft): safe log compaction with snapshot metadata ... - lastSnapshotIndex/Term bound the compacted prefix; lastLogIndex/Term and AppendEntries prevLog checks respect the snapshot base - compactLog drops entries only through min(matchIndex, lastApplied) on the leader so lagging peers can still catch up via AppendEntries - Persist snapshot fields in raft_state.bin; BARADB_RAFT_LOG_MAX_ENTRIES - Fix commit-index scan to use findLogEntryByIndex (works after compact)	2026-07-30 21:35:41 +03:00
dimgigov	9df8316305	feat(raft): transparent leader write/DDL forwarding ... - BARADB_RAFT_CLIENT_PEERS maps node id → SQL client host:port - Followers proxy DML/DDL to the known leader over the wire protocol (falls back to "not leader" when the map is missing) - E2E: follower CREATE/INSERT succeed via forward; docs updated	2026-07-30 21:31:05 +03:00
dimgigov	095698ba82	feat(raft): replicate schema DDL through the raft log ... - isRaftDdl + leader-only gate for CREATE/DROP/ALTER (not DATABASE) - appendDdlToRaft ships original SQL; applyCommand re-executes via applyReplicatedDdl (idempotent on leader double-apply) - Mixed DDL+DML batches use the DDL path so order is preserved - Fix secondary-index point lookup to use entry.lsmKey (not filter col) - E2E: CREATE only on leader, schema + index SELECT on follower	2026-07-30 21:25:58 +03:00
dimgigov	50f827f8cf	fix(raft): graph apply + reject non-default DB writes ... - applyReplicatedPut/Delete keep in-memory graphs in sync with node/edge table rows (idempotent edges via addEdgeWithIdIfAbsent). - When Raft is enabled, DML is refused on any database other than 'default' (the only DB the state machine is wired to). - Docs updated (en/bg); unit test for graph apply.	2026-07-30 21:19:01 +03:00
dimgigov	a462d21b25	docs: SQL writes through raft (C3b) done ... Mark the C3b design done; document leader-only DML, env vars, and default-DB apply limits in en/bg distributed docs; refresh the README raft status line.	2026-07-30 21:07:14 +03:00
dimgigov	ef264d7d69	feat: add unified search engine — HNSW heap-opt, segment index, boolean/phrase/ngram/facet ... New src/barabadb/search/ module with 9 components: - priority_queue.nim: BoundedHeap for O(log n) search - hnsw_opt.nim: heap-based searchLayer (2.4x faster, 92-99% recall@10) - inverted.nim: segment-based index with soft-delete and compaction - phrase.nim: positional phrase + proximity search - boolean.nim: recursive descent parser (AND/OR/NOT/ranges/wildcards) - ngram.nim: trigram index for O(1) fuzzy/prefix/wildcard - stemmer.nim: Porter2 stemmers (EN/BG/DE/FR/RU) - facet.nim: faceted search with filter pushdown - engine.nim: UnifiedSearchEngine combining all search types Performance (dim=128, efConstruction=200): N=1K: 0.30ms search, 99.6% recall@10 N=10K: 1.09ms search, 92.6% recall@10 N=50K: 2.26ms search, 75.5% recall@10 Includes search benchmarks (benchmarks/search_bench.nim), updated docs (en/bg fts.md, en/bg search.md), and crossmodal engine integration.	2026-05-30 13:42:08 +03:00
dimgigov	0c7847abba	docs: update backup.md with multi-database and HTTP API docs	2026-05-25 18:49:26 +03:00
dimgigov	eb62b381a1	feat: multi-database backup, HTTP API endpoints, admin panel UI ... - backup CLI: add --all-databases, --database, --data-root flags - backup format: tar.gz with databases/<name>/ + backup.json metadata - HTTP API: new endpoints /databases, /backup, /backups, /restore - HTTP API: database switching via X-Database header - Admin panel: database selector dropdown, Databases tab, Backups tab - Admin panel: backup/restore UI with fetch() to new endpoints - Update deps: hunos 1.3.0, jwt-nim-baraba 2.1.0 - Docker: backup cron uses --all-databases --data-root=/data/databases - Docs: update api-http.md, protocol.md with correct endpoints - OpenAPI spec updated to v1.1.6 Known limitation: DELETE /databases disabled due to ORC SIGSEGV in LSMTree.close(). Use SQL DROP DATABASE instead.	2026-05-25 18:46:07 +03:00
dimgigov	bb843b9a03	feat: migrate system + cross-DB engine + IMPORT/EXPORT syntax -- 22 files, client+server+docs	2026-05-21 19:32:14 +03:00
dimgigov	4a83eb6783	docs: update distributed/backup/schema/storage for multi-database ... - Add multi-database limitations to distributed docs - Fix backup commands and add multi-database backup guidance - Add SQL migration section to schema docs - Update storage examples to use per-database paths	2026-05-21 09:44:25 +03:00
dimgigov	a526a3aef9	docs: remove non-English/Bulgarian language docs, fix links ... Remove ar, de, fa, ru, tr, zh documentation folders. Update docs/index.md and docs/bg/index.md to only list en/bg. Update README badge from 7 to 2 languages. Update changelog entry for Bulgarian docs.	2026-05-21 09:44:17 +03:00
dimgigov	cd46edcb67	Bump version to 1.1.6; fix storage bugs, tests, CI pipeline and Docker config ... Storage fixes: - Fix bloom filter hash2 OverflowDefect (uint64 instead of int Hash) - Fix MemTable.put size calculation on overwrite (was leaking size) - Fix fuzz_test duplicate-key issues in LSM delete and SSTable tests Test fixes: - Fix stress_test.nim: replace deprecated threadpool with std/threads - Fix fuzz_test.nim: add missing imports (tables, algorithm, sets) - Fix fuzz_test.nim: var sst for close() compatibility - Remove unused imports from test_all.nim and bench_all.nim Docker / CI fixes: - Fix Dockerfile.source: invalid nimlang/nim:2.2.10-alpine tag → 2.2.10 + ubuntu:24.04 runtime - Fix Dockerfile.source healthcheck (--spider → -qO- for 200 OK) - Fix Dockerfile run comment ports (9470/9471 → 9912/9913) - Fix scripts/docker-run.sh healthcheck port (9470 → 9912) - Add ARG BUILD_DATE/VCS_REF to Dockerfile for docker-build.sh - Update all version strings 1.1.4 → 1.1.6 across nimble/docker/source/docs	2026-05-19 12:13:33 +03:00
dimgigov	343f479127	docs(bg,en): fix ports and WebSocket example for new server model ... - Update architecture diagram to include WebSocket server (port 9913) - Fix HTTP port from 9470 to 9912 (TCP + 440) in protocol docs - Fix WebSocket port from 9471 to 9913 (TCP + 441) in protocol docs - Fix WebSocket Nim example: remove non-existent onMessage API and unsafe cast[string](data), use correct WsServer API with safe helpers - Clarify TCP_NODELAY is also handled internally by hunos (HTTP) - Note that bytesToString/stringToBytes are wire-protocol helpers	2026-05-18 19:41:21 +03:00
dimgigov	8afa998516	feat: rate limiting, shared DB instance, TCP_NODELAY fix ... - Add rate limiter to TCP and HTTP servers - Share single LSMTree between TCP and HTTP servers - Replace unsafe cast[string]/cast[seq[byte]] with safe helpers - Stabilize gossip UDP socket with exponential backoff - Fix TCP_NODELAY via low-level setSockOptInt(IPPROTO_TCP) (asyncnet.setSockOpt(OptNoDelay) uses SOL_SOCKET and fails) - Apply TCP_NODELAY to server and websocket sockets	2026-05-18 19:33:40 +03:00
dimgigov	7e6a45e6b7	Стабилизация на storage слоя — 6 фази ... Фаза 1: SSTable Integrity - SSTable v3 формат с CRC32 footer (data/index/bloom CRC) - Нов модул storage/crc32.nim (zero-dep, IEEE 802.3) - verifySSTable() — проверка на magic, version, CRC - loadSSTable strict mode — отхвърля корумпирани файлове - newLSMTree логва [WARN] при corrupt SSTables Фаза 2: baradb repair - Нов модул tools/repair.nim - Сканира SSTables, проверява CRC, премества битите в corrupt/ - WAL replay (CrashRecovery) за възстановяване на данни - CLI: ./baradadb repair --data-dir=... [--dry-run] Фаза 3: MANIFEST File - Atomic write MANIFEST (tmp + rename) - newLSMTree зарежда от MANIFEST, fallback към walkDir - checkStorageConsistency() — orphan/missing detection - flushUnsafe и compaction записват MANIFEST Фаза 4: WAL Rotation & Incremental Backup - WAL segment rotation при 64MB (wal_archive/wal.000NNN.log) - maybeRotate() на всеки 1000 записа + при flush - backup incremental — архивира MANIFEST + SSTables + WAL - CRC verification на SSTables преди архивиране Фаза 5: Online Consistent Backup - checkpoint() — freeze memtable + flush + WAL rotate - ./baradadb checkpoint — offline consistent snapshot - backup --online — checkpoint + incremental backup Фаза 6: SSTable Version Migration - SSTable.fileVersion поле - listLegacySSTables() — намира v1/v2 файлове - migrateSSTable() — пренаписва към v3 (tmp + rename) - ./baradadb migrate [--dry-run] — offline migration Документация: - Обновени docs/en/backup.md, docs/bg/backup.md - Обновени docs/en/storage.md, docs/bg/storage.md - Добавени тестове в tests/test_all.nim	2026-05-18 15:04:49 +03:00
dimgigov	a28c845476	Bump version to 1.1.4 across all components	2026-05-17 20:57:19 +03:00
dimgigov	c95bc4cd44	docs: synchronize documentation across all languages ... - Add mcp.md to: bg, fa, ru, tr, zh, ar - Add index.md to Bulgarian (bg) - Add 24 missing German (de) documentation files Translations for all supported languages now complete.	2026-05-17 16:29:28 +03:00
dimgigov	40616ad3c0	Update repository URLs from GitHub to Codeberg	2026-05-15 12:11:00 +03:00
dimgigov	8c29e700c7	Revert "Update repository URLs from GitHub to Codeberg" ... This reverts commit 956066631e.	2026-05-15 12:10:36 +03:00
dimgigov	956066631e	Update repository URLs from GitHub to Codeberg	2026-05-15 12:03:11 +03:00
dimgigov	c55d3080cf	Update documentation and clients for v1.1.0 ... Documentation updates: - Fix v0.1.0 → v1.1.0 version numbers in en, ru, fa, zh docs - Add missing Window Functions, Multi-Tenant ERP, Supported Keywords sections to ru, fa, zh baraql.md (~105 lines each) - Expand Turkish and Arabic baraql.md (110 → 268 lines) - Expand Turkish and Arabic installation.md (62 → 307 lines) - Add new Bulgarian documentation files (18 new files) Client updates: - Python: Full async/await rewrite with asyncio, request queueing - Rust: Full async/await rewrite with tokio, async examples - Nim: Update README to v1.1.0 - All clients now support async patterns consistently	2026-05-14 23:05:47 +03:00
dimgigov	215df1cdf3	docs: update README and all docs with formal verification, new BaraQL features, OpenTelemetry tracing ... - Add Formal Verification section to README and architecture docs - Document TLA+ specs for Raft, 2PC, MVCC, Replication - Add new BaraQL features: JSON path (->, ->>), FTS @@, CREATE INDEX USING FTS, RECOVER TO TIMESTAMP, UNION/INTERSECT/EXCEPT - Add OpenTelemetry tracing example to README - Update Quick Start to use nimble test/bench - Update EN and BG documentation	2026-05-07 16:06:13 +03:00
dimgigov	9b7ed1fca8	chore: change default ports to non-standard ones (9472, 9470, 9471)	2026-05-06 23:23:29 +03:00
dimgigov	8993cdc6f3	docs: expand README and documentation for production release ... - Update README.md status from 'educational proof-of-concept' to 'production-ready' - Fix binary size: 286KB -> 3.3MB - Update test count: 162/35 -> 262/56 - Add sections: benchmarks, Docker, clients, security, config, monitoring, backup, cross-modal queries, troubleshooting - Expand project structure with all 49 modules and ~14,100 LOC - Add 10 new docs: performance, deployment, configuration, clients, security, monitoring, backup, crossmodal, troubleshooting, changelog - Expand docs/en: architecture, baraql, installation, protocol - Update docs/bg: architecture, installation - Update docs/index.md with new links - Update .gitignore for __pycache__, rust/target, nim binaries	2026-05-06 17:19:16 +03:00
dimgigov	e1bae0c7a0	Add comprehensive documentation with i18n support (EN/BG) ... - Add docs/ folder with English (en/) and Bulgarian (bg/) documentation - Create index.md with language switching and links - English docs: installation, quickstart, architecture, baraql, storage, schema, lsm, btree, vector, graph, fts, columnar, transactions, distributed, protocol, udf, api-binary, api-http, api-websocket - Bulgarian docs: installation, quickstart, architecture, baraql, schema, lsm, btree, vector, graph, fts, transactions, distributed - Update README license to BSD 3-Clause - Add LICENSE file with BSD 3-Clause text	2026-05-06 16:51:14 +03:00