baraba/Baradb
1
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
135 Commits 2 Branches 0 Tags
1923aa225b594c0769ab5d5e954fcf8955e14aea
Commit Graph

135 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
dimgigov 1923aa225b debug(ci): truncate test_all.nim to first half of suites 2026-05-13 13:31:15 +03:00
dimgigov 9777b73e7c fix(tests): add missing import std/tables in join_tests.nim 2026-05-13 13:27:34 +03:00
dimgigov ab2522657f debug(ci): add lock/lsm test to isolate failure 2026-05-13 13:22:06 +03:00
dimgigov adf5937198 debug(ci): add timeout to join_tests 2026-05-13 13:10:39 +03:00
dimgigov 113d7faafa debug(ci): run join_tests and tla_faithfulness separately 2026-05-13 13:07:32 +03:00
dimgigov 15a905bdd1 debug(ci): emit notice with 0x0.st URL for test_all.log 2026-05-13 13:02:14 +03:00
dimgigov 14791d8be6 debug(ci): remove || true mask from test_all run 2026-05-13 12:59:26 +03:00
dimgigov dbe92fab9d debug(ci): always upload test_all.log to branch 2026-05-13 12:55:48 +03:00
dimgigov d9835fe696 debug(ci): remove || echo mask from test_all binary run 2026-05-13 12:52:25 +03:00
dimgigov 1111fbf359 debug(ci): upload logs to new branch on failure 2026-05-13 12:48:05 +03:00
dimgigov 1ed9f90852 debug(ci): add nim version check step before minimal test 2026-05-13 12:40:31 +03:00
dimgigov dea4870d87 debug(ci): try iffy/install-nim instead of jiro4989/setup-nim-action 2026-05-13 12:38:17 +03:00
dimgigov 2926701f8c fix(ci): explicitly install openssl and ca-certificates in all workflows 2026-05-13 12:35:43 +03:00
dimgigov fb2bd1769d debug(ci): remove -d:ssl from minimal test to isolate issue 2026-05-13 12:33:15 +03:00
dimgigov cde443679e debug(ci): simplify debug workflow to isolate failure 2026-05-13 12:29:39 +03:00
dimgigov e0037ae817 debug(ci): add debug workflow to isolate test failure 2026-05-13 12:23:50 +03:00
dimgigov aaa4f37c77 debug(ci): post test log as commit comment on failure 2026-05-13 12:16:56 +03:00
dimgigov 25ba9911b7 debug(ci): emit notice annotation with 0x0.st URL 2026-05-13 12:11:52 +03:00
dimgigov 8e56ff721c debug(ci): upload test log to 0x0.st on failure 2026-05-13 12:11:28 +03:00
dimgigov 942910fae5 debug(ci): print nim version, nimble packages, system info 2026-05-13 12:05:49 +03:00
dimgigov f50cbd1555 debug(ci): upload test_output.log as artifact on failure 2026-05-13 12:04:59 +03:00
dimgigov 6978097768 debug(ci): capture test output to log for debugging GitHub Actions failure 2026-05-13 12:02:01 +03:00
dimgigov f6781c107e fix(ci): add --threads:on to all nim c commands 
Commit 6aaabb5 added std/locks usage in vector/engine.nim (HNSW thread-safety).
std/locks requires --threads:on. Local builds worked because /etc/nim/nim.cfg
had threads:on, but GitHub Actions runners (setup-nim-action) compile without
threads by default, causing the test job to fail silently at runtime.

Also updated baradadb.nimble tasks for consistency.

Fixes GitHub Actions CI failure on test / clients-ci workflows.
 2026-05-13 11:57:09 +03:00
dimgigov c0bd3dff86 feat: distributed gaps filled — gossip UDP transport, sharding data migration, inter-module wiring (raft-disttxn, gossip-sharding, replication-disttxn) 2026-05-13 11:11:53 +03:00
dimgigov 2a8d2a6cb4 docs: update PLAN.md and BUG_AUDIT.md for v1.0.0 release 
- Final metrics: 294 tests, 10 TLA+ specs, 32 bugs fixed
- Mark all critical/high/medium/config bugs as resolved
- Document SCRAM-SHA-256, crossmodal.tla, symmetry reduction
- List remaining post-v1.0.0 non-critical tasks
 2026-05-13 09:54:00 +03:00
dimgigov ac55237b72 feat: real SCRAM-SHA-256 authentication (Option C) 
Security:
- New scram.nim module with full SCRAM-SHA-256 per RFC 7677
  * PBKDF2-HMAC-SHA-256 key derivation
  * HMAC-SHA-256 with multiple overloads for bytes/strings
  * Secure nonce/salt generation via /dev/urandom
  * Client/server message parsing and proof verification

AuthManager updates:
- registerScramUser(): stores salted credentials (salt + iterations + storedKey + serverKey)
- startScram(): initiates challenge-response handshake
- finishScram(): verifies client proof and returns server signature
- Legacy amSCRAMSHA256 path kept for backward compatibility

HTTP endpoints:
- POST /auth/scram/start — accepts client-first-message, returns server-first
- POST /auth/scram/finish — accepts client-final-message, returns server-final

Tests:
- SCRAM-SHA-256 full handshake test (register → start → compute proof → finish)
- SCRAM-SHA-256 invalid proof rejection test

Build: 0 warnings, all tests pass
 2026-05-13 09:50:07 +03:00
dimgigov 422df08ab9 feat: clean build + crossmodal.tla + TLA+ symmetry (v1.0.0-prep) 
Build warnings cleanup (0 warnings):
- Suppress threadpool deprecation warning (baradadb.nim)
- Remove unused 'os' import (logging.nim)
- Fix ImplicitDefaultValue for newNode params (ast.nim)
- Add explicit cstring cast for posix.open (wal.nim)
- Fix HoleEnumConv for MsgKind parsing (server.nim)

TLA+ Formal Verification:
- Add symmetry reduction (Permutations) to all 9 existing specs
- Add SYMMETRY directive to all .cfg files
- New crossmodal.tla: cross-modal consistency spec
  * MetadataVectorConsistency, HybridResultValid
  * CommittedAtomicity, AbortedAtomicity, TxnStateValid
- New models/crossmodal.cfg

Tests:
- Add Cross-Modal TLA+ Faithfulness tests (4 tests)

Docs:
- Update PLAN.md and BUG_AUDIT.md with completed tasks
 2026-05-13 09:24:04 +03:00
dimgigov d08de7a062 Update BUG_AUDIT.md and PLAN.md: mark all bugs fixed, add session 6-7, plan for tomorrow 
- BUG_AUDIT.md: 34 bugs documented (32 fixed + 2 auth hardening), all metrics green
- PLAN.md: backup.tla and recovery.tla marked complete, 3 options for tomorrow
  - Option A: Clean build (warnings + symmetry reduction)
  - Option B: crossmodal.tla
  - Option C: True SCRAM-SHA-256
- Cleared 26GB of TLC state files from formal-verification/states/
 2026-05-13 00:17:06 +03:00
dimgigov c0596d6ba1 Update PLAN.md: mark backup.tla and recovery.tla as completed 2026-05-13 00:12:15 +03:00
dimgigov 32b38675a9 Add TLA+ formal verification specs for backup and recovery 
- backup.tla: models backup/restore/verify/cleanup with properties:
  BackupSnapshotsValid, RestoreIntegrity, VerifyIntegrity,
  RetentionInvariant, HistoryConsistency, BackupIdValid
- recovery.tla: models WAL replay REDO/UNDO with properties:
  RedoCommitted, RecoveryCompleteness, WalIntegrity
- Added models/backup.cfg and models/recovery.cfg with bounded constants
- Updated run_all.sh to include both new specs
- All 9 TLA+ specs pass TLC model checking
 2026-05-13 00:06:45 +03:00
dimgigov 5e27a987dd fix: auth token expiration + constant-time JWT signature comparison 
- createToken() добавя exp/iat/nbf в JWT payload
- verifyToken() parse-ва exp/iat/nbf и проверява expiration
- verifyToken() използва constantTimeCompare() за timing-attack resistance
- Добавен import std/times

292 теста, 0 failure-а.
 2026-05-12 23:36:17 +03:00
dimgigov a6aeb7801b docs: обновен BUG_AUDIT.md — всички критични/високи/средни бъгове поправени 2026-05-12 23:31:51 +03:00
dimgigov a72e17f063 fix: последните 4 критични/средни бъга — LSM-Tree, MVCC, DistTxn, Raft 
Поправени проблеми:
- LSM-Tree: WAL write вече е извън db.lock (отделен walLock) → по-добра concurrency
- MVCC: добавен compactVersions() който се изпълнява на всеки 100 commits
  Премахва стари overwritten версии, които не са видими за active транзакции
- DistTxn: commit() вече НЕ rollback-ва commit-нали participants
  Ако някой participant е commit-нал, транзакцията се маркира като committed
- Raft: добавен disk persistence за currentTerm, votedFor, log
  saveState() при всяка промяна; loadState() при стартиране

292 теста, 0 failure-а.
 2026-05-12 23:30:58 +03:00
dimgigov 750746eb18 docs: обновен BUG_AUDIT.md със статус на всички поправки 
- Отбелязани 28 поправени бъга (✅)
- Отбелязани 4 оставащи бъга (❌)
- Актуализиран план с 4 завършени спринта
- Актуализирани метрики
 2026-05-12 23:24:01 +03:00
dimgigov 5e585dd347 fix: deadlock detector, graph/query/lexer бъгове 
Поправени проблеми:
- Deadlock detector: cycle reconstruction вече проверява пълен цикъл
- Graph cypher: executeCypher acquire-ва lock при четене
- Graph engine: loadFromFile acquire-ва lock при зареждане
- Graph engine: lock поле е exported за външен достъп
- Query: parseRowData поддържа escape-ване на , и = в стойности
- Query: execUpdateRow escape-ва стойности при сериализация
- Lexer: readNumber спира при втора точка (1.2.3 вече не е валиден float)
- Lexer: skipBlockComment хвърля ValueError при незатворен коментар

292 теста, 0 failure-а.
 2026-05-12 23:21:29 +03:00
dimgigov 80d57a36bd fix: rate limiter, graph/vector/query/server бъгове 
Поправени проблеми:
- Rate limiter: globalRate вече се enforce-ва; cleanupStaleClients() за memory leak
- Graph engine: addEdge проверява дали src/dst nodes съществуват
- Vector engine: distance() хвърля ValueError при dimension mismatch
- Query: aggregate + * на empty result вече не crash-ва
- Query: exprToSql funcCall вече работи с 0 аргумента
- Query: INSERT trigger вече не crash-ва при празни VALUES
- Server: recvWithTimeout() за всички network reads
- Server: защита от negative activeConnections

292 теста, 0 failure-а.
 2026-05-12 23:15:09 +03:00
dimgigov 6aaabb518d fix: високо и средно приоритетни бъгове в query, protocol, storage, vector, fts 
Поправени проблеми:
- Wire protocol: bounds checking, max length limits, recursion depth limit
- SQL injection: escape-ване на quotes в exprToSql string literals
- ReDoS: escape-ване на regex metachars в LIKE/ILIKE
- Stale BTree indexes: добавен BTree.remove() + изтриване при UPDATE/DELETE
- SSL: quoteShell за всички shell команди с пътища
- Boolean literals: parser вече разпознава tkTrue/tkFalse
- Unary minus: lowerExpr map-ва ukNeg към irNeg (вместо irNot)
- Non-aggregate UDFs: lowerExpr създава irekFuncCall вместо NULL literal
- UTF-8 FTS: tokenize използва runes вместо байтове
- HNSW: добавен Lock за thread-safe insert/search

292 теста, 0 failure-а.
 2026-05-12 23:02:54 +03:00
dimgigov 131541a0e5 fix: критични бъгове в storage, MVCC, auth, Raft, query executor 
Поправени проблеми:
- MVCC: aborted транзакции вече не стават видими (добавено abortedTxns множество)
- LSM-Tree: поправена загуба на данни при immutable memtable overwrite
- LSM-Tree: поправена SSTable search order (сортиране по id вместо minKey)
- WAL: sync()/close() вече извикват posix.fsync()
- Auth: simpleHash (djb2) заменен с HMAC-SHA256
- Recovery: summary() вече не мутира базата данни
- Raft: поправена majority calculation за четен брой нодове
- Query: EXISTS subqueries вече изпълняват подзаявката
- Nimble: поправен build (-d:ssl) и bench task

Добавен BUG_AUDIT.md с пълен доклад и план за подобрения.

292 теста, 0 failure-а.
 2026-05-12 22:45:50 +03:00
dimgigov 3396ba4d63 Remove nimbling directory 2026-05-08 09:44:49 +03:00
dimgigov fecb52dca8 Remove reddit_post_draft.md 2026-05-08 01:32:47 +03:00
dimgigov c4b374e1db Initial commit 2026-05-08 01:13:54 +03:00
dimgigov 8f4299614d ci(clients): use docker healthcheck instead of nc 2026-05-08 00:38:19 +03:00
dimgigov 33194937db ci(clients): fix rust setup and nim server wait 2026-05-08 00:25:57 +03:00
dimgigov 13c2e94fb1 ci(clients): build Nim binaries in CI before Docker image 2026-05-08 00:21:31 +03:00
dimgigov ae2e07e626 feat(clients): professional clients with tests, CI/CD, and examples 
- Python: pyproject.toml, pytest suite (unit + integration), README, examples
- JavaScript: package.json, TypeScript definitions, node:test suite, README, examples
- Nim: integration tests, examples, README, improved nimble tasks
- Rust: fixed nodelay/localhost IPv6 bug, integration tests, examples, README
- Added GitHub Actions CI for all 4 clients against Docker server
- Added docker-compose.test.yml for local integration testing
- Added .gitignore for each client
 2026-05-08 00:18:34 +03:00
dimgigov e9d3c7e9de docs: add multi-language documentation (ru, fa, zh, tr, ar) 2026-05-07 23:42:55 +03:00
dimgigov abb382c419 feat(clients): sync all client drivers with current wire protocol 
- Python: fix column types read order, add auth/ping/query_params, proper recv
- JavaScript: wire up real TCP socket, add auth/ping/query_params, WireValue class
- Rust: add WireValue enum with structured types, fix type fidelity for ARRAY/OBJECT/VECTOR, add auth/query_params, fix ping/error parsing
- Nim: add missing MsgKind values, makeQueryParamsMessage, auth/ping, fix forward decl

All clients now support AUTH (0x09), QUERY_PARAMS (0x03), PING (0x08)
and align with server.nim + wire.nim protocol definitions.
 2026-05-07 22:38:09 +03:00
dimgigov 09247ffcad docs: add version badge at the top of README 2026-05-07 22:18:26 +03:00
dimgigov 8d39d633cf chore: update version strings to v1.0.0 in Docker and Nim code 
- Dockerfile, Dockerfile.source: LABEL version=1.0.0
- Dockerfile.source: update Nim base image 2.2.2 -> 2.2.10
- src/baradadb.nim, src/barabadb/core/httpserver.nim: v0.1.0 -> v1.0.0
- Rebuild baradadb binary with v1.0.0
 2026-05-07 22:06:04 +03:00
dimgigov 157775794d Release v1.0.0 
- 7 TLA+ specs formally verified (~69M states, 0 errors)
- 283+ Nim tests, all passing
- Raft: leader election + log replication + step-down on partition
- 2PC: coordinator crash/recovery + participant timeout
- MVCC: snapshot isolation + write skew detection
- Gossip: SWIM-like membership with strength-based gossip
- Replication: async/sync/semi-sync LSN tracking
- Sharding: consistent hashing with virtual nodes
- Deadlock detection: cycle detection in wait-for graph
- TLA+ faithfulness tests bridging specs to Nim code
- CI: GitHub Actions with automated TLC verification
 2026-05-07 22:01:43 +03:00