"PFS" branch: Core architecture + DB persistent storage; PFS+PQ for DMs; refactoring and internals redesigns - #103

Draft

jagerman wants to merge 205 commits into

devfrom

Commits on Jul 7, 2026

Fix unpleasant string chopping
jagerman
committed
6aae1d7
Refactor internal dependencies to use session-deps
jagerman
committed
3831d05
Drop libsodium-internal; add tweetnacl implementation for X->Ed
jagerman
committed
9474dad
API improvements for hashing, arrays, clearing, spans
jagerman
committed
49608f5
WIP - session db, PFS, device linking, etc.
jagerman
committed
3f6244c
Add simdutf to session-deps
jagerman
committed
61d3a40
Various build fixes
jagerman
committed
9b5418a
session-deps: session-router, libquic, and fix
jagerman
committed
7d744e5
Add devices message parsing
jagerman
committed
4485a01
Expose callbacks to components
jagerman
committed
eee237c
WIP: device linking
jagerman
committed
f6ea190
Add generic core message consumer
jagerman
committed
49c9f0f
formatting
jagerman
committed
aa6fff8
Hash & type unification
jagerman
committed
d8db5b4
Make hashing endian-safe; more blake2b_pers conversion
jagerman
committed
a46b400
Use std::byte to avoid oxenc buggy overload
jagerman
committed
7463d47
array_ucNN -> ucNN, for test suite
jagerman
committed
ec673dd
Bake int_for_hashing into the hash helpers
jagerman
committed
fae949c
Add emoji SAS support for link requests
jagerman
committed
04cbc9c
link request handling WIP
jagerman
committed
edf9cbb
Merge link requests and devices into same namespace
jagerman
committed
b2d37e2
Move device list to subkey of device group message
jagerman
committed
b96b207
WIP on device and account messages
jagerman
committed
b1e9bab
Account key rotation tie-breaking
jagerman
committed
4f4b59a
bump session-deps for sqlite3mc namespacing patch
jagerman
committed
8865051
Add network to core + fixes
jagerman
committed
78210a4
devices: publish & distributed tracking
jagerman
committed
91b448d
Implement update_info
jagerman
committed
39f20b5
Add a global adjustable system clock
jagerman
committed
1afcc89
Add test helper friend class
jagerman
committed
5aabcb5
Add optional Core polling of device & account namespaces
jagerman
committed
d7a519d
update session-deps
jagerman
committed
b9f3f21
formatting & small code simplifications
jagerman
committed
3a38ca1
add missing clock header
jagerman
committed
04f1e62
Devices tests; various fixes
jagerman
committed
f799b2a
add missing files
jagerman
committed
d20ade5
fix merge conflict
jagerman
committed
5cda501
Update session-deps
jagerman
committed
473812f
Add Electrum word lists
jagerman
committed
7133598
Add ability to use a predefined seed
jagerman
committed
c2af9f0
Seed word handling fixes and improvements
jagerman
committed
de91f75
Add checksum support to seed words
jagerman
committed
fd980f8
Mnemonics secure mem & integration with predefined_seed
jagerman
committed
8e28520
Make last_hash cache node-dependent
jagerman
committed
e3220f9
Add PFS+PQ remote session id cache & prefetching
jagerman
committed
934704b
Add negative-ack caching to PFS+PQ pubkey prefetching
jagerman
committed
5c1f640
improve ScopedClockOffset variable names
jagerman
committed
8f0b224
Add callback + status returns for remote PFS key prefetch
jagerman
committed
94a124d
Switch to SHAKE256; improve SHAKE256 API
jagerman
committed
d597712
Add SHA3-256 hasher
jagerman
committed
551a7b5
Abstract 32-or-64 seed input
jagerman
committed
f939173
bump session-router
jagerman
committed
6f6233b
Refactor: compile-time safe Ed25519 privkey args
jagerman
committed
7ca2b47
Add live (testnet) network test script
jagerman
committed
7a8f106
Add PFS + PQ encryption and decryption implementations
jagerman
committed
5048553
Improve test db naming to avoid parallel invocation overlap
jagerman
committed
d0321f6
Cache long-term x25519 private scalar alongside the seed
jagerman
committed
7c24552
Fix test suite
jagerman
committed
1a6583c
Refactor to use fixed-extent spans for fixed-size quantities
jagerman
committed
551379f
uint8_t -> unsigned char for byte values
jagerman
committed
24ac035
Add DM v1+v2 parsing and polling support
jagerman
committed
1a325b9
formatting
jagerman
committed
01f1c67
Split up big nested functions
jagerman
committed
89d779a
session_protocol: Replace destination-dispatch pattern with typed encode functions
jagerman
committed
d4fb0a4
Use hash::blake2b in more places
jagerman
committed
2dfa9a2
unsigned char -> std::byte refactor, part 1
jagerman
committed
cda7c98
Add fallback "no-PFS" support
jagerman
committed
f0054a9
Replace snprintf_clamped with fmt-based helpers
jagerman
committed
14956c7
Add "v2" DM construction via Core
jagerman
committed
55cc134
QUIC file server over session-router support
jagerman
committed
5f51bf0
Add a streaming decryptor; tweak encrypt keygen
jagerman
committed
beb6932
Make quic file uploader use streaming encryption
jagerman
committed
02663c0
update session-router/libquic to fix send_fin bug
jagerman
committed
211be88
Add -Werror=missing-declarations; fix issues it caught.
jagerman
committed
25f2991
QUIC file transfer improvements: progress, ready-gating; MTU config
jagerman
committed
b46b88f
unsigned char -> std::byte refactor, part 2: b32
jagerman
committed
ba90d7c
unsigned char -> std::byte refactor, part 3: crypto API reorganization
jagerman
committed
7662405
Merge conflicts
jagerman
committed
c9b2394
Add generic fmt::formatter for std::byte spans
jagerman
committed
6e6ddbd
std::byte refactor: cleanup, formatting, and API improvements
jagerman
committed
414b5ff
std::byte refactor: final reformatting
jagerman
committed
6559d36
Bump session-sqlite submodule to avoid undeclared oxenc dep
jagerman
committed
8ed0b89
formatting
jagerman
committed
c3e294f

Commits on Jul 8, 2026

Bump session-sqlite

jagerman
and
claude
committed
911d474
Bump session-deps

jagerman
and
claude
committed
2bcd8e9
Bump session-router

jagerman
and
claude
committed
4347851
Parse JSON from a char view rather than a byte range

jagerman
and
claude
committed
ab36475
Link simdutf, nlohmann_json and network into their targets

jagerman
and
claude
committed
a66aed3
Drive all LTO from USE_LTO; use bundled fmt/spdlog for static builds

jagerman
and
claude
committed
707c3f3
Miscellaneous build and compatibility fixes

jagerman
and
claude
committed
4955a49

Commits on Jul 16, 2026

Fix endian byte-swap in hash::detail::make_hashable big-endian path

jagerman
and
claude
committed
2c1c46e

Commits on Jul 17, 2026

formatting
jagerman
committed
f184204
Fix quic linking
jagerman
committed
5ddcc1c
Fix compilation with session-router is disabled
jagerman
committed
e80c69c

Commits on Jul 18, 2026

Build fixes: fmt/spdlog linking, oxen-logging/oxen::quic resolution, always-on networking

jagerman
and
claude
committed
fadbd49
Widen revocation ticket to 64-bit; accept signed ints in json_require

jagerman
and
claude
committed
5a4afe7
Pro wire format: milliseconds -> integer seconds

jagerman
and
claude
committed
6cc223d
Pro & config timestamps: milliseconds -> integer seconds, signed int64_t

jagerman
and
claude
committed
0b00131
Rename gen_index_hash -> revocation_tag

jagerman
and
claude
committed
be51dfc
Rename protobuf ProProof field genIndexHash -> revocationTag

jagerman
and
claude
committed
941b721
Reshape revocation list: drop per-entry expiry, add effective_ts/retry_in/retain_for

jagerman
and
claude
committed
02a9ca6
Pro payments: collapse provider/plan enums + typed IDs into opaque payment_id

jagerman
and
claude
committed
6003333
Refactor Pro feature bitsets into type-safe enum-class flags

jagerman
and
claude
committed
0d752b4
Reference wire spec instead of backend source permalinks

jagerman
and
claude
committed
bec7c25
Redesign pro_backend C/C++ API around free functions

jagerman
and
claude
committed
07b325e
Preserve sub-second precision on purchased_ts/revoked_ts (+ rename unredeemed→purchased)

jagerman
and
claude
committed
8399ec4
Remove wire version: gone from requests, personalisation-encoded for the proof

jagerman
and
claude
committed
96e14ca
Deduplicate and simplify session_protocol.cpp internal helpers

jagerman
and
claude
committed
1877db3
Make the C session_protocol_pro_proof_status delegate to ProProof::status

jagerman
and
claude
committed
8904745
Merge branch 'pro-flags-cleanup' into pro-backend-updates-pfs

jagerman
and
claude
committed
62d89d7
tests: purge arcane fprintf debug output in favour of Catch2 INFO

jagerman
and
claude
committed
f7658fc

Commits on Jul 19, 2026

pro_backend: build request bodies with a single nlohmann literal

jagerman
and
claude
committed
c82f716
pro: hash timestamps as int64_t, not uint64_t

jagerman
and
claude
committed
607834a
pro_backend: parse payment/user status as opaque string codes

jagerman
and
claude
committed
b0d11fc
pro_backend: fill in the backend proof-signing pubkey

jagerman
and
claude
committed
08228c0
pro_backend: add backend base URL + C export of the signing pubkey

jagerman
and
claude
committed
ed1fe13
tests: pin blake2b_pers integer little-endian encoding + add big-endian audit

jagerman
and
claude
committed
25ce702
test-bigendian: use local qemu-user-static + debian:sid

jagerman
and
claude
committed
1346490
Pro: rename *_unix_ts fields to *_at

jagerman
and
claude
committed
a48b509
Pro: give ProRequest an explicit content_type; body -> opaque data

jagerman
and
claude
committed
5ba0fa6
clang-format fixups after the *_unix_ts -> *_at rename

jagerman
and
claude
committed
d92d6c7
Pro C API: collapse request builders into thin C++ wrappers

jagerman
and
claude
committed
fcd65cd
Pro: add PUBKEY_X25519 constant (X25519 form of the backend pubkey)

jagerman
and
claude
committed
fd7598e
test-bigendian: local qemu-user-static + sid, quic-deps via apt, guarded tags

jagerman
and
claude
committed
bf1cdf2

Commits on Jul 20, 2026

Pro: drop the overloaded Response.status field

jagerman
and
claude
committed
f295a43
Pro: response envelope -> status enum + error_code slug + single error (Delta #12)

jagerman
and
claude
committed
837f985
Pro signing: sign the message directly (Delta #13), drop BLAKE2b

jagerman
and
claude
committed
ce1d17e

Commits on Jul 21, 2026

pro_backend: add visible_platforms() — user-visible purchasable slugs

jagerman
and
claude
committed
13817c6

Commits on Jul 22, 2026

pro_backend: parse the plan billing-period code (Delta #14)

jagerman
and
claude
committed
d86a720
pro_backend.h: collapse redundant forward-typedef struct declarations

jagerman
and
claude
committed
abe6e70
pro_backend: make C++ the owner of the payment-provider code constants

jagerman
and
claude
committed
7799a05
pro_backend: C responses wrap the owned C++ object; drop the arena

jagerman
and
claude
committed
efba4d8
session_protocol: idiomatic C header + C++-owned constants, misc cleanup

jagerman
and
claude
committed
7eb85e3
pro_backend: redesign ProviderURLs (optional fields, static per-provider constants)

jagerman
and
claude
committed
e70cd0d
pro_backend: add `found` to session_pro_backend_provider_urls (C)

jagerman
and
claude
committed
2a21123
Eliminate string8; it duplicated span_u8

jagerman
and
claude
committed
c3d7d57
pro_backend: split get_pro_details into get_pro_status + get_payment_details (Delta #15)

jagerman
and
claude
committed
ed23ecd

Commits on Jul 23, 2026

pro_backend: drop stale backend server.py link from the header preamble

jagerman
and
claude
committed
bac43bb
pro_backend: drop stale "Delta #14" spec citations

jagerman
and
claude
committed
1867b2b
Add live Pro-backend integration tests ([pro_live]) + CI

jagerman
and
claude
committed
43862ca
Add server-less known-answer vectors for Pro signed messages ([pro_kat])

jagerman
and
claude
committed
fe88f80
Harness: drop stale Delta-N spec citations; track backend upstream dev

jagerman
and
claude
committed
51cbdcd
CI: install python3-psycopg-pool for the Pro-backend live pipeline

jagerman
and
claude
committed
9937d65

Commits on Jul 24, 2026

CI: force a UTF-8 locale in the ephemeral-backend launcher

jagerman
and
claude
committed
21dd62c

Commits on Jul 27, 2026

Fix to_string_view causing problems with fmt9

jagerman
and
claude
committed
d40f8d6
Add missing <ranges> include

jagerman
and
claude
committed
098e88d
Fall back to room-less file URL format when parsing open group download URLs

jagerman
and
claude
committed
57c29e0
Clamp revocation list retry/cleanup values

jagerman
and
claude
committed
c666e8f
tests/pro_backend: fix seed_payment obfuscated-account-id derivation

jagerman
and
claude
committed
702332f
Network config runtime option cleanup

jagerman
and
claude
committed
046f188
Actually use the `custom_file_server_pubkey_hex` value

jagerman
and
claude
committed
5044f50
Merge remote-tracking branch 'origin/dev' into pfs
jagerman
committed
f320852
Add clarifying comment that swarm is preshuffled
jagerman
committed
3edd131

Commits on Jul 30, 2026

SnodePool: fix use-after-free when running post-refresh callbacks

mpretty-cyro
authored and
jagerman
committed
984e3a2
Merge remote-tracking branch 'origin/dev' into pfs
jagerman
committed
249392f
Fix C API declarations desynced from their definitions
jagerman
committed
f4fedca
Fix remaining -Wmissing-declarations errors
jagerman
committed
e1fce7c
Drop duplicated, stale comment on compress_message
jagerman
committed
c1e65bc

Commits on Jul 31, 2026

config: add synced refund-requested flag to UserProfile

jagerman
and
claude
committed
e889c8d
pro_backend: remove set_payment_refund_requested endpoint

jagerman
and
claude
committed
b21f31a
config: drop redundant condition in if-init statements

jagerman
and
claude
committed
b6c89d3
config: ignore refund-requested values older than a week

jagerman
and
claude
committed
d7160f8
pro_backend: remove /add_pro_payment; redemption is now implicit

jagerman
and
claude
committed
552d9dd
config: migrate legacy millisecond pro_access_expiry on read

jagerman
and
claude
committed
fa2be0b
pro_backend: collapse redundant ProProofResponse base

jagerman
and
claude
committed
a999938
config: stop persisting the proof version (dicts aren't atomic)

jagerman
and
claude
committed
7786407
config: store the pro credential as one atomic bt-encoded value

jagerman
and
claude
committed
53b4226
pro: add ProProof::rotating_seed deterministic generator

jagerman
and
claude
committed
92f5698
config: add maybe_span dict helper

jagerman
and
claude
committed
8b8d7a1
config: add pro_prepaid (purchase-in-flight) flag + auto-clears

jagerman
and
claude
committed
ee8c60f
config: add UserProfile::pro_renewal_target (when to re-request a proof)

jagerman
and
claude
committed
e195064
tests: use chrono duration literals for pro/refund timestamps

jagerman
and
claude
committed
9b6af9b
pro_message: assert the previously-ignored to_chars ec

jagerman
and
claude
committed
3f4e376
session_protocol: drop the ProSignedMessage struct

jagerman
and
claude
committed
ed47068
pro_backend: fold the *_sig(s) helpers into their *_request builders

jagerman
and
claude
committed
adad94e
session_protocol: make ProProof::status const

jagerman
and
claude
committed
51743f7
session_protocol: fix stale doc comments

jagerman
and
claude
committed
86e3101
session_protocol: drop the unused sent_timestamp from encode_for_community_inbox

jagerman
and
claude
committed
69deab8
session_protocol: use a cheap validly-encoded decoy signature

jagerman
and
claude
committed
ce0a2cb
Fix unused parameters
jagerman
committed
3516c32
config: use maybe_span instead of maybe_vector for pro/group key loads
jagerman
committed
e1bb841
session_protocol: rename ProProof::rotating_seed's timestamp param to now

jagerman
and
claude
committed
49f3a4e
config: defer pro_renewal_target briefly at a rotation boundary

jagerman
and
claude
committed
e95ab50
attachments: mark process_chunk's is_final [[maybe_unused]]

jagerman
and
claude
committed
1fe662c
session_protocol/config: apply review to the rotating-seed rename + renewal deferral

jagerman
and
claude
committed
df61ae1
util: view-based utf16_truncate/utf16_count; drop asserts on user input

jagerman
and
claude
committed
05a7143
session_protocol: pro_features_for_utf8/16 -> pro_features_for_message

jagerman
and
claude
committed
1983484
session_protocol/user_profile: fix "weekly rotation" wording; add jitter TODO

jagerman
and
claude
committed
5efc327
user_profile: only schedule a proof fetch when there's an entitlement signal

jagerman
and
claude
committed
b1c85de
pro_backend: surface advisory account_expiry_ts from the proof response

jagerman
and
claude
committed
b136c23
session_protocol: document PRO_RENEWAL_LEAD as a locked backend contract

jagerman
and
claude
committed
e8511cc
formatting
jagerman
committed
fdb5826
Merge pull request #106 from jagerman/refund-requested-config-pfs
jagerman
authored
4b9a59f
Drop redeemed_at/redeemed_ts and the "unredeemed" status

jagerman
and
claude
committed
e550278

Commits on Aug 1, 2026

Add missing backend modules
jagerman
committed
d38e148
Merge pull request #108 from jagerman/drop-redeemed-at-pfs
jagerman
authored
8a064a1
Rename payment provider rangeproof -> stf

jagerman
and
claude
committed
dfc7295
Merge pull request #111 from jagerman/rename-rp-to-stf-pfs
jagerman
authored
6490571
Validate blinded IDs before matching

Ap4sh
authored and
jagerman
committed
1bab2fe
Merge remote-tracking branch 'origin/dev' into pfs
jagerman
committed
6dc1f5e

Commits on Aug 3, 2026

Drop error_report from get_pro_status

jagerman
and
claude
committed
77d93ac
decrypt_group_message: parse via bt_dict_consumer require/maybe helpers
jagerman
committed
2002fa2
ci: backend: kwarg rename fix
jagerman
committed
971ab77
Merge pull request #113 from jagerman/drop-error-report-pfs
jagerman
authored
4954f41
Merge remote-tracking branch 'origin/dev' into pfs
jagerman
committed
e4e0a69