Richie
1d1bafbd30
feat(haproxy-logs): ingest HAProxy request logs into Richie DB
...
Add a pipeline to load HAProxy `option httplog` lines into the Richie
database so bot/crawler traffic can be analyzed.
- model: HaproxyRequest mirroring the httplog format, with a unique
line_hash dedup key and indexes on common filter columns
- migration: create the haproxy_request table (unique line_hash + indexes)
- haproxy_logs package:
- parser: httplog line -> columns, strips the journald prefix and
hashes the normalized line
- ingest: batched, idempotent insert that skips rows whose line_hash
already exists, so re-ingesting the same logs is a no-op
- cli: ingest-only `haproxy-logs` command reading stdin or a file
- tests: parsing of a real GPTBot line and idempotent re-ingestion
2026-06-23 21:13:20 -04:00
Richie
121eb979a4
added a index for the VEctor DB
2026-06-14 15:41:09 -04:00
Richie
cdded5da12
added ebook embedding to orm
2026-06-14 15:40:04 -04:00
Richie
41e3e265af
cleaned up audiobook.py mapped_column
2026-06-14 12:53:54 -04:00
Richie
9290cb46ee
updated series_index to float and added UniqueConstraint to audiobook and audiobook_author
treefmt / nix fmt (push) Successful in 5s
build_systems / build-bob (push) Successful in 32s
build_systems / build-leviathan (push) Successful in 41s
build_systems / build-rhapsody-in-green (push) Successful in 44s
pytest / pytest (push) Successful in 27s
build_systems / build-brain (push) Successful in 31s
build_systems / build-jeeves (push) Successful in 2m28s
pytest / pytest (pull_request) Successful in 26s
build_systems / build-bob (pull_request) Successful in 47s
treefmt / nix fmt (pull_request) Successful in 5s
build_systems / build-brain (pull_request) Successful in 44s
build_systems / build-leviathan (pull_request) Successful in 52s
build_systems / build-rhapsody-in-green (pull_request) Successful in 58s
build_systems / build-jeeves (pull_request) Successful in 2m27s
2026-06-13 22:29:56 -04:00
Richie
aff6f4e1bd
adding audiobook data to DB
2026-06-13 22:29:56 -04:00
Richie
261ff139f7
removed ds table from richie DB
2026-03-29 15:54:54 -04:00
Richie
3f4373d1f6
fixed tests and treeftm
2026-03-18 19:29:59 -04:00
Richie
976c3f9d3e
move signal bot to its own DB
2026-03-18 19:29:59 -04:00
Richie
7d2fbaea43
added bot class and rbac style auth with dynamic help msg base on roles
2026-03-18 19:29:59 -04:00
Richie
f1e394565d
migrated to tanasty and added dead letter queue
2026-03-14 11:49:44 -04:00
Richie
3a3267ee9a
fixed ruff warning
2026-03-14 11:49:44 -04:00
Richie
a6fbbd245f
fixed safety number logic
2026-03-14 11:49:44 -04:00
Richie
7ad321e5e2
moved device registry to postgresql
2026-03-14 11:49:44 -04:00
Richie
3dadb145b7
added congress data to database
2026-03-14 11:49:44 -04:00
Richie
69f5b87e5f
setup multy db suport
2026-03-09 07:18:01 -04:00
Richie