100 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Richie	7606ddc514	feat(haproxy-logs): ingest HAProxy request logs into Richie DB ... Add a pipeline to load HAProxy `option httplog` lines into the Richie database so bot/crawler traffic can be analyzed. - model: HaproxyRequest mirroring the httplog format, with a unique line_hash dedup key and indexes on common filter columns - migration: create the haproxy_request table (unique line_hash + indexes) - haproxy_logs package: - parser: httplog line -> columns, strips the journald prefix and hashes the normalized line - ingest: batched, idempotent insert that skips rows whose line_hash already exists, so re-ingesting the same logs is a no-op - cli: ingest-only `haproxy-logs` command reading stdin or a file - tests: parsing of a real GPTBot line and idempotent re-ingestion	2026-06-27 23:01:03 -04:00
Richie	137bd8ed2f	adding robots.txt	2026-06-27 23:01:03 -04:00
Richie	f936253ad5	flake update	2026-06-22 11:31:47 -04:00
Richie	fc01fb9d0b	Merge branch 'main' into feature/book-search-engine	2026-06-21 15:04:43 -04:00
Richie	09d963ba34	fix(ebook-search): skip comment lines in gold query loader and realign tests ... load_gold_queries now skips blank and `//` comment lines so the committed section separator in queries.jsonl no longer breaks dataset/load-test loading. Update tests left stale by the search refactor (6bc3011): - pass the now-required rank_constant to reciprocal_rank_fusion - expect bm25_candidates to receive the full query and drop the removed "BM25 query preparation" timing step - assert reranking is enabled by default	2026-06-21 14:45:31 -04:00
Richie	855af0fdff	updating 10-Primary to enp97s0f1	2026-06-21 14:25:02 -04:00
Richie	fcb69cc68b	adding words to spell check	2026-06-18 12:55:46 -04:00
Richie	6bc30115d9	fix(ebook-search): code clean up to impove reliablty and readabilty	2026-06-18 12:45:56 -04:00
Richie	6ae1ff1f5c	feat(ebook-search): add load-test CLI for the search service ... Add a Typer CLI script that drives POST /search on a running server at a configurable concurrency and reports latency percentiles (p50/p90/p95/p99), throughput, and HTTP status distribution. Queries are drawn from the shared eval JSONL set so load testing and evaluation exercise the same questions.	2026-06-18 12:39:55 -04:00
Richie	dbc6b5b53b	test(ebook-search): organize tests under dedicated package ... Move ebook search tests into tests/ebook_search and standardize mocking on pytest-mock.	2026-06-16 21:47:40 -04:00
Richie	a9daa60c17	moved TC001 expetop out of pyproject.toml	2026-06-16 18:31:40 -04:00
Richie	241a42b20d	updated front end	2026-06-16 00:00:13 -04:00
Richie	4640ebf8ce	converted addmin.py and page.py to DbSession and AppConfig	2026-06-15 22:01:42 -04:00
Richie	0c9583c1cc	moved config = load_config() to lifespan	2026-06-15 21:59:51 -04:00
Richie	f71ae7d2c6	added guardrails.py to constrain responses and added validation to config.py	2026-06-15 21:57:38 -04:00
Richie	2e68c83021	added health endpoints	2026-06-15 21:21:01 -04:00
Richie	b126987b63	added AppConfig and AppEngine	2026-06-15 21:08:55 -04:00
Richie	68b3a38b81	converting to pydantic-settings	2026-06-14 21:29:45 -04:00
Richie	a5d7c3be4f	fixed fomat issue	2026-06-14 15:42:05 -04:00
Richie	2995a75748	fixed test	2026-06-14 15:41:09 -04:00
Richie	dce1838163	opning ports for testing	2026-06-14 15:41:09 -04:00
Richie	121eb979a4	added a index for the VEctor DB	2026-06-14 15:41:09 -04:00
Richie	c88315e9b6	improved BM25 write	2026-06-14 15:41:09 -04:00
Richie	50795ab7fc	added ZstdMiddleware to ebook_search	2026-06-14 15:41:09 -04:00
Richie	e9a80a0308	added vector_engine to fix name postgres name space issue	2026-06-14 15:41:09 -04:00
Richie	eb76edb740	reworked ebook_search routers	2026-06-14 15:41:09 -04:00
Richie	c53afb3c70	made fastapi tools	2026-06-14 15:41:09 -04:00
Richie	8301db39e5	added proper cache invalidation to load_bm25_corpus	2026-06-14 15:40:31 -04:00
Richie	45a9e90524	updated tests	2026-06-14 15:40:31 -04:00
Richie	dd67de3993	improved reranking weights	2026-06-14 15:40:31 -04:00
Richie	6e3635ca01	fixed duplicat enrichment	2026-06-14 15:40:31 -04:00
Richie	11cbe31152	improved queary for vector search	2026-06-14 15:40:31 -04:00
Richie	5544dfa61c	add .ebook_search_bm25 to gitignore	2026-06-14 15:40:31 -04:00
Richie	911df63513	updated python	2026-06-14 15:40:31 -04:00
Richie	07eb170b34	setup tests	2026-06-14 15:40:04 -04:00
Richie	6715bbf0a5	build api and frountend	2026-06-14 15:40:04 -04:00
Richie	26ff1f0fd3	added answer.py and config	2026-06-14 15:40:04 -04:00
Richie	666ea97754	added __init__	2026-06-14 15:40:04 -04:00
Richie	e01c687625	made llm_interface.py	2026-06-14 15:40:04 -04:00
Richie	82a367a2b6	added rerank	2026-06-14 15:40:04 -04:00
Richie	ad1834c537	built ingest	2026-06-14 15:40:04 -04:00
Richie	aed1e14d95	built rag search setup	2026-06-14 15:40:04 -04:00
Richie	0a2d4c08cb	set up embedding system	2026-06-14 15:40:04 -04:00
Richie	db98bd3559	built BM25 search foundation	2026-06-14 15:40:04 -04:00
Richie	cdded5da12	added ebook embedding to orm	2026-06-14 15:40:04 -04:00
Richie	d022251a58	removed hedgedoc	2026-06-14 15:40:04 -04:00
Richie	e1ef4de6a3	adding embedding Models to jeeves	2026-06-14 15:40:04 -04:00
Richie	5c230a267c	ran treefmt	2026-06-14 13:53:02 -04:00
Richie	5215d66d40	adding noqa to DbSession	2026-06-14 13:50:49 -04:00
Richie	7ad198416b	added TYPE_CHECKING to contact main.py	2026-06-14 13:50:27 -04:00
Richie	1461c2552a	removed van-inventory from pyproject.toml	2026-06-14 13:48:17 -04:00
Richie	736717c2f8	added TYPE_CHECKING to middleware.py	2026-06-14 13:48:02 -04:00
Richie	ab2521867e	added TYPE_CHECKING to dependencies.py	2026-06-14 13:47:50 -04:00
Richie	8e0ab4190b	added TYPE_CHECKING to heater main.py	2026-06-14 13:46:40 -04:00
Richie	734fd7641e	moved fetch_weather to masked lat lon and	2026-06-14 13:46:03 -04:00
Richie	e898e08c48	added noqa to validate system	2026-06-14 13:41:50 -04:00
Richie	d916ea903c	removed dead code	2026-06-14 13:39:55 -04:00
Richie	d8e916dbe6	fixed type bug in get_snapshots	2026-06-14 13:38:14 -04:00
Richie	48e9f0199d	deleting van_inventory	2026-06-14 13:37:55 -04:00
Richie	a526420c8d	fixed un needed noqa's	2026-06-14 12:58:50 -04:00
Richie	41e3e265af	cleaned up audiobook.py mapped_column	2026-06-14 12:53:54 -04:00
Richie	38a17f6146	cleaned uo python dependencies	2026-06-14 12:49:22 -04:00
Richie	fe48d4c1ad	removing splendor	2026-06-14 12:00:39 -04:00
Richie	9290cb46ee	updated series_index to float and added UniqueConstraint to audiobook and audiobook_author	2026-06-13 22:29:56 -04:00
Richie	acd3f2d3ac	fixed omnibus for audio books	2026-06-13 22:29:56 -04:00
Richie	08e716f66a	deleted frontend dir	2026-06-13 22:29:56 -04:00
Richie	d197731af4	added llm_tool_calling.py	2026-06-13 22:29:56 -04:00
Richie	1ffc48bb02	built workflow	2026-06-13 22:29:56 -04:00
Richie	b6395ef18f	Add catalog.py for manually adding authors and series to the database.	2026-06-13 22:29:56 -04:00
Richie	aff6f4e1bd	adding audiobook data to DB	2026-06-13 22:29:56 -04:00
Richie	a9a96db944	cleaned up old_installer.py	2026-06-13 22:27:11 -04:00
Richie	d34154541d	moved installer.py to old_installer.py	2026-06-13 22:20:58 -04:00
Richie	5d3a851137	deleting data_science code ... this code was moved to https://gitea.tmmworkshop.com/Nornsight/weave	2026-06-13 21:14:42 -04:00
Richie	e05e5c77bc	deleting signal bot	2026-06-13 21:09:34 -04:00
Richie	b0a2ebc052	deleting unneeded files	2026-06-13 20:47:55 -04:00
Richie	f77c9657a3	chore: update flake.lock	2026-06-12 13:06:18 -04:00
Richie	f908f969d3	opening port for vllm	2026-06-08 19:43:07 -04:00
Richie	3cf49c5479	fixing update-flake-lock.yaml permissions	2026-06-07 11:21:10 -04:00
Richie	b34354f5e5	adding storage to bob	2026-06-07 10:48:47 -04:00
Richie	44826464de	flake update fro claud code	2026-06-07 10:01:51 -04:00
Richie	3de0ffccb0	adding workflow dispatch for gitea_flake_lock.py	2026-06-06 22:56:34 -04:00
Richie	c6c98b3e26	updated Primary nic	2026-06-04 18:10:41 -04:00
Richie	d459f3d675	adding brave	2026-06-04 18:10:41 -04:00
Richie	33e4b37cce	fixing jeeves dns	2026-06-04 18:10:41 -04:00
Richie	2a8e7e7f2b	updated my ssh_config.nix	2026-06-03 22:11:19 -04:00
Richie	07759353be	flake update	2026-05-29 22:30:33 -04:00
Richie	38fb14520e	removed --reload	2026-05-29 20:26:32 -04:00
Richie	006ae6079a	moved nornsight off my_python	2026-05-29 20:15:51 -04:00
Richie	7d507fb7e1	adding nornsight.nix	2026-05-29 18:39:27 -04:00
Richie	0f69022e51	disabled terminal bell	2026-05-29 13:52:46 -04:00
Richie	a260ae2470	adding ffmpeg to jeeves and rhapsody-in-green	2026-05-28 22:14:59 -04:00
Richie	820b4a53d2	adding photos to syncthing	2026-05-28 22:08:46 -04:00
Richie	ea77e83f06	setting forceImportRoot to false	2026-05-14 15:12:53 -04:00
Richie	a9da208bc3	added --accept-flake-config to nixos-rebuild step	2026-05-14 13:39:13 -04:00
Richie	739d7dd28c	droped whisper from my_python	2026-05-14 13:38:41 -04:00
Richie	651599796e	moved ./llm_tools.nix to gui only	2026-05-14 12:58:15 -04:00
Richie	b9d440597c	removed llm tools from gui	2026-05-13 10:03:15 -04:00
Richie	311cc5d7a7	adding pi-coding-agenta	2026-05-13 08:57:45 -04:00
Richie	fb2519046d	moved codex and opencode to master pkgs	2026-05-13 08:56:18 -04:00
Richie	bc6b1585ec	flake update	2026-05-10 13:49:53 -04:00