11 Commits

Include renames

Author	SHA1	Message	Date
Richie	7e6908ef3d	feat(networking): migrate host services from ZeroTier to Tailscale ... - replace legacy IP addresses with Tailscale MagicDNS names - route Prometheus scraping and exporter firewall access through Tailscale - wait for Tailscale before starting Prometheus - restrict service UI ports to the Tailscale interface - update PostgreSQL and Transmission access rules - remove Jeeves ZeroTier configuration and Docker host overrides	2026-08-27 12:25:27 -04:00
Richie	31ecad881f	feat(extraction): add deduplication limit parameter to YAKE extractor	2026-07-24 11:38:51 -04:00
Richie	68c9693711	feat(config): add new scoring parameters for phrase extraction and matching	2026-07-24 11:38:51 -04:00
Richie	e010756e09	refactor(ebook-search): simplify search and phrase matching	2026-07-24 11:38:51 -04:00
Richie	2706c4417d	feat(ebook): migrate to async DB/HTTP and parallelize phrase pipeline ... Convert the ebook-search web app to async end to end and add concurrency to the protected-phrase extraction and judging pipeline so large books no longer block the event loop or the UI. ORM / infra: - Add get_async_postgres_engine and factor shared URL/connect_args building into build_postgres_url (reused by the sync and async engine builders) - Add async FastAPI session helpers (get_async_db, AsyncDbSession) with expire_on_commit=False to avoid implicit IO under asyncio App: - Use AsyncEngine/AsyncSession throughout routes, search, ingest, embeddings, answer, rerank and LLM calls; convert handlers to async - Share a single httpx.AsyncClient in app state for LLM requests; size the connection pool for concurrent phrase-judging workers - Add judge_tasks: run per-book judging as tracked background tasks so a book already being judged isn't double-queued Protected phrases: - Add a process pool (pool.py) and worker-count config (extraction/judge book/phrase workers) to parallelize candidate generation and judging - Split admin actions into all/missing variants for generation and judging Config: - Add protected_phrase_extraction_workers, phrase_judge_book_workers, phrase_judge_phrase_workers	2026-07-24 11:38:50 -04:00
Richie	70bf8627a2	feat(ebook): implement phrase matching functionality and UI enhancements	2026-07-24 11:38:50 -04:00
Richie	6c8a4bfea7	feat(ebook): add protected phrase extraction library with config-driven tuning ... Refactor protected phrase handling from a single module into a python/ebook_search/protected_phrases package covering extraction, storage, and runtime matching. Phrase filtering is now data-driven via bundled TOML files: ignored_phrases, bad_starts, bad_ends, and most_common_words. Add phrase-tuning settings to EbookSearchConfig so candidate generation, scoring, LLM judging, and matching are configurable rather than hardcoded: token bounds, entity token limit, raw n-gram min count, frequency and chapter-spread score thresholds, candidate/LLM/target caps, confidence threshold, nesting defaults, and the phrase hit boost.	2026-07-24 11:38:50 -04:00
Richie	6bc30115d9	fix(ebook-search): code clean up to impove reliablty and readabilty	2026-06-18 12:45:56 -04:00
Richie	f71ae7d2c6	added guardrails.py to constrain responses and added validation to config.py	2026-06-15 21:57:38 -04:00
Richie	68b3a38b81	converting to pydantic-settings	2026-06-14 21:29:45 -04:00
Richie	26ff1f0fd3	added answer.py and config	2026-06-14 15:40:04 -04:00