Commit Graph
100 Commits
Author SHA1 Message Date
Richie a80de99175 adding math to bob 2026-04-12 10:08:23 -04:00
Richie 50d56a8a39 added config.toml to git ignore 2026-04-12 10:08:23 -04:00
Richie 30dc36588c updated BenchmarkConfig to have from_toml 2026-04-12 10:08:23 -04:00
Richie 68190901cb setup FinetuneConfig 2026-04-12 10:08:23 -04:00
Richie 275762843f deleted train.sh 2026-04-12 10:08:23 -04:00
Richie face93262f added containers dir 2026-04-12 10:08:23 -04:00
Richie ee34a0986b conveted to summarization_prompts 2026-04-12 10:08:23 -04:00
Richie e8b20bc7df moved renamed container.py to vllm_container.py 2026-04-12 10:08:23 -04:00
Richie 6c459985fa created working finetuing pipeline 2026-04-12 10:08:23 -04:00
Richie 20a204612f added data dir for traning 2026-04-12 10:08:23 -04:00
Richie 27b609052c updated spell check 2026-04-12 10:08:23 -04:00
Richie 20fb24e244 added storage pool 2026-04-12 10:08:23 -04:00
Richie 230ab1d7f6 added tiktoken 2026-04-12 10:08:23 -04:00
Richie 9ffaa1b755 added summarization_prompts.py to sore the prompts 2026-04-12 10:08:23 -04:00
Richie c6b4ed4814 added tools dir for on off scripts i used 2026-04-12 10:08:23 -04:00
Richie 88ceeb55a1 added batch_bill_summarizer.py
batch bill  summarizer sends a batch api call to gpt
2026-04-12 10:08:23 -04:00
Richie 6c57d74644 decreased root_pool/models snapshot life 2026-04-12 10:08:23 -04:00
Richie cb98090f95 added bill_token_compression.py
tested on sample size of 100 bills matching the distribution of our data
Compression saves ~11.5% on prompt tokens; completion/reasoning are roughly equal across the two sets.
prompt	completion	reasoning	total
compressed	349,460	157,110	112,128	506,570
uncompressed	394,948	154,710	110,080	549,658
delta	−45,488	+2,400	+2,048	−43,088
2026-04-12 10:08:23 -04:00
Richie 63cb48a3dd created main prompt bench 2026-04-12 10:08:23 -04:00
Richie 6f6d247d3e fixed sunshine.nix 2026-04-12 10:08:23 -04:00
Richie 6b63315579 converting bob to a server 2026-04-12 10:08:23 -04:00
Richie a093c72eb9 creating prompt_bench downloader 2026-04-12 10:08:23 -04:00
Richie 67622c0e51 setting up hedgedoc 2026-04-11 11:42:08 -04:00
Richie d2f447a1af disabling kafka 2026-04-11 11:11:21 -04:00
Richie af365fce9a setup sunshine.nix 2026-04-03 17:12:24 -04:00
Richie 6430049e92 updated postgres snapshot settings 2026-03-30 14:07:08 -04:00
Richie 26e4620f8f fixed systemd sandboxing 2026-03-30 14:07:08 -04:00
Richie 93fc700fa2 removed preStart step 2026-03-30 14:07:08 -04:00
Richie 8d1c1fc628 added mountpoint= to postgres zfs create 2026-03-30 14:07:08 -04:00
Richie dda318753b improving postgres wal 2026-03-30 14:07:08 -04:00
Richie 261ff139f7 removed ds table from richie DB 2026-03-29 15:54:54 -04:00
Richie ba8ff35109 updated ingest_congress to use congress-legislators for legislator info 2026-03-29 15:54:54 -04:00
Richie e368402eea adding LegislatorSocialMedia 2026-03-29 15:54:54 -04:00
Richie dd9329d218 fixed tests 2026-03-29 15:54:54 -04:00
Richie 89f6627bed converted session.execute(select to session.scalars(select 2026-03-29 15:54:54 -04:00
Richie c5babf8bad ran treefmt 2026-03-29 15:54:54 -04:00
Richie dae38ffd9b added ingest_congress.py 2026-03-29 15:54:54 -04:00
Richie ca62cc36a7 adding congress data to new DS DB 2026-03-29 15:54:54 -04:00
Richie 035410f39e adding nemotron-3-nano 2026-03-29 15:54:54 -04:00
Richie e40ab757ca making more generic exception handling 2026-03-29 15:54:54 -04:00
Richie 345ba94a59 ran ingest_posts 2026-03-29 15:54:54 -04:00
Richie f2084206b6 adding tables for 2023 2026-03-29 15:54:54 -04:00
Richie 50e764146a added ingest_posts.py 2026-03-29 15:54:54 -04:00
Richie ea97b5eb19 adding 2026 partitions 2026-03-29 15:54:54 -04:00
Richie 1ef2512daa adding post table 2026-03-29 15:54:54 -04:00
Richie f9a9e5395c added media/temp for fast dir when working with data 2026-03-29 15:54:54 -04:00
Richie d8e166a340 adding data_science_dev 2026-03-29 15:54:54 -04:00
Richie c266ba79f4 updated snapshot_config.toml 2026-03-29 14:12:06 -04:00
Richie f627a5ac6e enabling kafka 2026-03-26 09:59:31 -04:00
Richie a5e7d97213 adding full qwen3 2026-03-24 16:20:21 -04:00
Richie 1419deb3c6 setting up brain nix serve 2026-03-24 15:04:48 -04:00
Richie 1f06692696 adding zstd to firefix settings 2026-03-24 12:53:44 -04:00
Richie 8f8177f36e adding zstd compression to fastapi 2026-03-24 12:53:44 -04:00
Richie 8534edc285 added git key binds 2026-03-24 12:45:51 -04:00
Richie 73b28a855b fixed missed renames 2026-03-24 12:45:51 -04:00
Richie 0c0810a06b added cycle status 2026-03-24 12:45:51 -04:00
Richie 239bef975a adding availability status to HA 2026-03-24 12:45:51 -04:00
Richie 2577b791f7 removing antigravity 2026-03-24 12:41:28 -04:00
Richie b4d9562591 fixed treefmt 2026-03-22 19:07:23 -04:00
Richie 66f972ac2b removing react 2026-03-22 19:07:23 -04:00
Richie aca756f479 down grading transmision 2026-03-22 14:30:13 -04:00
Richie 7f59f7f7ac fixing brain gps data 2026-03-22 14:30:13 -04:00
Richie 1b5a036061 httpx conversion 2026-03-18 19:38:14 -04:00
Richie 42330ec186 changed to sa.Enum 2026-03-18 19:29:59 -04:00
Richie 3f4373d1f6 fixed tests and treeftm 2026-03-18 19:29:59 -04:00
Richie cc73dfc467 updated mats ssh key 2026-03-18 19:29:59 -04:00
Richie 976c3f9d3e move signal bot to its own DB 2026-03-18 19:29:59 -04:00
Richie 2661127426 updated _format_location to use van van_last_known_longitude and van_last_known_latitude 2026-03-18 19:29:59 -04:00
Richie 1b3e6725ea added sync_roles 2026-03-18 19:29:59 -04:00
Richie 7d2fbaea43 added bot class and rbac style auth with dynamic help msg base on roles 2026-03-18 19:29:59 -04:00
Richie a19b1c7e60 Add Signal location command backed by Home Assistant 2026-03-18 19:29:59 -04:00
Richie 76da6cbc54 set syncModels to false 2026-03-15 12:06:01 -04:00
Richie c83bbe2c24 added more data to van weatere and moved retry logic to tenacity 2026-03-15 12:06:01 -04:00
Richie 7611a3b2df fixed GPS 2026-03-15 12:06:01 -04:00
Richie aec5e3e22b adding qalculate-gtk 2026-03-15 10:39:17 -04:00
Richie 4e3273d5ec fixed tree fmt and removed chat with images 2026-03-14 11:49:44 -04:00
Richie b5ee7c2dc2 added logging 2026-03-14 11:49:44 -04:00
Richie 958b06ecf0 added auth cashe 2026-03-14 11:49:44 -04:00
Richie 71ad8ab29e removed comand prefix 2026-03-14 11:49:44 -04:00
Richie 852759c510 decreased signal_cli_rest_api version 2026-03-14 11:49:44 -04:00
Richie d684d5d62c add envvars to 2026-03-14 11:49:44 -04:00
Richie f1e394565d migrated to tanasty and added dead letter queue 2026-03-14 11:49:44 -04:00
Richie 754ced4822 added tenacity 2026-03-14 11:49:44 -04:00
Richie 5b054dfc8f added signalbot servec account 2026-03-14 11:49:44 -04:00
Richie 663833d4fa fixed tests 2026-03-14 11:49:44 -04:00
Richie 433ec9a38e fixed typo in van_inventory serviceConfig 2026-03-14 11:49:44 -04:00
Richie 3a3267ee9a fixed ruff warning 2026-03-14 11:49:44 -04:00
Richie 0497a50a43 removed repo_line_counter.py 2026-03-14 11:49:44 -04:00
Richie 6365dd8067 updated the van inventory to use the api 2026-03-14 11:49:44 -04:00
Richie a6fbbd245f fixed safety number logic 2026-03-14 11:49:44 -04:00
Richie 7ad321e5e2 moved device registry to postgresql 2026-03-14 11:49:44 -04:00
Richie 14338e34df updated BotConfig 2026-03-14 11:49:44 -04:00
Richie c73aa5c98a setup context manger for SignalClient and LLMClient 2026-03-14 11:49:44 -04:00
Richie f762f12bd2 added max retry and retry back off to run_loop 2026-03-14 11:49:44 -04:00
Richie ab5df442c6 reworked dispatch 2026-03-14 11:49:44 -04:00
Richie 3dadb145b7 added congress data to database 2026-03-14 11:49:44 -04:00
Richie 75a67294ea added bound checking to van invintory 2026-03-09 07:24:05 -04:00
Richie 58b25f2e89 ran treefmt 2026-03-09 07:18:01 -04:00
Richie 568bf8dd38 updated the van_inventory user and db 2026-03-09 07:18:01 -04:00
Richie 82851eb287 added van inventory serves 2026-03-09 07:18:01 -04:00