87 Commits

Author	SHA1	Message	Date
Stan Runge	0088e5202e	stats: history and culture collector (step 4): events, offices, people, holidays, UNESCO, religion, long-run series	2026-10-25 23:25:46 +00:00
Stan Runge	fa3aa25f0b	house-scrape: re-check huispedia, huislijn, huurportaal and rentola rows and mark clearly gone ones removed	2026-10-25 23:14:42 +00:00
Stan Runge	0fe0d36f87	PUBG drop map: live squad map with WebSocket rooms ... - server.js wraps Bun.serve to add /ws/<channel> upgrades (same server and port) and serve the map tiles from the host mount; Dockerfile now runs bun ./server.js - ws hub (channel registry, origin check) + pubg-map channel: rooms by unguessable code, validated + rate-limited messages, per-room write queue, presence - games.pubg_rooms / pubg_matches / pubg_markers; per-match sessions with history - /trackers/games/pubg/map hub (owner: rooms, landings over time, history) and /trackers/games/pubg/map/<code> fullscreen Leaflet map (all 11 maps) - deploy-remote.sh bind-mounts ~/pubg-maps; scripts/build-pubg-tiles.py rebuilds it	2026-10-25 22:46:30 +00:00
Stan Runge	e1fcd4f321	stats elections: CBS 37278 percentages to votes; Kiesraad municipal votes and turnout from EML kieskring counts; ballots include blank/invalid	2026-10-25 22:24:15 +00:00
Stan Runge	42c9351ebd	stats step 3: elections, party positions and opinion feeds (schema, collectors, timers); world-opinions data moved into stats.wo_*	2026-10-25 22:16:25 +00:00
Stan Runge	031ee4baf2	stats §8: Curaçao from ILOSTAT (SDMX), OWID, UN SDG 531, UN Comtrade 531 (cwintl + weekly timer), EU trade with CW (Eurostat ext_lt_maineu); CBS Curaçao LFS file pick fix; Curaçao detail panels on /stats/countries/CUW	2026-10-25 21:47:06 +00:00
Stan Runge	ff1520ae8b	stats §8: CBS Curaçao collector (topic-page scrape, sha256 manifest, CPI since 1970 from PDF, GDP by industry, government finance, population since 1900, LFS, tourism) into cw_cbs_* + stats.obs region CUW; cw_cbcs_bop for manual uploads; weekly timer	2026-10-25 21:38:30 +00:00
Stan Runge	fa58e5c661	stats B11: EP-Online energy labels (monthly total file → homes per label for NL, Gouda, Gouda PC4s; aggregates only), stats.ep_label_agg, monthly timer with key from ~/.config/stats/ep-online.env, charts on /stats/energy and /stats/gouda	2026-10-25 21:28:37 +00:00
Stan Runge	2a4466cb82	stats: /stats/countries comparison and /stats/countries/[iso3] profiles (Curaçao via World Bank), more WB indicators, Countries + Curaçao cards, nav/sitemap/start links	2026-10-25 21:22:20 +00:00
Stan Runge	d19313035f	stats: Eurostat pre-2007 household energy bands (nrg_pc_204_h/202_h folded into nrg_pc_204/202), stitched on /stats/energy; IMF revenue/spending from Fiscal Monitor codes	2026-10-25 21:14:50 +00:00
Stan Runge	02734607cc	stats: cast jsonb chunk param via text so jsonb_populate_recordset gets an array (step 2 loads)	2026-10-25 21:12:12 +00:00
Stan Runge	8958d3ff8f	stats step 2: World Bank, IMF WEO, OWID, Energy-Charts, Rijksfinanciën, US Treasury, USAspending collectors + tables, timers	2026-10-25 21:05:51 +00:00
Stan Runge	76bfb3dcec	stats: /stats overview, economy, energy and Gouda pages; CBS series map; nav, homepage, /start and sitemap links ... - CBS_SERIES: CPI, household tariffs (2007-now), energy balance, renewables, heat pumps, solar, cars, population (monthly, since 1942, components), house prices, housing stock, municipal levies for Gouda and its neighbours - shared StatChart/Kpi/chart helpers with per-chart source attribution - drop Eurostat nrg_pc_20x_h (404; CBS covers that history)	2026-10-25 20:50:47 +00:00
Stan Runge	a6ef263c7e	groceries: stats page with nightly snapshot (battles, basket, promos, CPI, range)	2026-10-25 20:39:35 +00:00
Stan Runge	8ef291f586	stats: new public stats schema (source/series/obs/region/fetch_run + raw CBS, Eurostat, FRED, BIS tables) and the stats collector (scripts/stats-fetch.ts); preflight checks the stats tables	2026-10-25 20:27:21 +00:00
Stan Runge	60370d4572	groceries: relevance-ranked search (plain/basic products first) ... - search.ts: score on the core name (brand/size stripped): exact or query+base suffix (kipdij+filet), head-final compounds, prefix, inside; penalties per extra word and per flavour/processing word (search-words.ts, editable); bonuses for store brands, the query's dominant category, store count, favourites; trigram tiebreak - groceries.synonyms table (seeded: kipdij/kippendij, pasta → spaghetti, …) expands queries - list rows show all pack sizes of a group; group picker uses the same ranking - scripts/groceries-search-eval.ts prints top results + latency; preflight now 8 tables	2026-10-25 20:20:34 +00:00
Stan Runge	e2af941b88	deploy preflight: groceries schema now has 7 tables (categories, manual_prices)	2026-10-25 19:12:23 +00:00
Stan Runge	707f07efd4	groceries: mobile-first tracker redesign — compact rows per product group (cheapest store badge, unit price, spread, promo), tap to compare stores; category tree (23 tops, subcategories, icons/colours) with chips, store tiles, sort and non-food toggle; owner shelf prices (manual source with date, photo, note)	2026-10-25 19:10:10 +00:00
Stan Runge	ce8b545f60	groceries: Lidl importer (online range), Dirk importer + store row, generic per-store GTIN backfill	2026-10-25 18:41:12 +00:00
Stan Runge	3f30bb883f	groceries: add PLUS, Xenos and Amazing Oriental stores, is_food flag, PLUS EAN backfill	2026-10-25 17:17:53 +00:00
Stan Runge	b23f7b3475	docs: prod host is stan-ovh (comments still said stan-vm)	2026-10-25 17:01:50 +00:00
Stan Runge	772e699655	data holders: private tracker of every organisation holding my address, email, phone or IBAN ... dataholders schema (orgs + identity) with migration and personal_app grants, idempotent CSV import (upsert on name+login, never wipes, keeps site edits and ticks), owner-only /trackers/data-holders with search, filters, pagination, inline edit/add and a moving checklist per identifier	2026-10-25 16:10:24 +00:00
Stan Runge	80803ef5ac	games: automatic CS2 / PUBG / R6 match history — games.matches, match_players, seasons, snapshots, accounts; in-app poller (Leetify, FACEIT, Steam share codes, PUBG API, Ubisoft) every 20 min plus scripts/games-ingest.ts for backfills; match history, stats, maps and seasons on the per-game pages	2026-10-25 16:00:48 +00:00
Stan Runge	7aeb31c46a	spotters: stricter logo checks (no photos, plates, insignia or old names; --recheck), planes operator bonus weighted down for historic types, Türkiye for iNat	2026-10-25 14:44:27 +00:00
Stan Runge	27987fb8e7	reading: owner archive / restore / delete / merge for books (⋯ menu on cards, rows and detail pages), archived filter, tombstones so merged ids redirect and the ingest never recreates deleted works, books-quarantine.py for deleted files	2026-10-25 14:22:40 +00:00
Stan Runge	11fa8ec006	spotters: fix 500 on detail pages of seen items (timestamp comes back as text); logos script uses small separate Wikidata queries	2026-10-25 14:10:53 +00:00
Stan Runge	516bc15545	music: Last.fm-style stats with 7d/30d/1y/all ranges and genres ... - Range picker (?range=7d|30d|1y|all) drives every section; the hours chart covers the whole range (daily for 7d/30d, weekly for 1y, monthly for all). - Genres from Last.fm artist top tags (music.artist_tags, normalised and filtered), split by artist listening time, with a per-bucket stacked chart. - Listening clock, new artists, comparison with the previous period and top movers, streaks, milestones, top albums with art, rank changes. - music.play_facts materialized view (refreshed by the app when plays arrive) plus a per-range cache keep the page fast. - scripts/music-fetch-tags.ts backfills tags, most-played artists first.	2026-10-25 14:03:39 +00:00
Stan Runge	5e4cd83748	spotters: logo coverage script (Wikidata logo/icon, multi-language infobox, website icon fallback), cheaper planes operator queries, refresh adds logos for new orgs	2026-10-25 13:54:27 +00:00
Stan Runge	7d6cee26a8	house tracker: contact status per listing (whose turn, last message, viewing) and labelled filters	2026-10-25 13:53:33 +00:00
Stan Runge	253cd69424	spotters: most-active-in sort with country/region selector, collection tracking (seen marks, progress, filters), refresh scripts score activity and report new NL entries	2026-10-25 13:24:37 +00:00
Stan Runge	92d6da959d	daisy-hook: accept a full "Name: value" header setting, redact the key from logs, retry once; start: brand icons on link and service tiles (trimmed simple-icons + saved favicons, monogram fallback)	2026-10-25 13:12:16 +00:00
Stan Runge	704880dc98	trains: stricter Commons photo matching (category files must name the type; no maps, class interiors, trucks)	2026-10-25 00:13:30 +00:00
Stan Runge	8c0fc74283	trains: Wikidata/Wikipedia import, Commons photos and refresh scripts	2026-10-25 00:09:07 +00:00
Stan Runge	8515cf0e9c	wildlife: photos script without response cache (it outgrew JSON.stringify)	2026-10-24 22:42:26 +00:00
Stan Runge	602ea9c8e1	wildlife: fetch English names without the NL place (it localised them to Dutch)	2026-10-24 22:27:16 +00:00
Stan Runge	ba44365c71	wildlife: iNaturalist/Wikidata/GBIF import, CC photos and refresh script	2026-10-24 21:58:35 +00:00
Stan Runge	eccae362ec	planes: stricter photo matching, skip company articles, payload-not-pax	2026-10-24 20:26:13 +00:00
Stan Runge	2259965a28	planes: wikidata/wikipedia import, commons photos and refresh script	2026-10-24 20:10:36 +00:00
Stan Runge	8442d59b68	cars: brand logos everywhere (search cards, brand grid, model headers), stricter logo matching + curated fixes, logo refresh in cars-photos	2026-10-24 17:43:47 +00:00
Stan Runge	7636f0b2bc	cars: keep MAZDA2/JAECOO7 names (no false typo strip), canonical upload.wikimedia.org thumbs, tidier gallery captions/credits	2026-10-24 16:54:14 +00:00
Stan Runge	bf0a1e1d2a	cars: Wikimedia Commons photos (cars.photos, card heroes, model gallery + lightbox, brand hero/logo), cars:photos + cars:refresh with --report-new, fold duplicate names (Golf VI, Peugot, Mustang Mach 1, Model 3/Y, i10/i30, Ceed, Lynk & Co)	2026-10-24 16:44:38 +00:00
Stan Runge	b757269151	music: self-hosted scrobbler (Spotify poller, Last.fm + streaming-history importers, /trackers/music, homepage listening card) ... - music schema: artists/albums/tracks (+album art), plays with source + dedupe, now_playing, spotify_auth, import_state; plays_deduped view hides Last.fm scrobbles Spotify also has - in-app Spotify poller (60s, leased) started from hooks init; no new role or env needed - /api/spotify/connect + callback (owner only), /trackers/music public stats - scripts: music-poll, music-import-lastfm (resumable), music-import-history - deploy/music-collector: optional host timer with its own role	2026-10-24 15:57:40 +00:00
Stan Runge	45c124a365	cars: default to most-common-in-NL order; dex numbers oldest first with unknown years last (--renumber)	2026-10-24 15:47:44 +00:00
Stan Runge	9e30e4246f	cars: import handles models without years, keeps roman numerals upper-case; don't cache an empty overview	2026-10-24 15:46:25 +00:00
Stan Runge	113eb54cd9	houses: Leefbaarometer liveability per listing (PDOK geocode + LBM 2024 grid/buurt), min-score filter and sort; store every regional listing (no price caps at scrape time)	2026-10-24 15:40:32 +00:00
Stan Runge	e95b7da1e3	cars: car pokedex tracker (brands, models, US variants from RDW + fueleconomy.gov), import script, search/filter UI, model pages	2026-10-24 15:39:08 +00:00
Stan Runge	b5748e5ae5	houses: one row per listing when a hand-added link is scraped later ... The nightly scraper and worker API now take over an existing row (e.g. source=manual) whose link is the same listing (normalized URL, or the Pararius key / Funda, Kamernet, Vesteda id in it) instead of inserting a copy; typed values are kept where the scrape has none. house-listing update/add give manual rows with such links the site key unless another row has it, update accepts --source/--source-id, and lookups by link ignore tracking params. scripts/house-rekey.ts backfills existing manual rows.	2026-10-24 14:59:03 +00:00
Stan Runge	35f78ec829	Money: private Documents page with admin-only file endpoint ... Lists contracts/pension docs with written summaries, an inline viewer and download at /trackers/money/documents. Files and summaries live on the host (MONEY_DOCUMENTS_ROOT, bind-mounted read-only by deploy-remote.sh), never in git or static/; the file endpoint is admin-only (401/403) and private, no-store.	2026-10-24 14:32:28 +00:00
Stan Runge	8818dde99d	houses: keep Kamernet to the Gouda region (small-city pages are padded with listings from all over NL), share GOUDA_REGION	2026-10-24 14:22:58 +00:00
Stan Runge	07d2c70973	health: smart-scale columns, deduped body measurement imports, quick-add form	2026-10-24 14:16:10 +00:00