From b03ee7032b2ea2d4d22ab7ec1346b7c9331cfc17 Mon Sep 17 00:00:00 2001 From: Petri Hienonen Date: Wed, 29 Oct 2025 15:18:30 +0200 Subject: Initial commit --- scrape/requirements.tsv | 15 +++++++++++++++ 1 file changed, 15 insertions(+) create mode 100644 scrape/requirements.tsv (limited to 'scrape/requirements.tsv') diff --git a/scrape/requirements.tsv b/scrape/requirements.tsv new file mode 100644 index 0000000..a9b5ecf --- /dev/null +++ b/scrape/requirements.tsv @@ -0,0 +1,15 @@ +ID Category Requirement +BACK-1 Scraping Download data fom oikotie API +BACK-3 Scraping Rate limiting (3 seconds between requests) +BACK-4 Scraping No external dependencies, except minio +BACK-5 Image Processing Use webp images with high resolution +BACK-6 Image Processing Store images in MinIO S3 (s3.tammi.cc) +BACK-7 Storage CouchDB for house data +BACK-8 Storage Proper connection handling and error recovery +BACK-9 Data Management Detect new, updated, and removed houses +BACK-10 Data Management Track house timeline (appearance/disappearance) +BACK-11 Notifications ntfy.sh integration for new houses +BACK-12 Configuration Environment-based configuration +BACK-13 Operations Systemd service and timer for daily runs +BACK-15 Error Handling Comprehensive error logging and retries +BACK-19 Data Retention Keep data indefinitely -- cgit v1.2.3-70-g09d2