diff options
| author | Petri Hienonen <petri.hienonen@gmail.com> | 2025-10-29 15:18:30 +0200 |
|---|---|---|
| committer | Petri Hienonen <petri.hienonen@gmail.com> | 2025-11-03 10:54:48 +0200 |
| commit | b03ee7032b2ea2d4d22ab7ec1346b7c9331cfc17 (patch) | |
| tree | efc0ce6823ab8611d9c6a0bf27ecdbd124638b73 /scrape/requirements.tsv | |
| download | housing-b03ee7032b2ea2d4d22ab7ec1346b7c9331cfc17.tar.zst | |
Initial commit
Diffstat (limited to 'scrape/requirements.tsv')
| -rw-r--r-- | scrape/requirements.tsv | 15 |
1 files changed, 15 insertions, 0 deletions
diff --git a/scrape/requirements.tsv b/scrape/requirements.tsv new file mode 100644 index 0000000..a9b5ecf --- /dev/null +++ b/scrape/requirements.tsv @@ -0,0 +1,15 @@ +ID Category Requirement +BACK-1 Scraping Download data fom oikotie API +BACK-3 Scraping Rate limiting (3 seconds between requests) +BACK-4 Scraping No external dependencies, except minio +BACK-5 Image Processing Use webp images with high resolution +BACK-6 Image Processing Store images in MinIO S3 (s3.tammi.cc) +BACK-7 Storage CouchDB for house data +BACK-8 Storage Proper connection handling and error recovery +BACK-9 Data Management Detect new, updated, and removed houses +BACK-10 Data Management Track house timeline (appearance/disappearance) +BACK-11 Notifications ntfy.sh integration for new houses +BACK-12 Configuration Environment-based configuration +BACK-13 Operations Systemd service and timer for daily runs +BACK-15 Error Handling Comprehensive error logging and retries +BACK-19 Data Retention Keep data indefinitely |