aboutsummaryrefslogtreecommitdiffstats
path: root/scrape/requirements.tsv
blob: a9b5ecf7f0f48f5fbb4461d65b297e47c00e3656 (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
ID	Category	Requirement
BACK-1	Scraping	Download data fom oikotie API
BACK-3	Scraping	Rate limiting (3 seconds between requests)
BACK-4	Scraping	No external dependencies, except minio
BACK-5	Image Processing	Use webp images with high resolution
BACK-6	Image Processing	Store images in MinIO S3 (s3.tammi.cc)
BACK-7	Storage	CouchDB for house data
BACK-8	Storage	Proper connection handling and error recovery
BACK-9	Data Management	Detect new, updated, and removed houses
BACK-10	Data Management	Track house timeline (appearance/disappearance)
BACK-11	Notifications	ntfy.sh integration for new houses
BACK-12	Configuration	Environment-based configuration
BACK-13	Operations	Systemd service and timer for daily runs
BACK-15	Error Handling	Comprehensive error logging and retries
BACK-19	Data Retention	Keep data indefinitely