Farming Product Monitor: Real-Time Agricultural Price & Stock Intelligence for Pakistani Markets

In the Pakistani agricultural supply chain, price and stock changes on platforms like Kissanghar.pk can happen without notice — affecting procurement decisions, competitive pricing, and supply forecasting. Manually monitoring hundreds of product listings across two platforms was impractical, and no off-the-shelf monitoring tool handled Pakistan's agricultural e-commerce platforms. Buyers, distributors, and competitive intelligence teams needed automated, real-time visibility into price and stock changes without the overhead of custom browser automation — and they needed alerts delivered to the channels their teams already live in.

We built two complementary versions of the monitoring platform, each targeting different operational needs. The Node.js watchlist monitor uses Puppeteer Extra with StealthPlugin — patching headless Chrome fingerprints to defeat Kissanghar's bot detection — to scrape a configurable product watchlist. SQLite stores the snapshot history in three tables (products, product_snapshots, changes), with a correlated subquery joining each product to its most recent snapshot for efficient change detection. The Django full-catalogue version uses async aiohttp to automatically discover and monitor every product on both platforms — including Syngenta's GraphQL API. BeautifulSoup parses product detail pages for title, price, and stock status. Both systems use field-level comparison against the previous snapshot to detect exactly which fields changed, then fire Discord webhook messages with old and new values per changed field to dedicated alert channels. A test mode in the Node.js version simulates random field changes to allow full end-to-end testing of the alert pipeline without waiting for actual price movements. An Express admin panel on port 3001 provides a web UI for bulk product URL import, monitoring toggle, deletion, and per-product change history views.

Node.js monitor: Node.js + Express + SQLite. Puppeteer Extra with StealthPlugin for headless Chrome scraping. EJS admin panel templates. Discord webhook alerting. Django monitor: Django + PostgreSQL. aiohttp async HTTP scraping. BeautifulSoup HTML parsing. GraphQL client for Syngenta API. Discord webhook alerting with separate channels per change type.