Qt GUI & Scrapy/Twisted Runtime Bridge
Thread-safe asynchronous bridge & execution lifecycle
Pause
Reset
1. User Action
2. Queue Pickup
3. Non-Blocking Crawl
4. Returned Progress
GUI Domain
Bridge / Queue Layer
Twisted / Scrapy Engine
Event Feedback
push
poll
defer
fetch
yield item
emit item
stats
qt signal / emit
QT GUI
COMMAND QUEUE
SPIDER RUNTIME THREAD
TWISTED REACTOR
SCRAPY SPIDERS
EVENT QUEUE
TASK MANAGER
PREVIEW PANEL
OUTPUT PIPELINE
System Architecture
Hover or click any node to inspect its function within the Qt/Scrapy architecture bridge.