Add resumable US policy news collectors and provenance
Development CI / check-and-build (push) Successful in 2m54s
GitHub Git mirror / mirror (push) Successful in 9s
Development CI / deploy-development (push) Failing after 4m24s

Collect official crypto and US policy documents with deterministic screening, full bodies and attachments, bounded retries, and durable history cursors. Preserve publication precision and source identity while keeping new collectors disabled.

Add real Congress, GovInfo, DOJ and Federal Register fixtures, offline capture replay, isolated database validation, and rollout instructions. Validate 982 backend tests, frontend checks, and 57 deployment control tests.
This commit is contained in:
eezd committed 2026-11-04 21:41:04 +08:00
1 parent dc8a283571
commit 89c729092c
31 files changed
+2199 -23

No files matched your search

@@ -97,12 +97,11 @@ class CoinDeskSpider(RssNewsSpider):
feeds = ("https://www.coindesk.com/arc/outboundfeeds/rss/",)
class FedSpider(RssNewsSpider):
from alphapulse.crawler.spiders.us_official import USOfficialSpider
class FedSpider(USOfficialSpider):
name = "fed"
feeds = (
"https://www.federalreserve.gov/feeds/press_monetary.xml",
"https://www.federalreserve.gov/feeds/speeches_and_testimony.xml",
)
class BlsSpider(RssNewsSpider):