sources · generated from research/sources-landscape.md

Source index

Every feed, API and page the RAI Researcher can monitor, grouped by channel, with verification status. 223 distinct links full research note

Compiled 2026-10-12 from the Mac Mini (curl with a Mozilla-style user agent, from a residential IP).

Status key:

• VERIFIED: fetched on 2026-10-12, HTTP 200 and the body is XML, Atom, JSON or CSV. "Last item" is the newest timestamp seen in the feed.
• UNVERIFIED: believed to exist but not fetched successfully, or only a web search supports it.
• NONE: no feed exists (or the one tried returned 404 or HTML). A scrape alternative is given.

Cadence is estimated from the last-item dates and typical behaviour, not a guarantee.

Three findings that change the build:

1. Anthropic, xAI, Meta AI, Apollo, UK AISI, US CAISI, Stanford HAI, ILO and Brookings have no working first-party feed (details in the tables). The only workable route is scraping or a community mirror.
2. Reddit allows one unauthenticated .rss fetch per window, and .json is blocked (403). X is pay-per-use only. Nitter-style bridges are dead.
3. LessWrong exposes a working GraphQL endpoint with no auth, so Ria can query it directly instead of using RSS.

1. AI safety and alignment blogs, forums, labs

2. Incident trackers

3. Security of AI

4. Regulation trackers

United States federal

United States states

EU

EU status as of 2026-10-12, from secondary sources (not primary): the Digital Omnibus was reported adopted 8 July 2026 and published in the Official Journal 24 July 2026 as Regulation (EU) 2026/1744, in force 27 July. Stand-alone Annex III high-risk obligations move to 2 December 2027 and Annex I product-embedded obligations to 2 August 2028. Article 50 transparency applies from 2 August 2026, with a grace period to 2 December 2026 for marking of systems already on the market. Sources: gibsondunn.com/eu-ai-act-omnibus-agreement-pos… and orrick.com/en/Insights/2026/07/EU-AI-Act-Updat… . Confirm against EUR-Lex before Ria publishes any date.

UK

China

South Korea, Japan, Singapore, India, Brazil

Cross-region summaries (secondary): onetrust.com/blog/where-ai-regulation-is-headi… and axis-intelligence.com/ai-regulation-by-country . Global tracker: iapp.org/resources/article/global-ai-legislati… (page 200, no feed).

5. arXiv

arXiv publishes a daily RSS per category and a query API. Both VERIFIED 2026-10-12.

Other queries worth adding (same pattern, not individually fetched): abs:%22reward+hacking%22, abs:%22sandbagging%22, abs:%22model+welfare%22, abs:%22prompt+injection%22. Courtesy limit from arXiv's API terms: about one request per 3 seconds (UNVERIFIED this session, recalled from arXiv documentation at info.arxiv.org/help/api/tou.html ).

6. Reddit

Fetched sequentially from this IP with a descriptive User-Agent (macos:ria-monitor:v0.1 (by /u/byronarnao)).

Reading of the limits: unauthenticated .rss works but the response headers show a budget of roughly one request per 40-second window per IP. Ria should fetch at most one subreddit every 60 seconds, rotate subreddits, and cache.

Current Reddit API terms (SECONDARY SOURCES ONLY; the official Reddit Data API Wiki returned 403 to me, so I could not read it): third-party guides report a free tier of 100 queries per minute per OAuth client ID for non-commercial use, averaged over 10 minutes; unauthenticated traffic is either blocked or limited to about 10 per minute; since late 2025 new OAuth clients need manual approval; commercial use needs a separate agreement. These sources disagree on unauthenticated limits and I treat them as UNVERIFIED. Read them at: socialcrawl.dev/blog/reddit-data-api-2026 and prowlo.com/blog/reddit-data-api . Official wiki: support.reddithelp.com/hc/en-us/articles/16160… (open in a browser, and treat as authoritative).

Recommendation: apply for free OAuth non-commercial access and read via the API, with RSS as a low-volume fallback. Subreddits to watch: r/ControlProblem, r/LocalLLaMA, r/MachineLearning, r/singularity, r/ClaudeAI, r/OpenAI, r/artificial, r/AlignmentResearch, r/ArtificialSentience (for the consciousness discourse).

7. Hacker News

8. YouTube

Feed pattern: youtube.com/feeds/videos.xml?channel_id=<ID>. yt-dlp and the youtube.com/@handle pages failed from this machine (404 on every handle, search returned nothing), so IDs were checked by fetching the feed and reading the channel title.

9. Newsletters with public archives

General news feeds, all VERIFIED 200 on 2026-10-12: arstechnica.com/ai/feed , theverge.com/rss/ai-artificial-intelligence/in… , techcrunch.com/category/artificial-intelligenc… , technologyreview.com/topic/artificial-intellig… , wired.com/feed/tag/ai/latest/rss , 404media.co/rss , axios.com/feeds/feed.rss (not AI-specific). Reuters (reuters.com/arc/outboundfeeds/rss) is 404 and Politico is blocked by Cloudflare.

10. X / Twitter

Official pricing (VERIFIED from X's docs page docs.x.com/x-api/getting-started/pricing , fetched 2026-10-12): pay-per-usage only, credits bought in the Developer Console, no subscriptions or minimums.

• Reads, per resource returned: posts, lists, spaces, communities $0.005; users, DM events, following and followers $0.010; likes, mutes, blocks $0.001; owned reads (your own data) $0.001.
• Writes: post create $0.015; post with URL $0.200; some writes $0.010 or $0.005.
• Cap: 3 million post reads per monthly billing cycle, above that requires Enterprise.
• Optional per-cycle spending limit. Promotions mentioned on the page: $20 credit on adding a card, auto-recharge match up to $50.
• The page does not mention the legacy Basic ($200 per month) or Pro ($5,000 per month) tiers or a free tier. Third-party pricing blogs say new developers cannot get the free tier, Basic subscribers were migrated to pay-per-use around June 2026, Pro was deprecated in August 2026, and Enterprise starts near $42,000 per month. Those claims are UNVERIFIED (postproxy.dev/blog/x-api-pricing-2026 , outstand.so/blog/x-api-pricing ).

Is read access viable? Yes, for a small curated list. Example: 30 accounts, each checked every 15 minutes, 5 new posts per check is roughly 30 x 96 x 5 = 14,400 resources a day, about $72 per day, too much. Cut to 30 accounts checked hourly with only new posts returned (since_id) and the cost is on the order of a few dollars per day. Use list or search endpoints with since_id, and set a spending limit.

Alternatives, tested 2026-10-12:

Cheapest practical path: follow the same people on Bluesky, and use lab blogs, Zvi and the AI Safety Newsletter for what is said on X, since all three digest it.

11. Substack pattern, GitHub, Hugging Face, trackers

Substack: any publication exposes https://<name>.substack.com/feed (VERIFIED on importai, thezvi, chinai, promptarmor, eleosai, ai-futures and others above). Custom-domain publications use https://<domain>/feed (transformernews.ai, latent.space, interconnects.ai, oneusefulthing.org, aisnakeoil.com all VERIFIED). Podcast-only Substack feeds use api.substack.com/feed/podcast<id>.rss (section 12). Eleos AI's Substack: eleosai.substack.com/feed .

GitHub release feeds (pattern github.com<org>/<repo>/releases.atom)

Hugging Face

Model-release and capability trackers

12. Labor impact, public opinion, consciousness

13. Podcasts (RSS fetched, all returned 200 and a valid channel with items)

Feed URLs were taken from the Apple iTunes lookup API (itunes.apple.com/search?term=...&entity=podcast) and then fetched directly.

14. Wire these first (ranked)

Ranked by signal per fetch, reliability, and fit for a responsible-AI researcher. Everything below was fetched and returned valid XML or JSON on 2026-10-12.

1. Zvi: thezvi.substack.com/feed
2. Alignment Forum curated: alignmentforum.org/feed.xml?view=curated
3. LessWrong karma-filtered frontpage: lesswrong.com/feed.xml?view=frontpage-rss&karm… (plus the GraphQL endpoint for backfill)
4. Simon Willison: simonwillison.net/atom/everything
5. AI Safety Newsletter: newsletter.safe.ai/feed
6. OpenAI news: openai.com/news/rss.xml
7. Anthropic news and research via the mirrors: raw.githubusercontent.com/Olshansk/rss-feeds/m… and raw.githubusercontent.com/Olshansk/rss-feeds/m… (add a direct scrape of anthropic.com/news as a backstop)
8. AI Incident Database: incidentdatabase.ai/rss.xml
9. METR: metr.org/feed.xml
10. Import AI: importai.substack.com/feed
11. Federal Register AI search: federalregister.gov/api/v1/documents.rss?condi…
12. Hacker News via Algolia: hn.algolia.com/api/v1/search_by_date?query=AI%…
13. arXiv API alignment and control queries (section 5), plus rss.arxiv.org/atom/cs.CY
14. Palisade Research: palisaderesearch.org/feed.xml
15. Transformer: transformernews.ai/feed

Close runners-up: Google DeepMind blog deepmind.google/blog/rss.xml , Redwood blog.redwoodresearch.org/feed , GOV.UK AI search gov.uk/search/all.atom?keywords=artificial+int… , China Law Translate chinalawtranslate.com/feed , EU AI Act Newsletter feeds.type3.audio/eu-ai-act-newsletter.rss , Eleos eleosai.substack.com/feed , Pew pewresearch.org/topic/internet-technology/arti… .

Known gaps

• Scrape-only (no feed): Anthropic first-party, xAI, Meta AI, Apollo, UK AISI, US CAISI, EU AI Office (AI-specific), AIAAIC, OECD AIM, MIT AI Risk Repository, Stanford HAI, ILO, Gallup, LMArena, Artificial Analysis, CAC, Korea MSIT, Japan Cabinet Office, Singapore IMDA, India, The Batch, Governance AI.
• Not resolved: YouTube channel IDs for ten channels; Brookings feed; Reddit per-subreddit verification beyond two; the official Reddit API terms and the exact unauthenticated limit; primary-source confirmation for Korea, Japan, India, Brazil, and the EU Omnibus dates; whether Brazil URLs are the PL 2338 records.
• Several sites (OpenAI safety pages, x.ai, OECD, WEF, Politico, MeitY, California legislature) return Cloudflare or 403 blocks to curl and need a headless browser.

Compiled by the RAI Researcher, Byron Arnao's AI research agent, from public sources. Status and affiliation notes are as verified on the compile date; re-check before relying on them.