Skip to content

feat(configs): add 76 curated live-verified feed configs - #321

Merged
gildesmarais merged 2 commits into
masterfrom
feat/add-100-curated-configs
Sep 5, 2026
Merged

feat(configs): add 76 curated live-verified feed configs#321
gildesmarais merged 2 commits into
masterfrom
feat/add-100-curated-configs

Conversation

@gildesmarais

@gildesmarais gildesmarais commented Aug 31, 2026

Copy link
Copy Markdown
Member

Summary

This PR expands the curated feed catalog in html2rss-configs by adding 76 high-value, live-verified RSS configurations across international public institutions, research councils, central banks, universities, transport authorities, and developer platforms. The total curated feed count in the repository increases from 143 to 219 configs.


Key Invariants & Quality Standards

  • Zero-Hallucination Verified: Every source URL was fetched live (HTTP 200) and verified with Html2rss.feed to extract valid articles before writing any YAML.
  • First-Party Feed De-duplication: Candidate surfaces were pre-screened via probe_rss; sites advertising native RSS/Atom feeds were skipped.
  • Link Diversity & Title Quality: Extracted items enforce non-trivial titles (>= 4 characters, no generic CTA boilerplate) and link diversity (unique_links >= min(count * 0.6, 2)) to eliminate navigational chrome or breadcrumb traps.
  • Active Gem Topic Vocabulary: All feeds strictly adhere to the 15 topics in Html2rss::Config::Validator::DIRECTORY_TOPICS.
  • Feed Directory Catalog Metadata: Each config includes full directory.topics, directory.title, directory.summary (<= 160 chars), and mirrored channel.title.

Newly Added Configurations (76 Feeds)

Central Banks, Financial Regulators & Development Banks

  • adb.org (Asian Development Bank — News)
  • bancaditalia.it (Banca d'Italia — Media & Comunicati)
  • bmf.gv.at (Austrian Federal Ministry of Finance — Pressemeldungen)
  • eib.org (European Investment Bank — Press Releases)
  • finma.ch (Swiss Financial Market Supervisory Authority — FINMA News)
  • hkma.gov.hk (Hong Kong Monetary Authority — Press Releases)
  • indec.gob.ar (INDEC Argentina — Noticias y Notas de Prensa)
  • inegi.org.mx (INEGI Mexico — Sala de Prensa)
  • iras.gov.sg (Inland Revenue Authority of Singapore — Newsroom)
  • piie.com (Peterson Institute for International Economics — Research)
  • resbank.co.za (South African Reserve Bank — Media Releases)

International Organizations, Multilateral Courts & Policy Centers

  • ceps.eu (Centre for European Policy Studies — Policy Publications)
  • comunidadandina.org (Andean Community CAN — Notas de Prensa)
  • europa.eu (European Commission — Latest News)
  • icrc.org (International Committee of the Red Cross — Operational News)
  • tas-cas.org (Court of Arbitration for Sport — Decisions & Media Releases)
  • unep-wcmc.org (UN Environment Programme WCMC — Conservation News)
  • wmo.int (World Meteorological Organization — Climate & Weather News)

National Science Bodies, Research Institutes & Think Tanks

  • boeckler.de (Hans-Böckler-Stiftung — WSI & IMK Pressemitteilungen)
  • csem.ch (Swiss Center for Electronics and Microtechnology — Innovations)
  • csiro.au (CSIRO Australia — Science & Tech News)
  • diw.de (DIW Berlin — Economic Research News)
  • dlr.de (German Aerospace Center DLR — News & Space Missions)
  • forskningsradet.no (Research Council of Norway — Science Funding News)
  • fz-juelich.de (Forschungszentrum Jülich — Press Releases & Archive)
  • mit.edu (MIT News — Research Breakthroughs)
  • smhi.se (SMHI Sweden — Meteorology & Hydrology News)
  • turing.ac.uk (Alan Turing Institute — Data Science & AI Updates)

Global Universities & Higher Education

  • auckland.ac.nz (University of Auckland — Research News)
  • chalmers.se (Chalmers University of Technology — Engineering News)
  • ed.ac.uk (University of Edinburgh — Campus & Research News)
  • kcl.ac.uk (King's College London — News & Analysis)
  • tum.de (TU Munich — Press Releases & Scientific News)
  • tuwien.at (TU Wien — News & Technological Innovations)
  • ucl.ac.uk (University College London — Research & Institutional News)
  • uni-heidelberg.de (Heidelberg University — Newsroom & Research)
  • unibas.ch (University of Basel — News & Events)
  • unsw.edu.au (UNSW Sydney — Newsroom & Academic Discoveries)
  • uoc.edu (Universitat Oberta de Catalunya — UOC News)
  • uu.se (Uppsala University — Research & Campus News)

Government Ministries, Judicial Authorities & Public Safety

  • baden-wuerttemberg.de (Landesregierung Baden-Württemberg — Pressemitteilungen)
  • berlin.de (Land Berlin — Aktuelle Pressemitteilungen)
  • bmeia.gv.at (Austrian Foreign Ministry BMEIA — Pressemeldungen)
  • bundesfinanzhof.de (Bundesfinanzhof Germany — Entscheidungen & Presse)
  • bundeskanzleramt.gv.at (Austrian Federal Chancellery — Nachrichten der Bundesregierung)
  • canada.ca (Public Service Commission of Canada — Stories)
  • conseil-constitutionnel.fr (Conseil Constitutionnel France — Actualités & Décisions)
  • ecologie.gouv.fr (Ministère de la Transition Écologique — Presse)
  • ico.org.uk (UK Information Commissioner's Office — News & Blogs)
  • imda.gov.sg (Infocomm Media Development Authority Singapore — Press Releases)
  • lyon.fr (Ville de Lyon — Actualités Municipales)
  • ncsc.gov.uk (UK National Cyber Security Centre — Reports & Advisories)
  • nea.gov.sg (National Environment Agency Singapore — News Releases)

Standards, Technical Safety & Public Utilities

  • afnor.org (AFNOR France — Normalisation & Standards)
  • agora-energiewende.org (Agora Energiewende — Energy Transition News)
  • cer-rec.gc.ca (Canada Energy Regulator — News Releases)
  • icasa.org.za (ICASA South Africa — Telecom & Broadcasting Notices)
  • oebb.at (Austrian Federal Railways ÖBB — Neuigkeiten & Fahrgastinfos)
  • parks.vic.gov.au (Parks Victoria — Environmental & Park Updates)
  • sahpra.org.za (SAHPRA South Africa — Health Products Regulatory Notices)
  • standards.org.au (Standards Australia — National Standards News)
  • swissmedic.ch (Swissmedic — Arzneimittel & Medizinprodukte Mitteilungen)
  • tuev-verband.de (TÜV-Verband — Presse & Prüfberichte)
  • vvs.de (Verkehrs- und Tarifverbund Stuttgart — Pressemitteilungen)

Developer Frameworks, Cultural Archives & Museums

  • albertina.at (Albertina Museum Wien — Exhibitions & Art News)
  • berlinale.de (Berlin International Film Festival — Pressemitteilungen)
  • clerk.com (Clerk Authentication — Product Changelog)
  • dnb.de (Deutsche Nationalbibliothek — Presse & Archivmitteilungen)
  • fiaformulae.com (FIA Formula E Championship — Race & Tech News)
  • kb.se (Kungliga biblioteket Sweden — Nyheter & Digitalisering)
  • mak.at (MAK Vienna — Museum für angewandte Kunst Presse)
  • ndl.go.jp (National Diet Library Japan — News & Library Updates)
  • qwik.dev (Qwik Web Framework — Official Blog & Announcements)
  • sentry.io (Sentry — Platform Changelog & Releases)
  • uffizi.it (Gallerie degli Uffizi — News & Mostre)

Verification Results

Quality Gate Command Outcome
CLI Validation make validate 219 / 219 configs valid (100% pass)
RSpec Test Suite make test 2,214 examples, 0 failures
Catalog Specs bundle exec rspec spec/lib/html2rss/configs/catalog_spec.rb 4 examples, 0 failures
Changed Configs Fetch Lane bin/rspec_changed_configs 76 / 76 configs passing live fetch
Linters & Formatting make lint yamllint, rubocop, prettier all clean

@gildesmarais
gildesmarais force-pushed the feat/add-100-curated-configs branch from 5e7bca4 to 919c196 Compare August 31, 2026 17:40
@gildesmarais gildesmarais changed the title feat(configs): add 79 curated live-verified feed configs and batch intake tooling feat(configs): add 79 curated live-verified feed configs Aug 31, 2026
@gildesmarais
gildesmarais force-pushed the feat/add-100-curated-configs branch from 919c196 to 60ea7ff Compare August 31, 2026 17:47
@gildesmarais gildesmarais changed the title feat(configs): add 79 curated live-verified feed configs feat(configs): add 78 curated live-verified feed configs Aug 31, 2026
@gildesmarais
gildesmarais force-pushed the feat/add-100-curated-configs branch from 60ea7ff to 7cabb90 Compare August 31, 2026 18:07
@gildesmarais gildesmarais changed the title feat(configs): add 78 curated live-verified feed configs feat(configs): add 76 curated live-verified feed configs Aug 31, 2026
- Add 76 curated RSS configs across global institutions, central banks, science bodies, and universities
- Expand total repository curated feeds from 143 to 219 configs
- Ensure full compliance with active gem topics, schema validation, and live fetch specs
@gildesmarais
gildesmarais force-pushed the feat/add-100-curated-configs branch from 3218ac0 to 3288760 Compare September 5, 2026 07:30
@gildesmarais
gildesmarais merged commit 13cdb5f into master Sep 5, 2026
7 of 8 checks passed
@gildesmarais
gildesmarais deleted the feat/add-100-curated-configs branch September 5, 2026 07:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant