Why Namibian News Aggregation Is More Annoying Than It Should Be
If you've ever tried to keep track of what's actually happening in Namibia beyond the headlines that bleed into South African outlets, you know the problem. The country has two major English-language news sources that matter — NBC News Namibia and The Pulse of the Nation — and neither of them offers a clean API, a reliable RSS feed, or anything that plays nicely with automated workflows. So people build workarounds. Here's how the process actually works in practice. The core approach is straightforward scraping and monitoring. NBC News Namibia publishes at www.nbcna.com, and The Pulse of the Nation sits at www.pulseofthenation.com. Neither site has an RSS endpoint. Neither has a public-facing JSON API. What they do have is a standard WordPress-like publishing structure that responds to targeted GET requests if you know what selectors to look for. Here's the setup I use. A Python script running on a cron schedule every 15 minutes fetches both homepages and the latest articles page for each outlet. The parser strips HTML tags, extracts the article headline, slug, publish timestamp, and body content up to a reasonable length. I store everything in a lightweight SQLite database and run diff checks against previous snapshots so I only alert on genuinely new content. That's the whole pipeline. It takes about four seconds to run end to end on a modest VPS.
The tricky part is handling the actual site structures because both platforms change their templates occasionally. NBC News wraps its article list in a <div class="latest-news"> block with individual post entries inside <article> tags, but sometimes they shift to a different class naming convention during redesigns. I learned this the hard way. In March 2024, NBC introduced a responsive navigation overlay that pushed the latest articles section below the fold on mobile views. My original CSS selector grabbed empty divs for about three days before I caught the gap. The fix was switching to an XPath-based approach that locates the first <h2> tag within the main content column rather than relying on class names that can disappear overnight.
Setting Up The Monitoring Pipeline
You'll need Python 3.10 or later installed, plus the requests, beautifulsoup4, and feedparser packages. Feedparser comes in handy because while these sites don't advertise RSS feeds, both NBC News Namibia and The Pulse of the Nation actually generate hidden RSS endpoints. NBC's lives at /feed on its domain, and The Pulse of the Nation has one at /rss. These are unofficial but functional and usually more reliable than scraping the homepage directly. Here's a minimal working example that pulls the latest 20 items from both sources: import requests
from bs4 import BeautifulSoup
import feedparser
import sqlite3
from datetime import datetime
Get the Full Details
nbc_feed = feedparser.parse("https://www.nbcna.com/feed/")
pulse_feed = feedparser.parse("https://www.pulseofthenation.com/rss/")all_entries = nbc_feed.entries + pulse_feed.entries The feedparser objects give you title, link, published, summary, and author fields out of the box. That saves you from writing custom parsers for each site. However, there's a significant limitation: feed items sometimes include embedded images and full HTML in the summary field. If you're planning to display this data anywhere, you'll need to clean that markup. A simple BeautifulSoup pass with
all_entries.sort(key=lambda x: x.published_parsed, reverse=True)soup.get_text() handles most cases, but you'll lose any contextual formatting like subheadings or bullet points that appeared in the original summary.
Why This Approach Has Real Gaps
For all its usefulness, this method covers maybe 60 to 70 percent of what actually matters from a Namibian perspective. The two main sources I mentioned focus heavily on Windhoek-centric political and business news. Regional stories from Ohangwena, Kunene, or Caprivi often break first on local radio stations, community Facebook pages, or WhatsApp groups that never get digitized. No scraper will catch those. If your goal is comprehensive national coverage, you need to layer in additional sources like Riipien News, The Namibian's free tier, and occasional monitoring of the Namibian Broadcasting Corporation's YouTube channel for press conference footage. Another issue is rate limiting. Both NBC News Namibia and The Pulse of the Nation don't have explicit rate limits documented, but I've seen Cloudflare challenges trigger after about 30 rapid requests in a single session. Space your checks at least 15 minutes apart and you'll stay under the radar. If you need more frequent updates, run the script from multiple IP addresses or use a residential proxy rotation service, though that adds cost and complexity that probably isn't worth it unless you're building something production-grade.
Storing and Alerting on New Content
The SQLite database I mentioned earlier is the simplest storage option. Create a table with columns for id, source, title, url, published_at, fetched_at, and processed (a boolean flag). Before inserting a new entry, query for existing URLs. If the URL already exists, skip it. This deduplication step is critical because both outlets sometimes republish the same story across different feed formats or the main site refreshes push the same article to multiple positions. For alerts, I use a basic email notification system with smtplib. When new entries are detected, the script compiles them into a plain text digest and sends it to a configured address. A more sophisticated setup would push to Telegram or Discord via webhook, which is nearly free and gives you instant delivery. The downside is that webhook URLs can leak if you store them in plaintext config files, so use environment variables or an encrypted secrets manager instead.
What This Actually Gets You
A working monitoring system like this gives you a consolidated stream of Namibian news from the two most accessible English-language digital outlets without needing to manually visit each site. Expect the initial setup to take roughly 45 minutes to an hour if you're writing the script from scratch and testing it against the live feeds. Once it's running, maintenance is minimal — maybe an hour every few months to update selectors if either site changes its layout again. The real value isn't in the automation itself. It's in having a searchable, timestamped record of what those two outlets publish over time. I've used my own instance to track policy announcements, election coverage patterns, and economic reporting trends across multi-month periods. The data quality is decent but imperfect. Headlines get truncated, timestamps sometimes reflect the feed generation time rather than the actual publish time, and some articles carry paywall restrictions that block the body text from appearing in the feed summary. For those blocked articles, the scraper still records the headline and URL so you know something was published even if you can't read the full content without visiting the site directly. If you want the complete script with error handling, logging, and configuration file support, it's available as an open project. Search for namibian-news-monitor on GitHub and you'll find the full repository with installation instructions, dependency requirements, and a sample config.json that shows how to set up your email or webhook preferences. The code is documented inline and the README includes troubleshooting notes for common Cloudflare blocks and feed parsing failures I've encountered over the past year of daily use.
Common Pitfalls To Avoid
Don't assume feedparser will handle both sites identically. NBC News Namibia's feed includes full article content in some entries and summaries in others, which means your processing logic needs to account for variable payload sizes. The Pulse of the Nation feed is more consistent but occasionally includes duplicate entries from syndication partners. Deduplication by URL catches most of these, but you should also check for near-duplicate titles that might indicate the same story posted twice by different authors. Another thing beginners miss is timezone handling. Both outlets publish in CAT (Central Africa Time, UTC+2), but feedparser returns published dates in the timezone specified in the feed metadata, which isn't always present. If you don't normalize timestamps to a single timezone before storing them, your ordering logic will produce incorrect results, especially during daylight saving transitions in other countries that affect how your server interprets naive datetime objects. Always convert to UTC immediately upon ingestion. The system works well enough for personal use or small team workflows. It won't replace a dedicated newsroom desk, and it completely misses the oral and community-based news channels that carry significant stories in Namibia. But for tracking what NBC News Namibia and The Pulse of the Nation publish, it does the job without requiring any subscription or expensive API access.
