colyptus.

Software · · 1 min read

Feeding fifty sites from one root

What a multi-site publishing network taught us: one pipeline, cleaning, category mapping and central control.

Feeding fifty sites from one root

Running fifty news sites one by one means doing the same job fifty times. A changed ad slot means fifty panels; a broken source means searching in fifty places. This post covers what we learned tying that load to a single root.

One pipeline, many outlets

Content sources flow into a single pipeline. As each story passes through, it is cleaned and routed to the right site and category. The sites stay separate, but they are fed from the same root.

Cleaning is half the job

  • Ads, repeated headlines and duplicate images from source pages must be stripped before publishing.
  • Non-news items like ticket sales and promotions must be filtered by rules.
  • Category mapping should follow the source's own category structure, not keyword guesses.

Managed from the centre

Ad slots and site settings live in one panel. A change is made once and lands on fifty sites. Verticals like sport, business and tech get their own colours and layouts derived from one shared theme, so each site looks like itself while upkeep stays single.

What scales shouldn't be the number of sites, but the cost of a change.

Today, adding a site is as easy as opening a new branch. When the root is solid, the branches multiply on their own.

Something waiting to open?

An idea, a half-built product, a brand that needs a second life. Let's start with a short note.