How to do ethical aggregation and news flow displays
The is an issue of fast flowing (lower quality) news sites dominating over slower flowing (quality) sites on short 5/10 story sidebars on the #OMN
To get round this the are a number of options:
- We only show one item (the latest) from each feed in embed RSS feed flows. This will mean that some content is “skipped” on high flow sites and some stays around for longer in low flow sites.
But for this to work in nodes (sites/hubs) with lots of source feeds we will need a rolling group RSS polling update system say 5 or 10 feeds at a time, divided into the total polling time frame.
So a site has 30 feeds polling ones per hour than it will divide this into 3 groups of 10 feeds and pole these in turns ever 20 min so that the feeds are undated ones per hour but in 3 different groups so that the is a turn over of content for the feed for option 1) to maximize slower site flows getting linked to in the #OMN
A second option that we do now on the node dispay iis we randomize the content in site flow feeds, this will give a wider view of older content and will even out faster/slower feed flows to bring diversity. But you wont get time based "news".
What we do now, we show content in liner order, however due to the way that RSS polling works the updates will be in groups and faster updating sites will dominate over slower updating sites. This is far from satisfactory, as it rewords sites that “game” the system by scatter gun publishing publishing lower quality content.
News - Ideas for ethical aggregation of content
The way forward for aggregation is to break away from the current failed strategies, and to make it “ethical”.
We need a clear separation of display formatting and content. In other words, content is published and formatted on the home site and displayed there, but it is aggregated to other sites as metadata. The content is still loaded from the home site, but the formatting is “hinting”, not finished formatting – the finished look and feel is defined by the aggregating site – the content (and hinted formatting) is loaded from the home site.
Thus the content is viewed from both the aggregating site AND the home site. Any edits or comments are published to and loaded from the home site. How they are displayed is up to the viewing site.
*** some temporary dynamic caching can be implemented to make scaling work, as needed ***
It's simple technology that makes aggregation real rather than stealing. How does current “bad aggregation” work? A number of ways:
1) Content is simply republished onto a new server. Comments and views are separated – the content is “stolen” from the host publisher site. This is the favourite parasitic strategy for the dot-coms like huffingtion post etc.
2) Headlines or excerpts are republished with a link back to the full article on the host site. Kinda OK but limited.
3) A silo is created and people are encouraged to publish their stores directly there, as done by projects such as Oximity. This is the most common and worst outcome.
How would what I am proposing be different? The outcome of this simple technology would be a widespread explosion of different sites full of content with radically different looks, feels, interfaces etc.
Content would spread organically. It would be placed in niche sites and good content pushed to the top sites to much larger distribution than you can get on any platform at the moment.
In my opinion, all current distribution is broken, we have to reboot.
Tools to use
Use RSS as the basis of the network to get 98% coverage of content from the project launch. And to give an easy output for other projects to build on. Existing CMS's like wordpress etc can then be used as sources and with plugins can become full members of the network.
You can't always get what you want
Facebook as news?
A post on Facebook:
the entirety of my news input comes from facebook these days. i prefer it this way. you lot got a delightful wonk on.
This is a (invisible) problem as Facebook has algorithms that choice what you see as news based on maximum ad revenue not news values...