Skip to navigation
Latest News

Rupert Murdoch begins blocking aggregators

Rupert Murdoch

By Stuart Turton

Posted on 8 Jan 2010 at 15:45

Times Online has confirmed that it's blocking news aggregator from linking to its content.

The newspaper has altered its robots.txt file to prevent the aggregator crawling its site. Rupert Murdoch spelled out his intention to block search engines from crawling his sites in November, and it looks like the media mogul has taken his first steps in carrying out his threat.

However, the move has left NewsNow baffled. "It is lamentable that News International has chosen to request we stop linking to its content and providing in-bound traffic and potential subscribers to the Times Online and right now it looks as though NewsNow has been singled out," says Struan Bartlett, managing director and chairman of NewsNow.

We note that no other major search engine has been blocked by NI in this manner

"We note that no other major search engine has been blocked by NI in this manner. NewsNow is not fundamentally different to other news search engines that are part of the internet infrastructure, such as Google News and Yahoo. Why block us and not them?"," he concludes.

NewsNow claims to receive two million visitors every month, and argues that services such as aggregators benefit newspapers by making it easier for readers to find their content. However, Murdoch has argued that he'd rather have fewer visitors who paid.

We contacted News International to ask whether this policy is likely to be extended to other website, and are still awaiting a response.

Subscribe to PC Pro magazine. We'll give you 3 issues for £1 plus a free gift - click here
User comments


"and right now it looks as though NewsNow has been singled out"

Seems a bit odd to do it in such a selective way.

By Lacrobat on 8 Jan 2010

Odd, maybe

I thought that maybe NI had no-one who understood, or even had the first clue about the Internet/web sites/ computers, so are taking them out one at a time.
Then I had a look at the NewsNow site...

"Tailored feeds from £95 per month. Generic feeds from £75 per month"
Does NI get any share of this subscription fee?
Maybe that has something to do with it

By greemble on 9 Jan 2010

Leave a comment

You need to Login or Register to comment.



Most Commented News Stories
Latest Blog Posts Subscribe to our RSS Feeds
Latest ReviewsSubscribe to our RSS Feeds
Latest Real World Computing


Sponsored Links

Your email:

Your password:

remember me


Hitwise Top 10 Website 2010

PCPro-Computing in the Real World Printed from

Register to receive our regular email newsletter at

The newsletter contains links to our latest PC news, product reviews, features and how-to guides, plus special offers and competitions.