Create Full-Text Feeds

Or select from one of the feeds below...

Schnews Medialens

Thanks to everyone who donated! :)

The next release should be available in the first week of March.

About

This is a free software project to help people extract and read full-text web content. It can extract content from a standard HTML page and return a 1-item feed or it can transform an existing feed into a full-text feed. It is being developed as part of the Five Filters project to promote alternative, non-corporate media.

Bookmark and Share

Bookmarklet

To easily transform partial-feeds you encounter (or convert any content on a page into a 1-item feed), drag the link below to your browser's bookmarks toolbar. Then whenever you'd like a full-text feed, click the bookmarklet.

Drag this: Full-Text RSS

API

To extract content from a web page or to transform an existing partial feed to full text, pass the URL (encoded) in the querystring to the following URL:

If you have an API key, add that to the querystring:

Web Service Limits: Free and Paid Modes

We have imposed certain limits to keep the service running smoothly and to avoid abuse:

Free$10/month
RSS items retrieved 4 1-10
Cache time 20 minutes 10 minutes
Link to fivefilters.org Yes No

If you don't like the limits associated with the free service, you can either download the source code and host it yourself (see below) or buy an API key for $10 a month.

Source Code and Technologies

Source code available on launchpad.net.
The application uses PHP, Readability, SimplePie and FeedWriter. Readability is the magic algorithm that identifies and extracts the content.

System Requirements

PHP 5.2.x is required (PHP 5.3 is not yet supported - support is planned for the next release). The code has been tested on a NearlyFreeSpeech.NET account and on Dreamhost. It should also work with other hosts. It has also been tested on Windows using WampServer.

The instructions below will install the code in a folder called 'full-text-rss'. The instructions have been tested on a NearlyFreeSpeech account but should work on other hosts which offer shell access and have the Bazaar client installed.

Download and Installation

The software can be downloaded completely free through launchpad.net using a Bazaar client (see below). However, many people have been in touch saying they're unable to follow the instructions or unwilling to install the Bazaar application required for the download. For those of you who'd like a simpler solution, you can now buy a zip package with the source code for $10 - you will receive an email with download instructions automatically. The zip file contains a readme file with instructions for uploading the code to your web host via FTP.

Installation with the Bazaar client

  1. Log in to your host using SSH
  2. Change to the directory where you want Full-Text RSS installed
  3. Enter bzr co http://bazaar.launchpad.net/~keyvan-k1m/fivefilters/content-only/ full-text-rss
  4. Now enter chmod 777 full-text-rss/cache/
  5. That's it! Try accessing the full-text-rss folder through your web browser, you should see the form asking for a URL.
  6. (Optional) If you'd like to customise the software, rename config-sample.php to config.php and edit the file.

If you'd like to create a feed without going through the form first, you can simply pass the URL in the query string to makefulltextfeed.php. For example:
http://example.org/full-text-rss/makefulltextfeed.php?feed=http://example.org/feed

Support

I'm happy to help activists/anarchists/progressives set this up on their servers. For anyone else, please email for paid support.

Bug reports and questions welcome.

License


This web application is licensed under the AGPL version 3 (find out why). The bulk of the work, however, is carried out by libraries which are licensed as follows...

The Full-Text RSS service has turned out to be very popular. I would love to continue working on it but will need users to support the development. Please donate if you can. This project currently relies on financial support from individual donors, API key holders and a web hosting reviews site.

Note: Thanks to everyone who contributed to the last fundraising drive. Version 1.0 has now been released!

Author

Created by Keyvan Minoukadeh for the Five Filters project.
Email: keyvan (at) keyvan.net