Answer by jaapz for Reading RSS feeds in php or python/something else?
Is solved this by adding a usleep() function at the end of each iteration of a feed. This drastically lowered cpu and memory consumption. The process used to take about 20 minutes, and now only takes...
View ArticleAnswer by ivoba for Reading RSS feeds in php or python/something else?
You could try to check Cache-Headers of the feeds first before parsing them.This way you can save the expensive parsing operations on probably a lot of feeds.Store a last_updated date in your db for...
View ArticleAnswer by Mikko Ohtamaa for Reading RSS feeds in php or python/something else?
You can parse raw XML using lxml which users underlying libxml C iibrary:http://lxml.de/parsing.htmlBecause parsing is done using native code it's fast.Someone is already doing in:Encoding error while...
View ArticleReading RSS feeds in php or python/something else?
I currently am developing a website in the Symfony2 framework, and i have written a Command that is run every 5 minutes that needs to read a tonne of RSS news feeds, get new items from it and put them...
View Article
