This idea, showing a relevant RSS Feed at the end of the post, came to my mind day before yesterday. That time, I had to install the wp-exec plugin that can handle PHP codes inside the post. Using that, I have included an RSS Feed at the end of the post to show live contents from external site.
However, that is not suitable for all. All wordpress users don’t know PHP. Moreover, it is not simply process. if you make a syntax error, you take a lots of trouble. So, I thought, I will make it simple. And yes, the initial version is done. I have plan to release an low-cost premium version with many customizable features that I have in my mind.
How it works?
After you install the plugin, you configure it from WP-Admin -> Settings -> In Post RSS link and set the number of items to show and show/hide Feed Title that is given by you as you see in the screenshot below:
Continue reading →
My first scraping work was www.stock.projanmo.com where I have fetched and processed stock data from www.dsebd.org and www.biasl.net. I had to scrap them as they did not have any syndication feed. I had to process line by line. That was tedious job.
Later, I have worked with eBay product scraping for a few of my clients. In many cases, I did not need to take much trouble as they have web services. Whatever, that was most boring tasks as I am not good at Regular Expression. So, I have denied a lots of such tasks.
Recently, one of my old customer requested me to work again on scraping for collecting articles from www.articlesnatch.com and auto blog in wordpress. It also was comparatively easy as it has RSS feed for search page. But the RSS had summary of article. I had to fetch the whole article.
Yesterday, I have started a pretty big scrapping project. I also took helping hands to complete it fast. This time, I had to scrap articles from www.articlebase.com and autoblog in wordpress on some preselected schedules (wordpress’s native cron). As they don’t have any feed for search keyword/category, it is a bit complex comparing to previous one. However, as I already have gain some scraping experience, it was very easy for me. And most surprisingly, I am now getting interest on scraping :P.