How to use WP Web Scraper?
WP Web Scraper lets you specify a URL source and a query to fetch specific content from it. WP Web Scraper can be used through a shortcode (for posts, pages or sidebar) or template tag (for direct...
View ArticleHow to optimize performance?
Here are some tips to help you optimize the usage: Keep the timeout as low as possible (least is 1 second). Higher timeout might impact your page processing time if you are dealing with content on slow...
View ArticleMinimum requirements & dependencies
As WP Web Scraper is a WordPress plugin, so over and above the minimum requirements of WordPress, you need to have a couple of things: PHP version 5.3.3 or greater (required). This is needed by...
View Articleremove_query and a_target
Fetch ‘Trending Now’ text from yahoo.com and display it as a list. External links to open in a new window. Shortcode Template Tag Output [wpws url="https://www.yahoo.com/"...
View Articlexpath query on RSS feed, lt and text output
Fetch ‘Hot Google searches’ using the RSS feed (https://www.google.com/trends/hottrends/atom/feed) using an XPath query and display only the first 10 items as a list. Shortcode Template Tag Output...
View Articlebasehref auto correction and a_target
Fetch US Market Indices from reuters.com and make sure links and image sources are not broken. Shortcode Template Tag Output [wpws url='http://www.reuters.com/finance/markets' query='#tab1...
View ArticleDynamic URL and on_error handling
Fetch stock quotes chart image from reuters.com and make sure links and image sources are not broken. Display a nice error message. (View this same page with a symbol argument for Google, Microsoft and...
View ArticleJSON and callback
Parse a JSON URL source (http://ip.jsontest.com/) using a custom callback function Shortcode Callback function Template Tag Output [wpws url='http://ip.jsontest.com/' basehref=0...
View ArticlePosting external content as Posts or Pages
Posting external content as Posts or Pages is possible using the Import functionality under the ‘Settings > WP Web Scraper’ screen. However, it should be noted that this is not what WP Web Scraper...
View ArticleProxies in WordPress + WP Web scraper
Using proxies to make requests via WP Web scraper is same as using the HTTP API with a Proxy. The allowed Proxy settings for the wp-config.php are the following: # HTTP Proxies # Used for e.g. in...
View ArticleImporting jobs into employsouthdakota.com
Employsouthdakota.com is a job aggregator for South Dakota region. They wanted to aggregate jobs directly from the job portals of corporations operating in the local area. They wanted the jobs to be...
View ArticleImporting jobs into medcareernews.com
Medcareernews.com is a great source of medical news and career advice in the US market. They wanted to further enhance their product by aggregating jobs from healthcare and pharmaceutical corporations....
View Article
More Pages to Explore .....