Request quote

Posts Tagged ‘php crawler script’

script to create a php site crawl robot easily

Posted on: August 30th, 2012 by Mohammed Aqeel 4 Comments

The following tutorial is a simple example of how to create a site crawl robot with php. This can be used for search engines, creating caches of your sites at regular intervals etc. The crawler uses php’s CURL library to fetch the URL contents. It will then look for an anchor tag inside the page […]