PHP Classes
Icontem

Class: Spider website


  Search   All class groups All class groups   Latest entries Latest entries   Top 10 charts Top 10 charts   Newsletter Newsletter   Blog Blog   Forums Forums   Help FAQ Help FAQ  
  Login   Register  
Recommend this page to a friend! ReTweet ReTweet Stumble It! Stumble It! Bookmark in del.icio.us Bookmark in del.icio.us
  Classes of Karol Janyst  >  Spider website  >  Download  >  Support forum Support forum (1)  >  Blog Blog  >  RSS 1.0 feed RSS 2.0 feed Latest changes  
Name: Spider website Support forum
Base name: spider
Description: Crawl a site and retrieve the the URL of all links
Related top rated classes: ,
Version: 0.1
Required PHP version: 5.0
License: GNU General Public License (GPL)
All time users: 760 users
All time rank: 2956
Week users: 13 users
Week rank: 514
 
  Author   Group folder image Groups   Detailed description  
  Rate classes User ratings   Applications   Files Files  

Author

Picture of Karol Janyst
Name: Karol Janyst <e-mail contact>
Published packages: 2 Browse this author's classes Browse this author's classes
Country: Poland Poland - PHP jobs in Poland
Home page: ???
Age: 22
All time rank: 1385
Week rank: 157

Groups

Group folder image HTML HTML generation and processing View top rated classes
Group folder image PHP 5 Classes using PHP 5 specific features View top rated classes
Group folder image Searching Search engines, crawling and indexing View top rated classes

Detailed description

This class can be used to crawl a site and retrieve the the URL of all links.

It can retrieve a page of a site and follow all links recursively to retrieve all the site URLs.

The class can restrict the crawling to URLs with a given extension and avoids accessing pages listed in the site robots.txt file, or pages set with the no index or no follow meta tags.

User ratings

Ratings
Utility
Consistency
Documentation
Examples
Tests
Videos
Overall
Rank
All time:
Good (83.3%)
Perfect (100.0%)
-
Good (91.7%)
-
-
Sufficient (60.8%)
652
Month:
Not yet rated by the users

Applications that use this class

No application links were specified for this class.
Add link image If you know an application of this package, send a message to the author to add a link here.

Files

File Role Description
Plain text file spider.class.php Class Main class file
Plain text file example.php Example Example file
Download all files: spider.tar.gz spider.zip
NOTICE: if you are using a download manager program like 'GetRight', please Login before trying to download this archive.

 
  Advertise on this site Advertise on this site   Site map Site map   Statistics Statistics   Site tips Site tips   Privacy policy Privacy policy   Contact Contact  

For more information send a message to :
info at phpclasses dot org.
Copyright (c) Icontem 1999-2009 PHP Classes - PHP Class Scripts
  PHP Book Reviews - Reviews of books and other products