Blackwidow Documentation News CGI Scripts Become A Member Contact Us Support Download Area   Documentation BLACKWIDOW:  V1.0 Copyright 2001 Psybercore, Inc. - All Rights Reserved. Selling redistributing or modifying any or all of the code for this program without prior written consent is expressly forbidden. You must obtain written permission before redistributing this software over the Internet or in any other medium. In all cases copyright and header information must remain intact. System Requirements Unix or  Lynyx  operating system Perl 5 Telnet Access Preliminaries Determine the path to PERL 5 on your web server host.  Note that some web hosting companies run both PERL 4 and PERL 5.  Make ABSOLUTELY sure you are not setting this up under PERL 4.  Ask your administrator if you are not sure. If you need to review or learn the basics of CGI and Perl check out the superscripts tutorial archives. Download the tarfile for this program and save it to your desktop. Unpack the tar archive on your desktop using a program that unpacks UNIX TAR ARCHIVES. If you don't have such a program then download WINZIP FREE from SHAREWARE.COM.  After you have unpacked the TAR archive you will have a collection of folders and files on your desktop.  Now you have to do some basic editing of each of these files (or at least some of them).  Use a text editor such as wordpad, notepad, BBEdit, simpletext, or teachtext to edit the files.  These are NOT WORD PROCESSOR DOCUMENTS they are just simple TEXT files so don't save them as word processor documents or save them with extentions such as .txt or they will NOT WORK.   Note that there may be a some files inside of folders which are "blank".   This is normal. Preparing the CGI scripts Define Path To PERL 5 The first step is to open up each and every file that has a .cgi extention and edit line number one of each script.  Each of the cgi scripts is written in perl 5. For your scripts to run they must know where perl 5 is installed on your web server. The path to perl 5 is defined to a cgi script in the first line of the file. In each of the cgi scripts the first line of code looks something like this: #!/usr/bin/perl If the path to perl 5 on your web server is different from /usr/bin/perl you must edit the first line of each cgi script to reflect the correct path. If the path to perl 5 is the same no changes are necessary. If you do not know the path to perl 5 ask the webmaster or system administrator at your server site.   Configure the .cgi files blackwidow.cgi (lines 21-22) @validsuffix = (jpg,gif); Include here all suffixes you want the spider to index (i.e. could be (html,htm,txt)) $rooturl="http://www.superscripts.com/demo/blackwidow"; This is the root URL from which you are indexing File Locations All files should be uploaded into your ROOT HTML DIRECTORY and NOT the cgi-bin. File Access Permissions File access permissions must be set correctly for this program to run. The table below lists the permissions of each file which are to be set by the unix command ( chmod ) used to set the correct access permissions. You must set the access permissions for each of these files.  CHMOD 755  CHMOD 777 blackwidow.cgi sites.txt RUN THE SCRIPT! Run from the telnet command prompt using the command perl blackwidow.cgi When indexing is complete "sites.txt" will contain a database of all of your URLS.