APM: Web Site Mapper

David Bluestein II dbii at mudpuddle.com
Wed Nov 12 12:10:04 CST 2003


Bill-

Some of them did various things that almost got me there (including sitemapper), but none did an image of what linked where. In looking, I think if I traverse the directory tree locally, use HTML::LinkExtor to grab links from the document, then make a hash of what links where I'll have the data I need. 

Then I'd just need a way to display it graphically. Bet there's a CPAN module or something if I passed in a hash of hashes/arrays.

David

On Wed, Nov 12, 2003 at 09:25:01AM -0800, Bill Raty wrote:
> Found a few via google at this link:
> 
> http://www.hotscripts.com/Perl/Scripts_and_Programs/Site_Mapping/
> 
> Looks like sitemapper has some of the features you want.
> 
> -Bill
> 
> 
> 
> --- David Bluestein II <dbii at interaction.net> wrote:
> > I am looking for a Perl Script/Module that maps a website.
> > What I want it
> > to do is:
> > 
> > * Given a starting URL, find all the attached pages on the
> > site, recursively
> > * Produce a list of pages, along with the pages they link to
> > * A graphical map of the site would be nice
> > * Can either be run remotely or on server where website
> > lives, from server
> > command line might be better since then it could identify
> > pages that exist
> > without links going to them.
> > 
> > I basically want to say "Go find all the pages on the site,
> > show me what
> > they link to" so I can do some site cleanup. I could whip one
> > up, but
> > figured someone probably could suggest some Open Source
> > Project/Module they
> > have used that has more features in it.
> > 
> > Thanks-
> > 
> > David
> > 
> > ----------
> > David H. Bluestein II                         President &
> > Lead Developer
> > dbii at interaction.net                         ii, inc.
> > 
> > http://www.interaction.net
> > -        Specializing in Designing Interactive Websites      
> >  -
> > -              and Searchable Internet Databases             
> >      -
> > 
> > 
> > 
> > 
> > 
> > _______________________________________________
> > Austin mailing list
> > Austin at mail.pm.org
> > http://mail.pm.org/mailman/listinfo/austin
> 
> 
> =====
> "There let the pealing organ blow, 
> To the full-voiced choir below, 
> In service high, and anthems clear, 
> As may with sweetness, through mine ear, 
> Dissolve me into ecstasies, 
> And bring all Heav'n before mine eyes". 
> John Milton - Il Penseroso (1632).



More information about the Austin mailing list