APM: Web Site Mapper
David Bluestein II
dbii at mudpuddle.com
Wed Nov 12 12:10:04 CST 2003
Bill-
Some of them did various things that almost got me there (including sitemapper), but none did an image of what linked where. In looking, I think if I traverse the directory tree locally, use HTML::LinkExtor to grab links from the document, then make a hash of what links where I'll have the data I need.
Then I'd just need a way to display it graphically. Bet there's a CPAN module or something if I passed in a hash of hashes/arrays.
David
On Wed, Nov 12, 2003 at 09:25:01AM -0800, Bill Raty wrote:
> Found a few via google at this link:
>
> http://www.hotscripts.com/Perl/Scripts_and_Programs/Site_Mapping/
>
> Looks like sitemapper has some of the features you want.
>
> -Bill
>
>
>
> --- David Bluestein II <dbii at interaction.net> wrote:
> > I am looking for a Perl Script/Module that maps a website.
> > What I want it
> > to do is:
> >
> > * Given a starting URL, find all the attached pages on the
> > site, recursively
> > * Produce a list of pages, along with the pages they link to
> > * A graphical map of the site would be nice
> > * Can either be run remotely or on server where website
> > lives, from server
> > command line might be better since then it could identify
> > pages that exist
> > without links going to them.
> >
> > I basically want to say "Go find all the pages on the site,
> > show me what
> > they link to" so I can do some site cleanup. I could whip one
> > up, but
> > figured someone probably could suggest some Open Source
> > Project/Module they
> > have used that has more features in it.
> >
> > Thanks-
> >
> > David
> >
> > ----------
> > David H. Bluestein II President &
> > Lead Developer
> > dbii at interaction.net ii, inc.
> >
> > http://www.interaction.net
> > - Specializing in Designing Interactive Websites
> > -
> > - and Searchable Internet Databases
> > -
> >
> >
> >
> >
> >
> > _______________________________________________
> > Austin mailing list
> > Austin at mail.pm.org
> > http://mail.pm.org/mailman/listinfo/austin
>
>
> =====
> "There let the pealing organ blow,
> To the full-voiced choir below,
> In service high, and anthems clear,
> As may with sweetness, through mine ear,
> Dissolve me into ecstasies,
> And bring all Heav'n before mine eyes".
> John Milton - Il Penseroso (1632).
More information about the Austin
mailing list