[Chicago-talk] How would you do this?
dave at obtiva.com
Mon Nov 12 10:23:37 PST 2007
The first thing that pops into my mind is Watir, a functional testing
tool for driving Internet Explorer. There are also Firefox and Safari
variants in the works.
Here are some examples...
On 11/12/07, David Young <davidy at nationalcycle.com> wrote:
> I'm on another mailing list of colleagues, and this question came up. What
> would you all recommend?
> -----Original Message-----
> Sent: Monday, November 12, 2007 10:32 AM
> To: techies at xxxxxxxxxxxxxxxxxxxx
> Subject: How would you do this?
> More and more, I'm finding the need to do some page-scraping of web pages
> that are Web 2.0-ey.
> My normal scraping tool is perl's WWW::Mechanize and such. But it is
> For example...I'd like to write something that goes to YouTube, looks up
> a set of videos, analyzes the comments and ratings, and presents a
> summary report. That's just an example of something that is conceptually
> simple (easily done manually) but can't be done with WWW::Mechanize.
> So if you wanted to do something like that, what would you use?
> I'm not adverse to using something other than perl...something Windows-based
> would be my last resort. I'd consider a commercial product, though
> preferably not a multi-hundred-dollar one...
> Obviously, something that submits as well as scrapes would be ideal.
> Chicago-talk mailing list
> Chicago-talk at pm.org
More information about the Chicago-talk