Archive for: September, 2009


Sep 20 2009 Published by under Dogs

No responses yet

Using grep to scrape web pages

Sep 18 2009 Published by under Linux

In preperation to scrape a number of web pages, I used grep to make a list of URLs I need to scrape.  The list of URLs was in an RSS file.

grep -P “\<link><\![CDATA\[(.*?)]” hawkeye_stories.xml > hawkeye_stories_links.txt

No responses yet