Click here to Skip to main content
Click here to Skip to main content
Search within:



 
Comments & Discussions

Web scraping with regular expressions

By , 18 Jan 2013
 
No downloads associated with this content

By viewing downloads associated with this article you agree to the Terms of use and the article's licence.

If a file you wish to view isn't highlighted, and is a text file (not binary), please let us know and we'll add colourisation support for it.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

About the Author

 Richard Penman
Australia Australia
Member
No Biography provided

About Article
Using regular expressions for web scraping is sometimes criticized, but I believe they still have their place, particularly for one-off scrapes. Let's say I want to extract the title of a particular webpage - here is an implementation using BeautifulSoup, lxml, and regular expressions:import reimpor
Type Technical Blog
Licence CPOL
First Posted 18 Jan 2013
Views 1,462
Bookmarked 2 times
Top News

The Next Version of Android - Some of What's Coming

Get the Insider News free each morning.
Related Videos
JavaScript: Regular Expressions Part 1
JavaScript: Regular Expressions Part 2
Scraping Dynamic WebSite data using Watin
Reputationator - CP Narcissists Rejoice! Part 1 of 4
Ripping Data on the Web
How to teach yourself web scraping
Data Scraping in ASP.NET Using WhoIs Search !!
VB.NET TextBox Validation Control
.NET RegEx Test
Expresso - A Tool for Building and Testing Regular Expressions
Web Scraping in ASP.NET with Regular Expression Matching and XML Transformation
Typical web scraping job
The 30 Minute Regex Tutorial
Web Extractor using Regular Expressions
Extract inner text from HTML using Regex
Fast regular expressions
Scraping dynamic data
.NET Regular Expressions Find and Replace Add-In for Visual Studio 2008
Simplifed use of Regular Expressions from within your Scripts
RegEx Tracer
Simple and Useful JavaScript Regular Expression Tutorial
JavaScript Regular Expression Tester
Permalink | Advertise | Privacy | Mobile
Web01 | 2.6.130516.1 | Last Updated 18 Jan 2013
Article Copyright 2013 by Richard Penman
Everything else Copyright © CodeProject, 1999-2013
Terms of Use
Layout: fixed | fluid