Click here to Skip to main content
13,706,648 members
Click here to Skip to main content
Add your own
alternative version

Stats

2.8K views
8 bookmarked
Posted 14 Sep 2018
Licenced CPOL

Web Scraping - Learn The Fundamentals In 60 Minutes

, 14 Sep 2018
Rate this:
Please Sign up or sign in to vote.
A free video course to learn the fundamentals of web scraping - usually missed by other sources!

Introduction

One of the things I talk to the community about a lot and always get a good response to is the black-art of web scraping. As the world becomes more and more hungry for data, it seems that more often than not, the data we want can be found on a website somewhere. But how to get that data so you can change it the way you want and do something interesting with it and add value to it? This is where web scraping comes in.

Web scraping involves two core skills - obviously, some programming knowledge to get started, and the other arguably more important, is the ability to know how a website is built, to be able to identify where the data you want actually comes from. Is the data you need embedded on the page? (really?) or is it in a CSS file, a tangled up mess encoded in Java-script, or being generated based on a JSON feed from an AJAX call to an API somewhere. Web scraping at the start is less about programming and more about the investigation - this is something that a lot of folks who start to web scrape miss.

One of my most popular series of articles is all about web-scraping - sometimes, however, the text is not enough, and we need visual help to see what's going on. With this in mind, I have created a free webscraping course that teaches the fundamentals of web scraping - it will take you from knowing little about the subject to having a solid knowledge of what you need to do when you start web scraping.

Most of the resources (both free and paid) I have come across assume the reader/student has more knowledge than they do - my aim with this course is to give you that important foundation knowledge, of course, for free :)

I am really enjoying the process of making courses (especially free ones) as a new way to pass skills and knowledge to others in the community - here is some of the amazing feedback I have received so far - I am delighted with it and it is the support of the community over the years that has allowed me to get to this stage.

"Finally, an instructor who knows how to teach students so that they are not lost or confused. Thank you!"

"Great course, wish I would have watched it before reading Python Scrapy documentation."

"I loved this course. It's a great introduction to web scraping! It's short, sweet and to the point!"

"Really impressed about theory and strategies to use... goes beyond my expectation"

If you want to learn the very fundamentals of web scraping - this is a great place to start, and it's free, and we like free:    

Free web scraping course link

History

  • 14/Sep/2018: Version 1

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

AJSON
Engineer
United Kingdom United Kingdom
Architect/engineer, student, always learning and refactoring my wetware. Happiest tucking into a big bowl of c# or python sprinkled with a crisp topping of Javascript...started with a single ZX80 a lifetime ago, now happily explore, build and create on interweb scale...



  • 1 Apr 2017 - Awarded Microsoft MVP for 2017
  • 18 Mar 2017 - "Calculating distance using Google Maps in ASP.NET MVC" - article of the day on ASP.net
  • 31 Dec 2016 - "How to improve Single Page App and Hybrid mobile performance" - article of the day on ASP.net
  • 23 Oct 2016 - "Multi-user/resource web diary in C# MVC with repeat events" - article of the day on ASP.net
  • 7 Jun 2016 - "Upload large files to MVC / Web API using partitioning" - article of the day on ASP.net
  • 16 Sep 2015 - "Single Page Application with MVC and SammyJS" - article of the day on ASP.net
  • 01 Sep 2015 - "KnockoutJS nested arrays in MVC" - article of the day on ASP.net
  • 21 Aug 2015 - "Audit trail and data versioning with C# and MVC" - article of the day on ASP.net
  • 6 Oct 2014 - "Full Calendar – A Complete Web Diary System for jQuery and C# MVC" - article of the day on ASP.net



You may also be interested in...

Comments and Discussions

 
SuggestionWeb Scraping Legalities Pin
alexcoder9917-Sep-18 5:58
memberalexcoder9917-Sep-18 5:58 
GeneralMy vote of 5 Pin
David A. Gray16-Sep-18 8:09
memberDavid A. Gray16-Sep-18 8:09 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

Permalink | Advertise | Privacy | Cookies | Terms of Use | Mobile
Web01-2016 | 2.8.180920.1 | Last Updated 14 Sep 2018
Article Copyright 2018 by AJSON
Everything else Copyright © CodeProject, 1999-2018
Layout: fixed | fluid