Learn Web Crawling In 30 Minutes

Web crawling/scrapping is a very fancy term  talked and heard now days, but very less people are aware, performing web crawling is very easy and any one can do with basic linux or any os skills without any programming knowledge.

This is what we try to address in this course by making it very simple, short and creating training material one of required skills for data collection from internet by web scrapping. In this course we will be crawling one e-commerce website owned by Trainer, and crawl the all products listed on website along with it’s prices.

The methods and applicability thought in the tutorial gives students some basic idea about any data which is crawl-able  on web, can be just done with right approach and some linux commands rather than using fancy apis of scraping like (Beautifulsoup, scrapy etc) in python and other java programming languages.

Besides technical details, this course also talks about the legal aspect of crawling and how and when it violates government security laws and what are the ways to do it in legit way.

This course is also not required any prior knowledge in web scrapping/crawling, but some knowledge in linux will be helpful.