IntroductionWe have been frequently said that between two big e-commerce platforms of Malaysia (Shopee and Lazada), one is normally cheaper as well as attracts good deal hunters whereas other usually deals with lesser price sensitive.So, we have decided to discover ourselves… in the battle of these e-commerce platforms!For that, we have written a Python script with Selenium as well as Chrome driver for automating the scraping procedure and create a dataset.
Here, we would be extracting for these:Product’s NameProduct’s NameThen we will do some basic analysis with Pandas on dataset that we have extracted.
We will work with Shopee during Part 2!Initially, we import the required packages:# Web Scraping
import seaborn as snsThen, we start the universal variables which are:Path of a Chrome web driverWebsite URLItems we wish to searchwebdriver_path = 'C://Users//me//chromedriver.exe' # Enter the file directory of the Chromedriver
search_item = 'Nescafe Gold refill 170g' # Chose this because I often search for coffee!After that, we would start off the Chrome browser.
We would do it with a few customized options:# Select custom Chrome options
IntroductionWe have been frequently said that between two big e-commerce platforms of Malaysia (Shopee and Lazada), one is normally cheaper as well as attracts good deal hunters whereas other usually deals with lesser price sensitive.So, we have decided to discover ourselves… in the battle of these e-commerce platforms!For that, we have written a Python script with Selenium as well as Chrome driver for automating the scraping procedure and create a dataset.
Here, we would be extracting for these:Product’s NameProduct’s NameThen we will do some basic analysis with Pandas on dataset that we have extracted.
We will work with Shopee during Part 2!Initially, we import the required packages:# Web Scraping
import seaborn as snsThen, we start the universal variables which are:Path of a Chrome web driverWebsite URLItems we wish to searchwebdriver_path = 'C://Users//me//chromedriver.exe' # Enter the file directory of the Chromedriver
search_item = 'Nescafe Gold refill 170g' # Chose this because I often search for coffee!After that, we would start off the Chrome browser.
We would do it with a few customized options:# Select custom Chrome options