top of page
Search

Women’s E-Commerce Review Dataset (Data Analysis)


 

Women’s E-Commerce Review Dataset

Includes 23486 rows and 10 unique features

Clothing ID: refers to the specific piece of clothing being reviewed

Age: refers to the reviewer’s age

Title: string variable for the title of the review

Review Text: string variable which includes the text of the review

Rating: score granted by the customer 1 being Worst and 5 being Best review

Recommended IND: binary variable describing if the customer recommends the product or not. 1 = recommend / 0 = not recommended

Positive Feedback Count: documents the number of customers who found the review positive

Division Name: categorical variable describing the division of the product

Department Name: categorical variable describing the department of the product

Class Name: Categorical variable describing the class of the product


Purpose of the Analysis

Goal: To perform Sentiment Analysis on the women’s clothing dataset in order to classify if a review is positive or negative

Allows the customer to better understand the product

Allows the company to receive accurate feedback about the product


Data Wrangling

Deleted ‘ID’ variable from the dataset

Identified and eliminated all rows with missing data

Due to the large number of categorical data eliminating the rows with missing values was more beneficial than replacing the missing values with the most common category per each variable.


Data Visualization

  • Pie Chart of Rating count

  • Over half of the reviews were given a 5-star rating

  • Over 75% of the reviews received at least a 4-star review









  • Count plot of reviews by age

  • Most reviews were written by customers in their 40’s

  • Reviews decreased as age of the reviewer decreased after 40



  • Count Plot of Recommended IND

  • Recommended = 82%

  • Not Recommended = 18%

  • Assumption: 75% of reviews received 4 or 5 star ratings and 82% of the reviews recommended the product therefore we can assume the recommended Ind variable correlates with the rating review.


  • Reviews per Department

  • The tops department received the most reviews





  • Reviews per Class

  • The dress class received the most reviews






  • Count plot of ratings per department and rating per class

  • Each department and class follow the same trend with most of the reviews per department/class are 5-star reviews and the least being 1-star reviews

  • Since the trend is the same per each department/class using this variable in the predictive model may not be as impactful








  • Eliminated 3-star reviews from the data set

  • 3-star ratings are considered neutral and are not beneficial predicting positive/negative reviews

  • Changed all reviews above 3 stars to positive reviews and reviews below 3 stars as negative reviews

  • After eliminating the 3-star reviews 88% of the reviews were classified as positive reviews


For each classifier the accuracy, precision and recall were calculated to determine which model had the best performance





Accuracy = (TN + TP)/(TN+TP+FN+FP)

The portion of the correctly predicted sentiment to the total number of predicted sentiment


Precision = TP/(TP+FP)

The proportion of positive sentiment were identified correctly


Recall = TP/(TP+FN)

The proportion of actual positives were correctly identified

 


Naïve Bayes Classifier

This classifier is based on the Bayes Theorem with the assumption of independence between every pair of features.





Results

  • Accuracy = 88%

  • Precision = 100%

  • Recall = 88.3%


 


K-Nearest Neighbor Classifier

This classifier is computed by a simple majority vote of the K-nearest neighbor of each point




Results

  • Accuracy = 87%

  • Precision = 97%

  • Recall = 90%