Since early childhood, I have been a big fan of cricket. Some of my earliest childhood memories are watching the game along with my loved ones in India. As much as I can recall, the first series I saw was between India and the West Indies during the early 80s, on a black and white TV set. Watching Sunil Gavaskar play the fearsome West Indian fast bowlers with aplomb, made me his fan…until a kid named Sachin Tendulkar arrived in 1989.
Other posts in this series: Ames Housing - Part 1 - Laying the foundation - Building a Data Pipeline Ames Housing - Part 2 - Walkthrough - An Exploratory Data Analysis In Part 1, we built a data pipeline that cleans the Ames Housing dataset, and in Part 2, we explored the finalized dataset.
In this post, we build linear and non-linear models, and we find out how well they predict the SalePrice of properties. A model is a formula that a computer learns from examples. A linear model adds up the features, each multiplied by a number (a coefficient) that it learns from the data. A non-linear model can also learn curved relationships.
Other posts in this series: Ames Housing - Part 1 - Laying the foundation - Building a Data Pipeline Ames Housing - Part 3 - Closing the deal - Building Models In Part 1, we built a data pipeline that cleans the Ames Housing dataset and creates new features. In this post, we explore the finalized dataset. An exploratory data analysis (EDA) is the first study of a dataset before we build models. We look at the features one at a time, then two and three at a time, to find which features affect the sale price. In Part 3, we use what we learn to build models.
Other posts in this series: Ames Housing - Part 2 - Walkthrough - An Exploratory Data Analysis Ames Housing - Part 3 - Closing the deal - Building Models In this case study, we use the Ames Housing dataset to predict the sale prices of houses. The case study has three posts:
In this post, we build a data pipeline: a series of steps that fixes errors in the data, fills in missing values, creates new features and drops features that we do not need. At the end, we save the finalized dataset. In Part 2, we explore the finalized dataset to find which features affect the sale price. In Part 3, we build models that predict the prices. A model is a formula that a computer learns from examples. Neighborhoods of Ames Location is very important for the price of a house. The version of the dataset that we use (from Kaggle) does not have the location of each property. But the full dataset by Dean De Cock, which is in the R package modeldata, has the latitude and longitude of 2930 properties. We use it to show where the neighborhoods are.
Other posts in this series: Diamonds - Part 1 - In the rough - An Exploratory Data Analysis Diamonds - Part 2 - A cut above - Building Linear Models In the previous posts, we found out which attributes of a diamond are important for its price. An exploratory data analysis showed that carat, clarity and color are the most important features to predict price. Then we built linear models to predict the prices, and we chose the best model by its metrics.
Other posts in this series: Diamonds - Part 1 - In the rough - An Exploratory Data Analysis Diamonds - Part 3 - A polished gem - Building Non-linear Models In a previous post in this series, we explored the diamonds dataset. We found that price has a strong correlation with carat, x, y and z, and that log(price) has an almost straight-line relationship with log(carat). For diamonds of similar weight, clarity and color also seemed to help predict the price.
Other posts in this series: Diamonds - Part 2 - A cut above - Building Linear Models Diamonds - Part 3 - A polished gem - Building Non-linear Models In this case study, we explore the diamonds dataset. Then, in the next posts, we build models that predict the price of a diamond. A model is a formula that a computer learns from examples. Some models are linear (they use straight-line relationships) and some are non-linear (they can also learn curves).