Data Manipulation in R with Dplyr Package

Data Manipulation

Data manipulation involves modifying data to make it easier to read and to be more organized. We manipulate data for analysis and visualization. It is also used with the term ‘data exploration’ which involves organizing data using available sets of variables.
At times, the data collection process done by machines involves a lot of errors and inaccuracies in reading. Data manipulation is also used to remove these inaccuracies and make data more accurate and precise.

For example:
We will use the default iris table in R, as follows:

#To load datasets package<br>
library("datasets")<br>
#To load iris dataset<br>
data(iris)<br>
summary(iris)

Output:

So after going through what data manipulation in R is, we are going to cover the following topics in this tutorial:

Redefine Yourself as a Data Science Expert

Achieve More with Data Science Learning

Explore Program

• Data Manipulation in R
• Data Manipulation in R With dplyr Package.
• Grouping
• Pipe Operator

Sample()

It is used to generate a sample of a specific size from a vector or a dataset, either with or without replacement.
The basic syntax of sample() function is as follows:

sample(data, size, replace = FALSE, prob = NULL)

For example:

#To return 5 random rows<br>
index<-sample(1:nrow(iris), 5)<br>
index<br>
iris[index,]

Output:

Table()

It is used to create a frequency table to calculate the occurrences of unique values of a variable.
The table() function generates an object of the table class.
For example:

#To find the frequency distribution of Species in iris table<br>
data(iris)<br>
freq.table <- table(iris$Species)<br>
head(freq.table)

Output:

Shape your future in Data Science for free.

Learn from Top Data Science Experts for Free

Explore Program

Data Manipulation in R With dplyr Package

There are different ways to perform data manipulation in R, such as using Base R functions like subset(), with(), within(), etc., Packages like data.table, ggplot2, reshape2, readr, etc., and different Machine Learning algorithms.
However, in this tutorial, we are going to use the dplyr package to perform data manipulation in R.
The dplyr package consists of many functions specifically used for data manipulation. These functions process data faster than Base R functions and are known the best for data exploration and transformation, as well.
Following are some of the important functions included in the dplyr package
select() :- To select columns (variables)
filter() :-To filter (subset) rows.
mutate() :-To create new variables
summarise() :- To summarize (or aggregate) data
group_by() :- To group data
arrange() :- To sort data
join() :- To join data frames.
To install the dplyr package, run the following command:

install.packages("dplyr")

#To load dplyr package<br>
library("dplyr")<br>
#To load datasets package<br>
library("datasets")<br>
#To load iris dataset<br>
data(iris)<br>
summary(iris)

 Output:

It contains 150 samples of three plant species (setosa, virginica, and versicolor) and four features measured for each sample.

Select()

It is used to select data by its column name. We can select any number of columns in a number of ways.
For example:

#To select the following columns<br>
selected <- select(iris, Sepal.Length, Sepal.Width, Petal.Length)<br>
head(selected)<br>
#To select all columns from Sepal.Length to Petal.Length<br>
selected1 <- select(iris, Sepal.Length:Petal.Length)<br>
#To print first four rows<br>
head(selected1, 4)<br>
#To select columns with numeric indexes<br>
selected1 <- select(iris,c(3:5))<br>
head(selected1)

Output:

Output:

Output:

#We use(-)to hide a particular column<br>
selected <- select(iris, -Sepal.Length, -Sepal.Width)<br>
head(selected)

Output:

Filter()

It is used to find rows with matching criteria. It also works like the select() function, i.e., we pass a data frame along with a condition separated by a comma.
For example:

#To select the first 3 rows with Species as setosa<br>
filtered <- filter(iris, Species == "setosa" )<br>
head(filtered,3)

Output:

#To select the last 5 rows with Species as versicolor and Sepal width more than 3<br>
filtered1 <- filter(iris, Species == "versicolor", Sepal.Width > 3)<br>
tail(filtered1)

Output:

Mutate()

It creates new columns and preserves the existing columns in a dataset.
For example:

#To create a column “Greater.Half” which stores TRUE if given condition<br>
is TRUE<br>
col1 <- mutate(iris, Greater.Half = Sepal.Width > 0.5 * Sepal.Length)<br>
tail(col1)

Output:

#To check how many flowers satisfy this condition<br>
table(col1$Greater.Half)

Output:
FALSE=84  TRUE=66

Arrange()

It is used to sort rows by variables in both an ascending and descending order.
For example:

#To arrange Sepal Width in ascending order<br>
arranged <- arrange(col1, Sepal.Width)<br>
head(arranged)<br>
#To arrange Sepal Width in descending order<br>
arranged <- arrange(col1, desc(Sepal.Width))<br>
head(arranged)

Output:

Summarise()

It is used to find insights(mean, median, mode, etc.) from a dataset. It reduces multiple values down to a single value.
For example:

summarised <- summarise(arranged, Mean.Width = mean(Sepal.Width))<br>
head(summarised)

Output:

Mean.Width<br>
1   3.057333

Grouping10

It is done to group observations within a dataset by one or more variables. Most data operations are performed on groups defined by variables.
For example:

#To find mean sepal width by Species, we use grouping as follows<br>
gp <- group_by(iris,Species)<br>
mn <- summarise(gp,Mean.Sepal = mean(Sepal.Width))<br>
head(mn)

Output:

Pipe Operator

Pipe operator lets us wrap multiple functions together. It is denoted as %>% . It can be used with functions like filter(), select(), arrange(), summarise(), group_by(), etc.
For example:

#To get rows with the following conditions<br>
iris %>% filter(Species == "setosa",Sepal.Width > 3.8)

Output:

#To find mean Sepal Length by Species, we use pipe operator as follows<br>
iris  %>% group_by(Species) %>% summarise(Mean.Length = mean(Sepal.Length))

Output:

In this tutorial we were talking about what data manipulation in R is, data manipulation in R using functions in the dplyr package, grouping, and using the pipe operator to tie multiple functions together. In the next section, we are going to cover data visualization in R.

If you are interested in learning Data Science, we recommend a perfect Data Science Course.