How to Correctly Use Lists in R?

Question

Brief background: Many (most?) contemporary programming languages in widespread use have at least a handful of ADTs [abstract data types] in common, in particular,

• string (a sequence comprised of characters)

• list (an ordered collection of values), and

• map-based type (an unordered array that maps keys to values)

In the R programming language, the first two are implemented as character and vector, respectively.

When I began learning R, two things were obvious almost from the start: list is the most important data type in R (because it is the parent class for the R data.frame), and second, I just couldn't understand how they worked, at least not well enough to use them correctly in my code.

For one thing, it seemed to me that R's list data type was a straightforward implementation of the map ADT (dictionary in Python, NSMutableDictionary in Objective C, hash in Perl and Ruby, object literal in Javascript, and so forth).

For instance, you create them just like you would a Python dictionary, by passing a key-value pair to a constructor (which in Python is dict not list):

x = list("ev1"=10, "ev2"=15, "rv"="Group 1")

And you access the items of an R List just like you would those of a Python dictionary, e.g., x['ev1']. Likewise, you can retrieve just the 'keys' or just the 'values' by:

names(x)    # fetch just the 'keys' of an R list

# [1] "ev1" "ev2" "rv"

unlist(x)   # fetch just the 'values' of an R list

#   ev1       ev2        rv 

#  "10"      "15" "Group 1" 

x = list("a"=6, "b"=9, "c"=3)  

sum(unlist(x))

# [1] 18

but R lists are also unlike other map-type ADTs (from among the languages I've learned anyway). My guess is that this is a consequence of the initial spec for S, i.e., an intention to design a data/statistics DSL [domain-specific language] from the ground-up.

three significant differences between R lists and mapping types in other languages in widespread use (e.g,. Python, Perl, JavaScript):

first, lists in R are an ordered collection, just like vectors, even though the values are keyed (ie, the keys can be any hashable value not just sequential integers). Nearly always, the mapping data type in other languages is unordered.

second, lists can be returned from functions even though you never passed in a list when you called the function, and even though the function that returned the list doesn't contain an (explicit) list constructor (Of course, you can deal with this in practice by wrapping the returned result in a call to unlist):

x = strsplit(LETTERS[1:10], "")     # passing in an object of type 'character'

class(x)                            # returns 'list', not a vector of length 2

# [1] list

A third peculiar feature of R's lists: it doesn't seem that they can be members of another ADT, and if you try to do that then the primary container is coerced to a list. E.g.,

x = c(0.5, 0.8, 0.23, list(0.5, 0.2, 0.9), recursive=TRUE)

class(x)

# [1] list

my intention here is not to criticize the language or how it is documented; likewise, I'm not suggesting there is anything wrong with the list data structure or how it behaves. All I'm after is to correct is my understanding of how they work so I can correctly use them in my code.

Here are the sorts of things I'd like to better understand:

• What are the rules which determine when a function call will return a list (e.g., strsplit expression recited above)?

• If I don't explicitly assign names to a list (e.g., list(10,20,30,40)) are the default names just sequential integers beginning with 1? (I assume, but I am far from certain that the answer is yes, otherwise we wouldn't be able to coerce this type of list to a vector w/ a call to unlist.)

• Why do these two different operators, [], and [[]], return the same result?

x = list(1, 2, 3, 4)

both expressions return "1":

x[1]

x[[1]]

• why do these two expressions not return the same result?

x = list(1, 2, 3, 4)

x2 = list(1:4)

Please don't point me to the R Documentation (?list, R-intro)--I have read it carefully and it does not help me answer the type of questions I recited just above.

(lastly, I recently learned of and began using an R Package (available on CRAN) called hash which implements conventional map-type behavior via an S4 class; I can certainly recommend this Package.)

Answer 1

A list in R programming is a non-homogeneous data structure, which implies that it can contain elements of different data types. It accepts numbers, characters, lists, and even matrices and functions inside it.

A list can contain any other class as each element. So you can have a list where the first element is a character vector, the second is a data frame, etc. Lists are re-used for a variety of purposes in R, including forming the base of a data.frame, which is a list of vectors of arbitrary type (but the same length).

For example:

list1 <- list("a"=1:5, "b"=1:6,  "s"=search,"c"=matrix(1:9, nrow=3))

lapply(list1, class)

Output:

 

$a

[1] "integer"

 

$b

[1] "integer"

 

$s

[1] "function"

 

$c

[1] "matrix"

While Vector is homogeneous in nature, which means that it only contains elements of the same data type. Data types can be numeric, integer, character, complex or logical. Coercion takes place in a vector from lower to top, if the elements passed are of different data types from Logical to Integer to Double to Character

For example:

n = numeric(10)

names(n) = LETTERS[1:10]

i = integer(5)

v = c(n,i)

lapply(v, class)

Output:

$A

[1] "numeric"

$B

[1] "numeric"

$C

[1] "numeric"

$D

[1] "numeric"

$E

[1] "numeric"

$F

[1] "numeric"

$G

[1] "numeric"

$H

[1] "numeric"

$I

[1] "numeric"

$J

[1] "numeric"

[[11]]

[1] "numeric"

[[12]]

[1] "numeric"

[[13]]

[1] "numeric"

[[14]]

[1] "numeric"

[[15]]

[1] "numeric"

In this case, you have created two different lists. x has four vectors, each of lengths 1. x2 has 1 vector of length 4:

 x = list(1, 2, 3, 4); x2 = list(1:4)

> length(x[[1]]) [

1] 1 

> length(x2[[1]])

 [1] 4

The difference between [ ] and [[ ]] is that [[ ]] selects a single item from a list and [] returns a list of the selected items.

For example:

x = list(1, 2, 3, 4)

 > x[1] 

[[1]]

 [1] 1 

> x[[1]]

 [1] 1