Borealis
Borealis

Reputation: 8490

How to convert entire dataframe to numeric while preserving decimals?

I have a mixed class dataframe (numeric and factor) where I am trying to convert the entire data frame to numeric. The following illustrates the type of data I am working with as well as the problem I am encountering:

> a = as.factor(c(0.01,0.02,0.03,0.04))
> b = c(2,4,5,7)
> df1 = data.frame(a,b)
> class(df1$a)
[1] "factor"
> class(df1$b)
[1] "numeric"

When I try and convert the entire data frame to numeric, it alters the numeric values. For example:

> df2 = as.data.frame(sapply(df1, as.numeric))
> class(df2$a)
[1] "numeric"
> df2
  a b
1 1 2
2 2 4
3 3 5
4 4 7

Previous posts on this site suggest using as.numeric(as.character(df1$a)), which works great for one column. However, I need to apply this approach to a dataframe that may contain hundreds of columns.

What are my options for converting an entire dataframe from factor to numeric, while preserving the numeric decimal values?

The following is the output I would like to produce where a and b are numeric:

     a b
1 0.01 2
2 0.02 4
3 0.03 5
4 0.04 7

I have read the following related posts, although none of them apply directly to this case:

  1. How to convert a factor variable to numeric while preserving the numbers in R This references a single column in a dataframe.
  2. converting from a character to a numeric data frame. This post does not take into account decimal values.
  3. How can i convert a factor column that contains decimal numbers to numeric?. This applies to only one column in a data frame.

Upvotes: 39

Views: 236604

Answers (4)

Rich Scriven
Rich Scriven

Reputation: 99391

You might need to do some checking. You cannot safely convert factors directly to numeric. as.character must be applied first. Otherwise, the factors will be converted to their numeric storage values. I would check each column with is.factor then coerce to numeric as necessary.

df1[] <- lapply(df1, function(x) {
    if(is.factor(x)) as.numeric(as.character(x)) else x
})
sapply(df1, class)
#         a         b 
# "numeric" "numeric" 

Upvotes: 28

R. Prost
R. Prost

Reputation: 2088

Using dplyr (a bit like sapply..)

df2 <- mutate_all(df1, function(x) as.numeric(as.character(x)))

which gives:

glimpse(df2)
Observations: 4
Variables: 2
$ a <dbl> 0.01, 0.02, 0.03, 0.04
$ b <dbl> 2, 4, 5, 7

from your df1 which was:

glimpse(df1)
Observations: 4
Variables: 2
$ a <fctr> 0.01, 0.02, 0.03, 0.04
$ b <dbl> 2, 4, 5, 7

Upvotes: 33

n8sty
n8sty

Reputation: 1448

df2 <- data.frame(apply(df1, 2, function(x) as.numeric(as.character(x))))

Upvotes: 10

Jilber Urbina
Jilber Urbina

Reputation: 61214

> df2 <- data.frame(sapply(df1, function(x) as.numeric(as.character(x))))
> df2
     a b
1 0.01 2
2 0.02 4
3 0.03 5
4 0.04 7
> sapply(df2, class)
        a         b 
"numeric" "numeric" 

Upvotes: 4

Related Questions