Reputation: 1192
I have data in Excel that comes from an application that summarizes that data into different tables. The data looks good in Excel, but when I try to import it into R some columns are skipped and not aligned. I need to tidy up the data so that I can plot it.
Below is a reproducible sample.
df <- data.frame( ` ` = c("cars","buses","","under 1yr","1-2 yrs","2-5 yrs",">5 yrs"),
fcltA = c("1","5","","","","","" ),
` ` = c("","","fcltA","5","","","1"),
fcltB = c("6","","","","","",""),
` ` = c("","","fcltB","3","","2","1"),
fcltC = c("2","2","","","","",""),
` ` = c("","","fcltC","1","2","","1"),
check.names = FALSE, fix.empty.names = FALSE)
Below is what I want
dfClnd <- data.frame( ` ` = c("cars","buses","","under 1yr","1-2 yrs","2-5 yrs",">5 yrs"),
fcltA = c("1","5"," fcltA","5","","","1" ),
fcltB = c("3","3","fcltB","3","","2","1"),
fcltC = c("2","2","fcltC","1","2","","1"),
check.names = FALSE, fix.empty.names = FALSE)
I found this question but it does not work well for my problem because it shifts some values to the incorrect columns.
Below is a sample of how the data looks like:
Upvotes: 1
Views: 637
Reputation: 39154
A solution using dplyr and purrr. Notice that when creating df
I set stringsAsFactors = FALSE
to avoid creating factor columns. This is because the coalesce
function will not work on different factor levels. df3
is the final output.
library(dplyr)
library(purrr)
# Replace "" with NA
df[df == ""] <- NA
# Get the new column names
NewCol <- names(df)
NewCol <- NewCol[!NewCol %in% " "]
# Conduct the merge of columns
df2 <- map_dfc(NewCol, function(x){
df_temp <- df[which(names(df) %in% x) + c(0, 1)]
df_out <- as_data_frame(coalesce(df_temp[, 1], df_temp[, 2])) %>%
setNames(x)
return(df_out)
})
# Merge the first column with the new data frame
# Replace NA with ""
df3 <- bind_cols(df[, 1, drop = FALSE], df2)
df3[is.na(df3)] <- ""
df3
# fcltA fcltB fcltC
# 1 cars 1 6 2
# 2 buses 5 2
# 3 fcltA fcltB fcltC
# 4 under 1yr 5 3 1
# 5 1-2 yrs 2
# 6 2-5 yrs 2
# 7 >5 yrs 1 1 1
DATA
df <- data.frame( ` ` = c("cars","buses","","under 1yr","1-2 yrs","2-5 yrs",">5 yrs"),
fcltA = c("1","5","","","","","" ),
` ` = c("","","fcltA","5","","","1"),
fcltB = c("6","","","","","",""),
` ` = c("","","fcltB","3","","2","1"),
fcltC = c("2","2","","","","",""),
` ` = c("","","fcltC","1","2","","1"),
check.names = FALSE, fix.empty.names = FALSE,
stringsAsFactors = FALSE)
Upvotes: 1