CODEWITHSUNDEEP
rmatrixnestednested-lists
JMCrocs
JMCrocs

Reputation: 77

complex nested list to a clean matrix in R?

I have struggled for two days longs to find a way to create a specific matrix from a nested list

First of all, I am sorry if I don't explain my issue correctly I am one week new to StackOverflow* and R (and programming...)!

I use a file that you can find there :

With rjson, I have a nested list like this : Nested list of MEP Votes

List of 23905
 $ :List of 7
  ..$ ts     : chr "2004-12-16T11:49:02"
  ..$ url    : chr "http://www.europarl.europa.eu/RegData/seance_pleniere/proces_verbal/2004/12-16/votes_nominaux/xml/P6_PV(2004)12-16(RCV)_XC.xml"
  ..$ voteid : num 7829
  ..$ title  : chr "Projet de budget général 2005 modifié - bloc 3"
  ..$ votes  :List of 3
  .. ..$ +:List of 2
  .. .. ..$ total : num 45
  .. .. ..$ groups:List of 6
  .. .. .. ..$ ALDE   :List of 1
  .. .. .. .. ..$ : Named num 4404
  .. .. .. .. .. ..- attr(*, "names")= chr "mepid"
  .. .. .. ..$ GUE/NGL:List of 25
  .. .. .. .. ..$ : Named num 28469
  .. .. .. .. .. ..- attr(*, "names")= chr "mepid"
  .. .. .. .. ..$ : Named num 4298
  .. .. .. .. .. ..- attr(*, "names")= chr "mepid"

then my goal is to have something like this : final matrix

First I would like to keep only the lists (from [[1]] to [[23905]]) containing $vote$+$groups$Renew or $vote$-$groups$Renew or $vote$'0'$groups$Renew. The main list (the 23905) are registered votes. My work is on the Renew group so my only interest is to have a vote where the Renew groups exist to compare them with other groups.

After that my goal is to create a matrix like this all the [[x]] where we can find groups$Renewexists: final matrix

 V1             V2 (not mandatory)   V3[[x]]$voteid
[mepid==666] GUE/NGL     + (mepid==[666] is found in [[1]]$vote$+$groups$GUE/NGL)              
[mepid==777] Renew       - (mepid==[777] is found in [[1]]$vote$-$groups$GUE/NGL)

I want to create a matrix so I can process the votes of each MEP (referenced by their MEPid). Their votes are either + (for yea), - (for nay) or 0 (for abstain). Moreover, I would like to have political groups of MEP displayed in the column next to their mepid. We can find their political group thanks to the place where their votes are stored. If the mepid is shown in the list [[x]]$vote$+$groups$GUE/NGL she or he belongs to the GUE/NGL groups.

What I want to do might look like this

# Clean the nested list
Keep Vote[[x]] if Vote[[x]] list contain ,
$vote$+$groups$Renew, 
or $vote$-$groups$Renew,
or $vote$'0'$groups$Renew

# Create the matrix (or a data.frame if it is easier)
VoteMatrix <- as.matrix(
V1 = all "mepid" found in the nested list
V2 = groups (name of the list where we can find the mepid) (not mandatory)
V3 to Vy = If.else(mepid is in [[x]]$vote$+ then “+”,
mepid is in [[x]]$vote$- then “-“, "0")
)

Thank you in advance,

*Nevertheless, I am reading this website actively since I started R!

Upvotes: 0

Views: 327

Answers (1)

IRTFM
IRTFM

Reputation: 263301

You can see that the 'votes' sublist is composed of three items a list of member numbers stored within what I think are party designators. Here's how you might "straighten" the positive voter 'memids' by party:

str( unlist(  sapply(names(jlis[[1]]$votes$'+'$groups), function(x) unlist(jlis[[1]]$votes$'+'$groups[[x]]) ) ) )
 Named num [1:104] 28268 4514 28841 28314 28241 ...
 - attr(*, "names")= chr [1:104] "ALDE.mepid" "ALDE.mepid" "ALDE.mepid" "ALDE.mepid" ...

You get a named numeric vector with 108 entries. Perhaps this will demonstrate what sort of terminology to use in better describing your desired result. (Just giving a partial schema for the desired result leaves way too much ambiguity to support a fully formed request.)

I do NOT see the number 23905 anywhere in what I downloaded from your link. We are clearly looking at different data. I see this for the timestamp: chr "2004-12-01T15:20:31". I'm not going to cut you any slack for not knowing R, since the task needs to be fully explained in a natural language. I will cut you slack regarding grammar if English is not your native tongue, but you definitely need to make a better effort at explication. This is what I see for the names with the votes$'+'$groups sublists of the first three items, but since RENEW is not in any of them there's not a lot that could be demonstrated about picking items:

> names( jlis[[1]]$votes$'+'$groups)
[1] "ALDE"    "GUE/NGL" "IND/DEM" "NI"      "PPE-DE"  "PSE"     "UEN"    
> names( jlis[[2]]$votes$'+'$groups)
[1] "GUE/NGL" "IND/DEM" "NI"      "PPE-DE" 
> names( jlis[[3]]$votes$'+'$groups)
[1] "ALDE"      "GUE/NGL"   "IND/DEM"   "NI"        "PPE-DE"    "PSE"       "UEN"       "Verts/ALE"

Furthermore, when I looked at all of the possible votes values using this method (for all three of the items you made available) I still see no RENEW names.

sapply( jlis[[1]]$votes[c("+","-","0")], function(x) names(x$groups) )

After second edit: Here's the next step of isolating those votes that contain a "Renew` value. I'm assuming that its possible to have a "Renew" value in only one of the three possible 'votes' values (+,-.0). If not (and there are always "Renew" values in each of them when there is one in any of them) then you might be able to simplify the logic. We make three logical vectors:

 sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['0']][['groups']]) } )
#[1] FALSE FALSE FALSE  TRUE
 sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['+']][['groups']]) } )
#[1] FALSE FALSE FALSE  TRUE
 sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['-']][['groups']]) } )
#[1] FALSE FALSE FALSE  TRUE

And then wrap them in a matrix call with 3 columns and take the maximum of each row (the maximum of c(TRUE,FALSE) is 1 and then convert back to logical.

selection_vec = as.logical( apply( matrix( c( 
   sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['0']][['groups']]) } ),
   sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['+']][['groups']]) } ),
   sapply( seq_along(MEPVotes)  , function(i){ 'Renew' %in% names( MEPVotes[[i]]$votes[['-']][['groups']]) } ) ),
                                             ncol=3 ), 1,max))

> selection_vec
[1] FALSE FALSE FALSE  TRUE

Upvotes: 1

Related Questions