Related
I have a list of lists called cj1. Each list contains multiple data frames/elements. I want to extract the first element/data frame from each list in a separate list of data frames. The first rows in the first element of each list look like this
as.data.frame(cj1[[1]])
cj1[[1]]
..a15.pdf 1.27679608
..a17.pdf 1.05090176
..a18.pdf 1.51820192
..a15.pdf etc. is a rowname. If I use as.data.frame(cj1[1][1]), I get the same results, but the name of the column is the combination of all rownames and coeffients.
I'd like to make a list of all of these data frames. In the image below, the name of the element/data frame I am interested in is coefficients. In total there are 462 of them
To extract my desired list (results1) I tried:
results1<-sapply(cj1, function(x) as.data.frame(cj1[1][1]))
This renders a list with more than 15000 elements (same number as cj1), which is more than I would expect (462). In addition, when I access the elements, they are all the same: the coefficients data frame from list 1.
I also tried a for loop, which does not seem right to me, and not surprisingly does not work.
results1 <- c()
for (i in 1:462) {
results1[[i]] <- as.data.frame(cj1[[1]])
}
My original list:
str(cj1)
List of 15708
$ : Named num [1:22] 1.28 1.05 1.52 2.3 1.49 ...
..- attr(*, "names")= chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
$ : Named num [1:92] -1.1 3.79 1.17 -1.12 -1.1 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : Named num [1:92] 0.0909 0.2637 0.269 0.1049 0.095 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : Named num [1:92] -0.327 -0.372 -1.394 -0.514 -1.373 ...
..- attr(*, "names")= chr [1:92] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : num [1:22, 1:22] -1.45 0 0 0 0 ...
..- attr(*, "dimnames")=List of 2
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : int 22
$ :List of 5
..$ qr : num [1:92, 1:22] -1.45 0 0 0 0 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:92] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
..$ rank : int 22
..$ qraux: num [1:22] 1 1 1 1 1 ...
..$ pivot: int [1:22] 1 2 3 4 5 6 7 8 9 10 ...
..$ tol : num 1e-11
..- attr(*, "class")= chr "qr"
$ :List of 12
..$ family : chr "binomial"
..$ link : chr "logit"
..$ linkfun :function (mu)
..$ linkinv :function (eta)
..$ variance :function (mu)
..$ dev.resids:function (y, mu, wt)
..$ aic :function (y, n, mu, wt, dev)
..$ mu.eta :function (eta)
..$ initialize: language { if (NCOL(y) == 1) { ...
..$ validmu :function (mu)
..$ valideta :function (eta)
..$ simulate :function (object, nsim)
..- attr(*, "class")= chr "family"
$ : Named num [1:92] -2.3 -1.03 -1 -2.14 -2.25 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : num 87
$ : num 148
$ : num 148
$ : int 17
$ : Named num [1:92] 0.0826 0.1941 0.3933 0.1878 0.0859 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : Named num [1:92] 1 1 2 2 1 1 2 1 2 2 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : int 70
$ : int 92
$ : Named num [1:92] 0 1 0.5 0 0 0 0.5 1 0.5 0.5 ...
..- attr(*, "names")= chr [1:92] "1" "2" "3" "4" ...
$ : logi TRUE
$ : logi FALSE
$ :'data.frame': 92 obs. of 2 variables:
..$ Y: num [1:92, 1:2] 0 1 1 0 0 0 1 1 1 1 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : NULL
.. .. ..$ : chr [1:2] "win1" "win2"
..$ X: num [1:92, 1:22] 0 0 0 0 0 0 0 0 0 1 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:92] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
.. ..- attr(*, "assign")= int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
..- attr(*, "terms")=Classes 'terms', 'formula' language Y ~ X - 1
.. .. ..- attr(*, "variables")= language list(Y, X)
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. .. ..$ : chr "X"
.. .. ..- attr(*, "term.labels")= chr "X"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 0
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: 0x000001b58a90fc78>
.. .. ..- attr(*, "predvars")= language list(Y, X)
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ : language BTm(outcome = cbind(win1, win2), player1 = player1, player2 = player2, data = x)
$ :Class 'formula' language ~..
.. ..- attr(*, ".Environment")=<environment: 0x000001b58a910420>
$ :Classes 'terms', 'formula' language Y ~ X - 1
.. ..- attr(*, "variables")= language list(Y, X)
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. ..$ : chr "X"
.. ..- attr(*, "term.labels")= chr "X"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 0
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: 0x000001b58a90fc78>
.. ..- attr(*, "predvars")= language list(Y, X)
.. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ :'data.frame': 92 obs. of 4 variables:
..$ player1: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 1 1 1 1 1 1 1 1 1 2 ...
..$ player2: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 5 8 9 12 13 15 16 19 20 3 ...
..$ win1 : num [1:92] 0 1 1 0 0 0 1 1 1 1 ...
..$ win2 : num [1:92] 1 0 1 2 1 1 1 0 1 1 ...
$ : NULL
$ :List of 3
..$ epsilon: num 1e-08
..$ maxit : num 25
..$ trace : logi FALSE
$ : chr "glm.fit"
$ : Named list()
$ : int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
$ : chr ".."
$ :'data.frame': 92 obs. of 1 variable:
..$ ..: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 1 1 1 1 1 1 1 1 1 2 ...
$ :'data.frame': 92 obs. of 1 variable:
..$ ..: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 5 8 9 12 13 15 16 19 20 3 ...
$ : chr ".."
$ : Named num [1:22] 2.097 2.198 1.918 0.801 2.162 ...
..- attr(*, "names")= chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
$ : Named num [1:94] -1.15 0.89 3.59 -1.14 -1.05 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : Named num [1:94] 0.1281 0.3097 0.2786 0.1266 0.0516 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : Named num [1:94] -0.522 -0.6154 -0.9306 0.0702 -1.3505 ...
..- attr(*, "names")= chr [1:94] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : num [1:22, 1:22] -1.46 0 0 0 0 ...
..- attr(*, "dimnames")=List of 2
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : int 22
$ :List of 5
..$ qr : num [1:94, 1:22] -1.46 0 0 0 0 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:94] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
..$ rank : int 22
..$ qraux: num [1:22] 1 1 1 1 1 ...
..$ pivot: int [1:22] 1 2 3 4 5 6 7 8 9 10 ...
..$ tol : num 1e-11
..- attr(*, "class")= chr "qr"
$ :List of 12
..$ family : chr "binomial"
..$ link : chr "logit"
..$ linkfun :function (mu)
..$ linkinv :function (eta)
..$ variance :function (mu)
..$ dev.resids:function (y, mu, wt)
..$ aic :function (y, n, mu, wt, dev)
..$ mu.eta :function (eta)
..$ initialize: language { if (NCOL(y) == 1) { ...
..$ validmu :function (mu)
..$ valideta :function (eta)
..$ simulate :function (object, nsim)
..- attr(*, "class")= chr "family"
$ : Named num [1:94] -1.918 -0.801 -0.951 -1.931 -2.911 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : num 68
$ : num 131
$ : num 142
$ : int 18
$ : Named num [1:94] 0.1117 0.4276 0.201 0.1106 0.0979 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : Named num [1:94] 1 2 1 1 2 1 1 2 3 2 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : int 72
$ : int 94
$ : Named num [1:94] 0 0.5 1 0 0 ...
..- attr(*, "names")= chr [1:94] "1" "2" "3" "4" ...
$ : logi TRUE
$ : logi FALSE
$ :'data.frame': 94 obs. of 2 variables:
..$ Y: num [1:94, 1:2] 0 1 1 0 0 0 0 1 2 1 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : NULL
.. .. ..$ : chr [1:2] "win1" "win2"
..$ X: num [1:94, 1:22] 0 0 0 0 0 0 0 0 0 1 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:94] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
.. ..- attr(*, "assign")= int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
..- attr(*, "terms")=Classes 'terms', 'formula' language Y ~ X - 1
.. .. ..- attr(*, "variables")= language list(Y, X)
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. .. ..$ : chr "X"
.. .. ..- attr(*, "term.labels")= chr "X"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 0
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: 0x000001b592c99120>
.. .. ..- attr(*, "predvars")= language list(Y, X)
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ : language BTm(outcome = cbind(win1, win2), player1 = player1, player2 = player2, data = x)
$ :Class 'formula' language ~..
.. ..- attr(*, ".Environment")=<environment: 0x000001b5877fb898>
$ :Classes 'terms', 'formula' language Y ~ X - 1
.. ..- attr(*, "variables")= language list(Y, X)
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. ..$ : chr "X"
.. ..- attr(*, "term.labels")= chr "X"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 0
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: 0x000001b592c99120>
.. ..- attr(*, "predvars")= language list(Y, X)
.. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ :'data.frame': 94 obs. of 4 variables:
..$ player1: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 1 1 1 1 1 1 1 1 1 2 ...
..$ player2: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 4 5 8 9 12 13 15 16 20 3 ...
..$ win1 : num [1:94] 0 1 1 0 0 0 0 1 2 1 ...
..$ win2 : num [1:94] 1 1 0 1 2 1 1 1 1 1 ...
$ : NULL
$ :List of 3
..$ epsilon: num 1e-08
..$ maxit : num 25
..$ trace : logi FALSE
$ : chr "glm.fit"
$ : Named list()
$ : int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
$ : chr ".."
$ :'data.frame': 94 obs. of 1 variable:
..$ ..: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 1 1 1 1 1 1 1 1 1 2 ...
$ :'data.frame': 94 obs. of 1 variable:
..$ ..: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 4 5 8 9 12 13 15 16 20 3 ...
$ : chr ".."
$ : Named num [1:22] 1.9 1.85 1.56 1.69 1.09 ...
..- attr(*, "names")= chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
$ : Named num [1:89] -1.19 3.77 -1.26 6.01 -1.14 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : Named num [1:89] 0.156 0.265 0.205 0.166 0.124 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : Named num [1:89] -0.82 -0.743 -0.889 -0.789 -0.878 ...
..- attr(*, "names")= chr [1:89] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : num [1:22, 1:22] -1.55 0 0 0 0 ...
..- attr(*, "dimnames")=List of 2
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
.. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
$ : int 22
$ :List of 5
..$ qr : num [1:89, 1:22] -1.55 0 0 0 0 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:89] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "X..a15.pdf" "X..a17.pdf" "X..a18.pdf" "X..a21.pdf" ...
..$ rank : int 22
..$ qraux: num [1:22] 1 1 1 1 1 ...
..$ pivot: int [1:22] 1 2 3 4 5 6 7 8 9 10 ...
..$ tol : num 1e-11
..- attr(*, "class")= chr "qr"
$ :List of 12
..$ family : chr "binomial"
..$ link : chr "logit"
..$ linkfun :function (mu)
..$ linkinv :function (eta)
..$ variance :function (mu)
..$ dev.resids:function (y, mu, wt)
..$ aic :function (y, n, mu, wt, dev)
..$ mu.eta :function (eta)
..$ initialize: language { if (NCOL(y) == 1) { ...
..$ validmu :function (mu)
..$ valideta :function (eta)
..$ simulate :function (object, nsim)
..- attr(*, "class")= chr "family"
$ : Named num [1:89] -1.69 -1.02 -1.35 -1.61 -1.95 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : num 75.4
$ : num 139
$ : num 141
$ : int 18
$ : Named num [1:89] 0.132 0.195 0.163 0.139 0.218 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : Named num [1:89] 1 1 1 1 2 1 2 2 3 3 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : int 67
$ : int 89
$ : Named num [1:89] 0 1 0 1 0 ...
..- attr(*, "names")= chr [1:89] "1" "2" "3" "4" ...
$ : logi TRUE
$ : logi FALSE
$ :'data.frame': 89 obs. of 2 variables:
..$ Y: num [1:89, 1:2] 0 1 0 1 0 0 1 1 1 2 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : NULL
.. .. ..$ : chr [1:2] "win1" "win2"
..$ X: num [1:89, 1:22] 0 0 0 0 0 0 0 0 0 1 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:89] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:22] "..a15.pdf" "..a17.pdf" "..a18.pdf" "..a21.pdf" ...
.. ..- attr(*, "assign")= int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
..- attr(*, "terms")=Classes 'terms', 'formula' language Y ~ X - 1
.. .. ..- attr(*, "variables")= language list(Y, X)
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. .. ..$ : chr "X"
.. .. ..- attr(*, "term.labels")= chr "X"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 0
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: 0x000001b587c20440>
.. .. ..- attr(*, "predvars")= language list(Y, X)
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ : language BTm(outcome = cbind(win1, win2), player1 = player1, player2 = player2, data = x)
$ :Class 'formula' language ~..
.. ..- attr(*, ".Environment")=<environment: 0x000001b587c20b40>
$ :Classes 'terms', 'formula' language Y ~ X - 1
.. ..- attr(*, "variables")= language list(Y, X)
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "Y" "X"
.. .. .. ..$ : chr "X"
.. ..- attr(*, "term.labels")= chr "X"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 0
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: 0x000001b587c20440>
.. ..- attr(*, "predvars")= language list(Y, X)
.. ..- attr(*, "dataClasses")= Named chr [1:2] "nmatrix.2" "nmatrix.22"
.. .. ..- attr(*, "names")= chr [1:2] "Y" "X"
$ :'data.frame': 89 obs. of 4 variables:
..$ player1: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 1 1 1 1 1 1 1 1 1 2 ...
..$ player2: Factor w/ 23 levels "a12TTT.pdf","a15.pdf",..: 5 8 9 10 12 13 15 16 20 3 ...
..$ win1 : num [1:89] 0 1 0 1 0 0 1 1 1 2 ...
..$ win2 : num [1:89] 1 0 1 0 2 1 1 1 2 1 ...
$ : NULL
$ :List of 3
..$ epsilon: num 1e-08
..$ maxit : num 25
..$ trace : logi FALSE
$ : chr "glm.fit"
$ : Named list()
$ : int [1:22] 1 1 1 1 1 1 1 1 1 1 ...
$ : chr ".."
[list output truncated]
- attr(*, "dim")= int [1:2] 34 462
- attr(*, "dimnames")=List of 2
..$ : chr [1:34] "coefficients" "residuals" "fitted.values" "effects" ...
..$ : NULL
Extract from dput
dput(cj1[c(1, 3, 8)])
list(c(..a15.pdf = 1.27679607834331, ..a17.pdf = 1.05090175857491,
..a18.pdf = 1.51820192474905, ..a21.pdf = 2.30296037386815, ..a2TTT.pdf = 1.48568731934637,
..a5.pdf = 0.493713103224402, ..B11.pdf = 1.02705905465749, ..B12.pdf = 0.999747360884078,
..B13.pdf = 2.40828101927852, ..B22.pdf = 0.695152132033603,
..B24.pdf = 2.1436001615064, ..B4.pdf = 2.25444037842867, ..B7.pdf = 0.909773940025014,
..B8.pdf = 1.14837173756827, `..cw10-1.pdf` = -1.36323271003293,
`..cw15-1TTT.pdf` = 0.341428535787024, `..cw17-1.pdf` = -0.786878348480425,
..cw18.pdf = 0.793720472787986, ..cw3.pdf = -1.57831038567642,
..cw4.pdf = 0.277733503122777, ..cw7_1TTT.pdf = -0.0364645818969112,
`..cw13-1.pdf` = -18.336668416705), c(`1` = 0.0908780807219899,
`2` = 0.263654664895121, `3` = 0.268991096134461, `4` = 0.104930779989728,
`5` = 0.0949671345831925, `6` = 0.240786617491842, `7` = 0.796284595482489,
`8` = 0.31137037055408, `9` = 0.82896509427021, `10` = 0.556234653434742,
`11` = 0.447966262353147, `12` = 0.562111772393927, `13` = 0.64144559057026,
`14` = 0.295919740681443, `15` = 0.590739226571063, `16` = 0.618473870745292,
`17` = 0.730874229815385, `18` = 0.385255456804764, `19` = 0.392984164719899,
`20` = 0.505960393621032, `21` = 0.512785811414426, `22` = 0.588011150512112,
`23` = 0.230846313945379, `24` = 0.917898796713428, `25` = 0.670284750854893,
`26` = 0.862685953007114, `27` = 0.99999999619736, `28` = 0.508127935292484,
`29` = 0.735846044750689, `30` = 0.620375626350015, `31` = 0.348554704521668,
`32` = 0.946921016898213, `33` = 0.909296911948067, `34` = 0.673593098928319,
`35` = 0.825586698787513, `36` = 0.78637523124224, `37` = 0.473694150487632,
`38` = 0.883420398016852, `39` = 0.999999998912766, `40` = 0.729477690591574,
`41` = 0.612688711990574, `42` = 0.341208618334042, `43` = 0.945262830874797,
`44` = 0.758460698474656, `45` = 0.769936700176506, `46` = 0.820855140443936,
`47` = 0.146699277115816, `48` = 0.397459740469979, `49` = 0.537997737731323,
`50` = 0.782550437769477, `51` = 0.888154125425794, `52` = 0.553785981995655,
`53` = 0.582223288022616, `54` = 0.226640083932377, `55` = 0.529287713363298,
`56` = 0.999999996105605, `57` = 0.196465439953117, `58` = 0.551325299580471,
`59` = 0.92943599314157, `60` = 0.738118436855869, `61` = 0.893836974671663,
`62` = 0.920176356697468, `63` = 0.99999999902145, `64` = 0.173748802751829,
`65` = 0.446549562485168, `66` = 0.388595549230014, `67` = 0.587520249127046,
`68` = 0.814879076916803, `69` = 0.4753778467418, `70` = 0.90665523878871,
`71` = 0.999999994572681, `72` = 0.730119396156374, `73` = 0.970881561088295,
`74` = 0.865979290569218, `75` = 0.898444979546349, `76` = 0.793256288161879,
`77` = 0.871357134749265, `78` = 0.811642757783275, `79` = 0.440631930364752,
`80` = 0.906616650865072, `81` = 0.845096998613173, `82` = 0.691457736894216,
`83` = 0.873829387141476, `84` = 0.587745042243573, `85` = 0.7658162723501,
`86` = 0.999999996550512, `87` = 0.755526305253868, `88` = 0.515918376716212,
`89` = 0.999999992269536, `90` = 0.999999976109623, `91` = 0.135164835661148,
`92` = 0.999999947284594), structure(list(family = "binomial",
link = "logit", linkfun = function (mu)
.Call(C_logit_link, mu), linkinv = function (eta)
.Call(C_logit_linkinv, eta), variance = function (mu)
mu * (1 - mu), dev.resids = function (y, mu, wt)
.Call(C_binomial_dev_resids, y, mu, wt), aic = function (y,
n, mu, wt, dev)
{
m <- if (any(n > 1))
n
else wt
-2 * sum(ifelse(m > 0, (wt/m), 0) * dbinom(round(m *
y), round(m), mu, log = TRUE))
}, mu.eta = function (eta)
.Call(C_logit_mu_eta, eta), initialize = {
if (NCOL(y) == 1) {
if (is.factor(y))
y <- y != levels(y)[1L]
n <- rep.int(1, nobs)
y[weights == 0] <- 0
if (any(y < 0 | y > 1))
stop("y values must be 0 <= y <= 1")
mustart <- (weights * y + 0.5)/(weights + 1)
m <- weights * y
if ("binomial" == "binomial" && any(abs(m - round(m)) >
0.001))
warning(gettextf("non-integer #successes in a %s glm!",
"binomial"), domain = NA)
}
else if (NCOL(y) == 2) {
if ("binomial" == "binomial" && any(abs(y - round(y)) >
0.001))
warning(gettextf("non-integer counts in a %s glm!",
"binomial"), domain = NA)
n <- (y1 <- y[, 1L]) + y[, 2L]
y <- y1/n
if (any(n0 <- n == 0))
y[n0] <- 0
weights <- weights * n
mustart <- (n * y + 0.5)/(n + 1)
}
else stop(gettextf("for the '%s' family, y must be a vector of 0 and 1's\nor a 2 column matrix where col 1 is no. successes and col 2 is no. failures",
"binomial"), domain = NA)
}, validmu = function (mu)
all(is.finite(mu)) && all(mu > 0 & mu < 1), valideta = function (eta)
TRUE, simulate = function (object, nsim)
{
ftd <- fitted(object)
n <- length(ftd)
ntot <- n * nsim
wts <- object$prior.weights
if (any(wts%%1 != 0))
stop("cannot simulate from non-integer prior.weights")
if (!is.null(m <- object$model)) {
y <- model.response(m)
if (is.factor(y)) {
yy <- factor(1 + rbinom(ntot, size = 1, prob = ftd),
labels = levels(y))
split(yy, rep(seq_len(nsim), each = n))
}
else if (is.matrix(y) && ncol(y) == 2) {
yy <- vector("list", nsim)
for (i in seq_len(nsim)) {
Y <- rbinom(n, size = wts, prob = ftd)
YY <- cbind(Y, wts - Y)
colnames(YY) <- colnames(y)
yy[[i]] <- YY
}
yy
}
else rbinom(ntot, size = wts, prob = ftd)/wts
}
else rbinom(ntot, size = wts, prob = ftd)/wts
}), class = "family"))
The dput output from above probably presents the rows 1,3,8 from V1 only i.e. coefficients, fitted values, family (see image here).
The desired output would be a list of data frames with the coefficients and their names (first row) in all of the columns presented in the image, i.e. V1:V462. When I extract the data from the first row and first column, the names are rownames. But I was not able to access coefficients in V2 etc. cj2[2][1] accessess the residuals (second row) in V1. cj2[1][2] gives null.
Illustration of the output
Data frame one
..a15.pdf 1.27679608
..a17.pdf 1.05090176
..a18.pdf 1.51820192 and so on for the 22 names that I have (i.e.a15.pdf)
Data frame 2
..a15.pdf 2.09668756
..a17.pdf 2.19826038.....etc for 22 names (if they are all included).
So basically I want the data that on the image appears to be in row one across all the columns.
So after messing around, the answer seems to be very simple: `results1<-cj1["coefficients",]. This creates the list that I want. Akrun, if you read this, thank you for your support.
I have a data frame APD which consists of a factor (Serial_number) and each element of this factor has some observables (Amplification against Voltage). Now I would like to apply the function invest from the investr package to do an inverse regression across all serial numbers (means an inverse regression separated for each serial number).
This works very well if I only use the dataset of one Serial_number, e.g.:
> model<- lm(Amplification ~ Voltage + I(Voltage^2), data = APD[APD$Serial_number==608004648,])
> inverse<- invest(model, y0=150, interval=c("inversion", "Wald", "percentile", "none"),
level=0.95, mean.response = FALSE
)
> inverse
estimate lower upper
385.4670 385.0665 385.8446
When I take the whole data frame:
> models<- dlply(APD, "Serial_number", function(df) lm(Amplification ~ Voltage + I(Voltage^2), data = df))
> inverse<- invest(models, y0=150, interval=c("inversion", "Wald", "percentile", "none"),
level=0.95, mean.response = FALSE
)
> Error in UseMethod("invest") :
no applicable method for 'invest' applied to an object of class "list"
I tried inverse<- invest(models[1], y0=150, interval=c("inversion", "Wald", "percentile", "none") but it's the same problem.
I can't get my head around how to proceed further. I think this must be such a daily issue there are probably already practical solutions present. Don't they?
My next step would be to create a lm-object for each Serial_number but also this seems unnecessary complicated.
> model<- lm(Amplification ~ Voltage + I(Voltage^2), data = APD[APD$Serial_number==608004648,])
> str(model)
List of 12
$ coefficients : Named num [1:3] 59714.045 -318.043 0.424
..- attr(*, "names")= chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
$ residuals : Named num [1:4] -0.0483 0.1458 -0.1459 0.0484
..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
$ effects : Named num [1:4] -295.61 -38.412 3.412 -0.217
..- attr(*, "names")= chr [1:4] "(Intercept)" "Voltage" "I(Voltage^2)" ""
$ rank : int 3
$ fitted.values: Named num [1:4] 124 138 155 175
..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
$ assign : int [1:3] 0 1 2
$ qr :List of 5
..$ qr : num [1:4, 1:3] -2 0.5 0.5 0.5 -770 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:4] "1" "2" "3" "4"
.. .. ..$ : chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
.. ..- attr(*, "assign")= int [1:3] 0 1 2
..$ qraux: num [1:3] 1.5 1 1.37
..$ pivot: int [1:3] 1 2 3
..$ tol : num 1e-07
..$ rank : int 3
..- attr(*, "class")= chr "qr"
$ df.residual : int 1
$ xlevels : Named list()
$ call : language lm(formula = Amplification ~ Voltage + I(Voltage^2), data = APD[APD$Serial_number == 608004648, ])
$ terms :Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. ..- attr(*, "order")= int [1:2] 1 1
.. ..- attr(*, "intercept")= int 1
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
$ model :'data.frame': 4 obs. of 3 variables:
..$ Amplification: num [1:4] 124 138 155 175
..$ Voltage : num [1:4] 382 384 386 388
..$ I(Voltage^2) :Class 'AsIs' num [1:4] 145900 147440 148975 150528
..- attr(*, "terms")=Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. .. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "order")= int [1:2] 1 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. .. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
- attr(*, "class")= chr "lm"
str(models) are hundreds of lines.. a few are:
models<- dlply(APD, "Serial_number", function(df) lm(Amplification ~ Voltage + I(Voltage^2), data = df))
str(models)
(...)
$ 713006445 :List of 12
..$ coefficients : Named num [1:3] 68847.991 -386.479 0.543
.. ..- attr(*, "names")= chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
..$ residuals : Named num [1:4] -0.0655 0.1964 -0.1962 0.0653
.. ..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
..$ effects : Named num [1:4] -317.503 45.226 4.347 0.293
.. ..- attr(*, "names")= chr [1:4] "(Intercept)" "Voltage" "I(Voltage^2)" ""
..$ rank : int 3
..$ fitted.values: Named num [1:4] 131 146 167 191
.. ..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
..$ assign : int [1:3] 0 1 2
..$ qr :List of 5
.. ..$ qr : num [1:4, 1:3] -2 0.5 0.5 0.5 -730.1 ...
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:4] "1" "2" "3" "4"
.. .. .. ..$ : chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "assign")= int [1:3] 0 1 2
.. ..$ qraux: num [1:3] 1.5 1 1.96
.. ..$ pivot: int [1:3] 1 2 3
.. ..$ tol : num 1e-07
.. ..$ rank : int 3
.. ..- attr(*, "class")= chr "qr"
..$ df.residual : int 1
..$ xlevels : Named list()
..$ call : language lm(formula = Amplification ~ Voltage + I(Voltage^2), data = df)
..$ terms :Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. .. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "order")= int [1:2] 1 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: 0xb810100>
.. .. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
..$ model :'data.frame': 4 obs. of 3 variables:
.. ..$ Amplification: num [1:4] 131 147 166 191
.. ..$ Voltage : num [1:4] 362 364 366 368
.. ..$ I(Voltage^2) :Class 'AsIs' num [1:4] 131064 132516 133974 135445
.. ..- attr(*, "terms")=Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. .. .. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. .. .. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. .. .. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. .. .. ..- attr(*, "order")= int [1:2] 1 1
.. .. .. ..- attr(*, "intercept")= int 1
.. .. .. ..- attr(*, "response")= int 1
.. .. .. ..- attr(*, ".Environment")=<environment: 0xb810100>
.. .. .. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. .. .. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. .. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
..- attr(*, "class")= chr "lm"
$ 713006446 :List of 12
..$ coefficients : Named num [1:3] 58059.34 -331.908 0.475
.. ..- attr(*, "names")= chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
..$ residuals : Named num [1:4] -0.0574 0.1729 -0.1727 0.0573
.. ..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
..$ effects : Named num [1:4] -300.53 -41.391 3.808 -0.258
.. ..- attr(*, "names")= chr [1:4] "(Intercept)" "Voltage" "I(Voltage^2)" ""
..$ rank : int 3
..$ fitted.values: Named num [1:4] 124 139 158 180
.. ..- attr(*, "names")= chr [1:4] "1" "2" "3" "4"
..$ assign : int [1:3] 0 1 2
..$ qr :List of 5
.. ..$ qr : num [1:4, 1:3] -2 0.5 0.5 0.5 -717.9 ...
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:4] "1" "2" "3" "4"
.. .. .. ..$ : chr [1:3] "(Intercept)" "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "assign")= int [1:3] 0 1 2
.. ..$ qraux: num [1:3] 1.5 1 1.37
.. ..$ pivot: int [1:3] 1 2 3
.. ..$ tol : num 1e-07
.. ..$ rank : int 3
.. ..- attr(*, "class")= chr "qr"
..$ df.residual : int 1
..$ xlevels : Named list()
..$ call : language lm(formula = Amplification ~ Voltage + I(Voltage^2), data = df)
..$ terms :Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. .. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. .. ..- attr(*, "order")= int [1:2] 1 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: 0xb6fc150>
.. .. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. .. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
..$ model :'data.frame': 4 obs. of 3 variables:
.. ..$ Amplification: num [1:4] 124 139 157 180
.. ..$ Voltage : num [1:4] 356 358 360 362
.. ..$ I(Voltage^2) :Class 'AsIs' num [1:4] 126715 128145 129576 131024
.. ..- attr(*, "terms")=Classes 'terms', 'formula' language Amplification ~ Voltage + I(Voltage^2)
.. .. .. ..- attr(*, "variables")= language list(Amplification, Voltage, I(Voltage^2))
.. .. .. ..- attr(*, "factors")= int [1:3, 1:2] 0 1 0 0 0 1
.. .. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. .. ..$ : chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
.. .. .. .. .. ..$ : chr [1:2] "Voltage" "I(Voltage^2)"
.. .. .. ..- attr(*, "term.labels")= chr [1:2] "Voltage" "I(Voltage^2)"
.. .. .. ..- attr(*, "order")= int [1:2] 1 1
.. .. .. ..- attr(*, "intercept")= int 1
.. .. .. ..- attr(*, "response")= int 1
.. .. .. ..- attr(*, ".Environment")=<environment: 0xb6fc150>
.. .. .. ..- attr(*, "predvars")= language list(Amplification, Voltage, I(Voltage^2))
.. .. .. ..- attr(*, "dataClasses")= Named chr [1:3] "numeric" "numeric" "numeric"
.. .. .. .. ..- attr(*, "names")= chr [1:3] "Amplification" "Voltage" "I(Voltage^2)"
..- attr(*, "class")= chr "lm"
$ 713006449 :List of 12
..$ coefficients : Named num [1:3] 56708.406 -324.219 0.464
(...)
I use RStudio/Ubuntu 14.04.
edit: Due to advices of joran and Gregor I tried the following:
> invest(models[[1]], y0=150, interval=c("inversion", "Wald", "percentile", "none"), level=0.95, mean.response = FALSE)
Error in invest.lm(models[[1]], y0 = 150, interval = c("inversion", "Wald", :
'x0.name' is missing, please select a valid predictor variable
and
in case of lapply I'm not sure how to define it > lapply(X, FUN, ...) and in my case this would be lapply(object, invest(object, ..)) :
> lapply(models, invest(models, y0=150, interval=c("inversion", "Wald", "percentile", "none"), level=0.95, mean.response = FALSE))
Error in UseMethod("invest") :
no applicable method for 'invest' applied to an object of class "list"
editedit:
I tried to use a lmList as follows:
library(nlme)
models<- lmList(Amplification ~ Voltage + I(Voltage^2)|Serial_number, data= APD)
> invest(models[[1]], y0=150, interval=c("inversion", "Wald", "percentile", "none"),
+ level=0.95, mean.response = FALSE)
Error in eval(object$call$data, envir = parent.frame()) :
object 'dat' not found
Has someone an idea how to proceed? I take every solution which allows to apply a lm fit to the factor of a dataset and then to apply the invest function to each lm object.
Isn't there the possibility to extract a lm object out of a list of lm objects and it remains as an lm object?
In case someone else will have a hard time solving this "trivial" issue: I circumvented the scenario above by splitting the data frame into many data frames separated by the levels of the factor:
new_data_frame<- split(data_frame, data_frame$factor)
Next, I iterate through all data frames and fit and invest each:
for(i in 1:length(new_data_frame)){
temp_data_frame<- as.data.frame(new_data_frame[i])
fit<- lm(Response ~ Predictor, data = temp_model_frame)
inverse_regression<- invest(fit, y0=150, interval=c("inversion", "Wald", "percentile", "none"), level=0.95, mean.response = FALSE)
# some lines to store each time inverse_regression..
}
I am performing a Newey-West test to assess an estimator of a regression with heteroskedastic and autocorrelated residuals.
I am using the "sandwich" and "lmtest" packages.
While I can easily reproduce examples found on other sites, my own script causes the error:
Error in dimnames(cd) <- list(as.character(index(x)), colnames(x)) : 'dimnames' applied to non-array
My code:
ffregression <- lm(ex.return ~ fff$Mkt.RF + fff$SMB + fff$HML)
coeftest(ffregression,vcov=NeweyWest)
str(ffregression):
List of 12
$ coefficients : Named num [1:4] 0.00604 0.72976 0.90351 0.13548
..- attr(*, "names")= chr [1:4] "(Intercept)" "fff$Mkt.RF" "fff$SMB" "fff$HML"
$ residuals :An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34] -0.03637 0.0408 -0.00672 0.04648 -0.02275 ...
Indexed by objects of class: [yearmon] TZ:
Original class: 'double'
xts Attributes:
NULL
$ effects :An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34] -0.0606 0.1785 0.1379 0.0204 -0.0262 ...
Indexed by objects of class: [yearmon] TZ:
Original class: 'double'
xts Attributes:
NULL
$ rank : int 4
$ fitted.values:An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34] -0.000725 -0.031716 0.003868 0.051386 -0.047005 ...
Indexed by objects of class: [yearmon] TZ:
Original class: 'double'
xts Attributes:
NULL
$ assign : int [1:4] 0 1 2 3
$ qr :List of 5
..$ qr : num [1:34, 1:4] -5.831 0.171 0.171 0.171 0.171 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:34] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:4] "(Intercept)" "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. ..- attr(*, "assign")= int [1:4] 0 1 2 3
..$ qraux: num [1:4] 1.17 1.05 1.14 1.14
..$ pivot: int [1:4] 1 2 3 4
..$ tol : num 1e-07
..$ rank : int 4
..- attr(*, "class")= chr "qr"
$ df.residual : int 30
$ xlevels : Named list()
$ call : language lm(formula = ex.return ~ fff$Mkt.RF + fff$SMB + fff$HML)
$ terms :Classes 'terms', 'formula' language ex.return ~ fff$Mkt.RF + fff$SMB + fff$HML
.. ..- attr(*, "variables")= language list(ex.return, fff$Mkt.RF, fff$SMB, fff$HML)
.. ..- attr(*, "factors")= int [1:4, 1:3] 0 1 0 0 0 0 1 0 0 0 ...
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:4] "ex.return" "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. .. .. ..$ : chr [1:3] "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. ..- attr(*, "term.labels")= chr [1:3] "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. ..- attr(*, "order")= int [1:3] 1 1 1
.. ..- attr(*, "intercept")= int 1
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. ..- attr(*, "predvars")= language list(ex.return, fff$Mkt.RF, fff$SMB, fff$HML)
.. ..- attr(*, "dataClasses")= Named chr [1:4] "nmatrix.1" "nmatrix.1" "nmatrix.1" "nmatrix.1"
.. .. ..- attr(*, "names")= chr [1:4] "ex.return" "fff$Mkt.RF" "fff$SMB" "fff$HML"
$ model :'data.frame': 34 obs. of 4 variables:
..$ ex.return :An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34, 1] -0.03709 0.00909 -0.00285 0.09786 -0.06975 ...
- attr(*, "dimnames")=List of 2
..$ : NULL
..$ : chr "RF"
Indexed by objects of class: [yearmon] TZ:
Original class: 'double'
xts Attributes:
NULL
..$ fff$Mkt.RF:An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34, 1] 0.0043 -0.0019 0.0206 0.0261 -0.0204 0.0424 -0.0197 0.0252 0.0255 -0.0006 ...
- attr(*, "dimnames")=List of 2
..$ : NULL
..$ : chr "Mkt.RF"
Indexed by objects of class: [yearmon] TZ:
xts Attributes:
NULL
..$ fff$SMB :An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34, 1] -0.0185 -0.0419 -0.0185 0.0301 -0.0422 0.004 -0.038 0.0428 -0.0205 0.0259 ...
- attr(*, "dimnames")=List of 2
..$ : NULL
..$ : chr "SMB"
Indexed by objects of class: [yearmon] TZ:
xts Attributes:
NULL
..$ fff$HML :An ‘xts’ object on Mar 2014/Dec 2016 containing:
Data: num [1:34, 1] 0.0503 0.011 -0.0036 -0.0066 -0.0002 -0.0055 -0.0119 -0.0168 -0.0298 0.0212 ...
- attr(*, "dimnames")=List of 2
..$ : NULL
..$ : chr "HML"
Indexed by objects of class: [yearmon] TZ:
xts Attributes:
NULL
..- attr(*, "terms")=Classes 'terms', 'formula' language ex.return ~ fff$Mkt.RF + fff$SMB + fff$HML
.. .. ..- attr(*, "variables")= language list(ex.return, fff$Mkt.RF, fff$SMB, fff$HML)
.. .. ..- attr(*, "factors")= int [1:4, 1:3] 0 1 0 0 0 0 1 0 0 0 ...
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:4] "ex.return" "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. .. .. .. ..$ : chr [1:3] "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. .. ..- attr(*, "term.labels")= chr [1:3] "fff$Mkt.RF" "fff$SMB" "fff$HML"
.. .. ..- attr(*, "order")= int [1:3] 1 1 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. .. ..- attr(*, "predvars")= language list(ex.return, fff$Mkt.RF, fff$SMB, fff$HML)
.. .. ..- attr(*, "dataClasses")= Named chr [1:4] "nmatrix.1" "nmatrix.1" "nmatrix.1" "nmatrix.1"
.. .. .. ..- attr(*, "names")= chr [1:4] "ex.return" "fff$Mkt.RF" "fff$SMB" "fff$HML"
- attr(*, "class")= chr "lm"
Example:
set.seed(04012017)
n<-34
correlated_residuals<-arima.sim(list(ar = .9), n)
y<-correlated_residuals
x<-1:n
plot(x,correlated_residuals)
fit<-lm(y~x)
abline(fit)
summary(fit) # standard estimates
coeftest(fit,vcov=NeweyWest(fit,verbose=T))
str(fit):
List of 12
$ coefficients : Named num [1:2] -0.179 0.148
..- attr(*, "names")= chr [1:2] "(Intercept)" "x"
$ residuals : Named num [1:34] -0.9529 0.976 0.3025 -0.0486 -1.1214 ...
..- attr(*, "names")= chr [1:34] "1" "2" "3" "4" ...
$ effects : Named num [1:34] -14.026 8.449 0.25 -0.085 -1.142 ...
..- attr(*, "names")= chr [1:34] "(Intercept)" "x" "" "" ...
$ rank : int 2
$ fitted.values: Named num [1:34] -0.0314 0.1163 0.264 0.4116 0.5593 ...
..- attr(*, "names")= chr [1:34] "1" "2" "3" "4" ...
$ assign : int [1:2] 0 1
$ qr :List of 5
..$ qr : num [1:34, 1:2] -5.831 0.171 0.171 0.171 0.171 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:34] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:2] "(Intercept)" "x"
.. ..- attr(*, "assign")= int [1:2] 0 1
..$ qraux: num [1:2] 1.17 1.23
..$ pivot: int [1:2] 1 2
..$ tol : num 1e-07
..$ rank : int 2
..- attr(*, "class")= chr "qr"
$ df.residual : int 32
$ xlevels : Named list()
$ call : language lm(formula = y ~ x)
$ terms :Classes 'terms', 'formula' language y ~ x
.. ..- attr(*, "variables")= language list(y, x)
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "y" "x"
.. .. .. ..$ : chr "x"
.. ..- attr(*, "term.labels")= chr "x"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 1
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. ..- attr(*, "predvars")= language list(y, x)
.. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. ..- attr(*, "names")= chr [1:2] "y" "x"
$ model :'data.frame': 34 obs. of 2 variables:
..$ y: num [1:34] -0.984 1.092 0.566 0.363 -0.562 ...
..$ x: int [1:34] 1 2 3 4 5 6 7 8 9 10 ...
..- attr(*, "terms")=Classes 'terms', 'formula' language y ~ x
.. .. ..- attr(*, "variables")= language list(y, x)
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "y" "x"
.. .. .. .. ..$ : chr "x"
.. .. ..- attr(*, "term.labels")= chr "x"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. .. ..- attr(*, "predvars")= language list(y, x)
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:2] "y" "x"
- attr(*, "class")= chr "lm"
It seems that R is complaining that it cannot assign dimnames because your data is coming from a non-array. Try to use only one xts object for your data instead.
fff$ex.return <- ex.return
ffregression <- lm(ex.return ~ Mkt.RF + SMB + HML, data = fff)
coeftest(ffregression,vcov=NeweyWest)
Assuming I have an X matrix and y vector such as the following:
X=
[,1] [,2] [,3]
[1,] 83.0 234.289 235.6 ...
[2,] 88.5 259.426 232.5 ...
[3,] 88.2 258.054 368.2 ...
y=
[1] 60.323 61.122 60.171...
After conducting a decomposition, I find the coefficients B and residuals E. How can I create a new lm object (ie lmQ) that stores my results for B and E in order to get something like this:
> lmQ(X)
$coefficients
X1 X2
B1 B2
$residuals
[1] R1 R2 R3...
Please help thanks!
Objects are just lists with a class attribute.
Create a list, assign the components, set the class -- til it looks like what str() gives.
Now, lm() returns somewhat large objects so you have some work to do:
> df <- data.frame(y=runif(10), x=rnorm(10))
> fit <- lm(y ~ x, df)
> str(fit)
List of 12
$ coefficients : Named num [1:2] 0.5368 0.0314
..- attr(*, "names")= chr [1:2] "(Intercept)" "x"
$ residuals : Named num [1:10] 0.2899 -0.3592 -0.1753 0.3187 -0.0235 ...
..- attr(*, "names")= chr [1:10] "1" "2" "3" "4" ...
$ effects : Named num [1:10] -1.734 0.104 -0.325 0.485 -0.158 ...
..- attr(*, "names")= chr [1:10] "(Intercept)" "x" "" "" ...
$ rank : int 2
$ fitted.values: Named num [1:10] 0.553 0.526 0.573 0.479 0.569 ...
..- attr(*, "names")= chr [1:10] "1" "2" "3" "4" ...
$ assign : int [1:2] 0 1
$ qr :List of 5
..$ qr : num [1:10, 1:2] -3.162 0.316 0.316 0.316 0.316 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:10] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:2] "(Intercept)" "x"
.. ..- attr(*, "assign")= int [1:2] 0 1
..$ qraux: num [1:2] 1.32 1.22
..$ pivot: int [1:2] 1 2
..$ tol : num 1e-07
..$ rank : int 2
..- attr(*, "class")= chr "qr"
$ df.residual : int 8
$ xlevels : Named list()
$ call : language lm(formula = y ~ x, data = df)
$ terms :Classes 'terms', 'formula' length 3 y ~ x
.. ..- attr(*, "variables")= language list(y, x)
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "y" "x"
.. .. .. ..$ : chr "x"
.. ..- attr(*, "term.labels")= chr "x"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 1
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. ..- attr(*, "predvars")= language list(y, x)
.. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. ..- attr(*, "names")= chr [1:2] "y" "x"
$ model :'data.frame': 10 obs. of 2 variables:
..$ y: num [1:10] 0.843 0.167 0.398 0.798 0.545 ...
..$ x: num [1:10] 0.504 -0.337 1.151 -1.835 1.011 ...
..- attr(*, "terms")=Classes 'terms', 'formula' length 3 y ~ x
.. .. ..- attr(*, "variables")= language list(y, x)
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "y" "x"
.. .. .. .. ..$ : chr "x"
.. .. ..- attr(*, "term.labels")= chr "x"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. .. ..- attr(*, "predvars")= language list(y, x)
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:2] "y" "x"
- attr(*, "class")= chr "lm"
>
I am looking to extract the p-value generated from an anova in R.
Here is what I am running:
test <- aov(asq[,9] ~ asq[,187])
summary(test)
Yields:
Df Sum Sq Mean Sq F value Pr(>F)
asq[, 187] 1 3.02 3.01951 12.333 0.0004599 ***
Residuals 1335 326.85 0.24483
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
12 observations deleted due to missingness
When I look a the structure, this is what I see. I usually can work through lists to get what I need, but I am having a hard time with this one. A Google searched also seemed to reveal much simpler structures than I am getting.
NOTE: ASQ is my data frame.
str(test)
List of 13
$ coefficients : Named num [1:2] 0.2862 0.0973
..- attr(*, "names")= chr [1:2] "(Intercept)" "asq[, 187]"
$ residuals : Named num [1:1337] 0.519 0.519 -0.481 -0.481 -0.481 ...
..- attr(*, "names")= chr [1:1337] "1" "2" "3" "4" ...
$ effects : Named num [1:1337] -16.19 -1.738 -0.505 -0.505 -0.505 ...
..- attr(*, "names")= chr [1:1337] "(Intercept)" "asq[, 187]" "" "" ...
$ rank : int 2
$ fitted.values: Named num [1:1337] 0.481 0.481 0.481 0.481 0.481 ...
..- attr(*, "names")= chr [1:1337] "1" "2" "3" "4" ...
$ assign : int [1:2] 0 1
$ qr :List of 5
..$ qr : num [1:1337, 1:2] -36.565 0.0273 0.0273 0.0273 0.0273 ...
.. ..- attr(*, "dimnames")=List of 2
.. .. ..$ : chr [1:1337] "1" "2" "3" "4" ...
.. .. ..$ : chr [1:2] "(Intercept)" "asq[, 187]"
.. ..- attr(*, "assign")= int [1:2] 0 1
..$ qraux: num [1:2] 1.03 1.02
..$ pivot: int [1:2] 1 2
..$ tol : num 1e-07
..$ rank : int 2
..- attr(*, "class")= chr "qr"
$ df.residual : int 1335
$ na.action :Class 'omit' Named int [1:12] 26 257 352 458 508 624 820 874 1046 1082 ...
.. ..- attr(*, "names")= chr [1:12] "26" "257" "352" "458" ...
$ xlevels : list()
$ call : language aov(formula = asq[, 9] ~ asq[, 187])
$ terms :Classes 'terms', 'formula' length 3 asq[, 9] ~ asq[, 187]
.. ..- attr(*, "variables")= language list(asq[, 9], asq[, 187])
.. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. ..- attr(*, "dimnames")=List of 2
.. .. .. ..$ : chr [1:2] "asq[, 9]" "asq[, 187]"
.. .. .. ..$ : chr "asq[, 187]"
.. ..- attr(*, "term.labels")= chr "asq[, 187]"
.. ..- attr(*, "order")= int 1
.. ..- attr(*, "intercept")= int 1
.. ..- attr(*, "response")= int 1
.. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. ..- attr(*, "predvars")= language list(asq[, 9], asq[, 187])
.. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. ..- attr(*, "names")= chr [1:2] "asq[, 9]" "asq[, 187]"
$ model :'data.frame': 1337 obs. of 2 variables:
..$ asq[, 9] : int [1:1337] 1 1 0 0 0 1 1 1 0 0 ...
..$ asq[, 187]: int [1:1337] 2 2 2 2 2 2 2 2 2 2 ...
..- attr(*, "terms")=Classes 'terms', 'formula' length 3 asq[, 9] ~ asq[, 187]
.. .. ..- attr(*, "variables")= language list(asq[, 9], asq[, 187])
.. .. ..- attr(*, "factors")= int [1:2, 1] 0 1
.. .. .. ..- attr(*, "dimnames")=List of 2
.. .. .. .. ..$ : chr [1:2] "asq[, 9]" "asq[, 187]"
.. .. .. .. ..$ : chr "asq[, 187]"
.. .. ..- attr(*, "term.labels")= chr "asq[, 187]"
.. .. ..- attr(*, "order")= int 1
.. .. ..- attr(*, "intercept")= int 1
.. .. ..- attr(*, "response")= int 1
.. .. ..- attr(*, ".Environment")=<environment: R_GlobalEnv>
.. .. ..- attr(*, "predvars")= language list(asq[, 9], asq[, 187])
.. .. ..- attr(*, "dataClasses")= Named chr [1:2] "numeric" "numeric"
.. .. .. ..- attr(*, "names")= chr [1:2] "asq[, 9]" "asq[, 187]"
..- attr(*, "na.action")=Class 'omit' Named int [1:12] 26 257 352 458 508 624 820 874 1046 1082 ...
.. .. ..- attr(*, "names")= chr [1:12] "26" "257" "352" "458" ...
- attr(*, "class")= chr [1:2] "aov" "lm"
Here:
summary(test)[[1]][["Pr(>F)"]][1]
since the suggest above didn't work for me this is how i managed to solve it:
sum_test = unlist(summary(test))
then looking at the names with
names(sum_test)
i have"Pr(>F)1" and "Pr(>F)2", when the first it the requested value, so
sum_test["Pr(>F)1"]
will give the requested value
I know this is old but I looked around online and didn't find an explanation or general solution and this thread is one of the first things that comes up in a Google search.
Aniko is right, the easiest way is looking in summary(test).
tests <- summary(test)
str(tests)
That gives you a list of 1 for an independent measures aov object but it could have multiple items with repeated measures. With the repeated measures each item in the list is defined by the error term for the item in the list. Where a lot of new people get confused is that if it's between measures the one lone list item isn't named. So, they don't really notice that and don't understand why using a typical selector doesn't work.
In the independent measures case something like the following works.
tests[[1]]$'Pr(>F)'
In repeated measures it's similar but you could also use named items like...
myModelSummary$'Error: subject:A'[[1]]$'Pr(>F)'
Note there I still had to do that list selection because each one of the list items in the repeated measures model is again a list of 1.
Check out str(summary(test)) - that's where you see the p-value.
Somewhat shorter, than in BurningLeo's advice:
summary(test)[[1]][[1,"Pr(>F)"]]
summary(aov(y~factor(x)))[[1]][[5]][1]
unlist(summary(myAOV)[[2]])[[9]]
2 and 9 are the positions of p-value in myAOV model