I would like to make a custom function of this modified dplyr procedure:
randomly replacing percentage of values per group with NA in R dataframe
library(dplyr)
mtcars %>%
mutate(mpg = replace(mpg, sample(row_number(),
size = ceiling(0.3 * n()), replace = FALSE), NA))
The arguments should be:
df = dataframe
x = column
y = double number (here 0.3)
My approach so far:
my_func <- function(df,x,y){
df %>%
mutate(x = replace({{x}}, sample(row_number(),
size = ceiling(y * n()), replace = FALSE), NA))
}
When applying this function:
my_func(mtcars, mtcars$mpg, 0.3)
#gives:
mpg cyl disp hp drat wt qsec vs am gear carb x
Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4 21.0
Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4 NA
Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1 22.8
Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1 21.4
Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2 NA
Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1 18.1
#....etc..
My question:
I want to change mpg column by adding NA's there, not adding a new column x
Putting the first x = in {{x}} = throws an error:
Error: unexpected '=' in:
" df %>%
mutate({{x}} ="
> size = ceiling(y * n()), replace = FALSE), NA))
Error: unexpected ',' in " size = ceiling(y * n()),"
> }
Error: unexpected '}' in "}"
>
This works; does it solve your problem?
library(dplyr)
#>
#> Attaching package: 'dplyr'
#> The following objects are masked from 'package:stats':
#>
#> filter, lag
#> The following objects are masked from 'package:base':
#>
#> intersect, setdiff, setequal, union
my_func <- function(df,x,y){
df %>%
mutate({{x}} := replace({{x}}, sample(row_number(),
size = ceiling(y * n()), replace = FALSE), NA))
}
my_func(mtcars, mpg, 0.3)
#> mpg cyl disp hp drat wt qsec vs am gear carb
#> Mazda RX4 NA 6 160.0 110 3.90 2.620 16.46 0 1 4 4
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
#> Datsun 710 NA 4 108.0 93 3.85 2.320 18.61 1 1 4 1
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
#> Merc 230 NA 4 140.8 95 3.92 3.150 22.90 1 0 4 2
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
#> Merc 450SE NA 8 275.8 180 3.07 4.070 17.40 0 0 3 3
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
#> Cadillac Fleetwood NA 8 472.0 205 2.93 5.250 17.98 0 0 3 4
#> Lincoln Continental NA 8 460.0 215 3.00 5.424 17.82 0 0 3 4
#> Chrysler Imperial NA 8 440.0 230 3.23 5.345 17.42 0 0 3 4
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
#> Toyota Corona NA 4 120.1 97 3.70 2.465 20.01 1 0 3 1
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
#> Ford Pantera L NA 8 351.0 264 4.22 3.170 14.50 0 1 5 4
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
#> Maserati Bora NA 8 301.0 335 3.54 3.570 14.60 0 1 5 8
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
Created on 2021-12-18 by the reprex package (v2.0.1)
From https://adv-r.hadley.nz/quasiquotation.html?q=:=#tidy-dots :
:= is like a vestigial organ: it’s recognised by R’s parser, but it doesn’t have any code associated with it. It looks like an = but allows expressions on either side, making it a more flexible alternative to =. It is used in data.table for similar reasons.
Related
I need to calculate row sums for a data frame except for the first 5 columns. The output will consist of these first 5 columns and the row sums.
I tried this:
df1$rowsums <- rowSums(df1[,-c(1:5)], na.rm= T)
But I get this error message:
Error in rowSums(df1[, c(1:5)], na.rm = T) : 'x' must be numeric
without data my guess is, that the columns you are using are not numeric. Then it will be hard to calculate the rowsum. Make sure, that columns you use for summing (except 1:5) are indeed numeric, then the following code should work:
library(tidyverse)
df2 <- df1[,-c(1:5)] %>%
rowwise() %>%
mutate(rowsum = sum(c_across(everything()), na.rm = T))
df_result <- cbind(df1[,c(1:5)], df2$rowsum)
EDIT: I added na.rm = T (dont know if necessary). And you might want to rename the resulting "df2$rowsum" column of the resulting df_result dataframe this can be done using
df_result <- df_result %>% rename(rowsum_name = "df2$rowsum")
You could select the columns except the first 5 by -c(1:5) and use rowSums like this (I use mtcars as an example):
library(dplyr)
mtcars %>%
mutate(rowsums = select(., -c(1:5)) %>%
rowSums(na.rm = TRUE))
#> mpg cyl disp hp drat wt qsec vs am gear carb rowsums
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4 28.080
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4 28.895
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1 27.930
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1 27.655
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2 25.460
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1 28.680
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4 26.410
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2 30.190
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2 33.050
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4 30.740
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4 31.340
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3 27.470
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3 27.330
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3 27.780
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4 30.230
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4 30.244
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4 29.765
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1 28.670
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2 28.135
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1 28.735
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1 27.475
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2 25.390
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2 25.735
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4 26.250
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2 25.895
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1 27.835
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2 26.840
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2 27.413
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4 27.670
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6 30.270
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8 32.170
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2 29.380
Created on 2022-07-09 by the reprex package (v2.0.1)
I need to pass a string as a column name using dplyr (code below). I can't get it to work. I've tried using [[name]] and .data[[name]] and this doesn't work. I need a solution specifically that allows me to rename a column as the string I've specified in the variable name.
colnames(mtcars) -> cols
rename_cols <- function(col) {
name = paste0(col, "_new") #I want to be able to parse this into the rename function below
mtcars %>%
rename(
name = col,
)
}
lapply(cols, rename_cols)
I would use a named vector instead of trying to mess around with the dplyr programming nuances. A benefit is that this method is already vectorized.
rename_cols <- function(col) {
name = paste0(col, "_new") #I want to be able to parse this into the rename function below
mtcars %>%
rename(setNames(col, name))
}
rename_cols(colnames(mtcars))
# mpg_new cyl_new disp_new hp_new drat_new wt_new qsec_new vs_new am_new gear_new carb_new
# Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
# Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
# Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
# Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
# Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
# Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
# ...
Edit
In this case, you might also find rename_with() to be what you need.
library(dplyr)
colnames(mtcars) -> cols
mtcars %>%
rename_with(~ paste0(., "_new"), any_of(cols))
# which is the same as the more concise but maybe less clear...
mtcars %>%
rename_with(paste0, any_of(cols), "_new")
Another option using some glue magic and the := assignment operator:
library(dplyr)
colnames(mtcars) -> cols
rename_cols <- function(col) {
name = paste0(col, "_new") #I want to be able to parse this into the rename function below
mtcars %>%
rename(
"{name}" := col,
)
}
lapply(cols, rename_cols)[1:2]
#> Note: Using an external vector in selections is ambiguous.
#> ℹ Use `all_of(col)` instead of `col` to silence this message.
#> ℹ See <https://tidyselect.r-lib.org/reference/faq-external-vector.html>.
#> This message is displayed once per session.
#> [[1]]
#> mpg_new cyl disp hp drat wt qsec vs am gear carb
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
#>
#> [[2]]
#> mpg cyl_new disp hp drat wt qsec vs am gear carb
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
This seems like doing things the hard way: you can replace the whole code with:
mtcars %>% setNames(paste0(cols, "_new"))
Or, if you only want to rename some columns:
names(mtcars[cols]) <- paste0(names(mtcars[cols]), "_new")
If for some reason this isn't what you want, you can turn name into a symbol and use !!name :=
colnames(mtcars) -> cols
rename_cols <- function(col) {
name = paste0(col, "_new")
name <- rlang::ensym(name)
mtcars[col] %>%
rename(
!!name := all_of(col),
)
}
as.data.frame(lapply(cols, rename_cols))
#> mpg_new cyl_new disp_new hp_new drat_new wt_new qsec_new
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60
#> vs_new am_new gear_new carb_new
#> Mazda RX4 0 1 4 4
#> Mazda RX4 Wag 0 1 4 4
#> Datsun 710 1 1 4 1
#> Hornet 4 Drive 1 0 3 1
#> Hornet Sportabout 0 0 3 2
#> Valiant 1 0 3 1
#> Duster 360 0 0 3 4
#> Merc 240D 1 0 4 2
#> Merc 230 1 0 4 2
#> Merc 280 1 0 4 4
#> Merc 280C 1 0 4 4
#> Merc 450SE 0 0 3 3
#> Merc 450SL 0 0 3 3
#> Merc 450SLC 0 0 3 3
#> Cadillac Fleetwood 0 0 3 4
#> Lincoln Continental 0 0 3 4
#> Chrysler Imperial 0 0 3 4
#> Fiat 128 1 1 4 1
#> Honda Civic 1 1 4 2
#> Toyota Corolla 1 1 4 1
#> Toyota Corona 1 0 3 1
#> Dodge Challenger 0 0 3 2
#> AMC Javelin 0 0 3 2
#> Camaro Z28 0 0 3 4
#> Pontiac Firebird 0 0 3 2
#> Fiat X1-9 1 1 4 1
#> Porsche 914-2 0 1 5 2
#> Lotus Europa 1 1 5 2
#> Ford Pantera L 0 1 5 4
#> Ferrari Dino 0 1 5 6
#> Maserati Bora 0 1 5 8
#> Volvo 142E 1 1 4 2
Created on 2022-03-08 by the reprex package (v2.0.1)
This question already has answers here:
Reshaping data.frame from wide to long format
(8 answers)
Closed 1 year ago.
So I want to reshape my wide format dataframe, and my varying variables range from item01-item21. Is there a shortcut that i can use instead of manually typing item01, item02, etc? This is the code I have now:
RTdataLong <- reshape(RTdata,direction="long",idvar=c("ID","Language","Gender"), varying=list(c("Time01","Time02","Time03","Time04","Time05","Time06","Time07","Time08","Time09","Time10","Time11","Time12","Time13","Time14", "Time15","Time16","Time17","Time18","Time19","Time20","Time21")))
It works, but I would really appreicate it if someone could give me some tips on how to do this more efficiently.
You don't provide an exmaple data but you could use tidyr::pivot_longer like so:
library(tidyverse)
mtcars
#> mpg cyl disp hp drat wt qsec vs am gear carb
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
mtcars %>%
pivot_longer(cols = 1:11, names_to = "col_name")
#> # A tibble: 352 x 2
#> col_name value
#> <chr> <dbl>
#> 1 mpg 21
#> 2 cyl 6
#> 3 disp 160
#> 4 hp 110
#> 5 drat 3.9
#> 6 wt 2.62
#> 7 qsec 16.5
#> 8 vs 0
#> 9 am 1
#> 10 gear 4
#> # ... with 342 more rows
Created on 2021-09-15 by the reprex package (v2.0.1)
I want to assert that one column in my data is always greater than the other column using the assertr package. As an example let's day that mtcars mpg should always be greater than cyl. Here is what I've tried but it throws an error. Am I making a simple mistake?
library(assertr)
greater_than <- function(x, y){if(x <= y) return(FALSE)}
assert(mtcars, greater_than, x = mpg, y = cyl)
> Error in improper.predicate(x) : argument "y" is missing, with no default
I don't think you want assert - instead I think you want assert_rows. That means you need a row reduction function (takes a row and results in a single value) in addition to the predicate function. Here the reduction function just finds the difference between the first two columns of a data frame. Then the last argument in assert_rows tells it to essentially use a data frame only consisting of mpg and cyl (in that order) for passing to the row reduction function.
I will say, the documentation is not great for this package. I had to go to their GitHub and then consult the code of assert_rows directly to come up with this answer.
library(assertr)
greater_than_0 <- function(x){if(x <= 0) return(FALSE)}
row_redux <- function(df){df[[1]] - df[[2]]}
assert_rows(mtcars, row_redux, greater_than_0, c(mpg, cyl))
#> mpg cyl disp hp drat wt qsec vs am gear carb
#> Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
#> Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
#> Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
#> Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
#> Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
#> Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
#> Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
#> Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
#> Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2
#> Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
#> Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
#> Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3
#> Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
#> Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
#> Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4
#> Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4
#> Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4
#> Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
#> Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
#> Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
#> Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1
#> Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
#> AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
#> Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
#> Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
#> Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
#> Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
#> Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
#> Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4
#> Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
#> Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8
#> Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
Created on 2019-09-17 by the reprex package (v0.3.0)
I'd like for R to print the dimensions of my updated dataframes to show how each of my steps influences the number of observations remaining. Typically my dataset size changes because there are NAs. I can always quickly check dimensions:
a = data.frame(a = c(1,2), b = c(3, NA))
na.omit(a) %>% dim
but I would want to do two things in that one line:
na.omit(a) %>% size
a <- na.omit(a)
since code gets messy with many dim() calls.
Is there a way to toggle R's output? Something like
a <- na.omit(a)
message: dimensions are now m x n
Edit: Added code to only display notification when the object changes under the original code.
If you just want the dimensions to print after every line that you execute you could write a taskCallBack
tc <- addTaskCallback(function(...){message("Dimensions are: ", paste(dim(a), collapse = " "));return(TRUE)})
# When you want to remove the callback
removeTaskCallback(tc)
Here is an example session of it in use. You could probably modify the taskCallBack to only print if things change.
> a <- mtcars
>
> tc <- addTaskCallback(function(...){message("Dimensions are: ", paste(dim(a), collapse = " "));return(TRUE)})
Dimensions are: 32 11
>
> a
mpg cyl disp hp drat wt qsec vs am gear carb
Mazda RX4 21.0 6 160.0 110 3.90 2.620 16.46 0 1 4 4
Mazda RX4 Wag 21.0 6 160.0 110 3.90 2.875 17.02 0 1 4 4
Datsun 710 22.8 4 108.0 93 3.85 2.320 18.61 1 1 4 1
Hornet 4 Drive 21.4 6 258.0 110 3.08 3.215 19.44 1 0 3 1
Hornet Sportabout 18.7 8 360.0 175 3.15 3.440 17.02 0 0 3 2
Valiant 18.1 6 225.0 105 2.76 3.460 20.22 1 0 3 1
Duster 360 14.3 8 360.0 245 3.21 3.570 15.84 0 0 3 4
Merc 240D 24.4 4 146.7 62 3.69 3.190 20.00 1 0 4 2
Merc 230 22.8 4 140.8 95 3.92 3.150 22.90 1 0 4 2
Merc 280 19.2 6 167.6 123 3.92 3.440 18.30 1 0 4 4
Merc 280C 17.8 6 167.6 123 3.92 3.440 18.90 1 0 4 4
Merc 450SE 16.4 8 275.8 180 3.07 4.070 17.40 0 0 3 3
Merc 450SL 17.3 8 275.8 180 3.07 3.730 17.60 0 0 3 3
Merc 450SLC 15.2 8 275.8 180 3.07 3.780 18.00 0 0 3 3
Cadillac Fleetwood 10.4 8 472.0 205 2.93 5.250 17.98 0 0 3 4
Lincoln Continental 10.4 8 460.0 215 3.00 5.424 17.82 0 0 3 4
Chrysler Imperial 14.7 8 440.0 230 3.23 5.345 17.42 0 0 3 4
Fiat 128 32.4 4 78.7 66 4.08 2.200 19.47 1 1 4 1
Honda Civic 30.4 4 75.7 52 4.93 1.615 18.52 1 1 4 2
Toyota Corolla 33.9 4 71.1 65 4.22 1.835 19.90 1 1 4 1
Toyota Corona 21.5 4 120.1 97 3.70 2.465 20.01 1 0 3 1
Dodge Challenger 15.5 8 318.0 150 2.76 3.520 16.87 0 0 3 2
AMC Javelin 15.2 8 304.0 150 3.15 3.435 17.30 0 0 3 2
Camaro Z28 13.3 8 350.0 245 3.73 3.840 15.41 0 0 3 4
Pontiac Firebird 19.2 8 400.0 175 3.08 3.845 17.05 0 0 3 2
Fiat X1-9 27.3 4 79.0 66 4.08 1.935 18.90 1 1 4 1
Porsche 914-2 26.0 4 120.3 91 4.43 2.140 16.70 0 1 5 2
Lotus Europa 30.4 4 95.1 113 3.77 1.513 16.90 1 1 5 2
Ford Pantera L 15.8 8 351.0 264 4.22 3.170 14.50 0 1 5 4
Ferrari Dino 19.7 6 145.0 175 3.62 2.770 15.50 0 1 5 6
Maserati Bora 15.0 8 301.0 335 3.54 3.570 14.60 0 1 5 8
Volvo 142E 21.4 4 121.0 109 4.11 2.780 18.60 1 1 4 2
Dimensions are: 32 11
> a <- a[1:5,]
Dimensions are: 5 11
>
> # When you want to remove the callback
> removeTaskCallback(tc)
[1] TRUE
If you want to only receive notifications when the object changes we can write a little bit more to actually monitor the object and only display the message when appropriate. Here is the code I'll use:
# #object_name - Character string. The object name you want to montior
# #example tc <- addTaskCallback(monitor_object("mtcars"))
monitor_object <- function(object_name){
object_dim <- NULL
if(exists(object_name)){
object_dim <- dim(get(object_name))
}
f <- function(...){
new_dim <- NULL
if(exists(object_name)){
new_dim <- dim(get(object_name))
}
if(!identical(new_dim, object_dim)){
msg <- paste0(object_name,
" changed.\nOld dimensions: ",
paste(object_dim, collapse = " "),
"\nNew dimensions: ",
paste(new_dim, collapse = " "))
object_dim <<- new_dim
message(msg)
}
return(TRUE)
}
return(f)
}
tc <- addTaskCallback(monitor_object("mtcars"))
# When you want to remove the callback
removeTaskCallback(tc)
And an example session...
> tc <- addTaskCallback(monitor_object("mtcars"))
> mtcars <- mtcars[,-1]
mtcars changed.
Old dimensions: 32 11
New dimensions: 32 10
> head(mtcars)
cyl disp hp drat wt qsec vs am gear carb
Mazda RX4 6 160 110 3.90 2.620 16.46 0 1 4 4
Mazda RX4 Wag 6 160 110 3.90 2.875 17.02 0 1 4 4
Datsun 710 4 108 93 3.85 2.320 18.61 1 1 4 1
Hornet 4 Drive 6 258 110 3.08 3.215 19.44 1 0 3 1
Hornet Sportabout 8 360 175 3.15 3.440 17.02 0 0 3 2
Valiant 6 225 105 2.76 3.460 20.22 1 0 3 1
> mtcars <- mtcars[1:5,]
mtcars changed.
Old dimensions: 32 10
New dimensions: 5 10
I've actually expanded upon this code because it was a fun little exercise and made it so you can specify the function you want to use to monitor the object. I made a gist for the function that can be found here.
One option would be to write a new function like so:
omitter<-function(x){
x<-na.omit(x)
print(paste0("The dimensions are now ",dim(x)[1]," x ", dim(x)[2]))
return(x)
}
This would print the message and store the new object:
y<-omitter(data.frame(a=c(1:5,NA)))
> y
a
1 1
2 2
3 3
4 4
5 5
Edit: based on #DavidKlotz comment above, you could use message in place of print