Dylan Pieper

@dylanpieper.bsky.social

Data scientist @ Pitt • Dog dad 🐕 • Pilot 🪂 • #rstats • https://dylanpieper.github.io

🦆 📦 redquack 0.3.0 now includes a suite of convenience functions, and more importantly, full control over labeling variables and coded values without separate imports. This makes redquack a great tool for large or small REDCap projects. ➡️ dylanpieper.github.io/redquack/ #rstats #redcap

Transfer REDCap Data to Database

Transfer REDCap (Research Electronic Data Capture) data to a database, specifically optimized for DuckDB. Processes data in chunks to handle large datasets without exceeding available memory. Features...

dylanpieper.github.io

Stretching DuckDB w/ Common Crawl, ~1.7B rows, ~300 parquet files. ~2-3s for single-column aggregations, ~2-3 mins to SUMMARIZE the data, peaking at ~12-14GB memory usage. Not exactly real-time, but the fact you can do this on a laptop with no server setups or Spark pipelines is still amazing.

Bild

Remember this #rstats post? I wasn't the only one talking about it & the tidyverse team was listening 😎 #databs New #dplyr functions? They're looking for feedback!! 🤔 replace_when, recode_values, replace_values 👀 Read this: github.com/tidyverse/ti... 🗣️ Comment on PR: github.com/tidyverse/ti...

Libby Heeren@libbyheeren.bsky.social · last yr.

Ever needed to recode a variable based on whether it matches something in a named list? Have you ever used rlang's `!!!` operator? It's pretty dang cool. I feel like {rlang} is so cool, but so enigmatic 😂 #rstats Here's a pic & gist (bc it's frustrating to not be able to copy/paste the pic) #databs

As a data manager, good documentation not only helps me do my job better, but also helps me annoy you less! 😅 Good documentation about inclusion criteria, READMEs about oddities in the data, consort diagrams and tracking to explain missing data, and so on, are all ways to ensure I bug you less! 🐛🐜🐝

New to me is the term "premature closure", where you too quickly latch on to the first solution you see. Always a danger in coding, but particularly so today when LLMs can give you a plausible fix so so quickly. www.shayon.dev/post/2025/16...

Pitfalls of premature closure with LLM assisted coding

When LLM models generates clean, professional-looking code, it's tempting to stop exploring alternatives. But therein lies the risks that comes with premature closure. So what is premature closure?

shayon.dev

Here's a functional programming trick for #rstats that I wish I started using sooner: if you need a #ggplot2 scale to be reusable across multiple plots and dynamically configurable without relying on global state, consider using a function factory (a function that returns a function) to build it

screenshot of a code editor showing the following R code:

library(quantmod)
library(ggplot2)
library(lubridate)

startYear <- 2015
startDate <- paste0(startYear, '-01-01')
getSymbols(c('spy', 'btc-usd'), from= startDate)

# function factory that creates a scale function that only shows valid years.
# try to keep code that could change in here!
make_valid_year_scale_function <- function(start_year){
  function(){
    list(
      scale_x_continuous(breaks = seq(start_year, Sys.Date() |> year(), 1)),
      theme(panel.grid.minor.x = element_blank()) # use function after other theme funcs
    )
  }
}

# this makes it so I can add scale_x_valid_years() to any plot
scale_x_valid_years <- make_valid_year_scale_function(startYear)

tl;dr — this EO co-opts the language of open science to implement a system of political control wherein presidential appointees are given broad latitude to designate any number of reasonable scientific activities and inferences as scientific misconduct, and to penalize those involved accordingly.

Restoring Gold Standard Science

By the authority vested in me as President by the Constitution and the laws of the United States of America, including section 7301 of title 5, United

whitehouse.gov

There's so much polarization around LLMs. They are way overhyped, I agree. But I also use them semi-regularly now. Here's a thread of genuine use cases where I find them helpful. Please add your own!

Registration for the posit::conf(2025) virtual experience is now open! Join us virtually, Sept 16–18, and access live-streamed keynotes and 100+ talks, on-demand recordings, Q&A sessions, and our virtual networking platform. Learn more in the blog post: posit.co/blog/posit-c... #RStats #Python

Text: posit conf 2024 Virtual Tickets Available, Atlanta, September 16-18. A drawing outline of the Atlanta skyline and abstract cubes.

I'm still thinking about my favorite quote from the Posit Data Science Hangout today. It perfectly sums up what I hope I provide to the researchers I work with: a trusted partner, who is there to support them in their work. Earn a reputation for being a good person to work with - Cara Thompson

I’m happy to share that I’ll be giving a talk at R/Medicine 2025! 🎊 I work with a BIG REDcap database for substance use treatment (200+ locations) which makes extraction difficult. I developed {redquack}, an #rstats 📦 that transfers REDCap data to DuckDB, and will talk about how to use it. 🦆

📊 🕵️‍♂️ #rstats community! Do you sometimes feel like you're just pretending to be a data scientist? I'm researching imposter syndrome for my upcoming talk at posit::conf(2025) 🔍 I'd love to hear YOUR experiences in a short 5-10 minute anonymous survey: forms.gle/YkJtwZWquyKM... Please share! 🔄

Imposter Syndrome in Data Science

This survey is intended to gather community feedback from data scientists and students or recent graduates interested in data science as a career. Your responses will be anonymous and may be used for...

forms.gle

Since it's in Atlanta, I'll be here at my first posit::conf! I'll be speaking here with @gosterhout.bsky.social about election night reporting with #rstats and #QuartoPub (showing off {targets} and other neat tricks like this: www.andrewheiss.com/blog/2024/11... )

Posit@posit.co · last yr.

We’re excited to announce that the session catalog for posit::conf(2025) has launched! View 100+ talks, sort by day and type, and add favorites to your schedule: reg.rainfocus.com/flow/posit/p... Our Early Bird discount is still available. Get your ticket today! #RStats #Python #PositConf2025

A graphic announcing the 'FULL PROGRAM LAUNCH' for 'posit conf (2025)'. Below the text is a stylized white outline of a city skyline. At the bottom left is the 'posit' logo followed by 'conf (2025)'. On the bottom right, in white text, are the dates 'SEPTEMBER 16-18' above 'Atlanta', accompanied by a small yellow cube.