Tessera
Folgen

Daniel Rizk MD MS

@notreallydaniel.bsky.social

UMich Med Internal Medicine resident at UMaryland https://github.com/TidierOrg/TidierDB.jl

37 Posts144 Follower228 Folgt
Grant McDermott@gmcd.bsky.social · 12mo ago

To borrow another example, taken from the `dbreg` README: github.com/grantmcdermo... Here I am running a fixed-effects regression on 180 million(!) row parquet dataset... and it completes **< 2 seconds**... on my laptop 🤯 This is powered by @duckdb.org under the hood. #rstats #econsky

Running dbreg::dbreg() on a full year of NYC taxi data... and it takes less than 2 seconds. dbreg( tip_amount ~ fare_amount + passenger_count | month + vendor_name, path = "read_parquet('nyc-taxi/**/*.parquet')", ## path to hive-partitioned dataset vcov = "hc1" ) #> [dbreg] Estimating compression ratio... #> [dbreg] Data has 178,544,324 rows and 24 unique FE groups. #> [dbreg] Using strategy: compress #> [dbreg] Executing compress strategy SQL #> #> Compressed OLS estimation, Dep. Var.: tip_amount #> Observations.: 178,544,324 (original) | 70,782 (compressed) #> Standard Errors: Heteroskedasticity-robust #> Estimate Std. Error t value Pr(>|t|) #> fare_amount 0.106744 0.000068 1564.742 < 2.2e-16 *** #> passenger_count -0.029086 0.000106 -273.866 < 2.2e-16 *** #> --- #> Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Grant McDermott@gmcd.bsky.social · 12mo ago

Nice post by @jamesbrandecon.bsky.social on the scaling benefits that come from offloading your big regression jobs to a database. jamesbrandecon.github.io/blog/posts_h... (Showcasing some new-ish 📦 s that he, @apoorvalal.com & myself have been working on, but haven't really advertised yet.)

Nicola Rennie@nrennie.bsky.social · last yr.

If you're interested in learning #JuliaLang and are currently an #RStats user (or even if you're not!), then here's a little introduction to getting started! 📊 Blog post: nrennie.rbind.io/blog/introdu... #QuartoPub #Julia @tidierjl.bsky.social

Introduction to Julia for R users – Nicola Rennie

This blog post will give R users an overview of what Julia is and why they might want to use it, introduce some data processing Julia packages, and show how they can incorporate Julia into existing R ...

nrennie.rbind.io

They-Ra@xanindigo.bsky.social · last yr.

interesting that microsoft researchers aren’t on this list. seems like somewhere a machine could excel by just making shit up

Aparna Nair@disabilitystor1.bsky.social · last yr.

Just a reminder this list is drawn from a piece written by four researchers for MICROSOFT (data scientists, CS people, economists) who have never stepped foot in an archive/never taken an oral history/studied material culture, by their CVs. Unlike them, I do my research, and don't talk out my ass.

Karandeep Singh@kdpsingh.bsky.social · last yr.

In my address to the JuliaCon community, I shared why it’s such an amazing time to be in healthcare - decades-long problems solved in a short time-frame by modern medicine and the whole gamut of basic to clinical research. But for this to work, the NIH needs to focus on science, not politics.

Bild
dr. thrasher also believes netanyahu is a war criminal@thrasherxy.bsky.social · last yr.

Billionaires shouldn’t exist. If they didn’t, one man wouldn’t own the bookstore, the record store, the grocery store, the hospital, one of two only functioning newspapers, the space program and, perhaps now, one of the two last magazine companies

Karl Bode@karlbode.com · last yr.

Bezos rumored to be buying Condé Nast, which would include Vogue, Teen Vogue, The New Yorker, GQ, Vanity Fair, Wired, Architectural Digest, and Ars Technica. Wired and Teen Vogue have done some of the best reporting in the Trump era. Ars Technica one of a handful of good remaining tech pubs.

Daniel Rizk MD MS@notreallydaniel.bsky.social · last yr.

As one of the few MDs wearing an n95 in all pt rooms, I gotta say, not getting sick all of intern year was incredible.

dr. thrasher also believes netanyahu is a war criminal@thrasherxy.bsky.social · last yr.

I love my N95. I wear it whenever I am indoors and not eating (& try eat outside most of them time). It make my life more carefree, not less. I visited a friend w cancer. My mask let us visit. Later I saw another friend who was ill & it turned out to be Covid. Didn’t have to worry bc of my N95!

Shayan Sardarizadeh @shayan86.bsky.social · last yr.

AI chatbots are increasingly being used by online users as fact-checking tools. But incorrect answers by ChatGPT and Grok are misleading users about the origin of photos showing National Guard troops, sent to Los Angeles during the recent unrest, sleeping on floors.