Tessera

TIL about marino pair, cool tool to collaborate with agents in interactive notebook-like sessions marimo.io/blog/marimo-...

Introducing marimo pair

A canvas where agents and developers collaborate on research and data work; structured working memory and a reactive Python runtime for agents.

marimo.io

just learned about ediff in emacs. M-x ediff-files n — Navigate forward to the next difference p — Navigate backward to the previous difference a — Overwrite the highlighted difference in File B with the text from File A b — Overwrite the highlighted difference in File A with the text from File B

TIL about Google's AI edge gallery, a smartphone app (Android and iOS) to try out LLMs locally. could be useful on planes and spotty cell service www.xda-developers.com/ran-a-full-l...

I ran a full LLM on my phone with no internet, and it's more useful than I expected

I owe the local LLM community an apology.

xda-developers.com

been ssh-ing into servers a lot, TIL about the -vv flag to get more details about the handshake for troubleshooting if errors arise ssh -vv user@hostname

SQL = thinking in shapes Python = thinking n steps

I sometimes wonder about how vague world of advancing your own skills and careers. ran into this more developer-centric rubric, but might be a helpful roadmap for growth and learning github.com/Semalab/deve...

github.com

Eric Leung@erictleung.bsky.social · 2mo ago

reminds me of task views that are listed on CRAN, giving a curated list of R packages to help with different tasks or types of analysis cran.r-project.org/web/views/

CRAN Task Views

CRAN task views aim to provide guidance which packages on CRAN are relevant for tasks related to a certain topic. They give a brief overview of the included packages which can also be automatically in...

cran.r-project.org

TIL that the @librarycongress.bsky.social has these cool research guides guides.loc.gov

TIL that the @librarycongress.bsky.social has these cool research guides guides.loc.gov

Research Guides

Index of Library of Congress Research Guides Research guides to the Library's collections, as well as subject guides prepared by Library of Congress staff, are listed below. More online guides coverin...

guides.loc.gov

more reminders, I had forgotten about some of the details around multicollinearity, besides it not being a good thing in a model statisticsbyjim.com/regression/m...

Multicollinearity in Regression Analysis: Problems, Detection, and Solutions

Multicollinearity is when independent variables in a regression model are correlated. I explore its problems, testing your model for it, and solutions.

statisticsbyjim.com

also TIL about the phi coefficient (aka Matthews correlation coefficient) as an evaluation metric for machine learning and statistical models medium.com/@cdefaux/phi...

Phi Coefficient A.K.A Matthews Correlation Coefficient (Binary Classification)

In machine learning/data science, we often run into problems where we’re trying to classify binary (two-class) data. In this case, you…

medium.com

random reminder of how to do SQL rolling average queries SELECT product_id, sale_date, daily_sales, AVG(daily_sales) OVER ( PARTITION BY product_id ORDER BY sale_date ROWS BETWEEN 2 PRECEDING AND CURRENT ROW ) AS rolling_avg_3_days FROM sales_data;

I've been trying to learn more about machine learning engineering to teach about it and found this nice overview about it. makes sense to be some blend of software engineering, data science, and mathematics, plus some knowledge of your application domain. www.maxmynter.com/pages/blog/b...

Max Mynter - Full Stack Machine Learning Engineer

Max Mynter - Full Stack Machine Learning Engineer. Explore my blog and portfolio. Multiple years of experience in data science, software engineering, and machine learning.

maxmynter.com

I've been using SQL for 5+ years now and only now have been paying a bit more attention. I got some code from a colleague and saw they did a join not using "on". at first I was confused, but learned this is an older standard. the following thread shows the difference. the more you know!

"Good docs answer what a new analyst would ask."

I've been digging deeper into better SQL queries, and looks like Google has a good documentation page on it. it's split out in a few sections: - reduce processed data - optimize query operations - reduce query output - avoid anti-SQL patterns docs.cloud.google.com/bigquery/doc...

Optimize query computation | BigQuery | Google Cloud Documentation

Best practices to optimize query performance.

docs.cloud.google.com

Eric Leung@erictleung.bsky.social · 4mo ago

🧵 some other cool built-in functions in R I found while I was already in there

i'm sure there are more optimized or vectorized versions, but it is cool to know there's a built-in edit distance function in R, utils::adist(): adist("kitten", "sitting") # [,1] # [1,] 3 stat.ethz.ch/R-manual/R-d...

R: Approximate String Distances

stat.ethz.ch

ah I was thinking of doing a word cloud and got reminded of a "better word cloud". couldn't remember but then eventually found them again, they're called "chatterplots", bringing a little order to an aimless word cloud medium.com/data-science...

a modified scatter plot where the points are the words themselves when analyzing text, the color representing sentiment, and size is frequency. moreover, the x-axis is sentiment and y-axis is word frequency

i've had to start using google bigquery, so this post was useful to get up to speed about it towardsdatascience.com/burn-data-ra...

A Definitive Guide to Using BigQuery Efficiently | Towards Data Science

Make the most out of your BigQuery usage, burn data rather than money to create real value with some practical techniques.

towardsdatascience.com

for R users wanting to get a list of the working titles of all R versions, you can run this SPARQL query from Wikidata query.wikidata.org#SELECT%20DIS...

query.wikidata.org

a great explanation and illustration on why bayesian statistics these days uses Hamiltonian Monte Carlo methods instead of Metropolis-Hastings algorithm that's behind Gibbs Sampling elevanth.org/blog/2017/11...

Markov Chains: Why Walk When You Can Flow?

In 1989, Depeche Mode was popular, the first version of Microsoft Office was released, large demonstrations brought down the wall separating East and West Germany, and a group of statisticians in the ...

elevanth.org

I hear a lot about "propensity score matching" en.wikipedia.org/wiki/Propens...

Propensity score matching - Wikipedia

en.wikipedia.org

i'm slowly moving my dotfiles from using stow to chezmoi, but also reuniting with my old friend tmux. i almost forgot how to scroll within a window. you can either do Ctrl-b [ (or whatever your prefix is), or set set -g mouse on # >=v2.1 set -g mode-mouse on # <v2.1 superuser.com/q/209437/941...

How do I scroll in tmux?

How do I scroll with either the keyboard or mouse? The tmux man page indicates one must enter copy-mode to scroll. Is there a way to quickly scroll without manually entering copy-mode?

superuser.com

also trying to learn more about causal inference methods. i'm familiar with the statistical rethinking materials on the subject, just need the practice to make it intuitive for myself

i'm trying to upskill in more experimentation techniques, and one method is to do geo lift analyses. this article here shows the GeoLift R package from Meta towardsdatascience.com/how-to-analy...

Analyzing Geo-based Campaigns with Synthetic Control | Towards Data Science

Using Meta's GeoLift Library

towardsdatascience.com

ah on Linux systems when upgrading R and you need to migrate all your old R packages over to the new version, you can run update.packages(checkBuilt = TRUE, ask = FALSE)