MetaROR
@metaror.bsky.social
MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.
🔓 "Who chooses open peer review and is it an indicator of article quality?" That's the subject of "an observational study of PLOS journals" evaluated on MetaROR. 👇 Read on MetaROR
Who chooses open peer review and is it an indicator of article quality? An observational study of PLOS journals - MetaROR
metaror.org
2️⃣ This one came back for a second evaluation round! Both reviewers agree comments were well-addressed and commend authors on on a well-written article, yet still express some doubts. 👇 Read the full second (and first!) evaluation now on MetaROR
Citation accuracy, citation noise, and citation bias: A foundation of citation analysis - MetaROR
metaror.org
MetaROR@metaror.bsky.social · 8mo agoOur latest article argues that citation noise "represents an [...] underexplored challenge in citation analysis". Reviewers appreciate the fresh/innovative approach but question its conceptual underpinning: can citation accuracy be determined objectively? 👇 Read the assessment, reviews & full text
Here is the revision of an article presenting an agent-based model of citation behavior and compares citation networks generated by this model with real-world citation networks. Reviewers feel most of their comments were addressed, though 1 reviewer mentions two more issues. 👇 Read now on MetaROR
Modeling the global citation network using the scalable agent-based simulator for citation analysis with recency-emphasized sampling (SASCA-ReS) - MetaROR
metaror.org
This one has come back from (extensive) revision! The reviewers applaud the changes, yet still highlight some issues; in particular with regard to the title suggesting generic as opposed to specifically biomedical application. 🙏 Thanks again to all those involved! 👇 Read the evaluation on MetaROR
Use of diverse data sources to control which topics emerge in a science map - MetaROR
metaror.org
MetaROR@metaror.bsky.social · last yr.Today's MetaROR paper discusses "the use of document data networks to control the topic clustering of a science map" with "rigorous methodology" & "careful presentation". Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback. 👇 Read on MetaROR
🌐 How accessible are preprint services and where are they located? That is the question addressed by this article evaluated by MetaROR. The two reviewers are generally positive, though they have some notes on some of the figures and would like to see more statistical tests. 👇 Read it now
The localisation and accessibility of preprint services: implications for Open Science - MetaROR
metaror.org
💭 Why is change in scholarly communication so hard to imagine? This article presents findings from a consultation for cOAlition S proposal Towards Responsible Publishing. Reviewers were generally positive but urged the authors to include more detail and potential solutions. 👇 Read now on MetaROR
Why is change in scholarly communication so hard to imagine? Findings from a stakeholder consultation for the cOAlition S proposal ‘Towards Responsible Publishing’ - MetaROR
metaror.org
👏 Great initiative by our friends at PREreview!
PREreview@prereview.bsky.social · 3w ago🎉 We’re celebrating #PeerReviewWeek with a Review-a-thon! Gather your lab, classroom, department, or community to review preprints or datasets as a team, in any language or research field. You can win a prize to support your Club's activities! Learn more & register by Aug. 31: bit.ly/Review-a-thon
This research plan outlines a study investigating how people perceive researchers who commit questionable research practices (investigators) compared to those who report them (inspectors). 👇 Full evaluation - including reviews, editorial assessment & full research plan text - is on MetaROR [1/3]
From misconduct to reform: Understanding perceptions of those who commit & call out questionable research practices - MetaROR
metaror.org
What is the relative efficiency of one- and two-stage research funding processes? This article studies that, concluding that two-stage processes “may lead to significant cost savings”. 👇 Read the editorial assessment, reviews, the author's response, and the full article text on the MetaROR website
Insights into the relative efficiency of one- and two-stage research funding processes using an Agent Based Modelling approach - MetaROR
metaror.org
and Zhicheng's extensive response to the reviews is here metaror.org/article/rest... , with the revised version now undergoing a second round of review.
Restructuring scientific papers for human and AI readers - MetaROR
metaror.org
This article proposes restructuring scientific papers, with front-loaded narratives for humans as well as machine-readable appendices. Reviewers found the idea worthwhile & timely, while suggesting engagement with previous work & needing an update on the AI processing. 👇 Full assessment on MetaROR
Restructuring scientific papers for human and AI readers - MetaROR
metaror.org
📝 Do preregistration & registered reports restrict exploratory research? This research plan aims to find out. The two reviewers agree the question is important but think the proposal as-is doesn't support its claims yet. 👇 Read the full research plan, editorial assessment & reviews now on MetaROR
Evaluating the claim that preregistration and registered reports restrict exploratory research - MetaROR
metaror.org
A second version of this article has now been evaluated - one of the reviewers of the original deems it "very good" and feels comments were adequately addressed. 🙏 Thanks again for everyone involved in making this happen! 📝 Read both evaluations now on MetaROR: metaror.org/article/the-...
The state of bronze open access in Web of Science - MetaROR
metaror.org
MetaROR@metaror.bsky.social · 5mo ago🔓 Our latest article presents an analysis of bronze open access publications in the Web of Science database. Reviewers did not identify major weaknesses, calling it solid, timely & sound, and suggested expanding the discussion on the concept of bronze OA. 👇 Read the full evaluation now on MetaROR
🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines. Reviewers praised it as timely & useful while providing recommendations. Read it now 👇
Handbook for Reproduction and Replication Studies - MetaROR
metaror.org
Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries. Reviewers recognize the approach's value & also provide (literature) suggestions. 👇 Read the assessment, reviews and full text on MetaROR
The relative intensity of bilateral and multilateral co-authorship with Russia since 1995 - MetaROR
metaror.org
This article, which went through two rounds of MetaROR evaluation, just got published in Quantitative Science Studies! 👏 Congratulations to the authors! Read it here: direct.mit.edu/qss/article/...
The varying perceptions of a statistician’s value, from “critical” to “not needed for 99.9% of applications”: A study of human research ethics committees in Australia
Abstract. Currently, much medical research is wasted due to inappropriate study design or analysis. Qualified statisticians are essential for ensuring ideal study design and analysis, and the ethical ...
direct.mit.edu
MetaROR@metaror.bsky.social · 5mo ago2️⃣ After the initial review, the authors returned to MetaROR for a second round. Reviewers believe that their concerns have been addressed, though one of them still prefers the author to drop three references. 👇 Read the 2nd evaluation round, incl. reviews, assessment and full article now on MetaROR
Our two Iranian co-authors, Saeed Shafiei Sabet of the University of Guilan and Marziyeh Amini Fard may not know about these positive reviews for our manuscript, because my emails to them continue to bounce. I wanted to recognize them here because I'm very concerned about their future.
MetaROR@metaror.bsky.social · 4mo ago🗨️ This article's authors announce expansion of CRediT into 36 languages & describe how translations from English were made. Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT. 👇 Read the full evaluation
🗨️ This article's authors announce expansion of CRediT into 36 languages & describe how translations from English were made. Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT. 👇 Read the full evaluation
Facilitating multilingual research publishing: Translations of the Contributor Roles Taxonomy (CRediT) - MetaROR
metaror.org
🔗 This new evaluation attempts to trace causal linkages from research funding towards societal outcomes. Researchers praise it for showing how targeted funding can foster mutually beneficial academia–industry collaborations. They also identify problems in framing, clarity & depth. 👇 Read now
Tracing causal mechanisms for the impact of societally targeted funding - MetaROR
metaror.org
We are delighted to see the growth of the ‘Publish, Review, Curate’ (PRC) initiatives in recent years!🚀 One of them is @metaror.bsky.social (MetaResearch Open Review). This platform focuses on open peer review and curation of metaresearch articles. Learn more about MetaROR👉️ metaror.org
Home - MetaROR
MetaResearch Open Review MetaResearch Open Review MetaResearch Open Review A new platform designed to transform how we review and share metaresearch A new platform designed to transform
metaror.org
Who owns the knowledge? Our latest evaluation is a call for researchers to act in response to AI models using their research. Reviewers consider it a good primer on the topic yet suggest more focus on the political/commercial context & greater precision in the legal analysis. 👇 Read now on MetaROR
Who owns the knowledge? Copyright, genAI, and the future of academic publishing - MetaROR
metaror.org
🔍 Academic search engine optimisation (A-SEO) vital for enhancing research visibility. Our latest evaluation is a study comparing four leading A-SEO tools. Reviewers emphasize the topic's relevance but do point out the limitation of including only 2 publishers in the study. 👇 Read now on MetaROR
SEO Metrics for Enhanced Academic Research Visibility: A Comparative Study of Global and Country-Level Traffic - MetaROR
metaror.org
2️⃣ The authors of this article on preprint adoption across discipline and region returned for a 2nd evaluation. Our editor found changes corresponding to most suggestions made in the reviews and reasonable and convincing arguments for why specific suggestions were declined. 👇 Read it all on MetaROR
MetaROR@metaror.bsky.social · 11mo ago⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this. The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues. 👇 Read it now on MetaROR
#Excited for the fteval Journal for Research and Technology Policy Evaluation X @metaror.bsky.social collaboration. We, @fteval, @rorinstitute.bsky.social @aimosinc.bsky.social, are joined by the mission for open & transparent peer review and strengthening international the field of meta-research.
2️⃣ After the initial review, the authors returned to MetaROR for a second round. Reviewers believe that their concerns have been addressed, though one of them still prefers the author to drop three references. 👇 Read the 2nd evaluation round, incl. reviews, assessment and full article now on MetaROR
MetaROR@metaror.bsky.social · 11mo agoA qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees. Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes. 👇Read it now on MetaROR
Today, author @tomhardwicke.bsky.social argues "that without safeguards, Synchronous Robustness Reports could inadvertently create more confusion than clarity about robustness. The reviewer, among other things, suggests distinguishing between different types of reports. 👇 Read it now on MetaROR
Risk of Bias in Robustness Reports - MetaROR
metaror.org
🔓 Our latest article presents an analysis of bronze open access publications in the Web of Science database. Reviewers did not identify major weaknesses, calling it solid, timely & sound, and suggested expanding the discussion on the concept of bronze OA. 👇 Read the full evaluation now on MetaROR
The State of Bronze Open Access in Web of Science - MetaROR
metaror.org
🤝 We are happy to announce another new partner journal: @jcre.bsky.social The Journal of Comments and Replications in Economics "aims for articles that comment on or replicate previously published articles in economics & closely related disciplines" 👇 See our full list of partners on our website
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...
metaror.org
🇬🇧 Our latest paper "uses broad bibliometrics to compare the STEM and SHAPE sectors over time in the UK, with comparisons to other countries" Reviewers find it timely & useful, yet suggest a different analytical approach as well as a tighter definition of SHAPE 👇 Find the full evaluation on MetaROR
Understanding the importance of SHAPE to the UK research ecosystem - MetaROR
metaror.org
🤝 MetaROR is happy to announce Replication Research as its new partner journal! @r2journal.bsky.social is an interdisciplinary journal for replication research focusing on reproductions, close replications and conceptual replications. 👇 See our full list of partners on our website
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions After peer review and editori...
metaror.org