We've evaluated 55+ papers/projects across global health, animal welfare, AI governance, environmental risks, and development economics; with more in the pipeline. We've built tools, databases , and partnerships. We’re now focusing on understanding and enhancing our impact — “ is this actually u

Suppose you are convinced that public expert evaluation and rating of publicly-hosted research is better than traditional journal accept/reject peer-review. You are considering using, submitting, or supporting The Unjournal, but you want to know more about how it works. Here's a talk-through explanaiton.

Another "unjournal in a nutshell" produced with the help of NotebookLM (content at https://notebooklm.google.com/notebook/bc4d4d2b-efd7-4b28-80e1-55b6b740f92f) and some overdub. Planning to produce a few of these explainer videos coming soon. Let me know if you find this type video compelling or useful, and if so, what would you like to see next. And If you want AI only: https://notebooklm.google.com/notebook/bc4d4d2b-efd7-4b28-80e1-55b6b740f92f?artifactId=7859c271-8f03-44c5-bdb8-08f125700cd7

Evaluation Summary and Metrics: "Adjusting for Scale-Use Heterogeneity in Self-Reported Well-Being" for The Unjournal.

Longer discussion with Professor Larisa Cioaca of the Freeman School of Business, on Unjournal.org and her experience with their evaluation of her co-authored paper "The Effect of Public Science on Corporate R&D" (see https://unjournal.pubpub.org/pub/evalsumpublicscience/). Interviewer: Anthony Rowett (Unjournal Field Specialist) Further response: David Reinstein, Founder and Co-Director of The Unjournal

We've evaluated 55+ papers/projects across global health, animal welfare, AI governance, and development economics; and more in the pipeline . We've built tools, databases, and partnerships. We’re now focusing on understanding and enhancing our impact — “ is this actually useful, who is using it,

Larisa Cioaca (https://larisacioaca.com/) speaks about having her co-authored paper "The Effect of Public Science on Corporate R&D" being evaluated by The Unjournal. See the evaluation package, including the authors' response , at https://unjournal.pubpub.org/pub/evalsumpublicscience/ Highlight video -- Full interview coming soon.

Overview The Unjournal is a nonprofit organization (est. 2023) that commissions rigorous public expert evaluations of impactful research. We've built…

Quick discussion of why and how to cite Unjournal evaluations when doing research, whitepapers, etc. Quick walk-through of how to do so. Not a slick video, sorry. Why: - Strengthen or temper claims: Use evaluator ratings and comments to signal credibility or highlight doubts, especially relevant for working papers & preprints - Methodological rationale: Cite evaluators' recommendations and discussion when you adopt them in similar contexts. - Your paper was evaluated by The Unjournal, and you're making the suggested chances ... cite the evaluation to justify and credit these - Credit specific insights from evaluators: Reference conceptual critiques or substantive points made by evaluators. - Support syntheses/meta-analyses: Incorporate Unjournal ratings as standardized evidence of study quality across papers. Links: Unjournal.pubpub.org (our evaluation output) https://unjournal.shinyapps.io/uj-dashboard/ (our data dashboard)

Project summary This project aims to run the first animal-focused forecasting tournament on the Metaculus platform. The goal is to generate forecasts on decision-relevant questions that will help both funders and animal-aligned organisations make more informed decisions about their funding allocation and strategy. Questions will be crowdsourced from the collective animal advocacy community and vetted appropriately to ensure the questions’ relevancy to decision-making in the community. The tournament contains a prize pool, which will be split amongst the best forecasters. What are this project's goals? How will you achieve them? The primary goals of this project are threefold: To enable funders in the animal welfare/rights space to prioritize animal-aligned interventions more effectively. To raise awareness amongst animal-aligned organisations about forecasting, to enable them to make better-informed decisions about their strategies and future direction. We also want forecasters outside the animal advocacy community to weigh in on the forecasts, diversifying the set of forecasters for the questions in the tournament. #1 and #2 will primarily be achieved by advertising the tournament in various animal advocacy communities (e.g. Hive, Sentient Futures) and partnering with a media body like Sentient Media. I’m hoping to achieve #3 by the presence of a prize pool in the tournament, so if forecasters weren’t intrinsically motivated to forecast these questions, at least the money to be won would be a good motivator. How will this funding be used? The funding will be used to create a prize pool for the Metaculus tournament. If funding exceeds $10,000, a small portion of the amount above the $10,000 will also be used to cover my efforts in filtering questions, operationalising them to a Metaculus-friendly format, advertising the tournament, and following up with decision makers in the animal advocacy community to gauge whether they have found the forecasts useful. The minimum funding is set such that the prize pool will hopefully be viable to incentivize a sufficient number of forecasters to predict. More money raised will produce a larger prize pool, greater participation incentive, and more attention on the tournament, and will also enable more outreach to spread awareness. Who is on your team? What's your track record on similar projects? It’s primarily me on the team. Jeffrey Maxim, a forecasting enthusiast and blogger from the Hive community, and Ryan Beck, the Forecasting Programs Coordinator at Metaculus are playing supporting roles. The team at The Unjournal will also be collaborating with me on selecting and refining the final set of questions. I have not personally worked on something similar, but Ryan Beck is experienced in shaping and operationalising Metaculus tournaments, including many of Metaculus’ active and past tournaments. What are the most likely causes and outcomes if this project fails? Questions evolve to become non-decision-relevant over time. Funders and animal organisations are unsure how to translate forecasts into concrete actions/decisions Aggregate forecasts on the tournament questions are completely unreflective of the actual outcome, leading decision makers to potentially make the wrong decisions How much money have you raised in the last 12 months, and from where? None.

Please note that all questions are optional. By completing this form, you will enter a draw with a chance of winning $100. Every 1 out of 10 respondents will receive the compensation.

Summary, metrics and ratings, and Manager's comments on Evaluation of “Artificial Intelligence and Economic Growth” by Aghion et al.