13 stories tagged Peer Review
Researchers found that large language models (LLMs) can often identify anonymous academic papers. This threatens the integrity of double-blind peer review, which relies on anonymity to prevent bias. The study shows that LLMs can match titles and abstracts to authors, even without full access to the papers.
Researchers developed an AI system to evaluate AI-written scientific papers, testing it on four leading AI scientist frameworks. The system assesses originality, rigor, clarity, and significance, offering a new way to compare AI research quality.
Researchers found that using official conference guidelines for AI-based peer review produces results most consistent with human judgments. This suggests that refined evaluation criteria from conference practice enhance AI review quality.
Researchers developed PeerCheck, a system to enhance AI-generated academic reviews toward human-level quality. It addresses challenges in the traditional peer review process as academic submissions grow.
Researchers created FirstPass, a dataset and AI model trained on real multi-round peer-review dialogues from Nature Communications. This could make AI evaluations of scientific papers more accurate by learning from actual editorial decision-making, not just stylistic mimicry.
A new arXiv study reveals that AI tools used in scientific peer review can be tricked by simply rephrasing a manuscript's abstract — without altering any scientific content. This vulnerability poses serious risks to the integrity of academic publishing.
AI tools are now creating high-quality research papers, making it harder for scientists to get noticed. This is creating a crisis in academic publishing and peer review.
A new AI called Cajal can draft research papers and simulate peer review. This could speed up scientific discovery but raises questions about authenticity.
A leading journal reports a surge in AI-generated academic submissions, raising concerns about quality and integrity. The trend threatens to dilute research standards and overwhelm peer review systems.
A new paper on arXiv introduces a two-layer certification framework to evaluate AI-generated research. This system separates knowledge quality from human contribution, addressing gaps in current publication standards.
OpenCLAW-P2P v6.0 enhances decentralized AI peer review with multi-layer persistence and live reference verification. This update strengthens the platform's ability to handle production-scale evaluations without human intervention.
Researchers developed GoodPoint, an AI system to generate actionable feedback for scientific papers. The tool focuses on validity and author action, aiming to augment rather than replace human oversight in research.
DeepReviewer 2.0 introduces a new AI system for scientific peer review that emphasizes traceability and auditability. It generates review packages with anchored annotations, evidence, and executable follow-up actions, setting a new standard for transparency in AI-driven review processes.