100% tevredenheidsgarantie Direct beschikbaar na je betaling Lees online óf als PDF Geen vaste maandelijkse kosten
logo-home
Eerder door jou gezocht
Eerder door jou gezocht
logo
Aca2.0Q&A” Usagescenariosandincentivesystems foradistributedacademicpublicationmodel R.Poss,S.Altmeyer,M.Thompson,R.Jelier May15,2014 €14,20
In winkelwagen
Snel navigeren naar
Voorbeeld
  2.  
  3. Aca2.0Q&A
  4.  
  5. Aca2.0Q&A

Tentamen (uitwerkingen)

Aca2.0Q&A” Usagescenariosandincentivesystems foradistributedacademicpublicationmodel R.Poss,S.Altmeyer,M.Thompson,R.Jelier May15,2014
 0 keer verkocht
  • Vak
  • Aca2.0Q&A
  • Instelling
  • Aca2.0Q&A

Prologue The present report is intended to be extended over time, as additional use cases, issues or opportunities are envisioned. Suggestions for improvements or new materials are welcome, and the contributor list can be adjusted accordingly. Thelatest version of this document, if any, can...

[Meer zien]

Voorbeeld 3 van de 18  pagina's

Document informatie

  • 3 augustus 2024
  • 18
  • 2024/2025
  • Tentamen (uitwerkingen)
  • Vragen en antwoorden

Onderwerpen

  • 22 anonymous reviews
  • aca20qa usagescenariosandincentivesystems for
  • 21 characteristics of the review process

Geschreven voor

  • Aca2.0Q&A
  • Aca2.0Q&A

Verkoper

avatar-seller
TIFFACADEMICS

Ontvangen beoordelingen

Voorbeeld van de inhoud

“Aca 2.0 Q&A”
Usage scenarios and incentive systems
for a distributed academic publication model
R. Poss, S. Altmeyer, M. Thompson, R. Jelier
arXiv:1404.7753v2 [cs.DL] 10 May 2014




May 15, 2014

Abstract
“Academia 2.0” is a proposal to organize scientific publishing around
true peer-to-peer distributed dissemination channels and eliminate the tra-
ditional role of the academic publisher. This model will be first presented
at the 2014 workshop on Reproducible Research Methodologies and New
Publication Models in Computer Engineering (TRUST’14) in the form of
a high-level overview, so as to stimulate discussion and gather feedback
on its merits and feasibility. This report complements the 6-page intro-
ductory article presented at TRUST, by detailing the review processes,
some use scenarios and answering the reviewer’s comments in detail.


Contents
Prologue 2

1 Introduction 2

2 Peer review 3
2.1 Characteristics of the review process . . . . . . . . . . . . . . . . 4
2.2 Anonymous reviews . . . . . . . . . . . . . . . . . . . . . . . . . 4
2.3 Organization of the review process . . . . . . . . . . . . . . . . . 6
2.4 Double blind reviews . . . . . . . . . . . . . . . . . . . . . . . . . 6
2.5 Previous work on open peer review . . . . . . . . . . . . . . . . . 8

3 Scenarios and incentives 10
3.1 Fear of credit loss . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
3.2 Early publication . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.3 File drawer effect . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.4 Next-generation journals . . . . . . . . . . . . . . . . . . . . . . . 12

4 Questions and Answers 13

Acknowledgements 16

References 16



1

,Prologue
The present report is intended to be extended over time, as additional use
cases, issues or opportunities are envisioned. Suggestions for improvements or
new materials are welcome, and the contributor list can be adjusted accordingly.
The latest version of this document, if any, can be retrieved from http://arxiv.
org/abs/1404.7753.


1 Introduction
Supposing the publishing industry did not exist, what could we achieve to opti-
mize scientific dissemination of knowledge and progress, short of recreating the
publishing industry? This is what the “Academia 2.0” proposal [17] addresses.
The proposal can be summarized as follows:
• every researcher can self-publish online; including reviews of other works
whenever they wish;
• works are securely timestamped and identified by title and author list and,
where applicable, content hash;
• public organizations are responsible for publishing reviews that reviewers
wish to keep anonymous while retaining accountability;
• a new semantic object, the “post-hoc citation” can be used to assert prior
work, influence or plagiarism relationships when they are discovered only
after publication;
• a new distributed infrastructure serves for document indexing and lookup;
it also provides public and free interfaces for search and syndication, to
aggregate and distribute, on-demand, relevant documents: per field of
expertise, geographical area, social affinity, or relevance to a topic.
Following this proposal, a large number of questions have been raised by
the TRUST review committee. The process of answering these questions also
contributes to the elaboration of our model; a synthetic answer suitable for a
summary would fail to convey the more nuanced aspects of our proposal.
For example, many questions have arisen regarding the organization of peer
review: how to annotate works with measures of their appreciation by other
members of the scientific community. For this, we elaborate a more complete
structured answer in section 2.
In particular, the reviewers have highlighted that there have been already
multiple efforts in the past to make the review process of scientific works more
transparent. Our position is that the “Academia 2.0” proposal is complementary
to these previous efforts, by focusing on a different set of goals (cf. the first
question in section 4 and section 2 of the TRUST article). Nevertheless, we also
review the relationship between our work and contemporary efforts in open peer
review below in section 2.5.
Similarly, the proposal enables a new incentive system, which in turn en-
ables new scenarios for the way scientists interact with each other. We have
highlighted two such scenarios in the TRUST submission; the reviewers have
asked for more details and alternate scenarios, which we provide in section 3.
We then address the remaining questions in section 4.




2

, Table 1: Example review object: a TRUST’14 review
Author “Anonymous reviewer 12 mandated by the TRUST’14 program committee”
Title “Review of submission 1”
Target document handle { “Academia 2.0: removing the publisher middle-man while retaining impact”,
[ “Raphael Poss”, “Sebastian Altmeyer”, “Mark Thompson”, “Rob Jelier” ],
“sha256/e83b0a9861eec4906f52d269056925bd0692c77882ee54d0a62eb876cc61be69” }
Overall evaluation 2/3, higher is better
Reviewer’s confidence 4/5, higher is better
Reviewer comments The paper presents the idea to have an open publication model. The reviewing,
indexing etc will be done in a crowd fashion using semantic technology. The paper
is well written and presents novel ideas. My major concern for now is that the value
of semantic technology is overestimated. It is also not clear how it can be made sure
that not only too few reviews will be available and thus a wrong impression about
the work is made visible.
Review process start date 2014-03-14
Review process end date 2014-04-14
Review process characteristics
• Author identity known to reviewer at start of process
• Review committee known to author before start of process
• Review object not released publicly before end of process
• Reviewed object not released publicly before end of process

Review process coordinators { “Grigori Fursin” (INRIA, France), “Bruce Childers” (University of Pittsburgh,
USA), “Alex K. Jones” (University of Pittsburgh, USA), “Daniel Mosse” (University
of Pittsburgh, USA) }
Reviewer identity escrow { “Jose Nelson Amaral” (University of Alberta, Canada), “Calin Cascaval” (Qual-
comm, USA), “Jack Davidson” (University of Virginia, USA), “Evelyn Duesterwald”
(IBM, USA), “Lieven Eeckhout” (Ghent University, Belgium), “Eric Eide” (Univer-
sity of Utah, USA), “Sebastian Fischmeister” (University of Waterloo, Canada),
“Michael Gerndt” (TU Munich, Germany), “Christophe Guillon” (STMicroelectron-
ics, France), “Shriram Krishnamurthi” (Brown University, USA), “Hugh Leather”
(University of Edinburgh, UK), “Anton Lokhmotov” (ARM, UK), “Mikel Lujan”
(University of Manchester, UK), “David Padua” (University of Illinois at Urbana-
Champaign, USA), “Christoph Reichenbach” (Johann-Wolfgang Goethe Universitat
Frankfurt, Germany), “Arun Rodrigues” (Sandia National Laboratories, USA), “Reiji
Suda” (University of Tokyo, Japan), “Sid Touati” (INRIA, France), “Jesper Larsson
Traff” (Vienna University of Technology, Austria), “Petr Tuma” (Charles Univer-
sity, Czech Republic), “Jan Vitek” (Purdue University, USA), “Vladimir Voevodin”
(Moscow State University, Russia), “Vittorio Zaccaria” (Politecnico di Milano, Italy),
“Xiaoyun Zhu” (VMware, USA) }
(Note: this example reflects a real review)



2 Peer review
The proposal promotes open peer review: where the review process is transpar-
ent, and the text of reviews is public. If so desired, the identity of reviewers
may be optionally hidden by an identity escrow service.
The basic “building block” is the review object: a document with semantic
fields that identify separately the work(s) being reviewed by their document
handles, the body of the review (text and/or grades), the author of the review,
and which review process was used to produce the review object.
An example is given in table 1. This review object represents a possible
encoding in our proposal of an actual review produced by the process of blind
review of our submission to the TRUST workshop.
As the example illustrates, review objects must be self-contained: the se-
mantic data for evaluation scores embeds information on how to interpret the
scores; the characteristics of the review process are embedded in the review
object; the full list of individuals that serve as escrow for the identity of the
reviewer is given explicitly, for accountability. Although not present in this ex-
ample, we suggest also including contact information for the people involved,
and optionally digital signatures to disambiguate homonyms.



3

Dit zijn jouw voordelen als je samenvattingen koopt bij Stuvia:

Bewezen kwaliteit door reviews

Bewezen kwaliteit door reviews

Studenten hebben al meer dan 850.000 samenvattingen beoordeeld. Zo weet jij zeker dat je de beste keuze maakt!

In een paar klikken geregeld

In een paar klikken geregeld

Geen gedoe — betaal gewoon eenmalig met iDeal, creditcard of je Stuvia-tegoed en je bent klaar. Geen abonnement nodig.

Direct to-the-point

Direct to-the-point

Studenten maken samenvattingen voor studenten. Dat betekent: actuele inhoud waar jij écht wat aan hebt. Geen overbodige details!

Veelgestelde vragen

Wat krijg ik als ik dit document koop?

Je krijgt een PDF, die direct beschikbaar is na je aankoop. Het gekochte document is altijd, overal en oneindig toegankelijk via je profiel.

Tevredenheidsgarantie: hoe werkt dat?

Onze tevredenheidsgarantie zorgt ervoor dat je altijd een studiedocument vindt dat goed bij je past. Je vult een formulier in en onze klantenservice regelt de rest.

Van wie koop ik deze samenvatting?

Stuvia is een marktplaats, je koop dit document dus niet van ons, maar van verkoper TIFFACADEMICS. Stuvia faciliteert de betaling aan de verkoper.

Zit ik meteen vast aan een abonnement?

Nee, je koopt alleen deze samenvatting voor €14,20. Je zit daarna nergens aan vast.

Is Stuvia te vertrouwen?

4,6 sterren op Google & Trustpilot (+1000 reviews)

Afgelopen 30 dagen zijn er 64302 samenvattingen verkocht

Opgericht in 2010, al 15 jaar dé plek om samenvattingen te kopen

Begin nu gratis

Laatst bekeken door jou

Tentamen (uitwerkingen) ·

(1)

TEXAS CLASS D WATER LICENSE EXAM NEWEST 2024 ACTUAL QUESTIONS AND CORRECT VERIFIED ANSWERS|100% GUARANTEED TO PASS CONCEPTS|ALREADY GRADED A+

Tentamen (uitwerkingen) ·

(0)

ANCC PMHNP CHAPTER 2 PSYCHIATRIC-MENTAL HEALTH NURSE PRACTITIONER ROLE, SCOPE OF PRACTICE, AND REGULATORY PROCESS 2024/2025 already graded A+

Voordeelbundel ·

(0)

ARE 5.0 Bundled Exams Together with complete solutions Questions and Answers Graded A+ , Latest Update (Verified Answers) (Full Solution Pack)

Tentamen (uitwerkingen) ·

(1)

NAVY AVIATION MACHINIST MATE A SCHOOL WEEK 1 QUIZ 2024-2026 ACTUAL EXAM 100+ QUESTIONS AND CORRECT DETAILED ANSWERS |ALREADY GRADED A+

Tentamen (uitwerkingen) ·

(0)

Test Bank for Aging as a Social Process: Canadian Perspectives 7th Edition By Andrew V. Wister 9780199028429 Chapter 1-12 Complete Guide .

Tentamen (uitwerkingen) ·

(0)

LOMA 311 Module 1 Practice Exam Questions Actual Exam Latest Update 2024-2025 250 Questions and 100% Verified Correct Answers Guaranteed A+

Tentamen (uitwerkingen) ·

(0)

ATI Leadership Proctored Exam 2023-2024 New Latest Version Updated with All Questions from Actual Past Exam and 100% Correct Answers

Tentamen (uitwerkingen) ·

(2)

RCFE CALIFORNIA PROCTORED REAL EXAM 2023/2024| 2 DIFFERENT VERSIONS 200+ QUESTIONS AND EXPERT ANSWERS| GUARANTEED PASS ALREADY GRADED A

Tentamen (uitwerkingen) ·

(1)

CFT MONITOR USMC EXAM 2024 | ALL POSSIBLY AND FREQUESTLY TESTED REAL EXAM QUESTIONS AND ANSWERS | ACCURATE FOR A GUARANTED PASS | LATEST UPDATE

€14,20
  • (0)
In winkelwagen
Toegevoegd