Many Designs: Competition and Moral Behavior


With #ManyDesigns we are running the first crowd-sourced project in behavioral economics!

In research teams (RTs) of two, everyone – from PhD student to full professor from around the world – will have the possibility to propose an experimental research design, all assessing the same research question:

Does competition affect moral behavior?

The project coordinators (PCs) will use the results of #ManyDesigns to learn about the scientific process and how competition affects moral behavior. They will study the variation in design choices and results, and write a metascience paper on the topic where all contributors whose design proposals were run will also be included as co-authors.

Procedure

With successful registration, there are six stages in #ManyDesigns : registration, submission of design proposals via a pre-registration, implementation of the experiment, peer assessment, data analysis, and writing of the paper.

  1. Registration
    1. Research teams (RTs) sign up for taking part in this study (without yet submitting a research design)
    2. Project coordinators (PCs) pre-screen applications for adherence with the eligibility conditions and invite all eligible RTs to submit a pre-registration outlining their design proposal.
  2. Design submission and selection procedure
    1. PCs pre-screen all submitted designs for adherence with the design conditions.
    2. Invited RTs submit a pre-registration outlining their experimental research design proposal.
    3. If more than 50 design proposals are eligible, 50 designs will be randomly selected for being included in the study.
  3. Experimental implementation
    • All selected designs will be implemented as online experiments using Prolific, payed for by the PCs.
    • All selected RTs program the experimental software for their design proposal themselves.
    • All selected RTs host the experimental software for their design proposal on their own servers.
  4. Peer assessment: All members of the selected RTs will assess 10 other RTs' design propsals.
  5. Analysis
    • RTs will submit their raw data and give PCs access to the server on which the experiment is hosted.
    • PCs will analyze the data as specified in RTs' respective pre-registrations.
    • PCs will analyze the data as specified in the PCs' pre-analysis plan.
  6. PCs will write a metascience paper; all members of selected RTs will be co-authors.

Participation criteria and researcher tasks. Learn more about the participation criteria and tasks for the research teams.

Project coordinators. The project will be coordinated by researchers from the Stockholm School of Economics, the University of Innsbruck, and the Vrije Universiteit Amsterdam. Meet the project coordinators.

Pre-analysis plan. Before inviting RTs to the study a pre-analysis plan (PAP) was uploaded outlining the design of the study. This frozen "pre-analysis plan" was uploaded to the Open Science Framework on April 28, 2021. Once all RTs have submitted their pre-registrations of their designs, but before the data collection starts, we will specify a standardized way to analyze the data and the exact hypotheses and tests as an addendum to the initial PAP.

schedule

  • Friday, 2021-05-21

    registration deadline

    Registration deadline to participate as a research team (RT; see registration).

  • Friday, 2021-05-28

    acceptance notification

    RTs are notified about acceptance into the project.

  • Friday, 2021-06-25

    submission deadline

    Deadline for RTs to submit a pre-registration outlining their design proposal (see template).

  • Friday, 2021-07-02

    notification of participation

    Up to 50 RTs are notified about participation.

  • Friday, 2021-10-01

    deadline for software submission

    Deadline for RTs to submit the experimental software (including experimental instructions; see experimental software).

  • Friday, 2021-11-06

    deadline for peer assessments

    Deadline for RTs to submit their peer assessments of RT design proposals (see peer assessment);
    the survey will be sent to RTs on Tuesday, 2021-10-05.

  • Starting 2021-10 (estimated)

    pilot sessions for the experiments

    Starting in October 2021, pilot sessions for the experiments as needed for feasibility will be conducted.

  • Starting 2021-11 (estimated)

    data collection

    Once the pilot sessions have successfully been completed, data collection starts and PCs will run all up to 50 full experiments.

  • After completion of data collection

    data analysis

    Once data collection is complete, RTs will submit their raw data and give PCs access to the server on which the experiment is hosted; PCs will analyze the data as specified by research teams in their pre-registration and as specified in the PCs' pre-analysis plan (see data & analyses).

  • Summer 2022 (estimated)

    first draft of the paper

project coordinators

The project will be curated by researchers from the Stockholm School of Economics, the University of Innsbruck, Vrije Universiteit Amsterdam, and WU Vienna University of Economics and Business. In case you have any questions regarding the project, please contact the project coordinators via info@manydesigns.online.

Anna Dreber
Anna Dreber
Stockholm School of Economics
Felix Holzmeister
Felix Holzmeister
University of Innsbruck
Christoph Huber
Christoph Huber
WU Vienna University of Economics and Business
Jürgen Huber
Jürgen Huber
University of Innsbruck
Magnus Johannesson
Magnus Johannesson
Stockholm School of Economics
Michael Kirchler
Michael Kirchler
University of Innsbruck
Utz Weitzel
Utz Weitzel
Vrije Universiteit Amsterdam