Skip to main content
Home
  • Connect!
  • Donate
  • My Account
  • Join/Login
  • S
  • About
    • What is Social and Personality Psychology?
    • Leadership
      • Elections
    • Get Involved
    • Committees
    • Diversity & Inclusion Initiatives
    • Government Relations
    • Foundation for Personality and Social Psychology
    • Governance Documents
    • Staff
    • Jobs at SPSP
      • Benefits of Working at SPSP
      • Current Openings
  • Connect!
  • Join/Login
  • Home
  • Members
    • Membership Categories and Rates
    • Member Demographics
    • Member Directory
    • APA Division 8
    • Fellowship
    • Listservs and Shared Interest Groups
    • Member Deals and Discounts
  • Publications
    • Best Practices
    • Publication Policies
    • Resources
    • PSPB
      • Editorial Philosophy
      • Manuscript Preparation/Submission Guidelines
      • PSPB Online
    • PSPR
      • Manuscript Preparation
      • PSPR Online
    • SPPS
      • Manuscript Preparation
      • SPPS Online
  • Events
    • 2021 Convention
      • Register Now
    • Future/Past Conventions
    • Summer Psychology Forum
    • Society of Southeastern Social Psychologists
    • APA Convention (Division 8)
    • Student Opportunities
      • SISPP
      • SPUR
      • SASP
      • EASP
      • EAPP
    • Online Learning
  • Giving
    • Ways to Give
    • Planned Giving
    • Tribute Wall
    • Annual Reports
    • ARP Awards
  • Awards/Grants
    • Annual Awards
      • Senior Career Contribution Awards
      • Mid-Career Awards
      • Early Career Awards
      • Teaching and Mentoring Awards
      • Prizes for a Single Outstanding Contribution
      • Media Awards
      • Service Awards
      • Student Awards
      • Diversity Awards
    • Student Awards
      • Heritage Dissertation Research Award
      • Outstanding Research Award
      • Graduate Student Poster Award
      • Undergraduate Student Poster Award
      • Student Publication Prize
      • Jenessa Shapiro Graduate Research Award
      • Graduate Registration Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
    • Diversity Awards
      • Jenessa Shapiro Award for Contributions to Diversity and Inclusion
      • Jenessa Shapiro Graduate Research Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
    • Legacy Program
    • Registration Awards
      • Graduate Registration Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
      • Teacher/Scholar Registration Award
      • International Registration Award
      • International Bridge-Building Award
    • Small Research Grant Program
    • Small Conference Grant Program
    • Community Catalyst Grant Program
  • News
    • Member Newsletter
    • Student Newsletter
    • Character and Context Blog
    • Press Releases
    • Member Updates
  • Resources
    • Connect!
    • COVID-19
    • Free-Form Fridays
    • Students
      • Graduate Program Directory
      • Applying to Grad School
      • Life in Graduate School
    • Early Career
    • Primarily Undergraduate Institutions
    • Multimedia
      • #SPSPchat
      • SPSP Experts
      • Out of the Lab
      • Convention Videos
    • Funding
    • International Study and Work
    • Statistics & Data Analysis
    • Teaching
      • Recommended Textbooks
      • Syllabi Examples
      • Teaching Aids
      • Video
    • Applied Psychology
  • Careers
    • Find/Post a Job
    • Graduation Outcomes
    • Career Resources
    • Academic Job Market
    • Non-Academic Internships
    • Undergraduate Research
  • About
    • What is Social and Personality Psychology?
    • Leadership
      • Elections
    • Get Involved
    • Committees
    • Diversity & Inclusion Initiatives
    • Government Relations
    • Foundation for Personality and Social Psychology
    • Governance Documents
    • Staff
    • Jobs at SPSP
      • Benefits of Working at SPSP
      • Current Openings
  • Connect!
  • Join/Login
  • Home
  • Members
    • Membership Categories and Rates
    • Member Demographics
    • Member Directory
    • APA Division 8
    • Fellowship
    • Listservs and Shared Interest Groups
    • Member Deals and Discounts
  • Publications
    • Best Practices
    • Publication Policies
    • Resources
    • PSPB
      • Editorial Philosophy
      • Manuscript Preparation/Submission Guidelines
      • PSPB Online
    • PSPR
      • Manuscript Preparation
      • PSPR Online
    • SPPS
      • Manuscript Preparation
      • SPPS Online
  • Events
    • 2021 Convention
      • Register Now
    • Future/Past Conventions
    • Summer Psychology Forum
    • Society of Southeastern Social Psychologists
    • APA Convention (Division 8)
    • Student Opportunities
      • SISPP
      • SPUR
      • SASP
      • EASP
      • EAPP
    • Online Learning
  • Giving
    • Ways to Give
    • Planned Giving
    • Tribute Wall
    • Annual Reports
    • ARP Awards
  • Awards/Grants
    • Annual Awards
      • Senior Career Contribution Awards
      • Mid-Career Awards
      • Early Career Awards
      • Teaching and Mentoring Awards
      • Prizes for a Single Outstanding Contribution
      • Media Awards
      • Service Awards
      • Student Awards
      • Diversity Awards
    • Student Awards
      • Heritage Dissertation Research Award
      • Outstanding Research Award
      • Graduate Student Poster Award
      • Undergraduate Student Poster Award
      • Student Publication Prize
      • Jenessa Shapiro Graduate Research Award
      • Graduate Registration Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
    • Diversity Awards
      • Jenessa Shapiro Award for Contributions to Diversity and Inclusion
      • Jenessa Shapiro Graduate Research Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
    • Legacy Program
    • Registration Awards
      • Graduate Registration Award
      • Diversity Graduate Registration Award
      • Diversity Undergraduate Registration Award
      • Teacher/Scholar Registration Award
      • International Registration Award
      • International Bridge-Building Award
    • Small Research Grant Program
    • Small Conference Grant Program
    • Community Catalyst Grant Program
  • News
    • Member Newsletter
    • Student Newsletter
    • Character and Context Blog
    • Press Releases
    • Member Updates
  • Resources
    • Connect!
    • COVID-19
    • Free-Form Fridays
    • Students
      • Graduate Program Directory
      • Applying to Grad School
      • Life in Graduate School
    • Early Career
    • Primarily Undergraduate Institutions
    • Multimedia
      • #SPSPchat
      • SPSP Experts
      • Out of the Lab
      • Convention Videos
    • Funding
    • International Study and Work
    • Statistics & Data Analysis
    • Teaching
      • Recommended Textbooks
      • Syllabi Examples
      • Teaching Aids
      • Video
    • Applied Psychology
  • Careers
    • Find/Post a Job
    • Graduation Outcomes
    • Career Resources
    • Academic Job Market
    • Non-Academic Internships
    • Undergraduate Research

You are here

Home » News » Member Updates

6 Online Research Platforms: Pros and Cons

by Barbara Toizer
July 23, 2020
image of four laptops computers

You’ve made the decision to move your research study online, but perhaps you are not familiar or entirely comfortable with the various tools available. We’ve compiled a list of some of the more popular ones here and take a look at the pros and cons of each.

The first step to moving online is transferring the study materials to an online platform. The best platform to use depends on the type of study being conducted. If the study is a survey, then the questions can be pasted into a survey-hosting platform. Popular platforms include Qualtrics, SurveyGizmo, SurveyMonkey, and Google Forms. You may have access to at least one of these platforms through your institution.

If a study employs a more complex behavioral task, consider using an experiment-hosting platform. Popular platforms include Gorilla, Inquisit, and Pavlovia. These platforms allow researchers to put together experimental tasks, either from a library of common tasks or individually programmed by the user. These platforms also host the experiment on their servers so researchers do not have to set up their own websites to host studies.

Gorilla is an experiment-hosting platform for behavioral tasks that cannot be hosted in a survey. Gorilla has a graphical interface, which researchers can use to set up studies using a library of experimental tasks. Researchers pay per participant response.
Pros
No programming knowledge is required to use Gorilla.
Cons
Complicated tasks can require coding if they are not already included in the built-in libraries.

Inquisit similarly hosts complex behavioral tasks on its platform. Researchers pay for a license to conduct unlimited experiments for a certain amount of time.
Pros
It requires participants to download software on their own computer, increasing confidence that participants have a standardized experience.

Inquisit enables researcher to see if a participant has navigated off of the experiment window.

It can be cost effective for running a lot of experiments with a lot of participants.
Cons
Many participants will not be willing to download new software to complete a study.
 
Using Inquisit requires knowledge of computer programming, as researchers write their tasks in a language similar to JavaScript.
 
It can be expensive to use in a less active research lab.

Pavlovia is also an experiment-hosting site for complex behavioral tasks. It supports tasks written in Python or JavaScript using the libraries PsychoPy, jsPsych, or lab.js.  Researchers can choose between paying for a license or paying per participant.
Pros
It can be easy to use if you already have experience with Python or JavaScript.

Other researchers’ code is often public.

Uses open-source programming languages and libraries, which means researchers can save their code and host the experiments elsewhere in the future.
Cons
Pavlovia requires comfort with computer programming languages and tools.

Researchers have to do the bulk of coding themselves, which can be time consuming.

The second step is to recruit people to participate in the study. Researchers with funding to compensate participants will often recruit from online participant pools. Popular platforms include Amazon Mechanical Turk and Prolific. Researchers at academic institutions with an undergraduate participant pool can disseminate their online studies through platforms specific to their school, such as Sona Systems. Another option is to use social media to recruit individuals who are not signed up for a participant pool.

Most hosting platforms will store the data collected. Depending on the platform, data can be downloaded in a variety of formats, such as CSV and SAV.

Amazon Mechanical Turk (MTurk) is the most popular recruitment platform for academics. Amazon founded Mechanical Turk to establish a workforce to complete discrete tasks that computers are unable to do.
Pros
There are a lot of workers on MTurk, making it possible to collect hundreds of responses within hours.
 
MTurk does not have any restrictions on participant payment.
 
Cons
Researchers have raised concerns about bots on the platform.
 
MTurk offers limited prescreening options and researchers must pay extra to use prescreening criteria.
 
The interface can be difficult to use, so many researchers use a platform called Cloud Research (formerly TurkPrime) to recruit from MTurk.
 

Prolific is an online participant pool established to support academic research and used only for data collection.
Pros
The staff at Prolific closely manage the participant pool, including verifying the phone number on each account and strategically releasing studies to participant accounts.
 
Prolific includes an extensive prescreening questionnaire, which researchers can use to target populations at no extra cost.
Cons
Minimum compensation rate of £5.00 (or $6.50) per hour.
 
As participants only sign up for the platform if they’re interested in research studies, there may be concerns about participant non-naiveté.

Sona Systems is a participant management system. Schools or departments typically purchase and manage a site for its members to use. Institutions most frequently use Sona to manage undergraduate student participant pools, though some maintain a pool of paid participants as well.
Pros
Sona allows a lot of control over participant management.
 
Paid and student pools can be managed on the same platform.
 
With a license, unlimited studies can be run without paying commission for each participant.
Cons
Using Sona requires an on-site administrator to manage the website.
 
Finding participants to sign up for the Sona pool rather than individual studies can be time consuming. 
 
It is cost prohibitive for individual researchers to obtain a license.
 


Barbara Toizer is a PhD student at the University of Kansas.

Announcement Categories: 
Member Updates

Share this page
 
Society for Personality and Social Psychology
1120 Connecticut Ave NW, Suite 280
Washington, DC 20036
(202) 869-3240
spspinfo@spsp.org
Facebook Icon Twitter Icon LinkedIn Icon
  • About
  • Connect!
  • Join/Login
  • Home
  • Members
  • Publications
  • Events
  • Giving
  • Awards/Grants
  • News
  • Resources
  • Careers
© 2021. Society for Personality and Social Psychology®. All rights reserved.

View our Privacy Policy here.