Skip to content

Rating tasks

A rating task shows each participant a batch of items (texts, images, products, stimuli) and collects the same set of rating questions about every item. Where a normal block asks its questions once, a rating block repeats its questions per item. Typical uses, idea evaluation, stimulus rating, content moderation studies, anywhere many items need ratings from many people.

The pieces

  • The rating block lives in the Builder and in Survey Logic like any block. The questions you add to it are the rating dimensions, each is asked for every item the participant rates. All standard question types work as dimensions.
  • Items live in the Ratings tab, one row each, with whatever data fields your design needs.
  • The display template defines what the participant sees for each item, an HTML template with placeholders that pull from the item's fields
{{ item.field_name }}

Leave it empty to use the default title and body layout.

Item fields

Items carry a field schema you control, each field has a name, label, and kind. Add fields manually in the Ratings tab or let a spreadsheet import extend the schema, see Importing items. Title, body, and external ID exist as built-in columns on every item.

Assignment settings

The Ratings tab configures how items are dealt out

  • Items per participant, the batch size each participant rates (default 10).
  • Assignment strategy
    • random, each participant gets a random batch.
    • sequential, items are dealt in order, filling earlier items first.
    • least rated, each batch picks the items with the fewest ratings so far, the strategy that evens out coverage fastest.
  • Randomize item order, shuffles the batch before display (always effectively on for the random strategy, meaningful for sequential and least rated).
  • Minimum ratings per item, your coverage target per item, the stats track progress against it.
  • Enforce capacity, when on, stops assigning an item once it has reached the target, concentrating remaining participants on items still short.
  • In-flight window (minutes), how long an assigned-but-unfinished batch reserves its items before they are considered available again (default 30), prevents abandoned sessions from starving coverage.
  • Submit button label, the continue button under the rating page.

Changes save automatically and participate in undo and redo.

Monitoring coverage

The Ratings tab and the rating block's card in the Builder show live statistics, item count, how many items have reached the coverage target, and total ratings collected.

Data

Every rating lands connected to its item and its participant. Exports include the per-item answers and the item's identifying fields, so analysis can group by item, by participant, or both.