turkle icon indicating copy to clipboard operation
turkle copied to clipboard

Versioning of templates

Open hltcoe-bot opened this issue 4 years ago • 2 comments

  1. Keep each version of the template for a project with a unique identifier
  2. Record the version of the template used for each task
  3. Include this template ID in the output CSV file
  4. Change the batch download to include the CSV file and all templates used for that batch

charman vandurme I believe this summarizes what we discussed through email.

Poster: Cash Costello id: 156

hltcoe-bot avatar Aug 07 '20 14:08 hltcoe-bot

Item 2 should probably be:

  • Record the version of the template used for each task ASSIGNMENT

When a user has requested redundant annotations, it's possible that the same Task will be displayed with different versions of the instructions to different workers (!!!).

When a user is piloting a task, I think it's very useful for them to be able to iterate on the template language without having to constantly republish batches. But for real data collection, they shouldn't be touching the template.

Poster: Craig Harman

hltcoe-bot avatar Aug 07 '20 14:08 hltcoe-bot

mentioned in issue #160

Poster: Craig Harman

hltcoe-bot avatar Aug 07 '20 14:08 hltcoe-bot