AutoMan
AutoMan copied to clipboard
Human-Computation Runtime
The issue is that the client-side runtime expands nonterminals in the order that they appear in the generated Javascript code. Instead, nonterminals should be expanded using in topographical sort order....
To reproduce: 1. TP = FixedTimeoutPolicy 2. Wait for tasks to timeout and answer them in later rounds 3. During the approval phase, you'll get the error `Exception in thread...
When tasks time out, *ALL* tasks are re-created, instead of only timed out ones. For example, I have created 3 tasks, of which 1 is filled, and 2 times out....
This issue occurs when you call a Question function a large number of times (e.g., mapping a function across a large list) which results in an MTurk HIT with many...
great library. plans for support for HTMLQuestion? (possible pull request for this, as well as adding some more question types)
Right now we use a monte carlo calculator based on Emery's proof-of-concept C++ code that I transliterated into Java. The current calculators generally work well, but they are expensive which...
We currently use a dual approach to handle checkbox questions. Let's also randomize which boxes are checked and which are not. We can decide whether we can then dispense with...
The test suite is incredibly useful, but only when both the exact form of the question and the outcome are both known. When pulling data from online sources (web queries;...
AutoMan’s memorization feature is incredibly useful when doing debug cycles. An AutoMan program may invoke other services that cost money (e.g., Bing) and should be conserved. A general-purpose memoization feature...