Create and release your Profile on Zintellect – Postdoctoral applicants must create an account and complete a profile in the on-line application system. Please note: your resume/CV may not exceed 2 pages.
Complete your application – Enter the rest of the information required for the IC Postdoc Program Research Opportunity. The application itself contains detailed instructions for each one of these components: availability, citizenship, transcripts, dissertation abstract, publication and presentation plan, and information about your Research Advisor co-applicant.
Additional information about the IC Postdoctoral Research Fellowship Program is available on the program website located at: https://orise.orau.gov/icpostdoc/index.html.
If you have questions, send an email to ICPostdoc@orau.org. Please include the reference code for this opportunity in your email.
Research Topic Description, including Problem Statement:
Recent research found two rapid, reliable ways to increase the accuracy of answers to challenging factual questions, particularly when experts disagree: (1) Aggregation of answers from individuals working independently. One study (Kosinski, 2012) began with answers to an IQ test taken by individuals with an average IQ of 120. Mechanically selecting the most common answer to each question produced a “group IQ” of about 150. (2) Brief discussion between two people who disagree on the answer. In one study by Chen (2019) used this method to increase the rate of correct answers from 67% to 98.8%. Research is needed to develop an effective technique for combining aggregation of answers with small-group discussion. Any technique should be tested on increasingly difficult questions starting with multiple-choice answers provided along with the questions, then developing a way to apply the technique to non-multiple-choice questions. Initial answers from many informed participants could produce a set of plausible multiple-choice answers to each question and a technique to be applied to those questions. Any developed technique should be easy and natural for busy professionals to use on the job. It should require no formal training or technical knowledge. It should be effective on a wide variety of factual questions, including predictions.
Relevance to the Intelligence Community:
Intelligence analysis often involves making judgments on factual questions. An effective method to help analysts perform this task quickly and accurately will strengthen intelligence analysis and provide better support for policy-makers.
Key Words: Aggregation of Opinion, Crowdsourcing, Reasoning, Expert Elicitation, Human-Computer Interaction