Research Scientist

The Research Scientist supports planning and execution of the MetaMetrics research agenda and product roadmap through the design, execution, and collaboration on applied research activities under the guidance of senior staff and leadership. The role focuses on reviewing relevant literature, developing study plans and materials, and conducting correlational and quasi-experimental studies for the purpose of demonstrating evidence for the validity and effectiveness of the Lexile and Quantile Frameworks, as well as new product offerings. The Research Scientist serves as a subject matter expert for research study design and educational outcomes for stakeholders within MetaMetrics as well as with educators and strategic partners. 

Essential Duties & Responsibilities

• Design and implement data-based case studies, correlational studies, and quasi-experimental studies with the Lexile Framework for Reading and the Quantile Framework for Mathematics. 
• Develop documents, including research protocols, literature reviews, and white papers, that clearly communicate information about studies, products, and assessments according to Standards for Educational and Psychological Testing (AERA, APA, NCME, 2014).
• Design data collection instruments, such as survey questionnaires, interview protocols, and other quantitative or qualitative collection instruments.
• Execute sophisticated statistical analyses to test hypotheses and yield insights from internal and external data sources according to various research designs.
• Communicate results and insights to diverse technical and non-technical audiences, including internal stakeholders, MetaMetrics partners, and professional conferences or publications.
• Collaborate with key stakeholders and subject matter experts on research design and feedback into MetaMetrics products and services.
• Perform other duties as assigned.

Supervisory Responsibilities  

None. Provides support only in accordance with the organization’s policies and applicable laws.

Education and/or Experience:

• Ph.D. in education measurement, evaluation, research methods, quantitative psychology, applied statistics, developmental/educational psychology, or a related field. Two years or more of research project management or relevant experience. 
• Demonstrated practical experience in research design, evaluation research, quantitative and qualitative research methods, and various statistical approaches. 

Computer Skills:

Extensive experience with word processing and spreadsheet software (e.g., Google Suite, Microsoft Office).

Experience with a research-oriented programming language (preferably R) for manipulating data and conducting statistical analyses.

Other Qualities:

• Language Skills - Ability to read, analyze, and interpret common scientific and technical journals and reports.  Ability to respond to common inquiries from researchers, customers, or members of the general public.  Ability to write presentations and articles for publication that conform to prescribed style and format.  Ability to effectively present information to colleagues, management, and/or public groups.
• Quantitative Skills - Ability to apply advanced statistical concepts such as multiple regression, hierarchical linear modeling, and classification analysis.  Ability to design and implement analyses related to the determination of test reliability and validity, analysis of variance, correlation techniques, sampling theory, and factor analysis. Familiarity with educational assessment concepts and psychometric methods, including but not limited to test construction, item writing, item response theory, and scale equating and linking.
• Reasoning Ability - Ability to apply principles of logical or scientific thinking to a wide range of intellectual and practical problems. Ability to deal with a variety of abstract and concrete variables.
• Publishing - A track record of peer-reviewed research publications and conference papers is preferred.