Associate Manager, Rater Training

Company Description

***Please submit Resume and Cover Letter when applying***

The Center for Applied Linguistics is a nonprofit organization promoting access, equity and mutual understanding for linguistically and culturally diverse people around the world.

The mission of the Center for Applied Linguistics (CAL) is to promote language learning and cultural understanding by serving as a trusted source for research, resources, and policy analysis. Through its work, CAL seeks solutions to issues involving language and culture as they relate to access and equity in education and society around the globe.

CAL is located in Washington, D.C. For this position, the employee may choose to work in their preferred combination of in person at the D.C. office in a hoteling capacity, or remotely (up to 100% remote). CAL does not compensate or reimburse candidates for relocation expenses. This position is not open to candidates residing in New York, New Jersey, Pennsylvania, Texas, California, or the U.S. Territories.

Job Description

The Associate Manager, Rater Training plays a crucial role in managing the creation and refinement of rater training and scoring materials for large-scale English language assessments. This position requires a dynamic individual with a strong background in educational assessment and project management, and a commitment to improving educational outcomes for K–12 English learners.

The Associate Manager, Rater Training will work closely with content experts and project stakeholders to ensure that high-quality training materials (e.g., anchor responses, training responses, score explanations, scoring guidance) are created following best practices, ensuring the reliable, consistent scoring of writing and speaking tasks on high stakes assessments.

This role involves balancing strategic oversight and planning with detail-oriented review and editing, as well as contributing to the continuous improvement of work processes to make a meaningful impact on the educational experiences of multilingual learners.

General

• Create and update procedures for developing rater training materials
• Create and update general rater training presentations
• Monitor and update team access to scoring resources
• Participate in special projects related to the training of test raters and scoring of constructed response tasks
• Collaborate with test development managers to document observations about task performance, including synthesizing rater feedback on tasks and communicating key takeaways to the larger team

Field Test Scoring

• Select anchor responses and create training response sets using response lists prepared by test development staff
• Review, revise, and approve written score justifications
• Review and revise task-specific scoring guidance, in collaboration with test development managers
• Ensure …