Job details

Psychometrician I

About the Team

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. College Board’s Psychometrics Team provides its partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board’s mission of access and equity in Education.

About the Opportunity

As Psychometrician I, you will conduct routine psychometric operational and research work for the College Board SAT Suite of Assessments. Tasks include developing, modifying, and running code to conduct routine analyses, interpreting results, raising issues/making recommendations based on results. Analyses include procedures such as item calibration, producing reports using classical and item response theory models, creating and reviewing test documentation materials, facilitating standard setting, drafting papers and reports, and presenting findings to internal and external audiences. These tasks are carried out independently or with senior staff. The role includes providing psychometric support for other College Board Assessment Programs (ACCUPLACER, CLEP, and AP) as needed.

In this role, you will:

Operational Psychometrics (70%)

Design and execute routine operational psychometric analyses for College Board assessments as assigned, including but not limited to item calibration and pretest analyses, DIF, and standard-setting, using standard and customized psychometric analysis tools and statistical software packages

Lead the development and improvement of operational processes
Independently conduct quality assurance and quality control procedures and identify opportunities for improvement of quality and efficiency of workflow
Independently develop software programs, documentation, and implementation of statistical and reporting systems
Responsible for the design, quality, and execution of technical reports for internal and external clients

Psychometric Research (20%)

Independently conduct research consistent with the research agenda for the program and Psychometrics
Create and deliver presentations of research you have led to internal and external audiences
Have papers accepted to major measurement conferences (such as NCME) where you are the first author and primary presenter at the conference
Be a named author in a professional publication in a peer-reviewed journal

Relationship Management (10%)

Build good working relationships with colleagues across psychometrics that are collegial and productive and show respect and appreciation for those you collaborate with
Work collaboratively with program staff and with committees (e.g., exam committees and technical advisory committees)
Serve as a mentor to interns

About you

You have:

A Doctorate in psychometrics, educational research, educational measurement or a related field
At least three years of post-PhD experience in the field of psychometrics
Experience in an operational setting with item response theory, classical test theory, equating, item and test analyses, DIF, standard setting, and other psychometric analyses is required

Operational experience with multiple statistical analysis tools (e.g., SAS, R, flexMIRT, GENOVA, and Python)
Demonstrated ability to design and conduct psychometric analyses, research studies, and complex statistical analyses
Proficiency with other statistical analysis and programming tools, such as: R, flexMIRT, C++ or Python
Ability to quickly and accurately work with new datasets and assessment data.
Ability to work in a collaborative environment that emphasizes quality, rigor, adaptability, and critical thinking

Ability and interest to apply evolving technologies to measurement challenges and issues
Excellent organizational, time management, and detail orientation skills
Excellent oral and written communication skills, including technical presentation, public speaking, interpersonal, and writing and editing skills
Strong problem-solving skills
Ability to travel up to 4 times a year
Authorized to work in the United States

About Our Benefits and Compensation

College Board offers a strong compensation and benefits package that attracts top talent looking to make a difference in education.

Our robust benefits package includes health, dental, and vision insurance, tuition assistance, paid time off, paid parental leave, retirement benefits with a generous matching program, and more.
We reward performance through annual bonuses and provide opportunities for salary growth over time through base compensation increases, merit raises and promotions.
We believe in compensating staff members fairly in relation to each other, their qualifications, and their impact. The salary range for a new employee in this position is $96,000 to $155,000. The salary offer of an individual candidate within this range is specific to their location and qualifications.
Each salary offer is determined carefully using internal and external benchmarking and adjusting for the candidate’s location. You will have an opportunity to discuss salary in more detail after you begin the application process.
As a self-sustaining non-profit organization with global impact, College Board offers a job that matters, a team that cares, and a place to learn, innovate and thrive!

#LI-REMOTE

#LI-GG1