Job Description

One of our government clients is looking for a Psychometrician (Planning, Designing, and Conducting Assessments)
Length: 2 Years contract, with high possibility extensions
Location: Toronto, ON - Remote
Working hours: Monday to Friday, 8:30 a.m. to 5:00 p.m.

DESCRIPTION:
To provide leadership and psychometric expertise in planning, designing, and conducting psychometric/statistical analyses of provincial assessment and field test data for multiple and large-scale provincial education assessments delivered by our office to design and conduct psychometric research studies and present results within the agency and at regional, national, and international conferences and publish in professional journals to improve current practices and contribute to knowledge in the field of psychometrics and educational measurement.

KEY RESPONSIBILITIES:

1. Research and Analysis

• Designs, conduct and/or participate on research projects and prepare research reports.
• Publishes and presents research results internally and at regional, national, and international conferences.
• Evaluates the application of current research findings and innovation to Ontario provincial assessments to ensure that psychometric procedures used are consistent with recent research.
• Establishes comparable score results across years for multiple large-scale provincial assessments, ensures fairness for all students and monitors student progress.
• Designs and conducts psychometric and statistical analysis of operational data using a variety of methods.
• Plans and manages all phases of psychometric activities, including timelines, schedules, and deliverables.
• Makes recommendations to the Executive Team on provincial cut scores.

2. Test Design and Development:

• Provides technical input to the building and maintenance of large-scale test item pools and ensures test items meet specified statistical and psychometric criteria.
• Participates in the design and development of reliability indices to examine/determine the soundness of test data and the accuracy of reports for schools and boards. Identifies areas for test design improvements for the next assessment cycle.
• Designs procedures, conducts analyses of field test data, interprets, and evaluates results and makes decisions about items to be included in future tests and collaborates with the Assessment team on test form construction.
• Develops specifications for scoring centre reports and guidelines for interpreting statistical results; documents all psychometrically related procedures/processes for inclusion in annual technical report.
• Prepares and presents material s to and works with the Psychometric Expert Panel and implements panel recommendations when appropriate.

3. Guidance and Training

• Provides expertise and advice to management and staff on psychometric issues related to the development, implementation and ongoing monitoring/review of quality control procedures and processes for all phases of the data capture and analysis process for all education assessments.
• Analyzes and provides expert advice and recommendations related to the effectiveness, validity and reliability of assessment test questions, the relationship of test components, and the alignment between assessments.
• Provides support and training to management/staff, interns, and research assistants on psychometric methods for educational assessment design and analyses.

FACTORS KNOWLEDGE / SKILLS:

• Education assessment theory, principles, methods and processes, relevant legislation, guidelines and professional standards and educational psychometrics and statistical measurement and analysis to conduct psychometric review and analysis of assessment designs, and data systems, processes, and results.
• Application of psychometric, quantitative, and statistical methods and techniques including item response theory (IRT), item calibration, score equating, Hierarchical Linear Modeling (HLM), collusion analyses, statistical procedures for dealing with missing data, etc.
• Ontario\'s education system, school and Board structure, Branch mandate, policies, and programs to provide technical input that can impact on assessment programs and policies.
• Project management and research skills to conduct /lead research and projects related to educational measurement/psychometrics.
• Assessment instrument design/development and data collection/analysis systems and processes to provide technical input assessment development and data management/control systems/processes.
• Using computer programs for the administration and scoring of psychological tests, write formal assessment reports and correspondence, conduct research, and analyze data. Programming skills and application of computer software such as: SAS, SPSS, MATLAB, SPLUSBILOG-MG, MULTILOG, LISREL, etc. to conduct analyses, interpret program output and communicate results.
• Oral communication and presentation skills to provide technical advic

...

e to management/staff and external contacts; write, present, and publish research reports and papers.

Interpersonal / Influencing Skills:

• Consultation skills to provide psychometric leadership within the agency, with other ministries, jurisdictions, external experts, and stakeholders on
• provincial assessments.
• Advisory skills to make recommendations that have a direct impact on decisions made by senior management and to provide psychometric and
• statistical expertise.
• Collaboration skills to work on projects with various departments, researchers, scholars in residence, external consultants, and vendors.

Analyzing / Problem Solving Skills:

• Analyzing and problem-solving skills to:
• Conduct psychometric/statistical analyses and interprets/evaluates results, ensuring accuracy of assessments.
• Analyze and evaluate the impact of demographic and statistical trends on student achievement.
• Conduct analysis to resolve issues related to students\' appeal process.
• Determine the information required, analysis and format of information to inform system partners of the status of system strategies and of current trends.
• Determine the risk assessment formula upon which inspectors\' work plans are based.
• Design and analyze program performance measures.

Decision Making / Responsibilities:

• Providing psychometric expertise for assessment development, implementation and data analyses and reporting.
• Conducting psychometric and statistical research and analyses on which student outcomes are fully dependent.
• Providing technical input to assessment operational systems, procedures, and processes.
• Designing, evaluating, recommending, and implementing new psychometric procedures and data analysis methods.
• Writing, publishing, and presenting research reports and papers internally and at regional, national, and international conferences.
• Has latitude to: devise new psychometric procedures and data analysis methods that impact on programs, practices and policies; provide specialty psychometric expertise to assigned areas of assessment planning, design, development, implementation, analysis and reporting; conduct psychometric/statistical analysis on assessment item content, and providing technical advice to assessment teams on test design/development; conduct research/analysis of assessment data systems design, data capture/analysis processes and quality assurance procedures and provides technical advice/recommendations to management/staff in the Data Management and Analysis Unit; conduct research and psychometric analysis of assessment and field test results and provides recommendations to improve the quality, validity and reliability of data in future assessment projects.
• Decisions are guided by: the Director and professional standards and EQOA mandates, policies, broad goals and objectives for the development/conducting of assessment projects and the analysis of assessment data results.

Contacts / Stakeholders:

• Branch management/staff and staff in other ministries to provide psychometric expertise related to assessment design/development, statistical
• analysis, and reporting.
• Staff in other ministries to provide information related to assessments, statistical analysis methods, and assessment project results.
• Branch and inter-ministry technical committees and task groups.
• Senior personnel of schools and boards, to provide information, advice and support related to the psychometric design, application, and interpretation
• Scholars-in-residence, advisors from Psychometric Expert Panel and other psychometricians and researchers to consult on psychometric issues.
• Representatives of other jurisdictions and external contractors/vendors to share/exchange information.

Guidance / Supervision:

• Provides psychometric expertise, advice, interpretation and training to Senior Management, staff, interns, and research assistants on psychometrically [1] related matters.
• Provides psychometric leadership to ensure compliance with psychometric practices.

DEMANDS AND PRESSURES:

• Frequent unexpected deadline modifications and demands on short notice, e.g., respond to requests for information and analysis, with tight time
• pressures.
• Daily conflicting work demands, e.g., multiple concurrent requests from different areas of the ministry, requiring incumbent to balance priorities.
• Daily conflicting work demands, e.g., multiple concurrent requests from senior management, priorities set by senior management.
• Occasional requirement to work beyond normal hours to complete work without interruption.

Mental / Sensory:

• Frequent unexpected deadline modifications and demands on short notice.
• Daily conflicting work demands requiring balancing of priorities.
• Occasional requirement to work beyond normal hours.
• Daily periods of concentrating intently to, e.g., write computer code to extract required information.

Conditions / Environment:

• Work is performed in a typical office environment.

URGENT: Please read the job description above. If this interests you, apply to the job with your most updated resume, including your contact number and email address.

The recruiter in charge of this role is Sunita.

If you do not think you are a match for this opportunity, but know someone who is, feel free to forward this job description to them and you will be eligible for a referral bonus upon a successful hire.

Please note that this is the most up to date version of job description available at this time - During Client Interview you will receive additional information - variance may apply!

Please note: Adherence to our end client\'s vaccination policy is a requirement.

Please visit the TEAMRECRUITER website to review other CAREER OPPORTUNITIES!

Jobboom