Archive : Category

How to Get Results You Can Trust with Psychometric Assessments

POSTED ON March 4th  - POSTED IN Blog

Psychometric Assessments

Do test scores truly indicate a person’s ability, or accurately reveal their personality? Psychometric assessments are used to make decisions about employees, so it is essential that scores really do indicate a person’s likely behaviour. Accuracy of results is affected by both the test itself and the way in which it is administered and interpreted. Here’s how to ensure scores can be trusted when you use psychometric assessments:

Stage 1: Preparation for Testing and Maximizing Candidate Engagement

Maximizing engagement means motivating the candidate to work earnestly and honestly as they complete their test. People need to see the value of putting effort into testing, and to consider potential outcomes of psychometric assessments worthwhile.

To maximize engagement, make sure that the process and purpose of the test is understood. Build trust on behalf of the candidate that assessment will be accurate, fair, and useful in identifying the best applicants.

If you’re familiar with psychometric qualities, you may recognize this as another way of saying the test should be standardized, reliable and valid. It’s up to you to communicate these qualities to your test takers in non-technical terms they’ll easily understand.

Consider candidate reactions to assessment, too. People are most likely to engage with a test that has both face and faith validity. Face validity refers to whether or not the test appears to be a good measure for its purpose. Does it look the part? Faith validity is the test taker’s belief that the test really does what it claims to. Again, this is about the person’s impression of the measure. Face and faith validity are both subjective reactions that can make a significant difference in how a test is undertaken.

It’s also helpful to explain clearly why candidates should respond accurately and truthfully when completing a test. This can include emphasizing why and how the test results will be used. For example, you can let the test taker know that scores will help assess whether he or she is a good match for a position. You can explain how this benefits the individual as well as your business.

Measures to prevent cheating, faking or lying on psychometric assessments can also be incorporated. There’s a lot that can be done here, ranging from requiring a signed honesty contract to analysing response patterns and statistics for computerized tests. An honesty contract requires signed agreement from the test taker on conditions such as completing the assessment independently, and responding truthfully. If tests are administered on-line, potential analyses of responses include overall time taken for the test, time spent on each item, and incorrect vs.correct answers to questions which vary in difficulty. Sanderson, Viswesvaren and Pace (2011) provide more detail in their discussion of ways to detect cheating on unproctored internet tests. For complex personality assessments, subscales are typically included to detect social desirability or faking. Scores on these subscales are examined to evaluate potential misrepresentation when answering test questions.

Stage 2: Administering the Test

The way a test is administered affects the accuracy of results. Consistency and control over the assessment processes help to keep unwanted influences from affecting test scores.

“Measurement error” is the term used to describe unplanned or uncontrolled influences on test scores. Anything about testing circumstances may fall into this category. Losing power when completing an on-line assessment is a clear example. Other measurement errors could include a noisy or badly lit room, an unprepared administrator, or an exhausted test taker.

Psychometric assessments typically have specific and standardized instructions for administration. These may include time allowed, a script for introducing the test, appropriate methods for administration, and ways to maintain security and maximize honest responding. Strictly adhering to these guidelines helps to ensure recommended procedures for testing are in place, and maximizes the opportunity for accurate measurement.

Stage 3: Scoring and Interpreting Results

Verify Apparent Test Scores

We talk a good deal about the need to treat scores as hypotheses on our Test User courses. It is essential that apparent results are supported with verifying information. For selection, this could include examining competencies through structured interviews. Ratings from others who know or work with the test taker can be used as part of 360 degree feedback for development. Candidates themselves can provide useful perspectives, including the way that they approached assessment, and how they feel they performed. This may take place through an interactive, two-way discussion following assessment. Information shared by the individual can help to indicate whether they were focused, motivated and optimally engaged in test taking. If so, their scores are more likely to indicate their true attribute levels.

Use Confidence Intervals to Interpret Results

Tests are not perfect, even under optimal conditions for assessment. By considering confidence intervals surrounding test scores, you can more fairly and justifiably (or legally) make decisions about results.

Here’s an example: Two candidates are being considered for progression to the interview stage of selection decisions. Steve’s verbal ability test score is 53. Frank’s score on the same test is 57. Are these scores different enough to justify choosing Frank for the job? If you are not sure, image how Steve would feel, or what his reaction would be!

Confidence intervals are constructed based on a statistic called the Standard Error of Measurement. They provide a range of scores that likely include an individual’s actual ability or attribute level, rather than assuming that a single score point (e.g., a 57) is completely accurate. Using confidence intervals increases the chance that you have really “captured” or identified the person’s true score. For example: You may not be completely certain that Mary’s score of 70 precisely indicates her computational skills, but you can be 95% certain that her numerical skills fall within the range of 63 to 77.

SxD trainees learn how to compute and use confidence intervals in our Test User Ability course. Alternately, we offer advice and consultation to anyone working with employment testing on this essential aspect of interpreting scores.

Ensuring accurate psychometric assessments requires planning and preparation across the stages of test set-up, administration and interpretation. By incorporating the suggestions above you can best achieve test results that you can trust. After all, isn’t that a key goal for workplace testing?

Wishing you happy and accurate testing!




Sanderson, K.R., Chockalingam, V., & Pace, V.L. (2011). UIT Practices: Fair and Effective? The Industrial-Organizational Psychologist, 48(3), 29-37.

Psychometric Testing in Selection – How to Maximize Candidate Reactions

POSTED ON February 10th  - POSTED IN Blog

Psychometric Testing in Selection - How to Maximize Candidates' Reactions

Just hearing the word test can evoke anxiety for people. Test implies that your performance is going to be judged—that you need to pass, and that you can fail. With psychometric tests widely used in hiring decisions, news of testing is a common experience for job candidates. A negative reaction to a selection method like testing can influence the accuracy of results (Nikolaou, Bauer & Truxillo, 2015). It may also lead to poor views of the hiring company.

Accurate or valid scores depend on persons being focused and motivated when completing tests. This becomes more likely if they buy-in to the assessment, trusting that it’s appropriate and fair. The way applicants are treated during psychometric testing can affect their views of the hiring company. If the process is viewed as unfair, the reputation of the company may suffer. It may become difficult for the business to attract strong candidates going forward. There may also a be a greater risk for legal challenges to hiring decisions.

If the first contact your business has with a potential employee is to request the completion of psychometric tests, it’s up to you to make a positive impression about assessment. Here are six ways to ensure the best reaction to the news, “There’s going to be a test…”

  1. Explain the purpose of testing and how results will be used.

If you don’t tell candidates exactly why you’re using tests, what you intend to measure, and how their results will fit in to the selection process, you’ll leave them guessing. You’ll also risk demonstrating a serious lack of respect for the candidate. A better approach? Remove all mystery surrounding assessment. Convey to the candidate the careful planning that goes into the assessment portion of recruitment, and that it will be professionally conducted. Take the time to ask if there are any questions, and if there are, be sure the candidate understands your answers.

  1. Consider the face validity of the instrument you’re using.

Be sure the test you’re using looks the part. Does it appear to measure what it’s intended to, and what you’ve told the candidate it is assessing? Reactions to a test will improve if the candidate feels it is appropriate and job-relevant. A mechanical engineer would question being asked to complete a clerical skills test, as an extreme example. How might a retail associate respond to a test of abstract reasoning?

  1. Assure candidates that testing will be fair.

Candidates should be assured that each person taking a test has the same opportunity to perform at their optimal level. Be able to explain what processes you have put in place across administration, scoring and interpretation to guarantee fair assessment to all. For example, is standardised timing in place? What about the instructions? Will computerised scoring be used to minimize human error? Will test performance be evaluated separately from candidate background and demographic data?

It is essential that candidates are asked about any unusual needs or special requirements they may have for workplace psychometric testing, and that these are considered in planning administration. Aside from addressing legal and ethical requirements, this is consistent with ensuring respectful and professional candidate treatment.

It may be helpful to have candidates sign an honesty contract prior to testing. An honesty contract provides an opportunity to clarify that they need to complete the test independently and as instructed, and the implications of failing to do so.

Finally, fairness will be partly judged by candidates according to the communication they receive about test results. This is referred to as procedural justice (Gilliland, 1994). It can be improved by explaining to candidates how their test scores will be evaluated, what type of information they will receive back about their performance, and how this will be communicated. For example, will they have the chance to discuss their performance during a feedback meeting? Will they receive a detailed written report of their results? Can they find out how they performed relative to other candidates?

  1. Give candidates a chance to complete sufficient practice items and become comfortable with the testing format.

Most tests include examples of sample items at the beginning. Instruct candidates to work through these items carefully, so they’re absolutely certain they understand how to find the answers or complete the responses. If testing remotely, provide candidates with a way to contact the test administrator with any questions. Knowing what to expect and how to proceed allows candidates to focus their attention on answering the questions. It can also help to alleviate anxiety, and to boost confidence as testing begins.

  1. Address data protection.

Explain to candidates how, where, for how long and in what form their data will be maintained. This is consistent with upcoming GDPR legislation going into effect on 25 May 2018. It’s up to you to ensure the rights of candidates regarding the protection of personal data are guaranteed.

  1. Explain to your candidates their rights related to psychometric testing.

Best practice in testing means guaranteeing that test takers’ rights are respected. These include areas like understanding precisely how test results will be used, and knowing how inquiries or complaints about testing will be handled. Explain to your candidates what their rights are, and the steps you are taking to ensure these throughout the testing process. This will demonstrate your commitment to treating those you are assessing, and their personal data, with respect, dignity and complete confidentiality. The BPS provides a useful summary of test taker rights in their Test Taker’s guide available here.

It takes time, effort, thought and planning on the part of the testing professional or hiring organisation to address each of these areas. But the potential gains in candidate trust, engagement and motivation will result in assessment that accurately and truthfully reflects the potential of your job candidates. By communicating the good news about psychometric testing, you can help ensure that your most promising prospects successfully complete the recruitment process.

References and readings

Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691-701.

Nikolaou, I., Bauer, T. & Truxillo, D. (2015). Applicant reactions to selection methods: An overview of recent research and suggestions for the future. In I. Nikolaou & J.K. Oostrom (Eds.) Employee Recruitment, Selection, and Assessment: Contemporary Issues for Theory and Practice (pp. 80-96). New York, NY: Psychology Press.

Would you like to find out more about candidate reactions to the selection process? You can find a useful White Paper from the Society for Industrial and Organizational Psychology here.


Learn to expertly use psychometric testing as part of the hiring process through Selection by Design’s training for BPS/EFPA Occupational Test User qualifications. We are enrolling now for our next courses!

Emerging Trends in Psychometric Testing and Workplace Psychology

POSTED ON January 23rd  - POSTED IN Blog

Emerging Trends in Psychometric Testing and Workplace Psychology

The BPS Division of Occupational Psychology annual conference was held 10-12 January in charming Stratford-upon-Avon. This year’s theme, ‘Evolution Evolution +/or Revolution: Changing with the Times’, focused on celebrating the value Occupational Psychologists offer. With no shortage of informative talks and engaging speakers, this was a great opportunity to find out about new and emerging trends in workplace psychology.

Several of the presentations and workshops focused on psychometric assessments. I’d like to share with you some of the themes I noticed among these.

1. An extensive and widely varied range of assessments is now available on the market.

The many test publishers present at the conference were a great source of information on new test development and directions. Tests of abilities are now a mainstay in the realm of psychometric testing, covering the traditionally measured verbal, numeric and logical areas, as well as specialized skills. There is a growing emphasis on more in-depth assessment including tests of personality, strengths, and emotional intelligence. These may be useful in identifying work roles and environments that optimally suit an individual, or provide insight for personal growth, well-being and performance.

There are many different formats for reports being offered by publishers today. Depending on the test, it may be possible to obtain combined results for work team members, or multiple ratings of an individual, as with 360 degree feedback. Choice of which instrument to use may be influenced by the report options available.

2. Research on the validity of tests

Knowing how well tests predict work behaviours is at the heart of justifying psychometric assessment for employment decisions. Validation research has a long-standing history, and it was fantastic to see the results of such studies being presented at the conference. The kinds of questions being examined include how well ability and personality tests related to competencies like problem solving, risk taking, creativity or motivation.

3. Testing on the go

There is strong interest among occupational psychologists in the potential for assessment through mobile apps. Psychometric tests that can be taken on smartphones or tablets offer flexibility and convenience. The technology for this has now arrived, and companies are beginning to offer this option. Related areas for research include comparability with traditional testing formats, consumer reactions, and potential threats to security.

4. The potential of gamification

Gamification is gaining attention as an alternative means of assessment. The potential for measuring areas such as risk taking, decision making and cognitive abilities in an engaging and interactive way holds great potential. Advantages may include greater accuracy than that achieved through self-report personality measures or typical ability tests. This is because reaction times, or responses to presented stimuli can be recorded with high precision, and over multiple trials within one single game. Also, candidates may have a positive and enjoyable assessment experience, possibly influencing impressions of the organisation. With gaming assessment applications now being developed, on-going (and fun!) research into their validity and usefulness is set to continue.


Psychometric testing has grown tremendously, and is now entrenched in employee selection and development. The widespread use of ability testing is now being followed by more sophisticated and in-depth measures. Research on the uses for and outcomes of workplace testing continues. Tests themselves are becoming more accessible, and there is a new focus on the individual’s reaction to assessment. New technology may well change the way workplace tests are administered. This is an exciting time to be working with psychometric tests!

– Barbara

If you’ve yet to complete the training required to obtain BPS/EFPA Test User qualifications, check out our recent blog series on the benefits of doing so, beyond access to psychometric tests. Part 1 addresses lesser know benefits of Test User ability training, while Part 2 covers Test User personality. Selection by Design offers Test User training throughout the year. You can find our training schedule and prices (including discounts for students) here

Tests You Can Access with Test User Qualifications (BPS/EFPA )

POSTED ON November 6th  - POSTED IN Blog

BPS/EFPA Test User Qualifications: Which Tests Can You Access? -

We receive a lot of queries on which tests can be accessed and used once you have obtained Test User qualifications. Recently I came across a new and valuable reference for identifying and locating accessible tests: the newly published British Psychological Society (BPS) “Tests available to RQTU members.” You can find this on their Psychological Testing Centre here.

Whether you’re an experienced psychometrician or just beginning to work with assessments, this is an extraordinarily useful source of information. A summary of tests that may be used with each of the 3 occupational Test User qualifications is presented, including Assistant Test User, Test User Ability and Test User Personality. A brief synopsis of what each test measures is included, along with publisher details. If you know which attributes you need to measure, options are clearly and concisely listed for you.

More details on the background, uses and psychometric qualities of the tests can be found in the BPS Test Reviews. Full Test Reviews are free to RQTU members. The “Tests available to RQTU members” resource includes direct links to available, instrument-specific BPS Test Reviews. It’s a very easy and efficient system for exploring qualities of any measures you’re considering using.

It is well worth having a look through this test listing. I think you’ll find it a great addition to your psychometric testing resources.

Happy testing!

Dr. Barbara Caska

If you’ve yet to complete the training required to obtain BPS/EFPA Test User qualifications, check out our recent blog series on the benefits of doing so, beyond access to psychometric tests. Part 1 addresses lesser know benefits of Test User ability training, while Part 2 covers Test User personality. Selection by Design offers Test User training throughout the year. You can find our training schedule and prices (including discounts for students) here

Back to Top