You need to assess the clerical skills of a pool of 60 applicants for an administrative assistant role. Psychometric testing seems like the best approach. But which tests should you use?

Whether you are an experienced psychometric Test User or initially exploring the potential benefits of including test results in an assessment, accessing information on available tests is essential. Reviews of critical technical and practical test qualities can be used to evaluate and compare instruments. Locating interpretable summaries of this kind of information however can be challenging.

Here are five useful resources to help you identify and compare commercially available psychometric tests.

  1. Tests available to RQTU members

Those who have completed the BPS Test User qualifications and are members of the Register of Qualifications in Test Use (RQTU) will find this list of tests available to them for purchase incredibly useful.

This impressive compilation offers many options to measure specific abilities, aptitudes, characteristics and qualities.

  1. BPS Registered Test reviews

Also available through the BPS website, test-specific reviews cover key areas to consider in comparing tests. Once potential tests for your specific purpose have been identified, you can refer to the BPS registry of test reviews to gather extensive data on the technical merits and practical details for each.

Tests included in this registry have been voluntarily submitted by test creators, publishers and distributors throughout the UK. Reviews are conducted independently and without commercial interest, using the European Federation of Psychologists Association Review Model for the Description and Evaluation of Psychological Tests (The EFPA Review Model).

To be awarded BPS Registered Test status, a test must demonstrate the ability to meet EFPA standards, which cover aspects such as the test’s technical and user documentation, quality of materials, validity, reliability, and normed comparison groups. The test reviews include ratings on each of these dimensions, allowing for clear comparisons across different measures.

Members of the RQTU and Chartered and Graduate members of the BPS may receive full reviews of tests free of charge. Non-members may access summary test reviews at no cost, and full reviews of tests may be purchased (details here).

  1. Buros Mental Measurements Yearbooks

If you need to evaluate tests considering a broader context, you will find the Buros Mental Measurement Yearbooks (MMY) a key resource.

The MMY is a series of test reviews published every three years by the Buros Center for Testing. Each volume includes thousands of test reviews, providing descriptions and professional evaluations for each. Tests included are commercially available, published in English, and newly revised or widely used since their last MMY listing. Reviewed instruments span the areas of occupational, educational, forensic and clinical assessment.

Each entry provides a comprehensive overview of the measure: test name; author and publisher; intended population; publication dates; forms and prices; plus additional information on reliability, validity, norming data, scoring and reporting services.

If the hardcopy MMY volumes are not readily available to you, Buros Test Reveiws Online is a great alternative.

  1. Test Publishers

Test publishers often have hardcopy or online catalogs of instruments on offer for purchase. Once you have identified a few assessments that may meet your needs, it can be helpful to contact the publishers to request further details and current pricing.

The BPS offers an informative listing of UK test publishers. If you’ve completed Test User training with SxD, you’ll already have received contact details for publishers we regularly use. You can also find additional links to test publishers here.

  1. Association of Test Publishers

It might be helpful to look at the Association of Test Publishers website for a broader listing of test publishers and distributors. This is a non-profit organization; ATP members include leading assessment providers and publishers in the testing industry.

These five information sources are great references for exploring your test options and drawing comparative data to aid in your choice of instruments.

If you currently hold psychometric testing accreditation, you may well already qualify to purchase the tests you wish to use. Otherwise, you have the option of completing required training, or hiring professional psychometrics consultants such as SxD to assist with your testing needs.

Best,

Barbara

 

The 25th May 2018 has passed. Where do we go from here?

The new regulation has resulted in keen awareness of the kinds of personal information being gathered, processed and stored by businesses and organizations. For many, the number of companies getting in touch to request updated contact information came as a surprise and raised a lot of questions: Did I freely give my personal data to so many organizations? What was done with it?

The GDPR increases awareness and control over how individuals’ private data may be used. This is a long overdue change, given the amount of data amassed by organizations and the prior limits in accountability to persons sharing their details.

Psychometric Testing and GDPR Compliance

The new legislation has important implications for those of us working with psychometric tests. If you conduct testing for businesses and clients, or process assessments at the request of others, you work with personal data.

While the GDPR is consistent with many existing psychometric test user’s privacy policies, very specific processes and guarantees of individual rights are now required. It is a good idea to review your own data privacy and security policy to evaluate consistency with the new legislation.

More than just ensuring legally required procedures are in place, compliance with the new legislation may require a change in perspective. Fulfilling the new obligations to protect individual data will require dedication and effort. Both businesses and individuals will continue to learn about their rights and responsibilities under the new legislation. Compliance with the GDPR is an on-going process, rather than an accomplishment.

With this in mind, we’ve put together some useful resources related to psychometric testing and GDPR compliance. Even if you were well-prepared for the 25th May, these references may help you in moving forward:

  1. The General Data Protection Regulation (GDPR) – FAQs

A useful webpage summary from the British Psychological Society of the key changes with the GDPR legislation, including individual rights, the data protection principles and definitions of data subjects, processors and controllers. Links to further useful sources of information are provided.

  1. Recruitment through the minefield of the GDPR

This brief paper by Andreas Lohff from Cut-e presents considerations for recruiters related to the GDPR. It includes discussion of the rights of job candidates.

  1. Data Protection Commission – Ireland

The website for the Data Protection Commission provides specific, highly detailed implications of the GDPR for individuals and organizations. It contains useful links and will be regularly updated, so may be a good resource for tracking new developments.

  1. Information Commissioner’s Office – UK

This website provides extensive and easily navigated information on all components of the GDPR. It is a thorough and highly useful reference source.

We hope this information will help you to monitor and maintain your compliance moving forward.

– Barbara

 

 

Psychological Contracts – What they Are, Why they Matter

The term ‘psychological contract’ refers to the tacit set of expectations that guide an employee-employer relationship. A psychological contract develops in addition to the more formally stated contract of employment. It is an unwritten, yet implicitly understood set of promises about the relationship between the employee and the employer. It may include a wide range of elements, such as level of support for career progression, opportunities for promotion, potential benefits, expected overtime, or the nature of the work environment. The employee and the organisation each have their own understanding of what is agreed upon. When their perspectives are at odds, problems may arise.

Psychological contracts are unique to each employee. They begin to form during initial contact with a potential employer, and continue to be updated and revised based on experiences with the organisation and its members. Both intentionally shared and unintentionally acquired information feed into an evolving set of employee expectations. Over time, these are evaluated as having been met or unmet. For example, has the chance to work on challenging new projects materialised over the first year of employment?

A breach of the psychological contract may lead to poor employee reactions. For example, if there are inconsistencies between formal stated policies and observed management practice, a potential for mistrust on behalf of the employee arises. If opportunities for career progression within the organisation do not materialise, expectations are unmet.

Psychological contracts can lead to positive or negative attitudes and behaviours, depending on whether they are upheld or breached. Met expectations and kept promises provide the basis for developing a relationship of trust and respect. Breached contracts can result in feelings of violation (Robinson & Morrison, 2000). A meta-analysis by Zhao et al. (2007) indicated strong links between contract violations, job satisfaction, organisational commitment and turnover intentions. Additional significant links were found with job performance and organisational citizenship behaviours. These are key workplace outcomes, and the target of many occupational interventions. Their importance signals the essential consideration of whether employee expectations are realistic enough to be met as they are brought on board as new organisational members. It is also vital to monitor changes in contract perceptions over time, because they continually evolve. As an organisational newcomer transitions to becoming a full member, do they continue to believe promises are have been kept?

Psychological contracts affect how employees feel about their organisation, and their willingness to exert effort on its behalf. It is essential that this commonly overlooked aspect of the employer-employee relationship is acknowledged and effectively addressed.

So, what can organisations do to help ensure their employees’ psychological contracts hold true?

1 – Ensure employees are treated fairly.

Make efforts to uphold any promises that have been directly made or even implied. This needs to happen from the moment of initial contact with potential employees, even when advertising jobs.

2 -Create a culture of honesty and trust.

Actively create an organisational culture where honesty is practiced and trust is a key component of the employer-employee relations. An unintentional breach of psychological contract may have fewer negative repercussions if it is understood to be a once-off occurrence. This is especially true if reasons for a breach are openly explained.

3 – Promote communication between employees and supervisors on promises and expectations.

The psychological contract should be acknowledged as an influence on the developing relationship between employer and employee. Open discussion about expectations, whether they are being met, or why they have been breached both validates the importance of employee perceptions and provides an opportunity for building a sense of trust.

4 – Carefully consider the feasibility of any promises made to employees.

This is consistent with an emphasis on honesty within the organisation’s culture. Rather than offering job candidates the sun and moon, promise only what is actually possible. This is in line with providing a realistic job preview, and will greatly improve the chances employee expectations are met.

How do psychological contracts relate to psychometric testing?

Since psychological contracts begin to form during recruitment and selection, interactions with the organisation at this early stage will affect them. Honest communication about reasons for testing, how scores will be used, and the way in which results will be communicated can help to foster a sense of respect and trust. This may help maximize candidate reactions to the testing process.

Psychometric testing, such as personality assessment, may be an on-going feature of team building, career progression and leadership development throughout an employee’s tenure.Previously met expectations may foster a belief that test results will be treated sensitively and respectfully. This may promote a willingness to honestly engage with assessments. A sense of trust may improve an employee’s receptivity to feedback. The success of employee development programmes that include psychometric testing depend on the participants’ perceived relationship with their organisation.

I would love to hear from you about your own experiences with psychological contracts, or any research you may doing on this fascinating topic.

Best wishes,

Barbara

References

Robinson, S.L.& Morrison, E.W. (2000). The development of psychological contract breach and violation: A longitudinal study. Journal of Organisational Behaviour, 21, 525-546.

Zhao, H., Wayne, S.J., Glibkowski, B.C. & Bravo. J. (2007). The impact of psychological contract breach on work-related outcomes: A meta-analysis. Personnel Psychology, 60, 647-680.

 

Do test scores truly indicate a person’s ability, or accurately reveal their personality? Psychometric assessments are used to make decisions about employees, so it is essential that scores really do indicate a person’s likely behaviour. Accuracy of results is affected by both the test itself and the way in which it is administered and interpreted. Here’s how to ensure scores can be trusted when you use psychometric assessments:

Stage 1: Preparation for Testing and Maximizing Candidate Engagement

Maximizing engagement means motivating the candidate to work earnestly and honestly as they complete their test. People need to see the value of putting effort into testing, and to consider potential outcomes of psychometric assessments worthwhile.

To maximize engagement, make sure that the process and purpose of the test is understood. Build trust on behalf of the candidate that assessment will be accurate, fair, and useful in identifying the best applicants.

If you’re familiar with psychometric qualities, you may recognize this as another way of saying the test should be standardized, reliable and valid. It’s up to you to communicate these qualities to your test takers in non-technical terms they’ll easily understand.

Consider candidate reactions to assessment, too. People are most likely to engage with a test that has both face and faith validity. Face validity refers to whether or not the test appears to be a good measure for its purpose. Does it look the part? Faith validity is the test taker’s belief that the test really does what it claims to. Again, this is about the person’s impression of the measure. Face and faith validity are both subjective reactions that can make a significant difference in how a test is undertaken.

It’s also helpful to explain clearly why candidates should respond accurately and truthfully when completing a test. This can include emphasizing why and how the test results will be used. For example, you can let the test taker know that scores will help assess whether he or she is a good match for a position. You can explain how this benefits the individual as well as your business.

Measures to prevent cheating, faking or lying on psychometric assessments can also be incorporated. There’s a lot that can be done here, ranging from requiring a signed honesty contract to analysing response patterns and statistics for computerized tests. An honesty contract requires signed agreement from the test taker on conditions such as completing the assessment independently, and responding truthfully. If tests are administered on-line, potential analyses of responses include overall time taken for the test, time spent on each item, and incorrect vs.correct answers to questions which vary in difficulty. Sanderson, Viswesvaren and Pace (2011) provide more detail in their discussion of ways to detect cheating on unproctored internet tests. For complex personality assessments, subscales are typically included to detect social desirability or faking. Scores on these subscales are examined to evaluate potential misrepresentation when answering test questions.

Stage 2: Administering the Test

The way a test is administered affects the accuracy of results. Consistency and control over the assessment processes help to keep unwanted influences from affecting test scores.

“Measurement error” is the term used to describe unplanned or uncontrolled influences on test scores. Anything about testing circumstances may fall into this category. Losing power when completing an on-line assessment is a clear example. Other measurement errors could include a noisy or badly lit room, an unprepared administrator, or an exhausted test taker.

Psychometric assessments typically have specific and standardized instructions for administration. These may include time allowed, a script for introducing the test, appropriate methods for administration, and ways to maintain security and maximize honest responding. Strictly adhering to these guidelines helps to ensure recommended procedures for testing are in place, and maximizes the opportunity for accurate measurement.

Stage 3: Scoring and Interpreting Results

Verify Apparent Test Scores

We talk a good deal about the need to treat scores as hypotheses on our Test User courses. It is essential that apparent results are supported with verifying information. For selection, this could include examining competencies through structured interviews. Ratings from others who know or work with the test taker can be used as part of 360 degree feedback for development. Candidates themselves can provide useful perspectives, including the way that they approached assessment, and how they feel they performed. This may take place through an interactive, two-way discussion following assessment. Information shared by the individual can help to indicate whether they were focused, motivated and optimally engaged in test taking. If so, their scores are more likely to indicate their true attribute levels.

Use Confidence Intervals to Interpret Results

Tests are not perfect, even under optimal conditions for assessment. By considering confidence intervals surrounding test scores, you can more fairly and justifiably (or legally) make decisions about results.

Here’s an example: Two candidates are being considered for progression to the interview stage of selection decisions. Steve’s verbal ability test score is 53. Frank’s score on the same test is 57. Are these scores different enough to justify choosing Frank for the job? If you are not sure, image how Steve would feel, or what his reaction would be!

Confidence intervals are constructed based on a statistic called the Standard Error of Measurement. They provide a range of scores that likely include an individual’s actual ability or attribute level, rather than assuming that a single score point (e.g., a 57) is completely accurate. Using confidence intervals increases the chance that you have really “captured” or identified the person’s true score. For example: You may not be completely certain that Mary’s score of 70 precisely indicates her computational skills, but you can be 95% certain that her numerical skills fall within the range of 63 to 77.

SxD trainees learn how to compute and use confidence intervals in our Test User Ability course. Alternately, we offer advice and consultation to anyone working with employment testing on this essential aspect of interpreting scores.

Ensuring accurate psychometric assessments requires planning and preparation across the stages of test set-up, administration and interpretation. By incorporating the suggestions above you can best achieve test results that you can trust. After all, isn’t that a key goal for workplace testing?

Wishing you happy and accurate testing!

Barbara

____________________

Reference

Sanderson, K.R., Chockalingam, V., & Pace, V.L. (2011). UIT Practices: Fair and Effective? The Industrial-Organizational Psychologist, 48(3), 29-37.

Psychometric Testing in Selection - How to Maximize Candidates' Reactions

Just hearing the word test can evoke anxiety for people. Test implies that your performance is going to be judged—that you need to pass, and that you can fail. With psychometric tests widely used in hiring decisions, news of testing is a common experience for job candidates. A negative reaction to a selection method like testing can influence the accuracy of results (Nikolaou, Bauer & Truxillo, 2015). It may also lead to poor views of the hiring company.

Accurate or valid scores depend on persons being focused and motivated when completing tests. This becomes more likely if they buy-in to the assessment, trusting that it’s appropriate and fair. The way applicants are treated during psychometric testing can affect their views of the hiring company. If the process is viewed as unfair, the reputation of the company may suffer. It may become difficult for the business to attract strong candidates going forward. There may also a be a greater risk for legal challenges to hiring decisions.

If the first contact your business has with a potential employee is to request the completion of psychometric tests, it’s up to you to make a positive impression about assessment. Here are six ways to ensure the best reaction to the news, “There’s going to be a test…”

  1. Explain the purpose of testing and how results will be used.

If you don’t tell candidates exactly why you’re using tests, what you intend to measure, and how their results will fit in to the selection process, you’ll leave them guessing. You’ll also risk demonstrating a serious lack of respect for the candidate. A better approach? Remove all mystery surrounding assessment. Convey to the candidate the careful planning that goes into the assessment portion of recruitment, and that it will be professionally conducted. Take the time to ask if there are any questions, and if there are, be sure the candidate understands your answers.

  1. Consider the face validity of the instrument you’re using.

Be sure the test you’re using looks the part. Does it appear to measure what it’s intended to, and what you’ve told the candidate it is assessing? Reactions to a test will improve if the candidate feels it is appropriate and job-relevant. A mechanical engineer would question being asked to complete a clerical skills test, as an extreme example. How might a retail associate respond to a test of abstract reasoning?

  1. Assure candidates that testing will be fair.

Candidates should be assured that each person taking a test has the same opportunity to perform at their optimal level. Be able to explain what processes you have put in place across administration, scoring and interpretation to guarantee fair assessment to all. For example, is standardised timing in place? What about the instructions? Will computerised scoring be used to minimize human error? Will test performance be evaluated separately from candidate background and demographic data?

It is essential that candidates are asked about any unusual needs or special requirements they may have for workplace psychometric testing, and that these are considered in planning administration. Aside from addressing legal and ethical requirements, this is consistent with ensuring respectful and professional candidate treatment.

It may be helpful to have candidates sign an honesty contract prior to testing. An honesty contract provides an opportunity to clarify that they need to complete the test independently and as instructed, and the implications of failing to do so.

Finally, fairness will be partly judged by candidates according to the communication they receive about test results. This is referred to as procedural justice (Gilliland, 1994). It can be improved by explaining to candidates how their test scores will be evaluated, what type of information they will receive back about their performance, and how this will be communicated. For example, will they have the chance to discuss their performance during a feedback meeting? Will they receive a detailed written report of their results? Can they find out how they performed relative to other candidates?

  1. Give candidates a chance to complete sufficient practice items and become comfortable with the testing format.

Most tests include examples of sample items at the beginning. Instruct candidates to work through these items carefully, so they’re absolutely certain they understand how to find the answers or complete the responses. If testing remotely, provide candidates with a way to contact the test administrator with any questions. Knowing what to expect and how to proceed allows candidates to focus their attention on answering the questions. It can also help to alleviate anxiety, and to boost confidence as testing begins.

  1. Address data protection.

Explain to candidates how, where, for how long and in what form their data will be maintained. This is consistent with upcoming GDPR legislation going into effect on 25 May 2018. It’s up to you to ensure the rights of candidates regarding the protection of personal data are guaranteed.

  1. Explain to your candidates their rights related to psychometric testing.

Best practice in testing means guaranteeing that test takers’ rights are respected. These include areas like understanding precisely how test results will be used, and knowing how inquiries or complaints about testing will be handled. Explain to your candidates what their rights are, and the steps you are taking to ensure these throughout the testing process. This will demonstrate your commitment to treating those you are assessing, and their personal data, with respect, dignity and complete confidentiality. The BPS provides a useful summary of test taker rights in their Test Taker’s guide available here.

It takes time, effort, thought and planning on the part of the testing professional or hiring organisation to address each of these areas. But the potential gains in candidate trust, engagement and motivation will result in assessment that accurately and truthfully reflects the potential of your job candidates. By communicating the good news about psychometric testing, you can help ensure that your most promising prospects successfully complete the recruitment process.

References and readings

Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691-701.

Nikolaou, I., Bauer, T. & Truxillo, D. (2015). Applicant reactions to selection methods: An overview of recent research and suggestions for the future. In I. Nikolaou & J.K. Oostrom (Eds.) Employee Recruitment, Selection, and Assessment: Contemporary Issues for Theory and Practice (pp. 80-96). New York, NY: Psychology Press.

Would you like to find out more about candidate reactions to the selection process? You can find a useful White Paper from the Society for Industrial and Organizational Psychology here.

________________________________________________________________________

Learn to expertly use psychometric testing as part of the hiring process through Selection by Design’s training for BPS/EFPA Occupational Test User qualifications. We are enrolling now for our next courses!

Emerging Trends in Psychometric Testing and Workplace Psychology

The BPS Division of Occupational Psychology annual conference was held 10-12 January in charming Stratford-upon-Avon. This year’s theme, ‘Evolution Evolution +/or Revolution: Changing with the Times’, focused on celebrating the value Occupational Psychologists offer. With no shortage of informative talks and engaging speakers, this was a great opportunity to find out about new and emerging trends in workplace psychology.

Several of the presentations and workshops focused on psychometric assessments. I’d like to share with you some of the themes I noticed among these.

1. An extensive and widely varied range of assessments is now available on the market.

The many test publishers present at the conference were a great source of information on new test development and directions. Tests of abilities are now a mainstay in the realm of psychometric testing, covering the traditionally measured verbal, numeric and logical areas, as well as specialized skills. There is a growing emphasis on more in-depth assessment including tests of personality, strengths, and emotional intelligence. These may be useful in identifying work roles and environments that optimally suit an individual, or provide insight for personal growth, well-being and performance.

There are many different formats for reports being offered by publishers today. Depending on the test, it may be possible to obtain combined results for work team members, or multiple ratings of an individual, as with 360 degree feedback. Choice of which instrument to use may be influenced by the report options available.

2. Research on the validity of tests

Knowing how well tests predict work behaviours is at the heart of justifying psychometric assessment for employment decisions. Validation research has a long-standing history, and it was fantastic to see the results of such studies being presented at the conference. The kinds of questions being examined include how well ability and personality tests related to competencies like problem solving, risk taking, creativity or motivation.

3. Testing on the go

There is strong interest among occupational psychologists in the potential for assessment through mobile apps. Psychometric tests that can be taken on smartphones or tablets offer flexibility and convenience. The technology for this has now arrived, and companies are beginning to offer this option. Related areas for research include comparability with traditional testing formats, consumer reactions, and potential threats to security.

4. The potential of gamification

Gamification is gaining attention as an alternative means of assessment. The potential for measuring areas such as risk taking, decision making and cognitive abilities in an engaging and interactive way holds great potential. Advantages may include greater accuracy than that achieved through self-report personality measures or typical ability tests. This is because reaction times, or responses to presented stimuli can be recorded with high precision, and over multiple trials within one single game. Also, candidates may have a positive and enjoyable assessment experience, possibly influencing impressions of the organisation. With gaming assessment applications now being developed, on-going (and fun!) research into their validity and usefulness is set to continue.

Conclusion 

Psychometric testing has grown tremendously, and is now entrenched in employee selection and development. The widespread use of ability testing is now being followed by more sophisticated and in-depth measures. Research on the uses for and outcomes of workplace testing continues. Tests themselves are becoming more accessible, and there is a new focus on the individual’s reaction to assessment. New technology may well change the way workplace tests are administered. This is an exciting time to be working with psychometric tests!

– Barbara


If you’ve yet to complete the training required to obtain BPS/EFPA Test User qualifications, check out our recent blog series on the benefits of doing so, beyond access to psychometric tests. Part 1 addresses lesser know benefits of Test User ability training, while Part 2 covers Test User personality. Selection by Design offers Test User training throughout the year. You can find our training schedule and prices (including discounts for students) here

BPS/EFPA Test User Qualifications: Which Tests Can You Access? - SelectionxDesign.com

We receive a lot of queries on which tests can be accessed and used once you have obtained Test User qualifications. Recently I came across a new and valuable reference for identifying and locating accessible tests: the newly published British Psychological Society (BPS) “Tests available to RQTU members.”

Whether you’re an experienced psychometrician or just beginning to work with assessments, this is an extraordinarily useful source of information. A summary of tests that may be used with each of the 3 occupational Test User qualifications is presented, including Assistant Test User, Test User Ability and Test User Personality. A brief synopsis of what each test measures is included, along with publisher details. If you know which attributes you need to measure, options are clearly and concisely listed for you.

More details on the background, uses and psychometric qualities of the tests can be found in the BPS Test Reviews. Full Test Reviews are free to RQTU members. The “Tests available to RQTU members” resource includes direct links to available, instrument-specific BPS Test Reviews. It’s a very easy and efficient system for exploring qualities of any measures you’re considering using.

It is well worth having a look through this test listing. I think you’ll find it a great addition to your psychometric testing resources.

Happy testing!

Dr. Barbara Caska

If you’ve yet to complete the training required to obtain BPS/EFPA Test User qualifications, check out our recent blog series on the benefits of doing so, beyond access to psychometric tests. Part 1 addresses lesser know benefits of Test User ability training, while Part 2 covers Test User personality. Selection by Design offers Test User training throughout the year. You can find our training schedule and prices (including discounts for students) here

The Veiled Benefits of BPS/EFPA Test User Personality Qualification - Selection by Design

Selection by Design’s Test User Personality training leads to specialization in the 16pf®. This is a well-known, defining feature of the course. Our trainees learn to score, interpret and use this test to assist with talent management, employee development and career decisions.

Just as with our Test User Ability training, though, there are gains in knowledge and skills—benefits—that aren’t always obvious. This second in our two part series on the lesser known benefits of obtaining the BPS/EFPA Test User qualifications focuses on Test User Personality training.

  1. Perspective on personality stability and change: Implications for testing

Academic and clinical approaches to explaining personality vary in their views on whether personality remains constant from an early age, or dynamically evolves over the course of life. In the Test User Personality course, we look closely at these perspectives and consider the implications of stability vs. change for predicting behaviour. Deciding how to use the results of personality tests in work decisions depends on which viewpoint is taken. Stability implies that the person hired today can be expected to retain their valued characteristics throughout their tenure. This means that identifying candidates’ personality traits can help in making good hiring decisions. If growth is possible, however, it makes sense to use personality testing in coaching, leadership and team development. For anyone working in these areas, understanding the potential nature and depth of change is essential.

  1. Knowing when to use trait or type measures

Selection by Design trainees have the chance to work with and learn about trait and type personality measures. Type tests like the Myers-Briggs Type Indicator® classify persons as belonging to one of several categories. As an alternative, tests such as the 16pf® measure characteristics as falling on a continuum. This means that the strength of a trait is indicted. You can be slightly extraverted, for example, or definitely introverted. As another possibility, persons might fall in the middle and behave as either introverts or extraverts depending on the situation.

Traits scales offer more in-depth assessment than type scales. Trait scores may be justifiably included in selection decisions. Type categories may be effectively used in team building or career guidance. Understanding how these tests vary, and when to use each, ensures that the nature of test results suit their intended use.

  1. How to apply psychology to testing and feedback

The content of the Test User Personality course draws upon the field of psychology when considering individual reactions to testing and result feedback. Knowing how candidates are likely to react to being tested and to feedback on their test scores is an asset when preparing to test. Anticipating and addressing potential problems means a smooth-running testing campaign. Here are a couple of examples of how psychology can be applied to testing:

Example 1. Taking a test: “I’ll make a great impression!” Socially, persons present themselves to make a positive impression on others. Similar efforts may influence responses to personality test questions. Learning about the kinds of biases that may affect test responses, how to detect these and how to prevent them from having an impact is necessary for an accurate interpretation of results.

The 16pf® includes scales and statistics that can be used to detect forms of self-presentation. Test User Personality trainees learn how to use these tools to see if candidates are honestly portraying themselves, and if they are not, how to deal with faking.

Example 2. Receiving feedback: “This is so me!” Adopting a phrase from PT Barnum, personality interpretations can offer “something for everyone.” We are all susceptible to believing vague information about ourselves if it is presented convincingly. Phenologists, tarot card readers and astrologers might take advantage of this, but what about Test Users?

An important part of feedback is verifying test results. This may be done by seeking confirming or disconfirming evidence from candidates with probing questions. Trainees practice using these methods to establish whether test scores really are what they seem to be. The Barnum effect can be avoided, as candidates are encouraged to question their apparent test scores. An accurate and realistic portrayal of personality results.

  1. Advanced feedback skills

Being able to effectively draw together and communicate test results is a must-have skill for those working with psychometric measures. Test User Personality trainees gain this skill through extensive practice in both face-to-face and written feedback, for purposes of selection as well as personal development.

Trainees hone their feedback skills through working with the 16pf®. This test offers many options for evaluating trait and profile patterns. Interpreting and communicating its results can be both intriguing and challenging. Effective feedback requires knowing what information to share with candidates, and how to phrase it accurately, sensitively and appropriately. Learning to do this as part of a two-way communication process is key for effective feedback discussions to take place.

The high level of skill acquired through 16pf® feedback practice has both immediate and long-term benefits. In the short run, trainees emerge from the course ready to start incorporating the 16pf® in their work-related assessments. In the long term, experience in developing and providing feedback for such an in-depth measure effectively prepares trainees for future work with additional, complex personality tests.

If you missed Part I in this two part series on the Veiled Benefits of BPS/EFPA Test User Qualifications, you can find it here.

Have you benefited in other ways from our Test User training? We would love to hear about it in your comments below.

For those yet to complete these courses, last chances for 2017 are offered in November. Enrol soon to secure your place!

 

The Veiled Benefits of BPS/EFPA Test User Ability Qualification - Selection by Design

We work with many people who undertake Occupational Test User Ability and Personality courses to become qualified to access psychometric tests. This is a clear benefit of Test User training, but it is not the only one. The Test User courses provide a much broader array of knowledge and skills than may be apparent initially. In this two part blog series, I’ll discuss some of these lesser realised benefits of Test User training. In Part 1, the veiled benefits of Test User Ability training are presented. Part 2 will examine the hidden payoffs of Test User Personality training.

Test User Ability (TUA) training provides skills needed to test work-related aptitudes, abilities and career interests. In addition to directly working with these kinds of tests, our trainees gain the following knowledge and practical abilities:

1. Determining if and how psychometric tests should be used in occupational decisions

Workplace assessments should provide appropriate, relevant and cost-effective information about employees. While psychometric tests are often a good choice for this, alternative ways of measuring attributes might also be useful. Our TUA trainees examine various kinds of measurement, and consider advantages and disadvantages of each. Examples include work sample tests, 360° feedback and measures of physical capacity. The potential benefits of combining data from several sources are explored. As a result, trainees know whether and how to include psychometric tests in an assessment campaign.

2. Critically evaluating psychometric instruments

To determine which test is best suited to a particular purpose, evidence for psychometric qualities must be evaluated. For example, if a test has to provide consistent results, reliability needs to be present. Specific types of validity must be taken into account if the goal of testing is to predict job success, or to assess understanding of certain skills. On the Test User Ability course, persons practice identifying and analysing evidence for such psychometric qualities. The result is better informed test choices.

3. Ensuring fairness in testing

Fair testing provides each candidate with an opportunity to have their abilities assessed in a way that is objective and unbiased. For example, a fair test of computation skills should measure only the ability to solve mathematical problems. Performance should not be influenced by testing conditions, language skills, personal disabilities or unjust comparisons with other test taker’s scores. Our Test User Ability training addresses issues of fairness in the contexts of administering, interpreting and incorporating test results.

Related to administration, means of establishing consistent test conditions for all candidates is considered. We also cover how to ensure candidates’ special needs are identified and appropriately addressed.

Towards interpreting scores, trainees find out how to choose appropriate comparison groups to assess candidates’ performance. Without a clear understanding of this process, there’s a risk for discrimination against protected group members. Test scores must differ sufficiently to justify selecting one candidate over another, too. Determining how to establish this is another key issue we cover. Finally, trainees learn how to guarantee test takers rights related to informed consent, data access and protection. Being able to assure clients of fair assessment means testing is likely to be legally justified and favourably received.

4. Best practice in high-stakes testing

High-stakes testing is used to make crucial decisions about individuals. In occupational contexts, this includes candidate short-listing. Best practice ranges from selecting an appropriately secure mode of administration to verifying scores through re-testing. Test User Ability training gives trainees the skills needed to ensure the best candidate decisions are made in these high-pressure contexts.

5. When and how to optimally share test results

Either client organisations or individual persons may require test feedback. Results might be presented through interactive discussion or in written format. Key skills include how to sensitively and accurately communicate test results, at a level of understanding matched to the audience. Trainees also learn how to verify tentative test results during feedback discussions. Cautions surrounding use of computer generated feedback reports are considered as well.

Trainees gain initial experience in developing and providing feedback during the Test User Ability course. More extensive practice is a key aspect of our second occupational course, Test User Personality.

In this blog I’ve highlighted a few of the lesser realised gains from Selection by Design’s Test User Ability training. If you would like to add these assets to your own set of skills, consider enrolling in our next course.

See you next time!

Barbara

Accurately predicting the future would be a great asset to an organisation. Which new products will be the most marketable? How much should we invest in a new advertising campaign? Is now the time to expand our workforce?

More focused workplace decisions might include: Who will make the most effective leader or supervisor? Is an employee likely to stay with the company on a long term basis? Who can I really count on to help get the work done under pressure?

While a reliable and carefully chosen method of evaluation can be a huge advantage, decisions are often made with an element of “gut reaction”. Sometimes instincts or hunches work out, but humans generally aren’t very good at predicting the future.

An exception to this is found with an unusual few “superforecasters,” as discovered by Phil Tetlock and colleagues. These are individuals who do far better than most of us at making accurate predictions. Why are some of us better at predicting outcomes than others? Can we all become better at forecasting? Are there special techniques or tricks that superforecasters use to better their odds?

In this intriguing National Public Radio (NPR) Hidden Brain podcast, Dr. Tetlock considers these issues as he discusses his research into forecasting the future. Among the secrets to their success, overlooking “gut instincts” in favour of reassessing and narrowing predictions with updated and evolving knowledge is key. Being open to possibilities of “maybe” helps, rather than drawing distinct yes or no conclusions. Application of this research to businesses is specifically addressed in this Harvard Business Review article.

This research has some interesting implications for employee-related decisions. What forecasting traps do we tend to fall into when hiring, promoting or more generally managing employees? How may psychometric measures contribute to effectively predicting workplace behaviour?

You can find out more about using psychometric tests to make decisions through our training for BPS/EFPA Occupational Test User qualifications. We are enrolling now for our September courses.

Additional related resources:

Association for Psychological Science https://www.psychologicalscience.org/news/degrees-of-maybe-how-we-can-all-make-better-predictions.html

Tetlock, P.E. & Gardner, D. (2016). Superforecasting: The art and science of prediction. Penguin Random House.