The 25th May 2018 has passed. Where do we go from here?
The new regulation has resulted in keen awareness of the kinds of personal information being gathered, processed and stored by businesses and organizations. For many, the number of companies getting in touch to request updated contact information came as a surprise and raised a lot of questions: Did I freely give my personal data to so many organizations? What was done with it?
The GDPR increases awareness and control over how individuals’ private data may be used. This is a long overdue change, given the amount of data amassed by organizations and the prior limits in accountability to persons sharing their details.
Psychometric Testing and GDPR Compliance
The new legislation has important implications for those of us working with psychometric tests. If you conduct testing for businesses and clients, or process assessments at the request of others, you work with personal data.
While the GDPR is consistent with many existing psychometric test user’s privacy policies, very specific processes and guarantees of individual rights are now required. It is a good idea to review your own data privacy and security policy to evaluate consistency with the new legislation.
More than just ensuring legally required procedures are in place, compliance with the new legislation may require a change in perspective. Fulfilling the new obligations to protect individual data will require dedication and effort. Both businesses and individuals will continue to learn about their rights and responsibilities under the new legislation. Compliance with the GDPR is an on-going process, rather than an accomplishment.
With this in mind, we’ve put together some useful resources related to psychometric testing and GDPR compliance. Even if you were well-prepared for the 25th May, these references may help you in moving forward:
A useful webpage summary from the British Psychological Society of the key changes with the GDPR legislation, including individual rights, the data protection principles and definitions of data subjects, processors and controllers. Links to further useful sources of information are provided.
This brief paper by Andreas Lohff from Cut-e presents considerations for recruiters related to the GDPR. It includes discussion of the rights of job candidates.
The website for the Data Protection Commission provides specific, highly detailed implications of the GDPR for individuals and organizations. It contains useful links and will be regularly updated, so may be a good resource for tracking new developments.
This website provides extensive and easily navigated information on all components of the GDPR. It is a thorough and highly useful reference source.
We hope this information will help you to monitor and maintain your compliance moving forward.
Psychological Contracts – What they Are, Why they Matter
The term ‘psychological contract’ refers to the tacit set of expectations that guide an employee-employer relationship. A psychological contract develops in addition to the more formally stated contract of employment. It is an unwritten, yet implicitly understood set of promises about the relationship between the employee and the employer. It may include a wide range of elements, such as level of support for career progression, opportunities for promotion, potential benefits, expected overtime, or the nature of the work environment. The employee and the organisation each have their own understanding of what is agreed upon. When their perspectives are at odds, problems may arise.
Psychological contracts are unique to each employee. They begin to form during initial contact with a potential employer, and continue to be updated and revised based on experiences with the organisation and its members. Both intentionally shared and unintentionally acquired information feed into an evolving set of employee expectations. Over time, these are evaluated as having been met or unmet. For example, has the chance to work on challenging new projects materialised over the first year of employment?
A breach of the psychological contract may lead to poor employee reactions. For example, if there are inconsistencies between formal stated policies and observed management practice, a potential for mistrust on behalf of the employee arises. If opportunities for career progression within the organisation do not materialise, expectations are unmet.
Psychological contracts can lead to positive or negative attitudes and behaviours, depending on whether they are upheld or breached. Met expectations and kept promises provide the basis for developing a relationship of trust and respect. Breached contracts can result in feelings of violation (Robinson & Morrison, 2000). A meta-analysis by Zhao et al. (2007) indicated strong links between contract violations, job satisfaction, organisational commitment and turnover intentions. Additional significant links were found with job performance and organisational citizenship behaviours. These are key workplace outcomes, and the target of many occupational interventions. Their importance signals the essential consideration of whether employee expectations are realistic enough to be met as they are brought on board as new organisational members. It is also vital to monitor changes in contract perceptions over time, because they continually evolve. As an organisational newcomer transitions to becoming a full member, do they continue to believe promises are have been kept?
Psychological contracts affect how employees feel about their organisation, and their willingness to exert effort on its behalf. It is essential that this commonly overlooked aspect of the employer-employee relationship is acknowledged and effectively addressed.
So, what can organisations do to help ensure their employees’ psychological contracts hold true?
1 – Ensure employees are treated fairly.
Make efforts to uphold any promises that have been directly made or even implied. This needs to happen from the moment of initial contact with potential employees, even when advertising jobs.
2 -Create a culture of honesty and trust.
Actively create an organisational culture where honesty is practiced and trust is a key component of the employer-employee relations. An unintentional breach of psychological contract may have fewer negative repercussions if it is understood to be a once-off occurrence. This is especially true if reasons for a breach are openly explained.
3 – Promote communication between employees and supervisors on promises and expectations.
The psychological contract should be acknowledged as an influence on the developing relationship between employer and employee. Open discussion about expectations, whether they are being met, or why they have been breached both validates the importance of employee perceptions and provides an opportunity for building a sense of trust.
4 – Carefully consider the feasibility of any promises made to employees.
This is consistent with an emphasis on honesty within the organisation’s culture. Rather than offering job candidates the sun and moon, promise only what is actually possible. This is in line with providing a realistic job preview, and will greatly improve the chances employee expectations are met.
How do psychological contracts relate to psychometric testing?
Since psychological contracts begin to form during recruitment and selection, interactions with the organisation at this early stage will affect them. Honest communication about reasons for testing, how scores will be used, and the way in which results will be communicated can help to foster a sense of respect and trust. This may help maximize candidate reactions to the testing process.
Psychometric testing, such as personality assessment, may be an on-going feature of team building, career progression and leadership development throughout an employee’s tenure.Previously met expectations may foster a belief that test results will be treated sensitively and respectfully. This may promote a willingness to honestly engage with assessments. A sense of trust may improve an employee’s receptivity to feedback. The success of employee development programmes that include psychometric testing depend on the participants’ perceived relationship with their organisation.
I would love to hear from you about your own experiences with psychological contracts, or any research you may doing on this fascinating topic.
Robinson, S.L.& Morrison, E.W. (2000). The development of psychological contract breach and violation: A longitudinal study. Journal of Organisational Behaviour, 21, 525-546.
Zhao, H., Wayne, S.J., Glibkowski, B.C. & Bravo. J. (2007). The impact of psychological contract breach on work-related outcomes: A meta-analysis. Personnel Psychology, 60, 647-680.
Do test scores truly indicate a person’s ability, or accurately reveal their personality? Psychometric assessments are used to make decisions about employees, so it is essential that scores really do indicate a person’s likely behaviour. Accuracy of results is affected by both the test itself and the way in which it is administered and interpreted. Here’s how to ensure scores can be trusted when you use psychometric assessments:
Stage 1: Preparation for Testing and Maximizing Candidate Engagement
Maximizing engagement means motivating the candidate to work earnestly and honestly as they complete their test. People need to see the value of putting effort into testing, and to consider potential outcomes of psychometric assessments worthwhile.
To maximize engagement, make sure that the process and purpose of the test is understood. Build trust on behalf of the candidate that assessment will be accurate, fair, and useful in identifying the best applicants.
If you’re familiar with psychometric qualities, you may recognize this as another way of saying the test should be standardized, reliable and valid. It’s up to you to communicate these qualities to your test takers in non-technical terms they’ll easily understand.
Consider candidate reactions to assessment, too. People are most likely to engage with a test that has both face and faith validity. Face validity refers to whether or not the test appears to be a good measure for its purpose. Does it look the part? Faith validity is the test taker’s belief that the test really does what it claims to. Again, this is about the person’s impression of the measure. Face and faith validity are both subjective reactions that can make a significant difference in how a test is undertaken.
It’s also helpful to explain clearly why candidates should respond accurately and truthfully when completing a test. This can include emphasizing why and how the test results will be used. For example, you can let the test taker know that scores will help assess whether he or she is a good match for a position. You can explain how this benefits the individual as well as your business.
Measures to prevent cheating, faking or lying on psychometric assessments can also be incorporated. There’s a lot that can be done here, ranging from requiring a signed honesty contract to analysing response patterns and statistics for computerized tests. An honesty contract requires signed agreement from the test taker on conditions such as completing the assessment independently, and responding truthfully. If tests are administered on-line, potential analyses of responses include overall time taken for the test, time spent on each item, and incorrect vs.correct answers to questions which vary in difficulty. Sanderson, Viswesvaren and Pace (2011) provide more detail in their discussion of ways to detect cheating on unproctored internet tests. For complex personality assessments, subscales are typically included to detect social desirability or faking. Scores on these subscales are examined to evaluate potential misrepresentation when answering test questions.
Stage 2: Administering the Test
The way a test is administered affects the accuracy of results. Consistency and control over the assessment processes help to keep unwanted influences from affecting test scores.
“Measurement error” is the term used to describe unplanned or uncontrolled influences on test scores. Anything about testing circumstances may fall into this category. Losing power when completing an on-line assessment is a clear example. Other measurement errors could include a noisy or badly lit room, an unprepared administrator, or an exhausted test taker.
Psychometric assessments typically have specific and standardized instructions for administration. These may include time allowed, a script for introducing the test, appropriate methods for administration, and ways to maintain security and maximize honest responding. Strictly adhering to these guidelines helps to ensure recommended procedures for testing are in place, and maximizes the opportunity for accurate measurement.
Stage 3: Scoring and Interpreting Results
Verify Apparent Test Scores
We talk a good deal about the need to treat scores as hypotheses on our Test User courses. It is essential that apparent results are supported with verifying information. For selection, this could include examining competencies through structured interviews. Ratings from others who know or work with the test taker can be used as part of 360 degree feedback for development. Candidates themselves can provide useful perspectives, including the way that they approached assessment, and how they feel they performed. This may take place through an interactive, two-way discussion following assessment. Information shared by the individual can help to indicate whether they were focused, motivated and optimally engaged in test taking. If so, their scores are more likely to indicate their true attribute levels.
Use Confidence Intervals to Interpret Results
Tests are not perfect, even under optimal conditions for assessment. By considering confidence intervals surrounding test scores, you can more fairly and justifiably (or legally) make decisions about results.
Here’s an example: Two candidates are being considered for progression to the interview stage of selection decisions. Steve’s verbal ability test score is 53. Frank’s score on the same test is 57. Are these scores different enough to justify choosing Frank for the job? If you are not sure, image how Steve would feel, or what his reaction would be!
Confidence intervals are constructed based on a statistic called the Standard Error of Measurement. They provide a range of scores that likely include an individual’s actual ability or attribute level, rather than assuming that a single score point (e.g., a 57) is completely accurate. Using confidence intervals increases the chance that you have really “captured” or identified the person’s true score. For example: You may not be completely certain that Mary’s score of 70 precisely indicates her computational skills, but you can be 95% certain that her numerical skills fall within the range of 63 to 77.
SxD trainees learn how to compute and use confidence intervals in our Test User Ability course. Alternately, we offer advice and consultation to anyone working with employment testing on this essential aspect of interpreting scores.
Ensuring accurate psychometric assessments requires planning and preparation across the stages of test set-up, administration and interpretation. By incorporating the suggestions above you can best achieve test results that you can trust. After all, isn’t that a key goal for workplace testing?
Wishing you happy and accurate testing!
Sanderson, K.R., Chockalingam, V., & Pace, V.L. (2011). UIT Practices: Fair and Effective? The Industrial-Organizational Psychologist, 48(3), 29-37.
Just hearing the word test can evoke anxiety for people. Test implies that your performance is going to be judged—that you need to pass, and that you can fail. With psychometric tests widely used in hiring decisions, news of testing is a common experience for job candidates. A negative reaction to a selection method like testing can influence the accuracy of results (Nikolaou, Bauer & Truxillo, 2015). It may also lead to poor views of the hiring company.
Accurate or valid scores depend on persons being focused and motivated when completing tests. This becomes more likely if they buy-in to the assessment, trusting that it’s appropriate and fair. The way applicants are treated during psychometric testing can affect their views of the hiring company. If the process is viewed as unfair, the reputation of the company may suffer. It may become difficult for the business to attract strong candidates going forward. There may also a be a greater risk for legal challenges to hiring decisions.
If the first contact your business has with a potential employee is to request the completion of psychometric tests, it’s up to you to make a positive impression about assessment. Here are six ways to ensure the best reaction to the news, “There’s going to be a test…”
Explain the purpose of testing and how results will be used.
If you don’t tell candidates exactly why you’re using tests, what you intend to measure, and how their results will fit in to the selection process, you’ll leave them guessing. You’ll also risk demonstrating a serious lack of respect for the candidate. A better approach? Remove all mystery surrounding assessment. Convey to the candidate the careful planning that goes into the assessment portion of recruitment, and that it will be professionally conducted. Take the time to ask if there are any questions, and if there are, be sure the candidate understands your answers.
Consider the face validity of the instrument you’re using.
Be sure the test you’re using looks the part. Does it appear to measure what it’s intended to, and what you’ve told the candidate it is assessing? Reactions to a test will improve if the candidate feels it is appropriate and job-relevant. A mechanical engineer would question being asked to complete a clerical skills test, as an extreme example. How might a retail associate respond to a test of abstract reasoning?
Assure candidates that testing will be fair.
Candidates should be assured that each person taking a test has the same opportunity to perform at their optimal level. Be able to explain what processes you have put in place across administration, scoring and interpretation to guarantee fair assessment to all. For example, is standardised timing in place? What about the instructions? Will computerised scoring be used to minimize human error? Will test performance be evaluated separately from candidate background and demographic data?
It is essential that candidates are asked about any unusual needs or special requirements they may have for workplace psychometric testing, and that these are considered in planning administration. Aside from addressing legal and ethical requirements, this is consistent with ensuring respectful and professional candidate treatment.
It may be helpful to have candidates sign an honesty contract prior to testing. An honesty contract provides an opportunity to clarify that they need to complete the test independently and as instructed, and the implications of failing to do so.
Finally, fairness will be partly judged by candidates according to the communication they receive about test results. This is referred to as procedural justice (Gilliland, 1994). It can be improved by explaining to candidates how their test scores will be evaluated, what type of information they will receive back about their performance, and how this will be communicated. For example, will they have the chance to discuss their performance during a feedback meeting? Will they receive a detailed written report of their results? Can they find out how they performed relative to other candidates?
Give candidates a chance to complete sufficient practice items and become comfortable with the testing format.
Most tests include examples of sample items at the beginning. Instruct candidates to work through these items carefully, so they’re absolutely certain they understand how to find the answers or complete the responses. If testing remotely, provide candidates with a way to contact the test administrator with any questions. Knowing what to expect and how to proceed allows candidates to focus their attention on answering the questions. It can also help to alleviate anxiety, and to boost confidence as testing begins.
Address data protection.
Explain to candidates how, where, for how long and in what form their data will be maintained. This is consistent with upcoming GDPR legislation going into effect on 25 May 2018. It’s up to you to ensure the rights of candidates regarding the protection of personal data are guaranteed.
Explain to your candidates their rights related to psychometric testing.
Best practice in testing means guaranteeing that test takers’ rights are respected. These include areas like understanding precisely how test results will be used, and knowing how inquiries or complaints about testing will be handled. Explain to your candidates what their rights are, and the steps you are taking to ensure these throughout the testing process. This will demonstrate your commitment to treating those you are assessing, and their personal data, with respect, dignity and complete confidentiality. The BPS provides a useful summary of test taker rights in their Test Taker’s guide available here.
It takes time, effort, thought and planning on the part of the testing professional or hiring organisation to address each of these areas. But the potential gains in candidate trust, engagement and motivation will result in assessment that accurately and truthfully reflects the potential of your job candidates. By communicating the good news about psychometric testing, you can help ensure that your most promising prospects successfully complete the recruitment process.
References and readings
Gilliland, S. W. (1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691-701.
Nikolaou, I., Bauer, T. & Truxillo, D. (2015). Applicant reactions to selection methods: An overview of recent research and suggestions for the future. In I. Nikolaou & J.K. Oostrom (Eds.) Employee Recruitment, Selection, and Assessment: Contemporary Issues for Theory and Practice (pp. 80-96). New York, NY: Psychology Press.
Would you like to find out more about candidate reactions to the selection process? You can find a useful White Paper from the Society for Industrial and Organizational Psychology here.
Learn to expertly use psychometric testing as part of the hiring process through Selection by Design’s training for BPS/EFPA Occupational Test User qualifications. We are enrolling now for our next courses!