Psychometric Tests in Singapore, Hong Kong, Malaysia, Asia, Australia, UK. Aptitude and Personality Tests for Recruitment, Selection and Development.
Aptitude Tests | Personality Tests | Psychometric Training | 360° Appraisal
Psychometric Assessment
Psychometric Tests and Training from Organisational Psychologists
Singapore, Hong Kong, Malaysia, China, Australia, Middle East & UK
 
 
Search
Email Us
Call Us
Sitemap
Australian Psychological Society Psychologist
  Home     Aptitude Tests     Personality Tests     Psychometric Training     360° Appraisal     Knowledgebase     Blog     Online Learning     Contact  
Psychometric Tests Blog
 

Types of Bias in Psychometric Test Translation

January 15th, 2010

Types of Bias in Psychometric Test Translation

With the demand and need for psychological tests increasing in various different cultures and countries, there has been much greater awareness regarding some of the issues that are associated with the development or adaptation of tests to be used in contexts and situations that may be different from which the test was developed for. This article focuses on one of the key aspects of translating tests, the types of bias that can occur.

When utilizing the test in a new cultural group, it is not quite as simple as directly translating the test, administering it and then comparing the results for its validity. There are a number of issues that need to be considered such as whether the area assessed with the test applies to the new culture or whether is may be biased towards that group and whether what is assessed by the test also has similar behavioral indicators? These are just some of the potential areas where bias can be found in the translation of tests and affect the validity of the test being utilized in the new context.

Van der Vijer & Hambleton (1996) differentiates between three distinct types of bias that may affect the validity of tests that have been adapted for different cultural contexts and these are construct biasmethod bias and item bias.

Construct bias occurs when the construct (e.g. personality) that is measured by the test displays significant differences between the original culture for which it was developed and the new culture where it is going to be utilized. These differences can occur in the way that the construct was formulated and developed as well as in the relevant behaviors that are associated with the construct. It is critical to examine whether the underlying theory of the test is subject to construct bias and this can be examined through the studies examining the construct and its associated behaviors in the context that it will be utilized in. If there are significant differences found in these studies, it may indicative that there is construct bias. Major revisions may be required to overcome this bias. If not, the validity of the test will be affected.

Method bias refers to factors or issues related to the administration of the test that may affect the validity of the test. Examples of areas that method bias can occur include social desirability, acquiescence response styles, the conditions in which the test was conducted and the motivation of the respondents. Across cultures, there potentially can be differences that can occur in these areas and these can affect the way that the respondents answer the items in the test. This potentially may lead to differences between found that can be erroneously attributed to cultural differences when in fact, these differences are the result of differences in the administration procedures. As a result, it is threat to the validity of tests that have been adapted for use in new cultures. Test developers also not only need to focus on the adaptation of the test itself but also need to be aware of issues regarding the implementation of the test in a new context.

Item bias is another source of bias that can occur in the translation of tests and these refer to biases that occur with the items in the test. This is usually the result of either poor translation choices for items or due to culturally inappropriate translations. For example, the phrase “kick the bucket” is essentially a phrase that referring to passing away in the Western context and is commonly known by most people in that culture; unfortunately, this phrase would have no meaning for people from cultures without any prior experience with that phrase. In this manner, a literal translation of that phrase would be a poor translation as it does not convey the correct meaning of the item. The items in the test need to be culturally equivalent, where the meaning of the items needs to be correctly translated so as to maintain the validity of the test in the new cultural context.

These are some of the biases that may occur during the translation of tests. Test developers will need to be aware of the sources of bias and take the appropriate measures to avoid these biases.

References:

Van der Vijer, F. and Hambleton, R. K. (1996). Translating tests: some practical guidelines. European Psychologist, 1, 89-99.

Psychometric Training in Singapore, Hong Kong, Malaysia, and China
If you are serious about using psychometric tests properly then we recommend joining PsyAsia International’s Psychometric Assessment at Work Course which leads to a certificate of competence in Occupational Testing Level A and Level B from the British Psychological Society. The Course is run publically in Singapore and Hong Kong or in-house anywhere.
More details about BPS Level A and B in Singapore and Hong Kong

Online Psychometric Training – Worldwide
Alternatively, you might be interested in introductory Online Psychometric Test Training presented live by a registered psychologist. PsyAsia is offering a special fee of just US$12 for anybody who registers for the February online psychometric training course!
More details about online psychometric test training

Online Psychometric Test Administration Course – only US$12!

January 11th, 2010

Psychometric Test Administration Online Training

Introduction
PsyAsia International is pleased to announce an exceptional offer for those interested in learning psychometric test administration from the comfort of their office or home.

Why only US$12?
Some months ago PsyAsia International was chosen to become part of the panel of beta-testers for a new online training software. The beta program will end next month as the software is almost ready to go live. In view of this PsyAsia is now ready to use the software as our final stage in the beta program with our valued clients. For this reason, rather than charging the regular fee for our online psychometric test administration training course, we are offering similar training for just a $12 registration fee.

Your facilitator
PsyAsia International is well known for professional and competent training in Psychometrics. This course will be no different. It will be facilitated live by award-winning psychologist Dr. Graham Tyler.

Course Outline
This is a first-level introductory course in psychometric test administration. The course will prepare attendees to become more competent in administering psychometric tests.

-What is a psychometric test
-Types of psychometric tests
-Requirements of good tests
-Psychometric Principles
-Reliability
-Validity
-Running a psychometric test session
-Candidate questions and deviance
-Scoring and norming of tests
-Ethical test use

More offers
Those who register for this online course, pay the US$12 fee and attend all 3 one hour sessions may also register for our 1-day BPS Test Administration Certificate Course in February in Singapore or March in Hong Kong at a 15% discount. Alternatively, you may choose to attend only the afternoon of the above training (which is mainly practical assessments) and pay only 50% of the published course fee. You will need to pay the BPS Assessment fee at the current rate if you wish to be assessed for the BPS certificate. A PsyAsia certificate will be presented to all attendees at the real-life course. Discount codes will be sent to eligible persons after the final training session.

Registration Process
Registration is simple! Click on the link below. Complete the short registration form and ensure that you provide your work email address (free accounts such as yahoo/gmail/hotmail etc will be rejected). Within one working day of completing the form you will receive an email from Paypal with a request for your US$12 payment. Click on the link in the email and pay using your credit card at the paypal site. Within one working day of your payment we will approve your registration and send you a link to download some files that we will use during the training and complete a pre-course quiz. The email will also contain a link for you to log-into each training session. Please pay the registration fee as soon as you can to avoid losing your place. Places are available on a first-paid/first-confirmed basis!!

Click here to register

How the training works
You will need a computer with a reasonable internet connection along with a microphone/headphone set. The training will be transmitted to your computer in slide form and live demo of various systems and websites related to psychometrics. The facilitator will use a mic to teach you. You will also have the opportunity to share with other attendees and ask questions either by way of your microphone or text chat.

Terms and Conditions
The training is open to anybody worldwide who is able to attend on all 3 days between 5pm and 6pm Singapore/Hong Kong time and who can satisfy ALL of the following:

1. Register with accurate data and a work email account
2. Pay the US$12 registration fee
3. Have a computer with an internet connection/headset and mic. However, you may choose to telephone in rather than use a mic/headphone. In this case you must be happy calling a number in USA, New Zealand or Australia. The number will be provided with your registration.
4. Must not be already trained in test administration or BPS Level A – this is because we want to give this opportunity to those who want to learn something new rather than those who may be more interested in finding out how our system works!
5. Must not be a competitor

Click here to register

Managing Performance at Work through Performance Appraisal and 360-Assessment

January 6th, 2010

Performance management involves an ongoing process of establishing goals, evaluating the activities undertaken to achieve those goals, as well as assessing the final outcomes within an organization. This ongoing process allows management to assess the performance of the employees within the organization and how effective the organization is in meeting their strategic goals.

The performance management process can take many forms, ranging from periodic performance reviews between the manager and subordinate to 360 degree performance appraisals which involve gathering information from varied sources such as from peers, subordinates of the individual being assessed and maybe even from external clients. Typically, these performance reviews are conducted on a formal basis whereby the manager will meet with the subordinate on a periodic basis to assess the performance over that period and to provide feedback to the subordinate. The feedback component of the performance review process is very important as it provides subordinates with information regarding the areas in which they meet expectations or excel as well as areas where they may require further development. These provide advice and guidance for improving their performance. When conducted properly, this feedback process can serve as a source of encouragement and motivation.

With this in mind, it is critical for organizations to provide effective feedback during their performance review processes. This is done by providing specific feedback on behaviours that can be changed so as to improve performance. General feedback regarding possible negative behaviours would likely undermine the confidence of the employee and may cause the employee to become more defensive. Thus it would be more effective to provide examples of ideal behaviour that would help to improve performance. It is also important to maintain the confidence levels of the employee by providing them with support and encouragement in their capacity to improve and meet their potential.

Another point to keep in mind for performance reviews is to ensure that the process is not directed at criticizing the employee. It should focus on problem solving and identifying potential solutions in a collaborative manner. In this way, the employee will not feel that they are being criticized on his or her job performance thus enabling both parties to have a discussion to identify possible ways for that performance to be improved. Even when covering performance issues, it is very important to treat employees with respect so that they do not feel that they are being personally criticized.

Although performance reviews are commonly conducted formally on a periodic basis, the inclusion of informal performance reviews can be of considerable benefit. This allows the managers and subordinates to meet on a more frequent basis to discuss their ongoing processes, identify performance issues and provide advice regarding potential solutions. This can be especially useful for employees dealing with new duties and responsibilities when feedback is provided in a timely manner and immediate remedial solutions can be explored instead of waiting for the formal performance review period when such feedback may not be as urgent or relevant.

These are just some suggestions whereby organizations can help to mitigate some of the stigma and negative public perceptions that are widely held regarding performance reviews. In addition, the motivation benefits that are associated with providing effective feedback during performance reviews can improve both individual and organizational performance.

If you are interested in using an online and validated 360 Performance Framework and Appraisal System, have a look at the Saville Consulting 360 Appraisal System at http://www.psyasia.com/360_performance_appraisal.php

Psychometric Test and Human Resource Management Blogs suspended until New Year!

December 16th, 2009

PsyAsia International will be suspending blog posts to our educational sites at www.assessmentcentral.com, www.psychometrictests.sg and www.psychometricassessment.com/blog until after the Christmas and New Year break while our blog writers take some well earned time off.  Thank you for keeping up to date with us at our blogs during 2009 and we look forward to writing more about psychometric tests, human resource management and business psychology for our readers in Singapore, Hong Kong, Malaysia, China and worldwide.  Enjoy the holidays!

Free Webinar – Identity Self-Perception Questionnaire

December 7th, 2009

Identity Psychometric Personality Questionnaire Webinar

Identity Psychometric Personality Questionnaire Webinar


Attendees will be introduced to this personality assessment which produces the most comprehensive assessment of personality on the market. Key decision-makers will also have an opportunity to trial Identity.

-Overview of the Identity Self Perception Questionnaire
-Scales of Identity
-Derived Psychological Models
-Identity Reports
-Identity Online
-Benefits of Identity
-Applications of Identity
-Comparison with other leading questionnaires
-Identity Accreditation

Click here to register

Psychometric Test Accreditation Training in Asia leading to BPS Level A & BPS Level B

November 30th, 2009

To complement the BPS Level A and BPS Level B Certificates of Competence in Occupational Testing Training in Singapore, we have announced new dates for the same psychometric training course in Hong Kong.  PsyAsia has been running this course in Singapore and Hong Kong since 2002 and we have collected many impressive delegate reviews.  The course is run by a British Psychological Society award-winning resident and registered business psychologist with a PhD earned through work with validation of Psychometric Tests in Asia – there is nobody more qualified in Asia to run this course!  For more details of the course and facilitator and to register online, please click here.

The Hong Kong Level A and B Psychometric Training Course will run over the following dates:

Level A: 9-11 March 2010
Level B: 16-18 March 2010
Psychometric Test Administration only: 9 March 2010

The Singapore Level A and B Psychometric Training Course will run over the following dates:

Level A: 27-29 January 2010 or 24-26 February 2010
Level B: 1-3 March 2010
Psychometric Test Administration only: 27 January 2010 or 24 February 2010

Delegates may opt to join Level A in Singapore and Level B in Hong Kong if they wish at no additional cost but should contact us before booking in order to ensure availability.

The day immediately following Level B is conversion training for the Saville Consulting Wave®. Level B delegates may register for this training at 50% off the regular fee by selecting that option during the booking process.

Psychometric Tests in Singapore

November 20th, 2009

The Market for Psychometrics in Singapore

There are so many Psychometric Tests on the market in Singapore now, the task of choosing the right one is not easy. Choice is always a good thing, however as humans we often look for easy or stereotypical ways of making those choices and they are not always the best ones to make. For example, a client of ours was preparing for an upcoming team-building session. He approached us asking if we had a certain test that he could use in that session. Our answer was that we don’t supply that test for various very good reasons. The client’s response was “but so many people use it”. This is a typical response.   Another potential client had been looking around in Singapore for Psychometric Personality Tests to use in his training sessions as an added benefit.  He categorically advised us that he was not interested in validity and was looking for something simple and cheap!  The reality here is that at best he is wasting his time and the time of those who will complete his tests.  At worst and most likely, his trainees will be led to believe things about themselves which frankly may not be true (reliable or valid!). 

Science, Psychology, Psychometrics and the Real World of Business

As busy professionals we often assume that if lots of other people are using a test it must be a good one. This is a huge mistake. Our evolution has programmed us to be seduced by glossy advertising materials and confident, friendly salespeople. On the other hand, we have a tendency to be turned off by less glossy scientific figures, statistics and perhaps psychologists such as myself who speak about the science and real value behind a test, its validity! Ultimately then, both our clients and ourselves as psychologists have problems to overcome!!

Psychologists have to be able to explain in more “glossy” terms about the technical properties of a test and our clients, usually the HR and aligned professions, are invited to turn their ears our way for a little while, just long enough to get the notion that there is more to a psychometric test than meets the eye!

Technical Properties of Psychometric Tests

When we talk of the technical properties of a psychometric test, we are referring to things such as its reliability and validity as well as how it was constructed. If a test is constructed well, it will take time. Not months, often years. The test will also evolve over time such that more and validity data will be added to its manuals. This process is costly, hence good tests cost money.

If you come across cheap tests, that should start to ring alarm bells. It’s possible to write a few questions on a napkin in a restaurant and call it psychometric and even try to sell it. If it looks good and the questions look relevant perhaps it will sell and gain a huge following. But how reliable is that test?

In other words, can it provide consistent measurement of your candidate? If your bathroom scales provide different results each time you weight yourself you take them back and say these are not reliable. Likewise with a test, you need to ensure that it is consistently assessing the constructs that it purports to assess. We often come across new clients who are shocked when we tell them that good personality tests often contain around 200 questions. However, buyer beware! We know that the longer the test, the more reliable the results (as long as it is not so long that the candidate falls asleep!).

An unreliable test can not be a valid test, hence reliability is a precursor to validity. However, validity is arguably the most important aspect of a test. You choose to use tests because you want them to illustrate where a candidate stands in terms of their ability or personality or in order to predict how your candidate will perform or behave in a job. The test’s ability to meet this need is referred to as validity.

Some tests on the market are simply more valid that others. In fact, one test in the past year has proven to be more valid than all other tests it was compared with on the market!  How come users stay with their current test then? Perhaps because of preference, habit, price, mass-following and so on. However, do ask yourself and your test supplier, how valid is your test – this is the single most important technical property in a psychometric test!

Sometimes tests which are more valid will be more expensive but this makes sense. If a test took a long time to develop, was developed well and by a reputable publisher and is based on well founded theories that have been researched internationally, then surely it is worth paying the extra as such a test will provide an excellent return on investment with its strong validity.

Training to use Psychometric Tests in Singapore 

Properly developed psychometric tests require proper training to be used competently. If your test supplier requires that you undergo very limited or no training, this is a reflection of the test as well as their lack of understanding of psychometrics. You need to understand the concepts referred to above, as well as error in testing and how to make decisions based on test results, let alone how to feed back results properly to candidates and decision-makers. The type of questions (i.e., forced choice versus rating scales) will also dictate how you can use the results – you need to be trained to understand this! In some parts of the world (South Africa for example), only psychologists can use psychometric tests. Whilst this is a strict rule, it has its logical basis in how easy it is for untrained professionals to use tests wrongly.

Purchasing Psychometric Tests in Singapore

You may also wish to consider where you purchase your tests from, particularly in Singapore. In recent years we have seen an influx of profiteers in the industry who seek to make money but lack any depth of understanding in psychometrics or psychology at work. This will change in time as psychology in Singapore develops. For now however, be wary of this and we suggest that you only purchase psychometric tests from fully registered organisational psychologists who have a firm grounding in personality, psychometrics and psychology at work and who are answerable to professional competence and ethics boards.  Many of those selling psychometric tests in Singapore are simply not answerable to anybody in terms of their conduct or competence.  You can therefore not be certain that any advice they provide is relevant, up-to-date or will work in your organisation.

There are many more things to be aware of when choosing psychometric tests in Singapore. We cannot entertain them all here due to space constraints. You may wish to look out for training courses in Psychometric Assessment such as our our Psychometric Assessment at Work training which leads to the internationally recognised British Psychological Society Level A and B Certificates of Competence in Occupational Testing.  Such courses will prepare you further for choosing the right test and therein avoid costly selection and development mistakes. Look for courses run by experts in psychometrics who are based in Singapore and hence have a strong understanding of test use aligned with local culture, laws and practice.

Note: some Singapore firms will ship in overseas trainers to run psychometric training.  We suggest you avoid this training reseller model given that the facilitator is based overseas and is thus likely to lack knowledge of the Singapore business/legal and cultural environment for Psychometric Testing.

This article is Copyright PsyAsia International Pte Ltd.
It was originally written for Human Resources Magazine in Singapore
A shorter version of the article appears in the magazine’s November 2009 issue

Do men cheat more on internet selection tests?

November 18th, 2009

MEN are considered much more likely to cheat on internet selection tests than women, a Saville Consulting
survey reveals. The report, commissioned by work psychologists at Saville Consulting, questioned over a
thousand UK students. In this sample, 42% thought men were more likely to cheat than women, compared to just 9% who thought that females were more likely to cheat than males.

Internet selection tests measure a respondent’s abilities in certain areas to predict their likely level of performance at work. Tests typically measure verbal, numerical or logical skills. Many organisations use such tests as part of their recruitment process, but the vast majority of such tests can be completed by job applicants on their home computer, in an unsupervised manner.

Worryingly, 14% of students openly admitted to receiving help from others on such internet tests. Overall, respondents also revealed that they knew more men who had cheated on internet tests than women. When students who rated themselves as being of lower ability were compared to those who reported being of a higher level of ability, 58% more students of lower ability admitted to receiving help on internet tests.

Previous research commissioned by Saville Consulting indicated that personality and intelligence tests were actually seen by people as being more useful selection methods than job interviews. Eight out of ten students in the current survey confirmed that many people exaggerate on job application forms. Moreover, the same proportion of respondents agreed that if an organisation followed unsupervised tests with longer supervised tests prior to appointment, this was an effective method for preventing cheats from being selected.

These findings undermine the use of unsupervised tests without the re-testing of applicants
under supervised conditions. Organisations may not re-test applicants because they believe this
offers a more economical recruitment process. However, recruiting dishonest and less intelligent
workers will inevitably be counterproductive for an organisation’s effectiveness.

 

Professor Peter Saville, International Chairman of Saville Consulting, said:

 

“Following up applicants who complete online unsupervised tests with supervised tests of equal or greater rigour is arguably the most effective way to prevent candidate cheating. Other methods, such as randomising the order of questions or adapting questions to the ability of a candidate simply do not get around the problem of unsupervised cheating. If job applicants know that they are going to be retested in a properly supervised environment, this can do much to reduce the problem of cheating. The supervised test at the later stage also provides a safeguard that the successfully appointed applicant has the abilities to match the requirements of the role.”

 

Can work performance be predicted from conscientiousness in personality?

November 12th, 2009

There has been much research conducted examining the relationship between Conscientiousness as defined as one of the dimensions in the “Big Five” Model of personality and job performance. Much of the research has indicated that Conscientiousness is a positive predictor for job performance across a range of job positions. Simply put and what many advocate, is that it appears that people who have been assessed to be higher on Conscientiousness tend to perform better at work. Nevertheless, an article by Tett (1998) highlights some considerations regarding accepting this conclusion and cautions against accepting this at face value.

In this article, a number of examples suggest that Conscientiousness and job performance may not be irrevocably linked as previous research has suggested. It provides two examples of work situations where Conscientiousness may actually hinder the job performance. Firstly, the author highlights situations where being conscientious may result in lower productivity where either tasks require more time to complete or where fewer tasks can be completed. This is illustrated by the example of managers who at times are required to make decisions even when they do not have all the relevant information (Tett, 1998). In such a situation, being high on conscientious may affect the speed at which decisions can be made.

The second example refers to rules and procedures; conscientious individuals tend to adhere to rules and procedures. Tett (1998) highlights that in certain professions, strictly following rules and procedures may affect creativity and innovation. It is proposed that such adherence to rules and procedures can affect productivity as such individuals would be unlikely to develop novel ideas and solutions.

Although Conscientiousness appears to remain as a significant predictor of job performance, it is important to note that there are situations where other factors can play a part.

Tett, R. P. (1998). Is Conscientiousness ALWAYS positively related to job performance? The Industrial-Organizational Psychologist, 36(1)

Why are there so many questions in personality tests?

October 28th, 2009

For psychometric assessments to have utility and be effective when assessing people for various purposes, the assessment has to be reliable and valid for the situation.

All personality tests are not 100% accurate and measurement errors from a variety of sources can affect the results. The length (i.e. the number of items) of the assessment affects the reliabilty of the assessment and research has demonstrated that measurement errors are smaller in longer assessments than in shorter assessments. In addition, a larger number of items better represents the abstract characteristics that are being assessed. For example, when assessing personality, one cannot expect to obtain an accurate picture of an individual through a few questions, therefore more items are needed. It has to be noted that after a limit, increasing the number of items will not provide further increases to reliability as other factors such as fatigue will set in.

It is for this reason that good personality assessments will have a large number of items and therefore require some time for the candidates to complete the assessment (usually between 200-250 questions, taking around 30-40 minutes). Psychometric assessments that are shorter will tend to be less reliable and valid. With a large number of items, the reliability of the test will be better and in turn the validity of the assessment will be better too. Validity is all about predicting performance. So with high validity human resource professionals get a higher return on their investment.

 
 
Archives
Recent Articles
Categories
Tags
Aptitude Tests
Professional Aptitudes
Work Aptitudes
Operational Aptitudes
Commercial Aptitudes
Customer Aptitudes
Administrative Aptitudes
Practical Aptitudes
Swift Analysis Aptitude
Swift Comprehension Aptitude
Swift Technical Aptitude
Personality Tests
Saville Consulting Wave®
Saville Consulting Wave Professional Styles
Saville Consulting Wave Focus Styles
Saville Consulting Wave Types
Wave Entrepreneurial Potential
Saville Consulting Wave Job Profiler
Saville Consulting Performance Card Set
Saville Consulting Wave Performance 360
Wave Employee Development
Wave Performance Culture
Identity Personality Questionnaire
Identity For Education
The Apollo Profile
Apollo Select Candidate Screening System
Psychometric Training
Psychometric Test Administration Course (with optional BPS Certification)
BPS Level A and B Training (British Psychological Society Certification)
Introduction to Psychometric Tests
Apollo Profile Accreditation Course
Identity Questionnaire Accreditation Course
Saville Consulting Wave Conversion Course
Saville Consulting Wave Full Training
Free Psychometric Mini-Series
Apollo Profile Online Learning
Online Learning Centre - Psychometric Assessment Category
Dates for Psychometric Assessment Courses
Online Psychometric Test Systems
Apollo Profile
Identity Personality Questionnaire
Saville Consulting Oasys™
Test Administrator Network
Bureau Scoring Service
Psychometric Test Candidates
Best Practice in Psychometrics
Psychologist-on-Call™
360° Performance Appraisal
Knowledgebase & Journals
Blog
Online Learning
Search
Email Us
Call Us
Sitemap
 
  Copyright © 2001-2010 PsyAsia International Pte. Ltd. A Psychology1 Group Site. All rights reserved.
  Psychometric Tests, Aptitude Tests & Personality Tests in Singapore, Hong Kong, Malaysia, China, Pakistan,
  India, Thailand, Brunei, Dubai, UAE, Qatar, Australia, UK, USA and more!