February 22, 2010

Readers’ Forum: What’s with the goofy tests?

Filed under: Job Search, Readers' Forum

Discussion: February 23, 2010 Ask The Headhunter Newsletter

In today’s newsletter, a reader asks for advice:

What’s with the psychological multiple-choice questions in job applications? What are they looking for and what do I do when I don’t “test well” with these kinds of questions? I’m a great employee, but these tests mess with my brain! Are there any resources on how to answer these questions? I’m finding I can’t even get an interview unless I first pass this part of the application process.

You can’t tell a company to stop using those goofy tests, and you’re right: It’s virtually impossible to figure out how to “pass” one. So the alternative is clear: Don’t apply using job applications. Go directly to a hiring manager.

HR uses such tests to weed out “undesirables.” (At least in the opinion of the HR manager.) But if a manager has already decided to interview you or hire you, the personnel jockey is not likely to stand in the way. The “weeding” tools usually go flying out the window. When you have a manager already interested, the smart thing to do is politely but firmly decline to do this kooky stuff. “Once we meet and decide there’s a mutual interest in taking our discussions further, I’d be glad to fill out your application forms.”

This ever-more-ridiculous, impersonal “hiring strategy” that companies are increasingly using accomplishes one thing. It alienates the best workers, who refuse to play the game. They will find their way in the door through personal contacts — or they’ll go to work for a competitor. Rather than waste their time with such administrative roadblocks, job hunters with high standards will invest their time meeting and cultivating people who can refer them to a hiring manager. They won’t bend over for personnel jockeys.

So the way to handle such tests (and preliminary application forms) is not to do them. Avoid them. Get in the door through a manager or another employee of the company.

This article might be helpful: Employment Tests: Get an edge.

.

23 Comments on “Readers’ Forum: What’s with the goofy tests?”
By Neva
February 23, 2010 at 5:06 am

Great topic.

Recruiters who specialize in trading women are notorious for offering up a line of offensive tests — a left over pink-ghetto practice in which all women should, in my view, refuse to participate.

It is unbelievable that top-notch, experienced legal or executive assistants, or equivalent, are still subjected to typing, grammar and spelling tests.

Such a battery of tests becomes even more absurd when an applicant with top scores lands up working for a micromanager in serious need of writing and grammar lessons!

By Chris
February 23, 2010 at 10:18 am

The problem is that hiring managers are using these tests.

I had an interview with a company that I thought was going well. At one point, one of the employees whom this position would support (it was like an internal consulting position) presented me with an issue she’d be having. I discussed how she could set up a system to help her tease information out of mounds of data.

She became real excited and even said, “Oh, you’ve got to come back and talk to my boss. He’d really be interested in this idea.”

A-ha! I thought. I’ve got an ally, if you will, who can influence the hiring manager in a very good way, and I’ve shown how I can do the job. You can’t get any more ATH-ish than that!

All this was blown because of a “concern” raised on one of these psychological tests…..a single 20 minute on-line test. The hiring manager specifically brought it up. I tried to address it, but he wasn’t buying it. It was some stupid attribute or tendency that didn’t line up with their concept of the perfect employee.

Keep in mind, everything was going well until the test results came back. I had already been through a couple phone interviews and one previous on-site interview.

Now if I’m asked to take these tests, I ask real hard questions, such as “Have you taken these tests?” and “Do you have any information about the predictive power of these tests or the population used to create/test the validity of these tests?” Most of them won’t be able to answer these questions; this can then provide an opportunity to challenge them.

My favorite response to a “no” when asked if they’ve taken these tests: “Hmmm….that’s interesting. As an engineer, I collect data to model a system. Obviously, what I create cannot then be used to model a different system, at least not with any comfortable degree of accuracy or reliability. I’m curious as to how the testing service was able to predict what employees would do well in your organization when it hasn’t tested current employees.”

If you really want to drop a bomb on them, ask if the tests are in any way derived from Scientology. There are still tests being used out there that are based on the rather, um, “interesting” theories put forth by the Church of Scientology’s founder. It’s called the OCA, and they license it to various firms so that it appears under various names.

(I don’t mean to offend any Scientologists out there, but it claims to be a church. If companies started using personality tests that were licensed by the Catholic Church, the Southern Baptists, a Muslim denomination, or something similar, there would be a big controversy about it, and it would probably violate non-discrimination laws.)

By Steve Amoia
February 23, 2010 at 11:34 am

Nick, there is a solution for this nonsense. Present the hiring manager or HR with your own test. “Potential Employers of Nick Corcodilos Test.”

1. Why do you use ridiculous tests to weed out potential employees?

2. How many of your current employees have taken and passed these tests?

3. Has your company made or lost money in the last 3 years?

4. What is your employee turnover rate?

5. Why should I work for a company that can’t use critical thinking skills to hire people?

6. Is there a real job here or are you collecting data for EEO purposes?

7. If you want a real test, hire me to write one. ;-)

By Erika
February 23, 2010 at 11:41 am

I agree that these psycho-tests are ridiculous and there is no evidence that they predict who will be a good employee. That is an ART as well as a science! I especially resent it when a 2-hr test is mandated before serious mutual interest is established! Sometimes, these companies automatically assume that they are the sole decision makers and applicant interest is taken for granted. I will not work at ANY price and benefits package! I expect an employer to make it worth my while if I am going to sacrifice 5 days out of 7 for them! Hello!

By Tim
February 23, 2010 at 12:04 pm

Any test used should be valid for the job in question. But for lots of tests out there, the validity is questionable. An interesting book on the subject is: “The Cult of Personality”, by Annie Murphy Paul. It should be required reading for any employer using tests to screen out applicants.

By G
February 23, 2010 at 12:59 pm

I resolved never to take one of those silly tests after a ridiculous experience a few years ago interviewing with a local company. They gave me a test that consisted of drawings of circles connected by lines, without any hint about what a line might represent or how it might function. Each had a question like: If the first circle has a 5 in it, what number will the last circle have?

It was incredibly pointless and stupid. I did ask them what they thought it measured and they claimed that they only hired people who did well on it and they always turned out well. (Proving they don’t know much about correlation or experimental design.)

Sadly the company is always looking for people since their turnover is high, not because it’s a bad company but because it requires 100% travel. I’d be an ideal employee but they’ve driven me away.

By Dave
February 23, 2010 at 2:00 pm

I was subjected to the Caliper Profile, which takes a couple of hours, before accepting a job offer back in 1990 — not my ideal situation, but I was out of work, having been laid off during a recession. I understand the Caliper costs its clients a fortune, and this company valued it highly. The company, a tiny U.S. division of a French industrial firm, surprisingly had the most entrenched bureaucracy I’ve ever seen. My sense is that they would never have waived the test for any potential employee.

I lasted about a year and a half before moving on. Not too long after I left, the parent company reorganized this division out of existence.

By JB King
February 23, 2010 at 2:37 pm

While I can agree that such tests tend to be beyond the ridiculous, another point is that most of these tests are supposed to carry the cavaet of, “There is no right or wrong answer, just be honest in answering these questions,” which may cause a chuckle or eyebrow to raise.

This reminds me of trick questions that can come up in an interview, which can be kind of fun if you have the mindset for it. For example, “Could 2+2=5 be true?” to which there are a couple obvious answers. The first is that “Of course not! 2+2=4, that is what I was taught and I’m not about to change now!” while a different answer is, “Certainly that could be true. For example, if we took all the value modulo 1, then this becomes 0+0=0 which is true.” There are probably other answers but I’d hope one could see the difference in tone and position of each answer.

Interviews can be a minefield, but at times I wonder how much slack can one get if they say, “Oh, I’m sorry I don’t test well so my results may be poor,” and see what response there is. One may have to explain in a bit more detail what the issue is, but it could be a fun way to take an interview way off course and see what happens.

By Erica Klein
February 23, 2010 at 4:18 pm

Hi Nick, thanks for the shout-out (link to my article about employment testing)! It provides tips for doing your best on employment tests.

To answer one of the comments above, sometimes tests are not given to current employees because the test has been validated in another setting and those results are generalizable to the current use. This is scientifically valid, and a legally defensible approach.

I’m in transition myself right now, and one thing that’s been frustrating is having to take the same lengthy personality test online every time I apply for a different job with the same employer. I suppose they can’t store my results due to privacy concerns?
Erica Klein (twittering on job search topics as EricaKleinPhD)

By Ray Saunders
February 23, 2010 at 4:36 pm

I’ve taken these tests 4 times in 46+ years. The only intelligent one was at IBM in 1963. The rest were garbage.
Always wanted to fill one out so the HR analyst would interpret it as meaning I was a homicidal maniac – who hated HR LOL

By Lisa
February 23, 2010 at 5:07 pm

Not long after high school, I applied for a job as a typist. The office manager gave me an IQ test from Reader’s Digest, and I aced it. I got the job, and then they found out I couldn’t type!

By Nick Corcodilos
February 24, 2010 at 12:44 pm

@Chris: The Scientology connection is a new one on me! But your approach is smart: Question the test. There are two major criteria for evaluating such tests: validity and reliability. If you’re going to push back when asked to take a test, I suggest you read up on those two criteria. Briefly, validity is a measure of whether a test actually measures what it’s intended to measure. Might seem obvious, but the items in a test might have low value in this regard. Reliability means, does the test return the same results the first time it’s administered, and the second and so on – today and next week? In other words, is the test a reliable measure of what you’re measuring?

Few managers or HR folks know what this means. But it’s worth discussing with them, and asking for information about a test’s reliability and validity. Then explain that you’d consider taking the test only if they promise to show you the results (either way) along with the written interpretation of the person scoring the test. “Uh, you don’t HAVE an expert scoring the test? Just software? Sorry, but I won’t subject myself to an automated test, not with all I’ve read about false negatives.” They don’t know what false negatives are? Bad sign ;)

Any manager who rejects an otherwise good candidate because of a single test item is ignorant. No test expert would support that kind of conclusion, simply because no single test item can be relied on.

Always be friendly when questioning employment tests. And always offer an alternative: I’d be glad to come in to talk with you further, but with all due respect, I won’t be judged by a test. I hope you understand – Do you think the manager in this case would consent to take a psychological test administered by me prior to my considering a job offer? So that I could assess whether he’s worth working for? Of course not, and I’d never suggest it. I’m sure you see my point.

Yah, and my point, too.

By Nick Corcodilos
February 24, 2010 at 12:51 pm

@Lisa: I’m LMAO! That’s the best indictment of over-reliance on “objective measures.” The results don’t matter if you’re not measuring what you need to know!

By Nick Corcodilos
February 24, 2010 at 1:00 pm

@Erica Klein (author of Employment Tests: Get an edge, referenced in this blog post): Thanks for chiming in on ths. Unfortunately, the results of some employment tests ARE stored and used again and again, because employers sometimes outsource candidate evaluations. The 3rd party gets your completed test and potentially “sells” the results to other employers — with or without your consent. Note: Does an employer ask you to sign a waiver before you take a test? Does the employer give you written assurance that your test results are confidential?

Real question: Do you want other employers to have access to test results you’ve never seen yourself? In some cases, testing is a racket “running in the background” of “HR consulting.” Be careful out there!

By From Massachusetts
February 25, 2010 at 11:42 am

Thanks, Nick, and all for the wise counsel (and funny stories).

A few years ago, a company I worked for as an independent marketing consultant was giving all their employees one of those tests, and they wanted me to take it too.

I absolutely refused. Couldn’t see what right they had to a psychological evaluation of me under the circumstances. It wasn’t like I was looking for or doing a high-level job with the CIA or anything!

By Nick Corcodilos
February 25, 2010 at 11:54 am

@Mass: Good for you. Many years ago a company I worked for was acquired by a much bigger company that had a very “active” HR department. So the new HR VP sends around to all of us “acquired” folks a non-compete agreement to sign. Everyone signed it. Except me. Why would anyone sign such a deal, except as a condition of new employment? The VP blustered and insisted, but knew she could not require me to sign it. I never argued with her. Instead, I just ignored her requests. She finally stopped, realizing that she had only one recourse: Fire me. And it would have been fun to watch her explain to a judge that the NCA was a condition of my “continued” employment. Lotsa luck. (Note: I’m not a lawyer and this is not legal advice.)

People need to realize they have rights. And even when they don’t, sometimes the right answer to a ridiculous, invasive and unnecessary demand is to walk out the door.

By Chris
February 27, 2010 at 12:10 am

Erica,

I disagree with the concept of test results being generalizable.

These tests are often put forth as determining if the prospective employee is a “match” for the company.

Every company is different. Every division, group, team, and so on is different. We can all take tests that classify us as problem solvers or team builders or lone wolves. But the problem solving or team building behaviors that work for one company do not necessarily translate into workable behaviors for another company.

Imagine a dating service where only half the people took tests because prior testing was “generalizable” to the other half. I don’t think many people would trust it.

If it’s truly scientifically valid, then companies would be shouting their R^2 values from the hills. I’ve yet to see this happen. I can’t imagine accuracy and repeatability to be a trade secret (as some claim) unless there is something to hide. If I had a tool that could predict success in matching candidates to company with a high accuracy, I’d slap that on every piece of marketing. And if I was a company that used such a test, I’d let every candidate know about it.

Again, I’ve yet to see such behavior.

By G
February 27, 2010 at 4:29 pm

@Lisa Your funny story reminds me of my first office job when I was just out of high school. I applied to be a temporary file clerk, back in the pre-computer days when files were all on paper. The temp agency rep gave us a spelling test and was very impressed with my score. No one had ever gotten 100% on the test before and the other applicants in my group had much lower scores.

But they hired all of us!

By Stupefied
March 4, 2010 at 5:19 am

About 15 years ago I was subjected to a skills and personality test by a small company to determine if an interview would be granted. The skills test consisted of elementary school math and other rudimentary knowledge. For a software development position that typically requests a technical college degree. The personality test seemed oriented towards deviance and ethics. It was all perfectly ridiculous, but being unemployed, figured it might be educational. It certainly confirmed my belief about how silly these tests are.

Interestingly, the company said it would share the test results, but I never bothered following up since I didn’t care. I wasn’t invited back either. Guess I flunked.

By Stupefied
March 8, 2010 at 10:37 pm

Actually, it could be worse. During the 1980’s I occasionally encountered small boxes on application forms requesting a handwriting sample. For years I puzzled over this, until learning it was for handwriting analysis (Graphology), which is supposedly still prevalent in Europe.

By scared_to_death
June 7, 2010 at 5:19 pm

Just recently when I applied to a couple of Energy Companies, I was required to take a personality test and some other test with word problems about a flag pole and a fence, a boat and the rate of current if the boat went up stream and made it to its destination, shapes and its rotation cycle, and other absurdities because the company thought highly of my resume and my potential as an employee. Of course, I didn’t pass the word tests which they say had no right or wrong answers but I didn’t make it to the interview level. All I was applying for was a receptionist or a Administrative Assistant position!!! If I knew how to answer those questions then I would have applied for the engineering positions! Ya think? Now I’m terrified of applying for an Admin. position at any energy company!

By Nick Corcodilos
June 8, 2010 at 10:14 am

@scared_to_death: Jumpin’ Jehosophat! Don’t worry. The HR consultants that sell those idiotic tests to employers don’t make it into many companies. Just the ones where HR is rich and lazy.

By psc result 2014
December 8, 2014 at 1:05 pm

great piece of information very providing.

Post a comment