{"id":6011,"date":"2012-07-05T13:27:58","date_gmt":"2012-07-05T18:27:58","guid":{"rendered":"http:\/\/bobbeaty.com\/wp\/?p=6011"},"modified":"2012-07-05T18:11:28","modified_gmt":"2012-07-05T23:11:28","slug":"the-real-utility-of-web-based-language-tests","status":"publish","type":"post","link":"https:\/\/bobbeaty.com\/wp\/archives\/6011","title":{"rendered":"The Real Utility of Web-Based Language Tests"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/bobbeaty.com\/wp\/wp-content\/uploads\/2007\/09\/cubelifeview.gif\" alt=\"cubeLifeView.gif\" title=\"cubeLifeView.gif\" border=\"0\" width=\"128\" height=\"128\" style=\"float:right;\" \/><\/p>\n<p>It's common to hear, the company you are interviewing with wants you to take a test on the language you <em>say<\/em> you're proficient in - just to make sure that you are what you say you are. It sounds very reasonable: You <em>say<\/em> you've been doing C++ coding, then taking a little test for an hour should be no big deal, right? Java, Ruby, anything can be tested, right? And this will let the employer know if you're really <strong><em>good<\/em><\/strong> at this. Right?<\/p>\n<p>Not so much.<\/p>\n<p>I've been taking and writing tests for many years, and I've no problem with tests of any kind - so long as the results of the test are balanced against other factors. For example, are you going to hire an architect for your house based on his ability to take a 60 min test on the loading of certain structures? Or the standard lengths of commercially available lumber? No. You want to see what he's <em>done<\/em>. That's what's impressive (or not).<\/p>\n<p>You want to look at what a person has done, and can do, in order to know if you want to hire them. It's <em>possible<\/em> that a one-hour test is a good measure for that, but I'm guessing not. I've taken too many of these tests in the past couple of years to think that <strong><em>any<\/em><\/strong> web-based test can be a good, complete, and accurate measure of a person's ability to write real-world systems.<\/p>\n<p>How are you going to test their ability to design solid thread-safe code? You can ask them questions about it, but that's not the same. You can ask about immutability, but that's not the same as knowing when to apply it, and when not to.<\/p>\n<p>The problem is that these tests are billing themselves as an authoritative measure of the quality of an individual, and they can't <em>possibly<\/em> be. They are far too narrow. How can you <em>possibly<\/em> measure a person in an hour? No way.<\/p>\n<p>So I had to take <strong><em>two<\/em><\/strong> of these today, and it just wiped me out. I got \"decent\", but not \"great\" scores - as I'd have expected, and that's about as good as I can expect. But I guess I need to look at these tests in a slightly different light -- if the employer is taking these ay face-value, then maybe that's telling me something important about their hiring policies, and maybe <em>that's<\/em> the critical take-away for me.<\/p>\n<p>In all my years, I'd <strong><em>never<\/em><\/strong> inflict this on someone. It's just not a useful metric for hiring a person. Going into a place that <em>requires<\/em> them means that I'll be forced to ask for them. Not necessarily a good thing, in my book.<\/p>\n<p><strong>UPDATE:<\/strong> I got a mid-40's percentile on the C++ test. From this, you'd think there are a <em>ton<\/em> of developers that are better than I am. As such, the employer that was asking me to take the test said I wasn't qualified. It hurts, I won't kid you, but in the end, I honestly believe it's saying more about them than me, and that's <em>really<\/em> what's important to me.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s common to hear, the company you are interviewing with wants you to take a test on the language you say you&#8217;re proficient in &#8211; just to make sure that you are what you say you are. It sounds very reasonable: You say you&#8217;ve been doing C++ coding, then taking a little test for an [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,7,5],"tags":[],"class_list":["post-6011","post","type-post","status-publish","format-standard","hentry","category-coding","category-everything-else","category-vendors"],"_links":{"self":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6011","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/comments?post=6011"}],"version-history":[{"count":4,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6011\/revisions"}],"predecessor-version":[{"id":6015,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/posts\/6011\/revisions\/6015"}],"wp:attachment":[{"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/media?parent=6011"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/categories?post=6011"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bobbeaty.com\/wp\/wp-json\/wp\/v2\/tags?post=6011"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}