{"id":770,"date":"2019-09-08T19:56:11","date_gmt":"2019-09-08T23:56:11","guid":{"rendered":"https:\/\/dwan.org\/?p=770"},"modified":"2019-10-25T11:26:37","modified_gmt":"2019-10-25T15:26:37","slug":"correcting-for-bias","status":"publish","type":"post","link":"https:\/\/dwan.org\/index.php\/2019\/09\/08\/correcting-for-bias\/","title":{"rendered":"Correcting for Bias"},"content":{"rendered":"\n<p>This is the second in a series of three or four posts. <\/p>\n\n\n\n<p>The first one, <a href=\"https:\/\/dwan.org\/index.php\/2019\/08\/27\/diverse-teams-perform-better\/\">diverse teams perform better<\/a>, explored some of the research on the measurable performance advantages that diverse teams have over monocultures. This and future posts will share real world examples about measuring and correcting for the bias that leads to a lack of diversity.  I hope to build a toolkit of useful techniques that can reduce bias in recruiting, hiring, promotion, and retention.<\/p>\n\n\n\n<p>I believe that my professional communities \u2013 high performance computing, biotech, data science, genomics, and the adjacent specialties \u2013 have a bias problem. Eventually, I hope to make that argument in some detail. Posts like this are the necessary groundwork. I hope you will bear with me.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Hang In There<\/h2>\n\n\n\n<p>Unfortunately, a lot of readers are about to check out on me. <\/p>\n\n\n\n<p>Even though this post is absolutely not about subjective <em>personal<\/em> labels like \u201cracist\u201d or \u201csexist,\u201d conversations about the specifics of measuring bias seem to land for some folks as accusations of bigotry. I\u2019ve had more than a few friends and colleagues turn belligerent and hostile at this point in the conversation. I\u2019ve been told that even wanting to talk about diversity beyond a high and fluffy level makes me sound like the \u201cdiversity police.\u201d <\/p>\n\n\n\n<p>Apparently nobody likes the diversity police.<\/p>\n\n\n\n<p>Bluntly, if a person can\u2019t bear to even talk about how one might measure and compensate for bias, it\u2019s a pretty safe bet that their organization is rife with it.<\/p>\n\n\n\n<p>Still, I\u2019m not making personal accusations or calling anybody nasty names. Name calling is ineffective and misguided. It\u2019s a waste of time.<\/p>\n\n\n\n<p><a href=\"https:\/\/en.wikipedia.org\/wiki\/Anne-Marie_Slaughter\">Anne-Marie Slaughter<\/a> said, \u201csystemic bias does not require a conspiracy of men.\u201d The Harvard Business Review built on this in their 2016 piece <a href=\"https:\/\/hbr.org\/2016\/07\/designing-a-bias-free-organization\">Designing a bias-free Organization<\/a>: <em>\u201c\u2026Rather than run more workshops or try to eradicate the biases that cause discrimination, companies need to redesign their processes to prevent biased choices in the first place.<\/em>\u201d  Effective managers and leaders should focus on compensating for bias, rather than \u201cnaming and shaming.\u201d<\/p>\n\n\n\n<p>Without the power to cut funding, terminate employment, or otherwise impose consequences \u2013 naming and shaming just enrages powerful, biased people. That\u2019s never a good scene.<\/p>\n\n\n\n<p>Still, I acknowledge that we\u2019re on uncomfortable ground.  In a good-faith effort to keep my HPC, biotech, and genomics friends engaged, I will start off with an absolutely non-tech-centric example in which I cannot possibly be talking about them.<\/p>\n\n\n\n<p>Let\u2019s go to the symphony.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Curtain Call<\/h2>\n\n\n\n<p>It sounds strange to my modern ears, but symphony orchestras used to be predominantly male. In the 1970\u2019s, women accounted for only 6% of the players in top tier ensembles. By the 1990\u2019s that number had risen to 21%. One major factor in that increase was the practice of \u201cblind\u201d auditions, where the player is hidden from the view of the judges behind a curtain or a screen. <\/p>\n\n\n\n<p>According to the 2000 study <a href=\"http:\/\/gap.hks.harvard.edu\/orchestrating-impartiality-impact-%E2%80%9Cblind%E2%80%9D-auditions-female-musicians\">Orchestrating Impartiality: The Impact of \u201cBlind\u201d Auditions on Female Musicians<\/a>: <em> \u201cUsing a screen to conceal candidates from the jury during preliminary auditions increased the likelihood that a female musician would advance to the next round by 11 percentage points. During the final round, \u201cblind\u201d auditions increased the likelihood of female musicians being selected by 30%.<\/em>\u201c<\/p>\n\n\n\n<p>No quotas, no diversity police, no name calling.  Just a curtain.<\/p>\n\n\n\n<p>Let\u2019s look at how that worked in practice:<\/p>\n\n\n\n<p>In 1980, <a href=\"https:\/\/en.wikipedia.org\/wiki\/Abbie_Conant\">Abbie Conant<\/a> <a href=\"https:\/\/www.wqxr.org\/story\/trombonist-got-job-munich-philharmonic-then-she-fought-them-court-13-years\/\">auditioned for principal trombone <\/a>of the Munich Philharmonic. The orchestra did not usually do blind auditions, but in this case one of the applicants was a relative of the decision maker, so they decided to guard against any appearance of favoritism.<\/p>\n\n\n\n<p>Oops.<\/p>\n\n\n\n<p>By all accounts, Conant blew the doors off that audition, performing well enough that one judge leapt to his feet, saying \u201cthere\u2019s our trombone.\u201d  On finding out who \u201ctheir trombone\u201d was, the director was nonplussed. <a href=\"http:\/\/www.osborne-conant.org\/ladies.htm\">He demoted her to second chair, paid her less than her peers, and spent years trying to get her fired. <\/a>Conant spent more than a decade waging a rather epic lawsuit against the orchestra while at the same time building an international reputation as a soloist and teacher.<\/p>\n\n\n\n<p>The Berlin Philharmonic didn\u2019t do another blind audition for nearly 20 years.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Mere Numbers<\/h2>\n\n\n\n<p>I love the simplicity of <a href=\"http:\/\/gap.hks.harvard.edu\/orchestrating-impartiality-impact-%E2%80%9Cblind%E2%80%9D-auditions-female-musicians\">the study above.<\/a> They literally <em><span style=\"text-decoration: underline;\">just counted<\/span><\/em> the number of men vs. women who got hired before and after a process change. As the HBR article says, \u201c<em>Marketers have been running A\/B tests for a long time, measuring what works and what doesn\u2019t. HR departments should be doing the same.<\/em>\u201c<\/p>\n\n\n\n<p>Of course, when we start trying to count, we find out that some job applicants are  constructing their own blind-audition screens. People replace their names with initials and otherwise remove the signals that biased organizations use as unconscious cues. <\/p>\n\n\n\n<p>What can I say? People are smart.<\/p>\n\n\n\n<p>I assume that everybody has heard about Jo Handelsman\u2019s  straightforward and awesome study \u201c<a href=\"https:\/\/www.pnas.org\/content\/109\/41\/16474\">Science faculty\u2019s subtle gender biases favor male students.<\/a>\u201d  The researchers asked faculty members to evaluate resumes for a notional lab manager that they might hire. The resumes were identical except for the gender of the applicants name. <\/p>\n\n\n\n<p><em>\u201cFaculty participants rated the male applicant as significantly more competent and hireable than the (identical) female applicant. These participants also selected a higher starting salary and offered more career mentoring to the male applicant.\u201d<\/em><\/p>\n\n\n\n<p>One really important result from this study is that the gender of the faculty member didn\u2019t affect the result. <em>\u201cFemale and male faculty were equally likely to exhibit bias against the female student.\u201d<\/em><\/p>\n\n\n\n<p>So spare me the line about how some particular decision can\u2019t be biased because a woman or a person of color participated in it.  That\u2019s not what the data says.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Excuses<\/h2>\n\n\n\n<p>Let\u2019s get real for a minute: Very, very few people in any of the industries where I make a living have adopted anything even as basic as the blind audition.<\/p>\n\n\n\n<p>We\u2019re not even looking.  We\u2019re not counting.  We\u2019re not doing the basic work, and yet we make excuse after excuse.<\/p>\n\n\n\n<p>We\u2019re damn sure not doing the rigorous statistics that would be required to back up arguments about pipelines, cost-benefits of delay vs. performance, and so on.  Future posts will get specific about what how we might do that.<\/p>\n\n\n\n<p>For the moment, just rest with this question:<\/p>\n\n\n\n<p>If your company had a \u201cprincipal\u201d position \u2013 trombone or otherwise \u2013 and the child of a powerful board member was applying for the job, what would you do to guard against the appearance of bias?<\/p>\n\n\n\n<p>Now do it anyway.<\/p>\n\n\n\n<p>Just don\u2019t be surprised when the person who blows the doors off your interview process isn\u2019t exactly who you were expecting.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is the second in a series of three or four posts. The first one, diverse teams perform better, explored some of the research on the measurable performance advantages that diverse teams have over monocultures. This and future posts will share real world examples about&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[],"class_list":["post-770","post","type-post","status-publish","format-standard","hentry","category-equity"],"_links":{"self":[{"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/posts\/770","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/comments?post=770"}],"version-history":[{"count":19,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/posts\/770\/revisions"}],"predecessor-version":[{"id":792,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/posts\/770\/revisions\/792"}],"wp:attachment":[{"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/media?parent=770"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/categories?post=770"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dwan.org\/index.php\/wp-json\/wp\/v2\/tags?post=770"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}