Testing for Law

The use of assessments worldwide is rapidly expanding and lawyers are still lagging at the back of the pack--way back. 

An article by Lisa Belkin in yesterday's New York Times notes that there are 2,500 "profiling instruments" that companies rely on more every year when deciding whom to hire or promote. Sixty-five percent of companies surveyed reported using assessments in 2006, up almost double from the 34 percent reported a year earlier, according to Staffing Industry Report, a human-resources newsletter.

To paraphrase her article, the content of tests has stayed more or less constant for three decades. What has changed is the workplace. The cost of losing experienced employees now represents a tremendous lost of investment.  "Employers want a guarantee that a new hire will stick — and the best way to do that is to make sure that job and candidate are a good fit in the first place."

Globalization that separates performance and accountability/review across continents has further complicated the process of finding and training the best person for the job. So offering on-line testing across those continents makes these assessments not only appealing but also fast.  

I am often asked by potential clients, particularly those who have been in corporate settings, if we either offer or recommend simple, cost-effective assessments for them to use in attorney recruitment, training and development.  While we can recommend and administer a number of good assessments that can be highly useful -- Myers Briggs Type Indicator (the most popular test in the country, used by 89 of the Fortune 100 and taken by 2.5 million Americans each year), Caliper's Personality Profile, Birkman Method, MayerSaloveyCaruso Emotional Intelligence Test, Thomas Kilmann Conflict Instrument, among others--they are not inexpensive and they are not targeted to lawyers. 

A recent college graduate friend took a Johnson O'Connor aptitude assessment, a common test for teens and young adults to help determine career possibilities.  Since her father and grandfather are lawyers and she is considering going to law school, she was surprised to find that "lawyer" was not one of her designated career possibilities.  She was told that a few years ago Johnson O'Connor stopped offering "lawyer" as an option for any of their test-takers.  The reason?  They are no longer able to reliably correlate attributes or aptitudes with the successful practice of law.

And therein lies one of the problems with assessing attorneys.  While research has indeed identified a number of attributes that lawyers exhibit to a greater degree than others-- for example, high pessimism, skepticism, urgency and autonomy, and low resilience, sociability and collaboration-- the problem lies in the data that shows the impact these characteristics are having on practitioners.  These very attributes present in so many lawyers are also the attributes contributing to the dissatisfaction and distress that the legal profession exhibits:  astonishingly high rates of depression and other mental illness, substance abuse, suicide, and divorce, for starters. High rates of dissatisfaction that are also contributing to the staggering drop-out and attrition rates.

In addition to the challenge of identifying what makes for a good (as well as well-adjusted lawyer), there is also the expense of doing that well.  The testing often done at corporations is highly individualized, developed after an extensive review of what attributes in fact produce productive and satisfied employees at that particular company, and sometimes at that particular location.  Google hires over 10,000 new employees each year and enjoys the amazingly low attrition rate of 4%, but to accomplish that.it invests in a highly detailed questionnaire and assessment that is developed from extensive employee data   That process is not inexpensive. 

Not only is it the individual lawyers who have complex and sometimes hard-to-read attributes.  Law firms and law departments, often in spite of their studied denial, also have "personalities."  Understanding those personalities is critical in determining the type of person who will thrive or fail there. 

Our unique expertise in understanding the attributes of individual lawyers, as well as each legal workplace, makes us ideally suited to help you enter the challenging world of 21st century attorney assessment, development and retention.

The Mathematical Proof for Diversity

What's the route to higher efficacy and productivity?  Might that be by staffing with "messy" groups?  So suggests a recent book entitled The Difference:  How the Power of Diversity Creates Better Groups, Firms, Schools and Societies by Scott E. Page, professor of complex systems, political science and economics at the University of Michigan. 

Using mathematical modeling, Dr. Page shows how variety in staffing produces organizational strength-- and bottom line results.  In his models, diverse groups of problem-solvers outperformed groups made up of similar individuals with high problem-solving ability.  The diverse groups got stuck less often that did the smart individuals, who tended to think similarly.

According to Dr. Page, different talents and perspectives, which he calls "tools," bring more and different ways of seeing a problem and result in faster/better ways of solving it.  Diverse cities are more productive, diverse boards of directors make better decisions, diverse companies are more innovative.  Interdisciplinary work is the biggest trend in scientific research, he says, and should be the route that business and the professions pursue.

So what does this have to do with lawyers?  Law departments that stretch across many countries are often diverse by necessity.  And by going global, many firms are diversifying by circumstance.  In both cases different cultural, personality and economic perspectives come into the mix.  While trying to preserve the benefits of diversity, these departments and firms are also confronted with the morass of confusion that many different people doing things differently can make.  Molding those differing perspectives into the "BigLaw" firm or department way of doing things--either purposefully, by circulating the administrative memo or lecturing the new recruits, or inadvertently, perhaps by unconsciously discouraging lawyers from ringing an alarm when they spot missteps, can leave you with unintended consequences. 

KPMG's program to test all US partners (see our KPMG Model Delivers Risk Management, Teamwork, Client Satisfaction and Diversity Too) and then use that information to balance various teams--marketing, client, industry and management, to name a few--is a shining example of the usefulness of diverse approaches to every type of issue facing professional services firms.  KPMG is affirmatively pursuing and integrating diversity in their business model to great benefit.

Finding the right balance to both capitalize on the benefits of diversity and to minimize the administrative and management fallout produced by those differences is a modern law firm's challenge.  There is every reason to believe that getting it right is worth the effort.

Women Board Members Are Where The Money Is

In a report released October 1st, Catalyst, a New York consultancy, found that Fortune 500 companies with at least three women on their boards strongly outperformed those companies with fewer or no women. Based on a study of four years of corporate results, the correlation was found to be so direct that the more women who serve on a board, the better the bottom line. 

The companies with the highest percentage of women on their boards had equity returns 53% higher, returns on sales 42% higher and returns on invested capital at least 66% higher than those companies with the least number of women board members. Higher returns kicked in once at least three women served on the corporation’s board, the study found, with companies having only three women board members raising each of those returns an average of 5% over corporations with fewer women.

Why would female board participation produce such concrete financial results? Various consultants and academics speculate that women are better able to understand the customer base, particularly of consumer goods companies, and that showcasing women on the board helps attract and retain women employees throughout the company. 

Another reason may well be women’s often strong collaboration skills, empowering them to better resolve conflict and move boards through the thorny discussions necessary to make and carry through critical decisions.

The Critical Ability of Emotionally Intelligent Legal Managers

What is the most important attribute to be looking for as you groom your young lawyers for management? 

A 2006 study reviewed in the Leadership and Organization Development Journal assessed the relationship between emotional intelligence and managerial effectiveness, confirming what you might expect.  A total of 38 supervisors (37 males and 1 female) and 1,258 subordinates from a large manufacturing organization participated. Data analysis found that the total MSCEIT score (an emotional intelligence assessment that I consider most reliable) displayed a strong positive correlation with supervisor ratings; that is, the more emotionally intelligent the supervisor, the more effective and productive s/he was rated by others in the organization.

First, I would point out that this study doesn't tell us whether these emotionally intelligent supervisors who were rated more effective actually were more effective than their lower EI colleagues.  All we know is that they were perceived to be more effective.  The implication being that even if those high EI supervisors weren't quite so great in the accomplishments department as advertised, their loyal team still saw them in the best possible light.

This distinction is particularly important in environments such as law firms and law departments, where dramatically high skepticism (averaging in the top 10% of the American population) creates hurdles that make it hard for managers to establish rapport and trust, much less garner appreciation for a job reasonably well done.  Second- and third-guessing is often standard procedure, regardless of how demonstrable  the accomplishment might be.  While emotionally intelligent managers may be in fact most effective, this and other studies demonstrate that they are in any event going to have the interpersonal skills to align legal staff and professionals on the same side.  Given the challenge of creating supportive cultures for growth and accomplishment in law organizations, identifying these kinds of leaders becomes imperative.

Two major subscores make up the MSCEIT total score.  In the study above, Experiential EI, which includes perceiving and using emotions, was found to be very highly correlated with high supervisor ratings, whereas the Reasoning EI subscore, which includes understanding and managing emotions, displayed no significant correlation.

Our study of emotional intelligence and lawyers (also using the MSCEIT) indicates that lawyers' scores in EI are generally a standard deviation below the general population (that is, 85 compared to 100).  In addition, lawyers score significantly lower on the Experiential subgroup than on the Reasoning one.  Their ability to "read" their own and others' emotions is notably low compared to the general population, and they also are not facile at "using" emotions, i.e., moving from a less appropriate emotion to a more appropriate one.  Their Reasoning scores are usually significantly higher than the Experiential ones, lawyers being evidently well-suited to logically analyze even the emotional realm.  The problem is that weakness in reading emotions creates a garbage-in, garbage-out result when that reasoning horsepower is applied to inaccurate information.  So lawyers often get blind-sided by what they hadn't originally correctly perceived .

This finding as to the importance of Experiential EI to effective management can be critical in the case of managing lawyers.  Not only should we be grooming our young lawyers to be emotionally intelligent managers, but we should also be specifically rewarding those who are expert at recognizing and using emotions, an item I would bet is not currently on any evaluation form.

Assessing Courage and Courageously Assessing

"We evaluate 'courage' as a behavioral characteristic of our lawyers, and we link this evaluation to compensation," says John P. Donahue, Senior Vice President, General Counsel and Secretary of Rhodia Inc., in the July 2007 issue of InsideCounsel.   Rhodia has "embraced professional objectivity of its in-house lawyers as a core value" and Donahue wants to make sure that "our lawyers can deliver bad news to clients," with whom they are often closely aligned. 

Valuing Courage

Given the data we have about the strong tendency of lawyers to avoid rather than confront conflicts (yes, even those feisty litigators, oddly enough) (see my article "The Unique Psychological World of Lawyers"), Donahue's goal is one that can't be lauded enough.  Hospital administrators contend that a ratio of 1 conflict avoider in 4 employees results in a "dangerous workplace"--think:  "I don't want to get so&so in trouble over reusing needles" or "Maybe she'll start writing down dosages after she gets used to our procedures". 

Left to their own proclivities, lawyers' much higher rate of avoidance than hospital workers risks being just as dangerous.  Avoidance not only fails to resolve firm and client issues, but at the extreme, failure to report and confront violations of Sarbanes-Oxley, insider trading and discrimination laws, to name a few, can not only crater a career, but also a firm or a company.  Add in malpractice, fraud and the range of criminal possibilities (see, for example, Enron and other corporate demises and the unfolding saga of Milberg Weiss Bershad & Schulman) and silence should never be considered golden.

Hence Donahue's laudable efforts to support and promote courage.   

Which is where our thought for today could end.

Evaluating Courage

But Donahue goes further than suggesting putting in place environmental supports like "constantly talking" about maintaining objectivity, creating a culture that embraces bearers of bad news and rotating lawyers among client departments. He wants his lawyers' courage to be evaluated and then to compensate them accordingly.

Evaluating courage or any other personal characteristic as it relates to their work is a radical idea to many lawyers. Basing compensation on that evaluation is outlandish.  They don't know what a "behavioral characteristic" actually means, don't trust the evaluation process, and certainly don't think their compensation should be linked to so un-rigorous a process.  They are, after all, good lawyers, and good lawyers average in the top 10% on the characteristic "skepticism" in personality assessments (see again my article "The Unique Psychological World of Lawyers").

In this case, they should get over it.  Whether Donahue is using structured assessments or more unstructured evaluation techniques, these behavioral and personality evaluations are likely to be the key for law firms and law departments to break their recruitment and retention quandaries and, as icing on the cake, help solve the diversity dilemma.  (See my January 5, 2007 blog entry "KPMG Model Delivers Risk Management, Teamwork, Client Satisfaction and Diversity Too," reporting on KPMG's use of the Birkman Method assessment to revamp its business model and achieve retention and diversity goals.)

This is not a new position, at least for me.  (See my article "The Case for Assessment: Using Discrimination for Better Hiring," which outlines all the uses of assessments in the non-law firm world and how law firms might profit from them.)  And now the tipping point is in sight as more law departments and law firms inch towards greater use of evaluations and assessments-- and trumpet the benefits.

General Counsel Scott Terrillion, of Boehringer Ingelheim Pharmaceuticals Inc, uses an "evaluative selection method" to find the best attorneys for his company, with diversity being a natural consequence.  Roland Dumas, director of diversity for the legal recruiting firm Major, Lindsey & Africa, points out that "if a law firm screens candidates based on what law school they went to and how well they did there, it won't achieve much diversity.  There simply are not enough African-American and Latino law students in the top law schools who would survive the 'top quarter' cut."  Instead, Dumas recommends "capabilities" interviews, which use rich conversations to probe candidates to find those who have the talents the firm values. 

Struggling to complete with bigger firms, Kansas City, Mo.-based Blackwell Sanders developed a system for selecting and assessing associates that is more behaviorally evaluative than most firms use, and it found that using these behavioral evaluations, starting with the initial interview, enabled the firm to spot talent it might otherwise miss. The firm has documented its efforts in a handbook, From Classes to Competencies, Lockstep To Levels, which, according to the foreword by Ida Abbott, is "an act of remarkable candor and leadership ... [that] will enable law firms to expedite the design and implementation of competency-based evaluations and performance-based advancement."

The proof, as they say, is in the pudding.  Blackwell Sanders doubled the total number of minority associates, tripled the number in recent incoming classes, and increased by 22% the number of females associates.  Perhaps even more notable, a "high" minority attrition rate declined to "0" within four years. 

Jeffrey N. Berman, managing partner at Berman Fink Van Horn, says that for the last 10 years his firm has taken an even more radical step--using individually administered psychological assessments as part of their hiring process. Determining assessment traits important to the firm has given the firm "a handle on the type of attorney that is going to be happy and successful here," Berman says.  

The firm tells all prospective hires, lawyers and staff, that they will be required to take a personality test if an offer is made.  Contrary to the fear of many hiring partners, Berman reports that no one has ever objected to the assessment or refused to proceed, in part, he believes, because everyone in the firm has participated and also because it has been so accurate in predicting success.   "It never ceases to amaze me how accurate the testing is," he adds, noting that it has never proved inaccurate with anyone they've hired, even when the results contravene the impression of interviewers.

So diversity is not the only benefit firms can expect from the targeted use of evaluations and assessments--law turnover and high satisfaction and performance result as well. 

Our firm offers law departments and law firms state-of-the-art advice on identifying the characteristics that produce happy, productive lawyers in your environment and designing evaluations and assessments to use in hiring and promoting those candidates.  Don't be left in the backwash.  This is a wave that can do much to move you forward.

 

The Superman General Counsel

Behavioral science is not often invoked in the halls of law departments, but maybe it should be.  Two recent articles highlight the importance to a GC's success of understanding why people think and act as they do.

General counsel are in the position of having to reconcile two jobs: being both a business partner in the management of the company's business and the guardian of the company's integrity.  One aspect of their work requires creativity, risk-taking and far-sightedness.  The other requires careful scrutiny of every corporate action in the short and long term for potential regulatory, liability and just plain reputation pitfalls.  Achieving high productivity with high integrity might strain even Superman's talents.

An article in Corporate Counsel by Ben W. Heineman Jr, former GE senior vice president-general counsel, entitled "How GCs Can Avoid Being Caught in the Middle" recites some of the recent scandals that attest to how difficult that balancing act can be:  the fraudulent financial practices at Enron, the pretexting at Hewlett-Packard Corp, and the wave of options backdating.

Perhaps what chilled GCs to the bone most recently were the guilty pleas by Purdue Pharma L.P., its president, GC and former chief medical officer to misleading the public about the drug OxyContin's risk of addiction.  They have agreed to pay a total of $634.5 million in fines.  Rather than relaying focus group concern about potential for abuse, Purdue Pharma gave false information to its sales representatives that the drug was less addictive than other painkillers.

Heineman mentions a number of attributes that can help GCs successfully straddle their two roles.   Vis-a-vis the other corporate managers, the GC must have the ability to stand his/her ground on clear illegalities and to make sure he/she has enough time to assess those situations that are not clear cut.  And GCs must be able to take those stands in the pressure-filled environment of a board meeting where the CEO is likely to be a ferocious skeptic and many board members will side with the CEO.  See our July 18, 2007 entry on Promoting an Effective Board about the importance of personal attributes in good decision-making.

The Texas Lawyer article "It's All in Your Head:  Cognitive Theory Can Help GCs Lead Organizations to Better Decisions" by Michael Maslanka, a managing partner at Ford & Harrison in Dallas, contends that a GC's real power--the ability to influence decisions-- comes from understanding the way people think, which requires tapping into cognitive science.

Maslanka lists a number of biases that people in general and managers specifically can suffer from if they aren't on the alert: 

  • The bias that there is only one cause when something bad happens
  • The tendency to focus on conclusions and generalities instead of specifics
  • Hardwiring that makes it easy to believe accusations and hard to disbelieve them
  •  A confirmation bias, which only admits facts that support our beliefs (and further reinforces our belief bias)
  • Overreliance on what is first heard
  • Resistance to change that can only be overcome with practice, practice, practice

Maslanka encourages GCs to be open to all possibilities and to question rather than dictate.  Heineman also points out the importance of maintaining within the law department a culture that welcomes, even requires, lawyers to raise concerns about financial, legal, ethical or reputational issues.  We refer to this as a "culture of dissent"-- one that invites concerns, follows up on them and does not punish anyone for raising them, but rather praises them.  See our March 16, 2007 entry on the article Handling Conflict and Dissent in Law Practice (and Life).

While it may not be mind reading, being cognitively aware of your own personal attributes and biases, as well as others', can help steer you toward that Superman performance to which all GCs aspire.