Summary Judgment Benchmarks for Settling Employment
Discrimination Lawsuits
Hofstra Labor & Employment Law Journal
Fall 2005
Vivian Berger[*],
Michael O. Finkelstein[*],
and Kenneth Cheung[* ]
I. INTRODUCTION
he number of employment discrimination lawsuits rose continuously
throughout the last three decades of the twentieth century. In
the federal courts, such filings grew 2000%, while the docket as
a whole increased a mere 125%. [FN1]
In the twelve-month period ending on September 30, 2003, tables
put out by the Administrative Office of the U.S. Courts indicate
that these actions amounted to slightly more than 8% of all civil
cases initiated in that fiscal year (FY).[FN2] Likewise,
filings at the EEOC have mounted.[FN3] The
two trends are not unrelated; in order to bring an action in court
to redress alleged job discrimination, the plaintiff must first
exhaust his administrative remedies. Usually, he will do so by
bringing his complaint to the EEOC (although in jurisdictions with
a similar state or local agency, he may opt to go there instead).
The vast majority of civil lawsuits do not culminate in post-trial
judgments; those that are not dismissed before trial very often
settle.[FN4] Employment
actions are no different. Courts and agencies, concerned about
controlling their dockets and using their limited resources efficiently,
deem settlement promotion desirable - particularly so in a case
category as large as employment discrimination. From a broader
vantage point, the public interest in vindicating civil rights
laws makes achieving just compromise an aim that transcends individual
litigants' goals.
Parties and lawyers entering settlement negotiations must be
able to assess the value of the case as accurately as possible.
To the extent that the adversaries have congruent views of the
worth of the lawsuit, resolution is not only more likely but also
more apt to be fair. But in actuality, the parties and the attorneys
involved in legal proceedings almost always harbor bias, an understandable
tendency to magnify the merits of their own positions.
The plaintiff employee, who has ordinarily resigned or been discharged
from his job prior to embarking on litigation, [FN5] is
often blinded by serious emotional and financial distress, [FN6] causing
an overly optimistic estimate of her chances of prevailing and
recovering significant damages. Similarly, defendant employers
are often irate at what they regard as the employee's betrayal
or extortion, producing the same distorting effect that plaintiffs'
strong feelings exert on case evaluation. In a perfectly logical
world, the parties' estimates of their probabilities of victory
should add up to 100%. In the real world, at the outset of talks,
the total may be as great as 150%! Such delusions impede settlement.
Mediation, by contrast, promotes compromise by injecting a neutral
third party into a dispute. The growing governmental (including
court) usage of alternative dispute resolution (ADR), fueled by
legislative mandates or encouragement, has created a large demand
for mediation services. [FN7] Many
of the cases sent to mediation by judges of the U.S. Courts for
the Southern and Eastern Districts of New York (S.D.N.Y. and E.D.N.Y.)
are ones alleging job discrimination. [FN8] The
EEOC, on its part, also relies heavily on mediation. [FN9]
Unlike courts, administrative agencies, or arbitrators, a mediator
does not make factual findings or issue orders; her role is solely
to facilitate talks between the parties. Furthermore, mediation
participants seeking ways to end controversy are not constrained
by governing law - they may agree to anything that is not illegal.
As a practical matter, however, the further along a case has proceeded
on the litigation track, the more the parties will feel pressured
to bargain in the shadow of the law. Otherwise put, in making and
weighing demands or offers, they will try to predict what would
happen if, instead of settling on specific terms, they went to
trial. Also, in "late-stage" employment cases, the employer
and the employee (who, as noted above, [FN10] have
usually long since parted ways), tend to focus their negotiations
mainly or exclusively on money.
In this context, a large part of the mediator's task, while in
private caucus with each side, involves "reality testing"
the litigants' and lawyers' assumptions and predictions. The mediator
assists the parties in estimating the probability of the jury's
finding a violation of law and awarding a particular amount of
damages. In the job discrimination area, this entails judging how
much the employee would likely receive in back pay, front pay,
compensation for pain and suffering, and - in rare cases - punitive
damages, discounted by the risk of a determination of no liability.
In addition, with the mediator's aid, the defendant must calculate
the odds that it will have to pay a prevailing plaintiff's attorney's
fees, [FN11] as
well as take into account the cost of its own counsel and other
litigation expenses, which it will incur in any event, win or lose,
in mounting its defense. The plaintiff does not have similar concerns.
He will not have to pay for opposing counsel and will often not
be responsible for his own attorney's fees because plaintiffs'
lawyers generally work on a contingency- fee basis. [FN12] This
arrangement does, however, give the attorney a stake in the case.
A major part of reality testing in employment actions involves
assessing the chance the defendant will succeed in getting summary
judgment, in whole or in part, against the plaintiff. In Professor
Berger's experience, most employers' counsel say during mediation
that they intend to file a "Rule 56" motion [FN13] if
the case does not settle; and at least in the Southern and Eastern
Districts of New York, a large number of employers do so. [FN14] By
contrast, practically no plaintiffs in employment cases make such
motions.
The judge's decision to grant or deny summary judgment is a critical
juncture - it can make or break a case. Except in the instance
of a motion for partial summary judgment, a grant means total defeat
for the plaintiff; the case is over unless he brings and wins an
appeal, an unlikely prospect. Thus, the mediator has to focus the
employee's team on the need to discount anticipated gains by the
risk of loss, not just at trial but of trial itself. Even partial
summary judgment, if it strikes at the heart of the plaintiff's
case, can constitute a major setback for him. For example, if the
court dismisses all of the plaintiff's federal claims with prejudice,
it is likely to dismiss his supplemental state claims without prejudice. [FN15] In
addition, a plaintiff occasionally expresses a wish to go to trial
rather than settle even if he understands that his chances of victory
are slim, stating that he will be content merely to tell his story
to, and be judged by, a jury of his peers. In order to make a rational
decision whether to reject offered terms to satisfy this emotional
interest, such a litigant plainly requires as accurate an estimate
as possible of his odds of talking to a jury at all.
Lastly, even though denial (total or partial) of a motion for
summary judgment does not theoretically dispose of the case, as
does a grant, practically it may. Defendants often become serious
about settling only when confronted by this negative turn of events.
Moreover, survival of one or more of the plaintiff's claims greatly
raises the settlement value of the case. [FN16] Litigation
costs will escalate if the matter is tried. Further, denial of
summary judgment forces a defendant to confront squarely the daunting
prospect that it may also end up paying substantial damages. Even
an employer sanguine about eventual victory knows that juries are
unpredictable. In these circumstances, early voluntary resolution
may present an attractive prospect to an employer focused on facts
rather than emotions. Therefore, a defendant, much like a plaintiff,
must be prodded to evaluate its risk of summary judgment carefully.
To be sure, although we have been speaking mainly in terms of
mediation, information bearing on the likelihood of summary judgment
is also useful to lawyers and clients in standard, unaided negotiations;
we hope and expect that our study will assist the employment bar
in settlement talks whether or not a neutral party participates.
But it does bear emphasis that a key advantage of mediation stems
from the presence of an impartial facilitator, who can employ private
conferences to explore candidly with each side its vulnerability
to a grant or denial of summary judgment (in addition to other
litigation perils). Given their bias, both parties tend to view
summary judgment through rose-colored glasses until the mediator
presses for a more realistic outlook.
Our examination of summary judgment comes fortuitously at a time
when scholars, as well as some judges and lawyers, have been drawing
attention to the "Vanishing Trial" phenomenon. In addition
to articles, symposiums have been devoted to this subject. [FN17] Using
data supplied by the Administrative Office, Professor Marc Galanter
has shown that in 1962, 11.5% of federal civil cases went to trial;
by 2002, the number had dwindled to a meager 1.8%. [FN18]
Interestingly, civil rights cases (a category of which about
half fall into the job discrimination area) now comprise more than
one-third of civil trials. [FN19] Yet
even in this class of cases, the number of trials has declined
dramatically: from 19.7% of civil rights dispositions in 1970 to
3.8% in 2000. [FN20]
Where have all the trials gone? The factors generally cited as
waxing while trials are waning include settlements, [FN21] ADR [FN22] -
and our concern, summary judgment. [FN23] Much
of the discussion of summary judgment in this setting consists
of bemoaning its major contribution to litigants' (principally,
plaintiffs') loss of the constitutionally guaranteed right to a
"live" trial, rather than one confined to papers. [FN24] Deploring
the loss of trials is basically a response to the "rhetoric
of 'explosion' and 'crisis"' fueled by advocates of tort reform. [FN25]
This article, by contrast, takes no position on these issues.
Descriptive, not normative, it is designed to aid lawyers and their
clients in employment discrimination actions in the district courts
of the Second Circuit - with or without a mediator's help - to
evaluate the worth of their case with a view toward achieving a
workable settlement. We now turn to the study itself.
II. THE STUDY: METHODOLOGY
ur aim was to generate a tool that would help the parties assess
the probability of their case's or claim's withstanding a defendant's
motion for summary judgment, according to the presence or absence
of certain parameters. Based on Professor Berger's experience,
those parameters were the following: type of discrimination claim--race,
color, national origin, religion, sex, disability, age or retaliation;
type of employer, private or public (governmental); and plaintiff's
status as represented or pro se. We also created a separate class
of "reverse discrimination" complaints, in which we listed
claims by males alleging sex discrimination and by Caucasians asserting
racial or ethnic bias by members of minorities. However, because
color was always linked to a charge of discrimination based on
race or national origin, we decided not to code it separately. [FN26]
We made a decision to include only those cases and claims in
which the court disposed of a defendant's summary judgment motion.
We did so because a favorable decision on such a motion by the
court is what attorneys for the defendant commonly predict in mediation,
and attorneys for the plaintiff commonly downplay; no one argues
about whether the motion will be made. Thus, we did not assemble
data to show the rate at which such motions are filed. As an extension
of our decision, (i) we counted as a denial any determination denying
a summary judgment motion in any respect; and (ii) we treated a
partial summary judgment motion that was fully granted as a grant,
not a denial. (We have more to say on this coding choice later. [FN27])
The basic statutes protecting employees against discrimination
by their employers are: Title VII of the Civil Rights Act of 1964
(Title VII), [FN28] the
Age Discrimination in Employment Act of 1967 (ADEA), [FN29] the
Americans with Disabilities Act of 1990 (ADA), [FN30] the
Equal Pay Act of 1963, [FN31] and
the Civil Rights Act of 1866. [FN32] The
Rehabilitation Act of 1973 [FN33] provides
federal employees with protection equivalent to the ADA. Although
a plaintiff will often combine one or more of these claims with
other causes of action, [FN34] we
confined our study to the abovementioned statutory claims. We did,
however, include in our purview causes of action arising under
state or city civil rights laws, such as those of New York State, [FN35] New
York City, [FN36] and
Connecticut, [FN37] which
fall under the pendent jurisdiction of the federal courts.
Our sources were two-fold. First, we surveyed all published opinions
deciding summary judgment motions by the defendant in employment
discrimination lawsuits in the district courts of the Second Circuit
for the first three-quarters of calendar year 2001. We relied primarily
on Westlaw. [FN38] A
less extensive search of cases reported by Lexis yielded virtually
no opinions that we had not discovered on Westlaw; hence, we abandoned
further research in the Lexis data base. Altogether, we found 191
relevant opinions.
We recognized, of course, that because of the well-known effects
of "publication bias" [FN39] this
method yields a skewed sample of cases. As Professors Peter Siegelman
and John J. Donohue, III have noted, rulings that dispose of a
case are more likely to generate opinions and be published than
those that do not. [FN40] Yet
short of reading hundreds of court files, we could not accurately
learn what types of claims plaintiffs had made and courts had ruled
on. To avoid the problem of substituting bad data for no data, [FN41] we
used the published opinions in ways that we believe were unaffected
by this bias. [FN42]
Our second source was the courts' online data base, "Pacer."
Among other things, it permits the user to read the docket sheets
of all cases in specific categories filed within a certain time
frame. Unlike the published opinions, these sheets do not reliably
indicate the type of discrimination (race, sex, disability, etc.)
alleged. But they do report the parties' represented or pro se
status and are indicative of whether a defendant is a public
or a private entity. Where we could not determine the latter,
we were able to garner this information from the internet.
We searched the sites for the S.D.N.Y. and the E.D.N.Y. under
the heading # 442 ("Civil rights: jobs"). For the E.D.N.Y.,
we used the calendar year 2000 and the first half of 2001, a total
of 679 cases. For the S.D.N.Y., a larger data base, we surveyed
610 docket sheets in 2000. [FN43] Looking
for cases in which the defendant had made a summary judgment motion
that the court had decided, we retrieved 294 out of a sample of
1,289 (679 + 610) filings. Thus, the rate of summary judgment dispositions
in cases filed in the two districts for the selected periods comes
out to be 22.8%.
When issues arose regarding proper classification of the data,
we made a number of categorizing choices. For one thing, the published
opinions did not always name the parties' attorneys; in this situation,
absent any mention of pro se status, we assumed the plaintiff was
represented. In addition, at times, published or Pacer cases revealed
that the plaintiff had counsel for only part of the case; we treated
the plaintiff's status at the time of the summary judgment motion
as salient for coding purposes.
When the only record of a motion's determination was a recommendation
by the magistrate judge to whom the matter had been referred, we
treated it as final; these recommendations are usually accepted.
Sometimes, too, plaintiffs would appeal grants of summary judgment.
Such decisions were virtually always affirmed. But where they were
not, we naturally treated the appellate decision as dispositive.
In a few cases, where defendants made more than a single motion,
we recorded the "bottom line": where matters stood after
the final determination. In several others, the court denied the
motion with leave to re-file later (for instance, where the plaintiff
required more discovery). In the absence of relevant subsequent
history, we coded the action as a denial.
We focused, moreover, on motions for summary judgment brought
by the company "employer," a legal entity. Although the
modern federal civil rights laws do not allow for personal liability
for individuals who exercise supervisory control over the plaintiff, [FN44] plaintiffs
will often name executives or managers as defendants (these are
actually "employees"). Represented by the firm's lawyer,
they will routinely move for and win dismissal from the case. We
did not count this collateral activity as summary judgment grants
for defendants; likewise, we ignored motions by non-employers such
as unions or employment agencies, although they are also liable
for discrimination under Title VII.
Perhaps the most difficult question was how to code the results
of motions in cases of more than a single plaintiff; happily, there
were very few. We opted for a contextual approach. If the plaintiffs
seemed to be virtually identically situated and the court made
the same decision as to all, we counted the motion only once. If,
by contrast, the plaintiffs had fewer commonalities - in outcome
or in circumstances - we recorded data for as many motions as there
were plaintiffs. In one such instance, arising on Pacer, we had
to consult the court file to get the pertinent details. [FN45]
A couple of remaining comments concern solely the Pacer cases.
We stress that we recorded data for summary judgment dispositions,
not for all motions made. Thus, if a motion was pending when the
case settled, we ignored it. Sometimes, however, though not issuing
a formal ruling, the judge behaved in a way we treated as a denial,
albeit implicit. For example, in several instances, the case went
to trial without the court's having acted on the motion. [FN46] In
one instance, the court rejected the defendant's express application
to have the motion heard before trial. Such actions or inaction,
charitably viewed, might reflect the judge's belief that uncertainty,
coupled with the looming specter of trial, would promote settlement,
thereby conserving both the parties' and court's resources.
III. THE STUDY: RESULTS
ut of our Pacer filing sample there were 294 cases in which
a summary judgment motion had been made and disposed of by the
court. Of those 294 cases there were 107 with motions that were
denied, for a rate of 36.4%. Because of publication bias one would
expect that in the universe of cases represented by our Pacer sample,
the denial rate (full or partial denial of the motion) would be
higher than in the published cases. [FN47] Our
data do reflect that bias, as appears in Table 1 below.
Table 1
Pacer vs. published cases: summary judgment denial rates
for represented and pro se cases combined, private
and public employers combined, and all districts combined.* |
| Sample |
# denied/ # total |
% denied |
| Pacer |
107/294 |
36.4% |
| Published |
59/191 |
30.9% |
| *In this and successive tables the districts
for Pacer are the Southern and Eastern Districts of New
York and for published cases are the Southern, Eastern,
Northern, and Western Districts of New York, and the Districts
of Connecticut and Vermont. |
The bias effect is relatively small - 5.5 percentage points -
but part of the effect is concealed by the larger number and proportion
of pro se plaintiffs in the Pacer cases. [FN48] One
would expect to see relatively fewer pro se matters generating
published opinions: because of unrepresented litigants' disadvantage
in articulating legal arguments, their cases are unlikely to produce
opinions of interest to anyone except the parties. Thus, when one
compares only represented cases, the difference becomes larger
- 11.3 percentage points - as shown in Table 2 below. The table
shows that summary judgment motions are denied in almost half (46.4%)
of represented cases.
Table 2
Represented Pacer and published cases: summary judgment denial
rates for private and public employer cases combined; all
districts combined. |
| Sample |
# denied/ # total |
% denied |
| Pacer |
91/196 |
46.4%* |
| Published |
54/154 |
35.1%* |
| * A 95% confidence interval for this 11.3 percentage
point difference is 0.5 percentage points to 22.2 percentage
points. |
The pro se plaintiffs in both Pacer and published cases have
summary judgment denial rates much lower than those of represented
plaintiffs. See Table 3 below. This is hardly surprising. Judges
often purport to read pro se papers with a thumb on the scale for
the plaintiff, [FN49] and
the Rules of the U.S. District Courts for the Southern and Eastern
Districts of New York require a represented movant for summary
judgment to serve on a pro se opponent a "Notice to Pro Se
Litigants Opposing Summary Judgment." However, such "band
aid"
devices cannot realistically level the playing field for the unrepresented
party. It is likely, moreover, that some, perhaps most of the pro
se plaintiffs tried to hire counsel but were turned down because
the lawyer believed they had poor chances of victory. Hence, pro
se cases start out weak and become weaker on account of the lack
of professional advocacy. Because of the distorting effect of pro
se status, the rest of our analysis, except for Table 4, is confined
to represented cases.
Table 3
Pro se Pacer and published cases: summary judgment denial
rates; private and public employer cases combined; all
districts combined. |
| Sample |
# denied/ # total |
% denied |
| Pacer |
16/98 |
16.3% |
| Published |
5/37 |
13.5% |
| * A 95% confidence interval for this 11.3 percentage
point difference is 0.5 percentage points to 22.2 percentage
points. |
The foregoing tables have combined results for the Eastern and
Southern Districts and for public (governmental) and private employers.
In represented cases, the Eastern District (46/98 = 46.9%) has
virtually the same denial rate as the Southern District (45/98
= 46.4%), and so we decided to amalgamate them, arriving thus at
the 91/196 = 46.4% figure in Table 2. Public employers have higher
motion-denial rates than private employers, as shown in Table 4
below, and the difference is of marginal statistical significance.
It is tempting to speculate about the cause for this discrepancy.
A colleague of ours thought that lawyers in the private sector
might furnish, on the whole, more skilled and zealous representation.
This possibility cannot be excluded. But in Professor Berger's
experience, at least attorneys for the New York City Law Department
as well as Assistant U.S. Attorneys provide service (in mediation,
at any rate) that is generally on a par with their private counterparts'.
In sum, we are not confident that we know of any reason for the
higher denial rate in cases against public employers; thus, despite
the finding of marginal significance, the results may well be due
to chance. [FN50] Accordingly,
except for Table 4, we have combined both types of employers.
Table 4
Pacer Cases: summary judgment denial rates by representation
and type of employer; Southern and Eastern districts
combined. |
| Type of Employer |
Represented Cases |
Pro Se Cases |
# denied/
# total |
% denied |
# denied/
# total |
% denied |
| Private |
47/117 |
40.2%* |
8/55 |
14.5% |
| Public |
44/79 |
55.7%* |
8/43 |
18.6% |
| * The P-value for this 15.5 percentage point
difference is 0.041. |
We wanted to examine the consistency of our data with those presented
in other studies. Because most other studies focused on the "Vanishing
Trial" phenomenon, they considered trial rates or total pre-trial
terminations averaged across all district courts, or groups of
districts not confined to a single circuit. In addition, they usually
combined broader collections of types of cases and made no adjustment
for pro se status. One study using Administrative Office data is
of particular interest because it is relatively recent and focuses
on employment discrimination cases. [FN51] Professors
Kevin M. Clermont and Stewart J. Schwab report that in FY 2000
the rate of "nontrial adjudications" in employment discrimination
cases for all district courts combined was 20%. [FN52] The
fact that this is higher than ours (14.5% [FN53])
may be due in part to (i) their categorization of "nontrial
adjudications" as encompassing all types of motions (for example,
motions to dismiss as well as for summary judgment), whereas we
consider only summary judgment motions and, perhaps more significantly,
(ii) their inclusion of all districts, whereas we include only
the S.D.N.Y. and E.D.N.Y. Notably, the former is reputed to be
one of three districts with the most restrictive approach to granting
summary judgment. [FN54]
Claim Survival by Type of Claim
Are some types of claims more likely to survive summary judgment
motions than others? To address this question, we examined summary
judgment denial rates in the published cases by claim type. (Recall
that the Pacer cases do not reliably indicate the kind of discrimination
involved. [FN55])
The rates of claim survival are all remarkably uniform - between
24.3% and 31.0% - with the notable exception of sex claims, which
have a survival rate of 41.7% (see Table 5, second column). The
survival rates, adjusted for publication bias, are shown in the
last column; the method of adjustment is explained below. [FN56]
Table 5
Represented published cases: claim survival rates by type
of claim; public and private employers combined; all
districts combined. |
| Type |
# Survived /
# Total |
% Survival |
Adjusted % Survival |
| Race |
14/51 |
27.5% |
36.3% |
| Sex |
20/48 |
41.7% |
55.0% |
| Age |
10/38 |
26.3% |
34.7% |
| Disability |
9/37 |
24.3% |
32.1% |
| Retaliation |
19/72 |
26.4% |
34.8% |
| Other* |
9/29 |
31.0% |
40.9% |
| Total |
81/275 |
29.5% |
38.9% |
| * National origin (5/17) + religion (2/7) +
reverse discrimination (2/5). |
The higher survival rate for sex claims (although not statistically
significant because of small sample size) appears to be due to
the inclusion of sexual harassment claims. We define these as accusations
of unwelcome sexual conduct, not solely charges that male co-workers
or supervisors created a generally hostile environment for a female
plaintiff (as, for example, by making demeaning remarks about women
or depriving them of opportunities given to men). For ease of description,
we refer to the latter as "gender," as opposed to "sexual
harassment," claims. [FN57] Of
the total of 48 represented sex cases in our sample, 27 involved
solely gender discrimination; for these the survival rate was 9/27
= 33.3%. By contrast, for the 21 sexual harassment cases, the survival
rate was 11/21 = 52%.
We have some thoughts about why complainants alleging sexual
harassment do better than others in resisting summary judgment.
For one thing, such cases frequently depend heavily on credibility
assessments. When the purported misconduct took place behind closed
doors, the historical facts raise classic "he said, she said" problems,
not susceptible to resolution on papers alone. In addition, even
in the absence of material disputes over primary facts, a finding
of sexual harassment depends on inferences drawn about the alleged
harasser's behavior and its effect upon the plaintiff. Specifically,
the focus is on whether a reasonable person would have found the
environment hostile and whether the victim, in fact, perceived
it that way. [FN58]
The latter issue plainly raises subtle questions about the plaintiff's
subjective feelings, which are ill-suited to determination on summary
judgment. Beyond that, however, as District Judge Jack B. Weinstein
suggested in Gallagher v. Delaney, [FN59] the
harassment inquiry's objective part also does not lend itself to
pretrial judicial resolution. Judge Weinstein wrote:
A federal judge is not in the best position to define the current
sexual tenor of American cultures in their many manifestations.
. . .
. . .Today, while gender relations in the workplace are rapidly
evolving and views of what is appropriate behavior are diverse
and shifting, a jury made up of a cross-section of our heterogenous
[sic] communities provides the appropriate institution for deciding
whether borderline situations should be characterized as sexual
harassment . . . . [FN60]
One might ask whether Gallagher has expressly motivated district
courts to deny summary judgment motions in cases of alleged sexual
harassment. Research reveals that 15 of our published opinions
cited Gallagher. But only three opinions used it in the context
of the need for jury determination of pertinent issues (rather
than, say, as support for a black-letter rule of law), [FN61] and
one of these granted the motion. [FN62] This
is not to say, however, that the same reasons that impelled the
Gallagher court to view sexual harassment claims as poor candidates
for summary judgment have not influenced district judges to come
to the same conclusion themselves.
Moreover, allegations of sexual misconduct, unlike charges of
wrongful dismissal, failure to promote, or other forms of discrimination
based on gender, cannot be countered with the typical defense that
the plaintiff's performance was unsatisfactory. Nor, to be sure,
can allegations of hostile environment founded on race or national
origin, for example. Yet these typically do not raise "borderline"
issues of characterization, credibility contests, or complex questions
of victim perception to the same degree as cases involving sexual
harassment. [FN63]
A second point of particular interest is that retaliation - the
largest category - does not have a higher survival rate and, in
fact, has a slightly below-average rate. Received wisdom is that
retaliation claims have higher survival rates. This makes sense.
A plaintiff can prevail on retaliation without proving the validity
of the underlying claim of discrimination: he need only show that
he engaged in protected activity known to the employer, that he
suffered an adverse employment action, and that the former caused
the latter. [FN64] Many
cases present the pattern of a bias complaint by the employee (which
is protected), followed by his termination. If the time interval
between the two is relatively brief, a jury will ordinarily be
permitted to infer causation. [FN65] Hence,
the relatively lower rate we found for retaliation claims may be
due to sampling error. [FN66]
Finally, it bears brief mention that disability claims came in
lowest in terms of survival (though, again, not by much). ADA claims
in general do poorly in the courts [FN67] because
of restrictive interpretations given the statute by the U.S. Supreme
Court. [FN68] We
would expect that the rate for this category would have been even
lower if not for the fact that New York State and New York City
have laws defining "disability" more broadly than the
ADA; [FN69] knowledgeable
plaintiffs routinely include such pendent claims in their complaints. [FN70]
Adjusting Claim Survival Rates for Publication
Bias
The figures in the second column of Table 5 apply only to claims
in published cases, leaving us with publication bias. To adjust
for this effect, imagine there is only a single claim made in each
case. In that event, the adjustment for publication bias for claims
would be the same as the adjustment for cases. This would be 46.4%
/ 35.1% = 1.32 (see Table 2). Thus, the overall claim survival
rate would rise by a factor of 1.32, from 29.5% to 38.9% (see Table
5). If publication bias affects different kinds of claims equally,
the survival percentages for each type of claim would increase
by 1.32, with the results shown in the last column of Table 5.
Making this adjustment, the survival rate for sex discrimination
claims rises to 55%, with the rest of the claim types ranging between
32.1% and 40.9%.
We justify applying this average adjustment rate to different
types of claims because the impetus for opinion writing and publication
would appear to be largely unrelated to the type of claim. [FN71] That
seems a reasonable assumption, at least when survival rates for
different kinds of claims are fairly close, as they are here. The
one exception is sex discrimination: since summary judgment is
denied more often in these cases than in other types, and since
denials of summary judgment are more likely to be unpublished than
grants, sex discrimination cases may be over-represented in unpublished
cases. If this is so, the adjustment factor would be smaller than
the 1.32 figure used in Table 5. We note that even if a systemic
difference existed, the effect would be dampened by the fact that
a substantial portion of the Pacer cases had published opinions. [FN72]
Adjustment for Multiple Claim Cases
The adjustment for publication bias was based on case-survival
figures, and was equal to the adjustment for claim survival on
the assumption of one claim per case. But since there are many
cases with multiple claims, we must now consider whether a further
adjustment for that factor is warranted. [FN73] We
refer to the factor by which case survival rates must be multiplied
to arrive at claim survival rates as the "claim-adjustment"
factor. [FN74]
When there are multiple-claim cases, the rate of case survival
will be higher than the rate of claim survival because the motion
fails if any challenged claim survives. Thus, the claim-adjustment
factor should be less than 1. Our published case data do demonstrate
this result: the claim survival rate is 84% of the case survival
rate. [FN75] The
size of the claim-adjustment factor is a function of the way claims
are distributed among cases. This is not known for the unpublished
cases, but we think it reasonable to assume that the distribution
of claims across cases is the same for unpublished as for published
cases. In that event, the claim-adjustment factor would be the
same for both groups of cases and would cancel out in the adjustment
ratio. [FN76] Hence,
we made no change in the ratio.
Other Sources of Bias
In addition to publication bias and case effect there are other
possible sources of bias. First, the Pacer cases are only from
the S.D.N.Y. and the E.D.N.Y., while the published cases come from
all the district courts in the Second Circuit. However, when published
cases are confined to the Southern and Eastern Districts the results
are virtually unchanged: the survival rate for represented cases
goes from 35.1% to 34.6% (37/107). The survival rates for claims
are also not greatly changed. For example, in the case of sex discrimination,
the rates of survival are almost the same for the two groups of
districts separately, so their combined figure fairly represents
each. [FN77] Second,
the Pacer data are cases filed in 2000 and 2001 with summary judgment
decision dates ending in June 2005; the published cases have decision
dates in 2000-2001. The time frames are, therefore, slightly different.
However, they substantially overlap, and we know of no intervening
developments in the law that would have affected survival rates.
Third, not all the Pacer cases were resolved in our study window,
creating the possibility of bias by excluding pending cases. This "tail" problem
is endemic in legal studies, and Mr. Finkelstein and his colleagues
have dealt with it elsewhere. [FN78] But
the problem does not appear to be serious here: after a follow-up
there were only 14 pending Pacer cases compared with 294 completed
cases. Accordingly, the excluded cases were less than 5% of the
total.
Fourth, one may question our decision to treat partial summary
judgment motions as granted (as long as they are fully granted)
even when the case survives for the claims not challenged. We recognize
the problem, but treating partial summary judgment motions as denials
with regard to the unchallenged claims would be somewhat inconsistent
with our decision to look at survival rates only for cases in which
a motion was made. Either treatment has its drawbacks. Fortunately,
there are only two published cases in our data in which partial
summary judgment motions were fully granted, so the issue is not
material.
The Appraisal of Cases
Assuming that our estimates of average survival probabilities
for the various types of claims are good starting points for evaluating
the claims, how should a mediator or negotiator assess the probability
of some claim surviving? When there is a single claim, the adjusted
percentages in the last column of Table 5 provide a fair starting
point for estimating survival probabilities. When there are multiple
claims, the problem is more difficult. Because the fates of claims
are highly intertwined, in most cases it would be inappropriate
to compute the probability of a claim surviving as if claim survivals
were independent events. The alternative is to estimate survival
rates for different groupings of claims. Unfortunately, there are
many possible groupings, and we do not have the large database
that would be required for that purpose. [FN79]
In our experience most cases have a claim that is the gravamen
of the action. As a result, a mediator or negotiator should probably
be guided by the probability of survival for that type of claim
without adding much or anything for other claims' survival probabilities.
The one exception might be where the second claim is for retaliation,
and in such cases some addition may be appropriate. [FN80]
IV. CONCLUSION
ur Pacer data provide an estimate that, in represented cases,
almost half of summary judgment motions are at least partly denied.
Based on our experience, this is probably closer to the plaintiff's
estimate of survival chances than most defendants'. By contrast,
where the plaintiff is pro se, denials occur in only about 15%
of the cases. The difference presumably arises both from the fact
that the case was weak (no lawyer, if any was asked, would take
it) and the plaintiff's disadvantage of lacking a lawyer to fight
the motion. [FN81] Nothing
else is as predictive of the result on summary judgment as the
status, represented or not, of the plaintiff. We also found a somewhat
higher rate of summary judgment denials when the defendant is a
public, as opposed to a private, employer. The reason for this
difference remains unclear.
When we compare our Pacer cases with our published cases, there
is evidence of publication bias: the former have a higher survival
rate. This is an expected result because a judge granting summary
judgment will almost surely write an opinion, but will not necessarily
do so when denying the motion.
|