National Center for State Courts

 

Improving Justice through Leadership
and Service to the Courts

     

  

Trial Court Perforrmance Standards & Measurement System

Standard 3.2: Juries

Jury lists are representative of the jurisdiction from which they are drawn.

Commentary. Courts cannot guarantee that juries will always reach decisions that are fair and equitable. Nor can courts guarantee that the group of individuals chosen through voir dire are representative of the community from which they were chosen. Courts can, however, provide a significant measure of fairness and equality by ensuring that the methods employed to compile source lists and to draw the venire provide jurors who are representative of the total adult population of the jurisdiction. Thus, all individuals qualified to serve on a jury should have equal opportunities to participate, and all parties and the public should be confident that jurors are drawn from a representative pool.

Standard 3.2 parallels the American Bar Association’s Standards Relating to Juror Use and Management (1993). These standards emphasize that "the opportunity for jury service should not be denied or limited on the basis of race, national origin, gender, age, religious belief, income, occupation, or any other factor that discriminates against a cognizable group in the jurisdiction" served by the court. Procedures designed to achieve representativeness include combining regularly maintained lists of registered voters and licensed drivers and using random selection procedures at each step of the jury selection process.

Measurement Overview. As noted in the introduction to this performance area, courts cannot guarantee that juries reach equitable decisions. Nor can they guarantee that the individuals chosen through voir dire to sit at trial are representative of the community from which they were chosen. Courts, however, can provide a significant measure of fairness and equality by ensuring that the methods employed to compile source lists and to draw the venire are representative of the total adult population of the jurisdiction. Thus, all those individuals qualified to serve on a jury should have equal opportunity to be considered and selected. This will help ensure that all parties and the public are confident that jurors are drawn from a representative pool.

Standard 3.2 parallels the emphasis on broad participation in and representation on juries found in the standards on juror use and management that have been adopted by the major national court organizations including the American Bar Association (ABA) and by many of the States.2 These standards emphasize that jury duty should not be denied or limited on the basis of any factor discriminating against a "cognizable group" in the jurisdiction served by the court. Such a group can be "an economical, occupational, social, religious, racial, political, or geographic group in the community such as physicians, blacks, Protestants, or welfare recipients." Procedures designed to achieve representativeness in juries are included in ABA Standard 2. This standard encourages maximizing representativeness and inclusiveness of the jury source list by combining regularly maintained lists of residents, if any single list is found lacking. ABA Standard 3 encourages the use of random selection procedures at each step of the jury selection process.

There are three measures associated with Standard 3.2. The measures focus on jury representativeness, considered by many courts to be the most crucial indicator of quality. However, the measures are presented here in a sequence that parallels the developmental nature of the jury selection process—compilation of the source list, design and application of random selection procedures, and selection of the juror pool.

Measure 3.2.1 focuses on the inclusiveness of the source list. Inclusiveness is measured by comparing the number of names on the source list with the number of age-eligible persons in the population of the jurisdiction.3 If the census or other demographic source indicates that the jurisdiction contains 100,000 persons over the age of 17 (assuming the statutory minimum age is 18) and the source list is the voter list containing 80,000 names, the inclusiveness of the voter list is 80 percent. Though not ensuring representativeness, high levels of inclusiveness provide reasonable representativeness. Theoretically, if inclusiveness is 100 percent, representativeness is achieved. Inclusiveness is an excellent first measure because it is subject to straightforward calculation and because it provides the first indication of compliance with this standard. It is possible that a small list with low inclusiveness could represent the population, particularly if the population is very homogeneous. However, many persons would not be available to be selected for jury service if the inclusiveness were low. In the interest of equality and fairness and the desirability of broad citizen participation, the inclusiveness should be as great as possible. The greater the inclusiveness, the greater the sharing of responsibility and burden of jury service. Thus, inclusiveness has a dimension beyond representativeness, that of citizen participation in the administration of justice.

Measure 3.2.2 focuses on the use of random selection procedures. For years the jury system was marked by the appearance of individuals hand selected from certain strata of the population. Discrimination, intentional or not, was usually the result. Verdicts reflected the community standards of these strata, and the viewpoints of juries rarely reflected those of the entire community. It was only in 1975 that the U.S. Supreme Court held that women could not be excluded simply because they are women.4 With the previous measure emphasizing the use of a broadly inclusive list, the advantages of such a list are lost if the selection of names from this list is not random. The ABA standards call for randomness at each stage of the juror selection process while recognizing that certain practices are nonrandom but nonetheless permissible. Employing these standards eliminates all other nonrandom procedures.

The permitted nonrandom procedures given in Standard 3 of Standards Relating to Juror Use and Management are as follows:

  • To exclude persons ineligible for service. The inability to communicate in English or the existence of a felony conviction are nonrandom within the population, but exclusion of these persons is permitted.

  • To excuse or defer prospective jurors. An excuse based on individual or community hardship or postponements to permit persons to serve who would otherwise be excused are nonrandom but permitted within statutory or case law limits.

  • To remove prospective jurors based on challenge for cause or if challenged peremptorily. These discretionary practices, if established by statute or rule, are permitted.

  • To provide all prospective jurors with an opportunity to be called for jury service and assigned to a panel. In this practice, all persons reporting for jury service are randomly assigned to a panel for voir dire before anyone is assigned a second time. The result is the best possible representativeness, although it is not a purely random selection.

The measures of randomness can be complex. The method proposed is based on careful observation rather than on statistical measures. Observations of situations of nonrandomness beyond reasonable expectations, in turn, place the burden on the court staff to explain the reasons for the unexpected outcomes.

Finally, Measure 3.2.3 focuses on the representativeness of the final juror pool. Representativeness of the pool or venire of prospective jurors is measured by the degree to which those persons in the pool or panel represent, by some demographic category, the population in the jurisdiction. Typical categories are race, ethnic origin, age, gender, occupation, and education. Representativeness is the means by which courts usually assess the selection, qualification, and summoning processes of the jury system, although standards of permissible deviations of representativeness have not been established.

Both inclusiveness and representativeness use the total population within the statutory age limits as the basis of comparison. The total community is the basis, whether drawing on the constitutional mandate of "an impartial jury of the State and District" or on the case law mandate of Duren v. Missouri, in which the U.S. Supreme Court defined the test for denial of a fair cross section.5 The census provides the best measure of the total community. Although some local data sources may be available, the following discussions for measuring the compliance with inclusiveness and representativeness are based on census data.

___________________________________
2 A publication, Standards Relating to Juror Use and Management, is available from the American Bar Association, 750 North Lake Shore Drive, Chicago, Illinois 60611.
3 G.T. Munsterman and J.T. Munsterman, "The Search for Jury Representativeness," Justice System Journal 11 (1986):59-78.
4 Taylor v. Louisiana, 419 U.S. 526 (1975).
5 Duren v. Missouri, 439 U.S. 357 (1979).

Go to Performance Area 3

Measure 3.2.1: Inclusiveness of Jury Source List

This measure compares the number of names on a court’s juror source list(s) with the number of age-eligible persons in the jurisdiction’s population. The more closely the numbers match, the better the court is performing on this measure.

Planning/Preparation. The U.S. Department of Commerce, Bureau of the Census, publishes the population statistics of all counties in the County and City Data Book.6 More detailed data for each State can be found in General Population Characteristics, also available from the Bureau of the Census.7 (The latter is PC 80–1–BXX where XX is the State volume number.) This volume contains the age, race, gender, and national origin composition of each county as reported by the census every 10 years. Extrapolations of these data for the period between the census years are prepared by the Bureau of the Census and by local units of government such as planning commissions. In addition, a Census Data Center in each State (usually at one of the major universities) provides access to and assistance with census data and other statistics or data sources.

The eligible population for these calculations are citizens 18 years old and over, or whatever age stratification is defined for the State. Excuses granted for the elderly do not reduce the eligible limits unless individuals over a certain age are prohibited from serving on jury duty. Courts may wish to adjust the eligible population by excluding those who are hospitalized or incarcerated, or who are nonresidents (e.g., military personnel). However, these adjustments are usually beyond the accuracy of the measurement.

Data Collection. The source list may be one or more combined lists from which names are selected. Typical lists are the voters list, the drivers list, the merged voters and drivers list, or other single or merged lists. The size of the source list is determined by summing the number of names on the list(s).

Inclusiveness is measured by dividing the size of the list by the size of the eligible population. For instance, if the size of the source list is 1,439,066 and the size of the eligible population is 1,541,050, the calculation of inclusiveness would be .9338 or 93.4 percent.

Data Analysis and Report Preparation. An absolute standard of inclusiveness has not been adopted. ABA’s Standards Relating to Juror Use and Management states that courts should determine inclusiveness and evaluate if improvement is needed. The national rate of voter registration and the percentage of drivers (including only those persons over 18 years of age), 64.3 and 86.6 percent, respectively, in 1986, suggest some guidelines.8

A problem with all lists is the inclusion of noneligible persons, which gives a false sense of inclusiveness. The drivers list may include out-of-State residents or persons under the age of 18. Merged lists may contain persons who appear on both original lists and were not recognized as duplicates.9 Inclusiveness in excess of 100 percent is often seen with merged lists due to these situations. The extent of the inflation can be estimated from the response to the first mailing sent to the names selected and from those found to be disqualified for reasons such as noncitizenship or nonresidence. The level of undeliverables is also a measure of how up-to-date and inclusive the list may be. High levels of nonresponse should be pursued not only to establish system integrity (i.e., are citizens recalcitrant or simply not there?) but to further refine the inclusiveness measure. While questioning the inclusiveness measure in these courts, they do attest to the good faith effort to broaden the coverage to the maximum extent possible.

A standard of 85 percent inclusiveness has been suggested for any list, which would require a good single source list or the merging of several lists.10 Although an 85 percent inclusive list could completely exclude a minority that constituted 15 percent of the population, such a result is highly unlikely.

This measurement of inclusiveness is considered a useful first indication of jury list adequacy. Comparisons by county within a State, the trend over years, or the change when new lists are compiled can provide a valuable benchmark to understanding the jury system. Courts with inclusiveness values less than 85 percent should examine their levels of representativeness as discussed in Measure 3.2.3.

________________________________________
6 Available from the Superintendent of Documents, Government Printing Office, Washington, DC 20402.
7 Most libraries have these volumes.
8 U.S. Department of Commerce, Statistical Abstract of the United States, 1988 (Washington, DC: Bureau of the Census, 1988).
9 National Institute of Law Enforcement and Criminal Justice, Multiple Lists for Juror Selection: A Case Study for San Diego Superior Court (Washington, DC: Law Enforcement Assistance Administration, U.S. Department of Justice, 1978).
10 National Center for State Courts, Methodology Manual for Jury Systems, NCSC Publication CJS-004, (Williamsburg, VA, 1981).

Go to top of page

Measure 3.2.2: Random Jury Selection Procedures

This measure determines whether a court is using random selection to select prospective jurors from the juror source list(s). Data are obtained by comparing actual prospective juror panels with those that would be expected if random selection was used.

Planning/Preparation. Although courts may say that all names are considered for selection, some statutes, rules, or jury plans specify that strata be observed. In such cases, courts draw names to represent each strata equally or to represent each strata according to some ratio. For instance, some jurisdictions draw by district strata so that the number of names selected from each district is in proportion to the population of the district as compared with the population of the whole jurisdiction. If the source list equally represented each district, a random selection would equally represent each district, to within a small margin of error. These stratified selections are intended to overcome any unequal representation in the source list or lists. However, before applying such techniques, courts should ensure that they are allowed by some authority.

Measures of randomness can be very complex.11 For this measurement, it is recommended that courts compare several observations with expected values. Although deviations from expectations are in some cases proof of randomness, persistent patterns of nonexpected results should require investigation. For instance:

  • A panel of 30 prospective jurors, all male, is expected to occur in every billion panels. One occurrence is reason for great amazement; two occurrences should provoke great concern.

  • Although the alphabet has never been shown to produce a bias, a group of prospective jurors in alphabetical order, or representing only a portion of the alphabet, raises questions of inclusiveness or discretion.

  • A potential jury pool consisting of more than one individual with the same last name or the same address can be expected to occur occasionally but should be checked if occurring regularly.

  • The same people often are called for jury service year after year or several times within the same year. Repeat selections are expected. If 10 percent of the list is selected each year, 1 percent will be selected in 2 successive years and .1 percent will be selected 3 successive years. Values greater than this need to be investigated.

Data Collection. This measure is conducted by examining the list of persons reporting for jury service. These persons may be the entire pool of prospective jurors or, if persons are brought to the court in panels, a number of panels could be examined. Several hundred names should be adequate for these examinations.

If suspicious patterns are found, persons reporting in at other court or jury terms should be examined. If the patterns persist, problems clearly exist. If the patterns are related to the date of service, problems likewise may exist. Patterns to examine are:

  • Alphabetical distribution. Half of the last names should be grouped A through K. Deviations of more than a few percent should be investigated to examine the alphabetical distribution of the source list or lists.

  • Alphabetical inclusiveness. The last names of those serving should represent the entire alphabet. Omissions of the top or bottom of the alphabet should be examined because such omissions would indicate that the whole list was not used. Panels of persons whose last names contain only a portion of the alphabet are probably being called in via a recording that identified individuals to report by last name. This practice should be replaced with one that uses random numbers to select individuals.

  • Geographical distribution. To the extent possible, the panels or pool of prospective jurors should represent the entire jurisdiction. Lack of representation for a distinct area of the jurisdiction could indicate that a geographical listing such as the voter list is being used sequentially rather than by a random selection from the entire list.

Data Analysis and Report Preparation. Nonrandom results are usually the result of the use rather than the generation of random numbers. The problem is in how these numbers are used to select names. If nonrandom results are discovered, detailed discussions with those making selections (i.e., data processing or court staff) are needed. Factors to examine include:

  • Are the same key factors used for each selection?12 If a random start/fixed interval method is used, the start number must be randomly selected in the range from one to the interval number. (If 100 names are desired from a list of 1,000 names, the interval is 10. If "2" is randomly selected, the names at 2, 12, 22, 32, etc., in the order are selected.)

  • If a computer random number generator is used, are the input numbers or seeds changed each time the program is run?

  • Are names held out or passed over due to permanent exemptions or prior service? If these names represent more than a few percent of the source list, this could be the cause of the problem.

  • Are the lists or files thought to be random actually sequential lists or files by alphabet or geography? Voter registration lists are often geographically separated by precinct, ward, or district. Lists ordered by voter registration number may have an age order with older citizens having lower voter numbers.

  • Do the selected names represent the same list? If a printout of the voters list or merged lists contains the same number of pages of "A’s" and "W’s," the selected names should have equal numbers of "A’s" and "W’s." The same list could be counted by ZIP Code, and the distribution of those selected should match the distribution of the source list. That is, if 10 percent of the names on the source list has ZIP Code 22180, about 10 percent of those selected should have that ZIP Code.

The lack of proper numbers for certain demographic groups (e.g., young or black) probably is due to the shortcomings of the source list rather than a problem of randomness. This lack of representation is the topic of the next measure.

____________________________________
11 D.J. Knuth, The Art of Computer Programming, Semi-Numerical Algorithms, vol. 2, 2d ed. (Reading, MA: Addison-Wesley, 1981).
12 National Center for State Courts, A Supplement to the Methodology Manual for Jury Systems: Relationships to the Standards Relating to Juror Use and Management (Williamsburg, VA, 1987), pp. 10-15.

Go to top of page

Measure 3.2.3: Representativeness of Final Juror Pool

This measure considers the representativeness of the final juror pool. It involves collecting demographic data by questionnaire on all persons reporting for jury duty during a specified period of time. The questionnaire data are compared to the demographic characteristics of the jurisdiction’s population to determine the extent of representativeness.

Planning/Preparation. The census publications or data obtained for Measure 3.2.1 also should contain the demographic data needed for this measurement.

The assistance of an individual familiar with demographic studies would be helpful for this measure. A local college or university likely has a faculty member with such qualifications. The added credibility brought to the examination by such a person could prove helpful if the jury system is ever challenged for selecting prospective jurors who are not representative of the population.

Data Collection. A questionnaire should be distributed to all persons serving, whether they are selected as a trial juror or not. Questionnaires should be used for several days or weeks scattered over a month. At least 200 questionnaires should be used. Excellent response rates can be obtained by asking people to complete the questionnaires before they leave the court. However, this necessitates using a short, quickly completed form.

Data Analysis and Report Preparation. Analysis consists of comparing the demographic characteristics of the population (obtained during the planning/preparation stage to the tabulated data obtained from the jurors. If the population is 30 percent black and the tabulated data indicates that 30 percent of those reporting to the courthouse are black, those reporting perfectly represent the population and there is no disparity between the population and prospective jurors for this particular demographic characteristic. Unfortunately, a difference or disparity usually exists. The two measures of the disparity generally used to measure the difference between the pool or panels (often called the venire) and the population are the absolute and comparative disparity.13 These measures are defined as follows:

  • Absolute disparity: This index measures representativeness as the difference between the proportions of the population and the source list of prospective jurors that are in the category of interest. If the 18 and over population is 30 percent black and the venire is 20 percent, the absolute disparity is 10 percent, or the difference between these two numbers. A criticism of this measure is that it is not sensitive to the relative size of the disparity. That is, a venire that contained no blacks drawn from a population that is 10 percent black would have the same absolute disparity as the 30 percent/20 percent disparity mentioned above. The former situation is much more serious than the latter, which is acceptable in many courts.

  • Comparative disparity: This measure compensates for the limitation in the concept of absolute disparity by relating disparity to the size of the underrepresented group in the population. Using an example similar to the one above, if the venire is 20 percent black and the population is 30 percent, the comparative disparity is 33 percent [(30-20)/30=.33]. A venire with the same absolute disparity (one that contained no blacks in a community that is 10 percent black) would produce a comparative disparity of 100 percent [(10-0)/10=1.0]. Thus, the comparative disparity more properly reflects the difference in these two situations. Comparative disparity is the percentage by which the probability of serving is reduced for people in the category being examined. (Note that this underrepresentation is positive while an overrepresentation is negative—a point which often causes confusion.)

Kairys et al., while admitting that no clear standard values exist based on case law, suggests a maximum comparative disparity of 15 percent.14 An article surveying California case law as of 1987 cites absolute disparity as low as 1.8 percent and comparative disparity of 43 percent and above as significant.15

The significance of the results should be based on all of the following:

  • The findings of the State’s appellate courts in representativeness challenges.

  • The level of the disparity (great disparities require greater actions by the court).

  • The alternatives available through other lists and the feasibility of merging or using these lists.

Finally, regardless of the exact numerical degree of disparity, there is a need to determine how and why the final juror pool is unrepresentative. What are the likely reasons for the disparity? Are out-of-date, invalid, or unreliable sources being relied on in the selection process? Does the unrepresentativeness arise from different attrition rates for jurors from different social groups? What policy changes might be necessary to remedy the situation? By addressing these questions, the court can use Measure 3.2.3 for basic self-improvement.

____________________________________
13 D.Kairys, J.B. Kadane, and J.P. Lehoczky, "Jury Representation, A Mandate for Multiple Source Lists," California Law Review 65 (1977):776-827.
14 See note 13.
15 Menaster, Spooner, and Greenberg, "Getting a Fair Cross-Section of the Community," Forum (1989):14-21.

Go to top of page

Go to Table of Contents

 

line.gif (1068 bytes)
Copyright © 2001 National Center for State Courts
Last Modified: January 23, 2005