National Center for State Courts

 

Improving Justice through Leadership
and Service to the Courts

     

  

Trial Court Perforrmance Standards & Measurement System

Measure 5.1.1: Court Employees’ Perceptions of Court Performance

This measure asks court employees about their views of the court’s performance in the other four standard areas. Data are collected by means of a mailed questionnaire to court employees.1 The measure should be conducted by an individual experienced in survey research who is perceived as independent of the court.

Planning/Preparation. Based on the experiences of courts involved in testing the measures, the perceived confidentiality of employee responses to the questionnaire is critical to the success of the measure. Some employees may refuse to participate if they believe their responses will be read by other individuals in the court. Several steps can be taken to help ensure both the reality and the perception that responses will be confidential:

  • Contact someone external to the court to conduct the measure. Some courts in the demonstration project requested that staff from their State’s administrative office of the courts conduct the measure. Private consultants and university faculty also could be approached.

  • Emphasize the confidentiality of survey responses in a cover letter accompanying the questionnaire. The following language was included in one court’s cover letter: "Please understand that your answers will be completely confidential and no individual responses will be identified. No one in the court will see the completed questionnaires. Rather, the court will receive aggregate results once all responses have been tabulated."

  • Do not place any type of code on the questionnaires for tracking who has not yet completed one. Instead, send a followup letter to all respondents thanking those who have completed the questionnaire and asking the others to complete and mail the questionnaire.

  • Include with the questionnaire a stamped return envelope with the address of the external individual administering the questionnaire.

  • Do not include any demographics on the questionnaire. This is especially critical for small courts in which there are only a few employees who fall into various demographic categories.

After considering the issue of confidentiality, the next step is to review Form 5.1.1, Court Employees’ Perceptions of Court Performance. The questionnaire items address standards for access to justice; expedition and timeliness; equality, fairness, and integrity; and independence and accountability. Some of its content was drawn from other surveys of the public’s perceptions of the justice system.2 The questionnaire can be used as is or modified to include questions on the most salient issues facing each community.3

Data Collection. A questionnaire should be sent to each full-time employee listed in the court’s personnel files.4 As noted above, a return envelope with the survey administrator’s name on it should be included with each questionnaire. Two weeks after the questionnaire is sent, a reminder letter should be sent to all employees asking them to complete the questionnaire if they have not done so already.

Data Analysis and Report Preparation. The number code corresponding to each question’s response is entered into a computer file. Using a computer software statistical package, the percentage of each response for each question is calculated.

Evaluations of the court are coded differently across items. Agreement with one question may indicate a positive appraisal whereas agreement with another question may indicate a negative appraisal. As a result, if the response of strongly agree is always scored as "1," a score of "1" or "2" may indicate good performance on some questions and poor performance on other questions.

For Section II of the questionnaire, items 5, 7, 10, 12, 14, 16, and 20 are negative items. In general, the more items on which a court is well perceived (a higher percentage of "3" and "4" on positive items and "1" and "2" on negative items), the closer the court comes to meeting the standards for public trust and confidence.

The items on the questionnaire also can be analyzed by performance areas. Items 2, 6, 10, 14, and 17 refer to the standards in Performance Area 1, Access To Justice; items 3, 7, and 11 refer to the standards in Performance Area 2, Expedition and Timeliness; items 4, 8, 12, 15, 18, and 20 refer to the standards in Performance Area 3, Equality, Fairness, and Integrity; and items 5, 9, 13, 16, and 19 refer to the standards in Performance Area 4, Independence and Accountability.

The percentage of positive responses on the items in each of these areas can be reviewed to determine the areas in which court employees approve of the court’s performance and the areas in which court employees consider the court’s performance lacking.

__________________________________
1 Although the survey addresses the perceptions of court employees, the instrument can be modified easily to address the perceptions of other publics such as attorneys, jurors, and litigants. Depending on the size of the population under study, the court may want to include some demographic questions on the modified instrument.
2 See, for example, Citizens' Commission to Improve Michigan Courts, Final Report and Recommendations to Improve the Efficiency and Responsiveness of Michigan Courts (Lansing, MI: Michigan Supreme Court, 1986); GMA Research Corporation, Washington State Judicial Survey (Olympia, WA: Office of the Administrator for the Courts, State of Washington, 1988); and Yankelovich, Skelly, and White, Inc., The Public Image of Courts: Highlights of a National Survey of the General Public, Judges, Lawyers and Community Leaders (Williamsburg, VA: National Center for State Courts, 1978).
3 If a court is interested in its performance in only one or two standard areas, the questionnaire can be modified by adding several questions in the areas of interest and eliminating questions from the other areas. The results of this survey will be more reliable with regard to public perception of court performance in the specific areas, but they will be less reliable with regard to public perception of the court's overall performance. As drafted, the instrument includes one question for each of the 19 standards in the first four performance areas.
4 Although a sample of employees could be drawn, there is value in soliciting everyone's opinions unless cost is a major consideration. In a few very large courts, the number of employees may exceed 1,000. For these courts, a systematic sample of employees should be selected.

Go to Form 5.1.1

Go to Standard 5.1

Go to Table of Contents

 

line.gif (1068 bytes)
Copyright © 2001 National Center for State Courts
Last Modified: January 23, 2005