DocketNumber： Nos. 96-17131, 97-15422
Judges： Boochever, Kleinfeld, Wilson
Filed Date： 7/12/1999
Status： Precedential
Modified Date： 10/18/2024
Plaintiff class of minority educators appeals the District Court’s finding that the Defendant California Commission on Teacher Credentialing’s CBEST exam did not violate Title VI or Title VII of the 1964 Civil Rights Act (“Plaintiffs’ Appeal”). Defendants cross-appeal the District Court’s earlier finding on summary judgment that Title VI and Title VII apply to California’s credentialing of public school teachers, and appeal the District Court’s denial of their costs (“Defendants’ Appeal”).
I. Facts and Procedural History
Effective February 1, 1983, the California State Legislature amended the California Education Code to bar the California Commission for Teacher Preparation and Licensing (“CTPL”) from issuing any credential, permit, or certificate to any applicant unable to demonstrate basic reading, writing and mathematics skills in the English language as measured by a basic skills proficiency test. Association of Mexican-American Educators v. State of California, 836 F.Supp. 1534, 1538 (N.D.Cal.1993) (“AMAE I”). In May 1983, after three test administrations, the CTPL assumed full responsibility for revising and administering the CBEST.
The United States has long provided California, through its Board of Education (“Board”), with financial assistance for educational purposes; it is undisputed that the Board has received such federal financial assistance continuously since 1983. AMAE I, 836 F.Supp. at 1537. During that same time period, the California Department of Education (“DOE”) has distributed most of that federal money to local school boards. Id.
At the same time, however, neither the CPTL nor its successor the CTC have received any federal funds. AMAE I, 836 F.Supp. at 1538. Indeed, the District Court found that in the entire history of California’s credentialing authorities, the federal government has provided financial assistance only to one project and that aid for that project ceased in 1979. Id.
Proportionately more of the minorities taking the CBEST have failed it, compared to Caucasians. This pattern appeared in the first administration of the test and has persisted. The Plaintiff class of minority educators brought suit to enjoin the use of the CBEST, alleging that it has a disproportionate adverse impact on racial minorities, that the Defendants failed to properly validate the test, and that the Defendants failed to adopt equally
In 1993, the District Court ruled on summary judgment that both Title VI and Title VII applied to the Commission's use of the CBEST as an employment screening device. Association of Mexican-American Educators v. State of California, 836 F.Supp. 1534 (N.D.Cal.1993) ("AMAE I"). Following a bench trial, in 1996 the District Court held 1) that Plaintiffs had established a prima facie case by showing that the CBEST has a disparate impact on minorities; 2) that all three studies of the CBEST submitted to the court proved it to be a valid measure of job-related skills; 3) that the passing score reflected professionally reasonably judgments about minimum skill levels of basic knowledge, skills and abilities for teaching jobs; and 4) that Plaintiffs had failed to show the existence of an equally effective alternate screening device. Association of Mexican-American Educators v. State of California, 937 F.Supp. 1397 (N.D.Cal.1996) ("AMAE II"). The District Court subsequently denied the Defendants' costs in an Order filed on February 12, 1997 ("Order").
On appeal, Plaintiffs contend that the District Court erred in holding that the CBEST was properly validated, and that the court violated Federal Rule of Evidence 706 by rel~ying upon the advice of an expert witness who was not subject to cross-examination and did not prepare an expert's report. The Defendants contend that the District Court erred in holding that Title VI and Title VII apply to its administration of the CBEST, and that it abused its discretion when it denied their costs of $216,443.67.
We review de novo the district court's summary judgment ruling that Title VI and Title VII apply to the Commission's testing activities and review the District Court's factual fndings for clear error. Under those standards, we conclude that Title VI and Title VII do not apply to the Commission's administration of the CBEST and we therefore grant Defendants' Appeal. As an alternative ground for upholding the District Court's judgment, we find that the District Court's factual findings were not clearly in error and we therefore deny Plaintiffs' Appeal. However, because we conclude that a court may only deny a prevailing party all costs when the party has engaged in misconduct, we remand the case to the District Court to reconsider Defendants' application for costs.
II. Legal Analysis
A. Standard of Review
We review de novo the District Court's conclusion of law that Title VI and Title VII apply to the Commission's testing activities, Bagdadi v. Nazar, 84 F.3d 1194, 1197 (9th Cir.1996), and review the District Court's factual findings for clear error. Clady v. County of Los Angeles, 770 F.2d 1421, 1427 (9th Cir.1985).
B. Application of Title VI to the 1~R1~ST
1. General Applicability of Title VI
Title VI was originally passed as part of the 1964 Civil Rights Act, and it contains a prohibition on the use of federal dollars to subsidize racial discrimination:
No person in the United States shall, on the ground of race, color, or national origin, be excluded from participation in, or be denied the benefits of, or be subject to discrimination in any program or activity receiving Federal financial assistance.
42 U.S.C.A. § 2000d.
The purpose of Title VI is clear: Congress wanted to avoid the use of federal resources to support discriminatory practices and it wanted to provide effective protection against those practices. Cannon v. University of Chicago, 441 U.S. 677, 704 n. 36, 99 S.Ct. 1946, 60 L.Ed.2d 560 (1979).
In the Civil Rights Restoration Act of 1987, Congress amended Title VI to in-
For the purposes of this subchapter, the terms "program or activity" and the term "program" mean all of the operations of-
(1)(A) a department, agency, special purpose district, or other instrumentality of a State or of a local government; or
(B) the entity of such State or local government that distributes such assistance and each such department or agency (and each other State or local government entity) to which the assistance is extended, in the case of assistance to a State or local government; or
(2)(A) a college, university, or other postsecondary institution, or a public system of higher education; or
(B) a local educational agency (as defined in section 8801 of Title 20), system of vocational education, or other school system; or
(3)(A)
(4) any other entity which is established by two or more of the entities described in paragraph (1), (2), or (3);
any part of which is extended Federal financial assistance.
42 U.S.C.A. § 2000d-4a.
In other words, the definition of "program or activity" provided by Congress means that if any part of a listed entity receives federal funds, the entire entity is covered by Title VI. Grimes v. Superior Home Health Care, 929 F.Supp. 1088, 1092 (M.D.Tenn.1996).
2. Application of Title VI to the CTC: Title VI Does Not Apply to the CTC Simply By Virtue of Its Existence as Part of the "Public School System" in California because the term "School System" Is Used More Expansively By The California State Constitution Than by 42 U.S.C.A. § 2000d-4a(2)(B)
The District Court found that neither the CTC nor its predecessor, the CTPL, had received federal funds after January 1, 1980. AMAE I, 836 F.Supp. at 1538. The District Court went on to observe that-although not a direct recipient of federal funds-the CTC could nevertheless be liable under Title VI if it was a part of a school system and any part of that system received federal funds. Id. at 1544 (citing 42 U.S.C.A. § 2000d-4a(2)(B)). Reviewing the structure of public education in California, the District Court held that public education in California was, in fact, a single school system and that as a State agency concerned with education, the CTC was a part of that single school system. Id. at 1544-45. Since public education in California receives federal funds, the District Court held that CTC was therefore "part of a ``school system' referred to in subsection (2)(B)" of § 2000d-4a. Id. at 1544.
In concluding that public education in California is part of a single school system, the District Court placed particular emphasis on a provision from the California State Constitution, which refers to public education in California as "the Public School System." AMAE I, 836 F.Supp. at 1544 (citing Cal. Const., art. IX, § 6, ¶ 2
We do not disagree with the District Court's conclusion that the CTC falls within the "Public School System" established by the California, Constitution. We do, however, disagree with a critical assumption apparently made by the parties. We do not assume that the "Public School System" defined by the California Constitution necessarily qualifies as the sort of "school system" to which Congress referred in § 2000d-4a(2)(B). In other words, we do not assume that the term "school system" is used in the same manner by Congress and the California State Constitution. As a result, we must determine whether the whole edifice of public education in the State of California would qualify under the federal definition of "school system" embodied in § 2000d-4a(2)(B).
To begin, we must determine the appropriate definition of "school system" as used in subsection (2)(B) of § 2000d-4a. For this purpose, we start with the language of the statute. As quoted above, § 2000d-4a(2)(B) applies to the operations of:
a local educational agency (as defined in section 8801 of Title 20), system of vocational education, or other school system.
42 U.S.C.A. § 2000d-4a(2)(B).
Of the three terms included in subsection (2)(B), "local educational agency" is both the only defined term and the only term to which any substantial jurisprudence has attached.
a public board of education or other public authority legally constituted within a State for either administrative control or direction of, or to perform a service function for, public elementary or secondary schools in a city, county, township, school district, or other political subdivision of a State, or for such combination of school districts or counties as are recognized in a State as an administrative agency for its public elem~ntary or secondary schools.
The term includes any other public institution or agency having administrative control and direction of a public elementary or secondary school.
20 TJ.S.C.A. § 8801(18)(A-B).
We also observe that 20 TJ.S.C.A. § 8801 contains a definition for a "State educational agency," which it describes as "the agency primarily responsible for the State supervision of public elementary and secondary schools." 20 U.S.C.A. § 8801(28).
The distinction between "local educational agency" and "State educational agency" is important in this case. It is true that the definition of "local educational agency," read broadly, could include any agency that had any regulatory control over a public school. However, such an expansive reading would ignore the fact that Congress has drawn a distinction between the State educational agencies that regulate schools and the local educational agencies that administer those schools. Los Angeles Branch NAACP v. Los Ange
In determining what constitutes an agency which actually administers the local schools, the Court is required to look to state law and practice to determine what entity is “recognized in a State as an administrative agency for its public elementary or secondary schools.” 20 U.S.C.A. § 8801(18)(A-B). In this case, notwithstanding the State Constitutional provision that public education is a part of “the Public School System,” we find that public schools in the State of California are administered by school districts.
Of course, neither the parties nor the District Court have asserted that the California “Public School System” is a “local educational agency” within the meaning of § 8801 and it might seem obvious that it is not.
We think that the catch-all term "other school system" cannot be interpreted independently, but must be interpreted in the context of the previous two terms. In determining whether something qualifies as an "other school system" within the meaning of § 2000d-4a(2)(B), we do not simply ask whether it calls itself a "school system." Labels alone are frequently misleading.
The legislative history of § 2000d-4a(2)(B) supports this conclusion. The Congressional Report on the Civil Rights Restoration Act of 1987 cautions that "[for two or more schools to be considered a ``school system', there must be some significant linkage between them. Thus, for example, any group of schools whose only connection to each other is that they belong to some umbrella advocacy or membership group, or that they are accredited by one central accrediting agency, would not constitute a school system." S.Rep. No. 100-64 at 17 (1987), reprinted in 1988 U.S.C.C.A.N. 3, 19 (emphasis added).
A second comment from the Report deserves attention here. The Report states that "{i]f federal financial assistance is extended to one of three secondary schools
In the present case, we find that the State Constitutional requirement of a single "Public School System" in California does not mean that public education in California is a "school system" within the meaning of § 2000d.-4a(2)(B). Although California requires that all of its public schools be chartered under State authority, Kennedy v. Miller, 97 Cal. 429, 436, 32 P. 558 (1893), the fact that they all derive from State power is not enough to make all such schools and school districts together a single "system" in the sense required for Title VI coverage. Cf. Gonzales v. State, 29 Cal.App.3d 585, 590, 105 Cal.Rptr. 804 (1972) (holding that while school districts exercise state power, they are each independent entities). As a consequence, we conclude that CTC is not covered by Title VI solely by virtue of its existence as part of the "Public School System" of the State of California.
3. Application of Title VI to the CTC: Title VI Does Not Apply to the CTC Simply by Virtue of Its Existence as Part of the State of California because Receipt of Federal Funds by One State Entity Does Not Automatically Subject the Entire State Government to Coverage.
Because the District Court found that § 2000d-4a(2)(B) resulted in coverage of the CTC under Title VI, the District Court declined to consider whether the CTC was covered under subsection (4) of § 2000d-4a. AMAE I, 836 F.Supp. at 1545 n. 8. Aa we have reached the opposite conclusion, we must proceed to consider whether § 2000d-4a(4) applies to the CTC.
As quoted above, § 2000d-4a(4) extends the definition of program or activity to "any other entity which is established by two or more of the entities described in paragraph (1), (2), or (3)." 42 U.S.C.A. § 2000d-4a(4). In essence, Plaintiffs allege that the State of California is subject to Title VI as a recipient of federal funds and that the CTC is covered under Title VI because the CTC is established by the State of California.
We disagree. Because the State itself cannot be considered a "program or activity" under § 2000d-4(a), only subsections of the State and not the State as a whole can be subject to Title VI.
As laid out above, § 2000d-4a(1) extends the definition of "program or activity" to all of the operations of "a department, agency, special purpose district, or other instrumentality of a State or local government" and to all of the operations of "the entity of such State or local government that distributes such assistance and each such department or agency (and each other State or local government entity) to which the assistance is extended." 42 U.S.C.A. § 2000d-4a(l)(A & B). In other words, § 2000d-4a(l) applies to any department or agency of the State which has received federal funds, whether the State entity receives such funds directly from the government or via another State entity.
At the same time, however, nothing in § 2000d-4a would include the State, as such, in the enumeration of entities listed in the definition of "program or activity." This omission cannot be accidental. Although we could begin with the interpretive cannon, expressio unius, the structure of the statute is direct and conclusive proof that Congress did not mean to subject an entire State to Title VI. Congress went to great lengths in subsection (1)(B) to detail the fact that each department or agency of a State which received federal funds would be subject to Title VI, even if they received such funds via another agency. Subsection (l)(B) would be superfluous if receipt by one agency of the State subjected the entire State to Title VI, and we strive to avoid any construction that would render some of the statute superfluous. Burrey v. Pacific Gas and Elec. Co., 159 F.3d 388, 393 (9th Cir.1998). Congress simply could not have meant to extend Title VI to the entire State government because one department or agency received aid (even aid intended for the State).
Again, the legislative history supports our conclusion. The Congressional Report explicitly concluded that "{f]or State and local governments, only the department or agency which receives the aid is covered." S. Rep. 100-64 (1987), reprinted in 1988 U.S.C.C.A.N. 3, 6. Although this is an issue of first impression in our Circuit, other Circuits interpreting the Civil Rights Restoration Act have also come to this conclusion. Schroeder v. City of Chicago, 927 F.2d 957, 961 (7th Cir.1991); Lightbourn v. County of El Paso, Texas, 118 F.3d 421, 427 (5th Cir.1997). In sum, we hold that while Title VI may apply to any subsection of the State which receives federal funds, Title VI will not apply to the State as a whole simply because one subsection receives such funds.
The District Court found that "the United States has long provided the State, through its Board of Education, financial assistance for use in education." AMAE I, 836 F.Supp. at 1537. The District Court also found that "the California Department of Education (``DOE') has distributed most of that money to local school boards." Id. These findings indicate that the California Board of Education, the Department of Education, and the local school boards are
The CTC was not created by the Board of Education, the Department of Education, or the local school boards. As a result, although such agencies are covered by Title VI, the CTC is not covered by virtue of § 2000d-4a(4).
In sum, we conclude that the Plaintiffs have not demonstrated that the CTC is covered by Title VI and we order the District Court to dismiss Plaintiffs' Title VI claim against the CTC.
4. Application of Title VI to Californ~ia's Statutory Requirement that Prospective Teachers Pass the CBEST: As Neither the Legislature Nor the CTC Receives Federal Funding, Title VI Does Not Attach to the State's Requirement For Teacher Certification
Our conclusion in the previous section that the State of California is not automatically subject to Title VI compels the conclusion that the State of California is not liable under Title VI for imposing the CBEST as a statutory requirement for a public teacher's credential. The receipt of federal funds by the California Board of Education subjects the Board to Title VI, but it does not extend the coverage of Title VI into all of the operations of the entire State. Likewise, the receipt of federal funds by the California Department of Education subjects that Department to Title VI, but it does not extend coverage of Title VI into all operations of the entire State. In this case, the statutory requirement was imposed by the California Legislature. It is clear that Title VI coverage does not attach directly to the requirement as imposed by the Legislature.
As we have found that the CTC is not a covered program or activity, and as there is no evidence that the Legislature is a covered program or activity, no Title VI liability could possibly result from their actions.
C. Application of Title VII to the State Requirement that School Districts May Only Employ Credentialed Individuals
1. Title VII Applies to Relationships Between Government Employers and Government Employees
Title VII was also originally passed as part of the 1964 Civil Rights Act, and Title VII makes it "an unlawful employment practice for an employer to fail or refuse to hire ... any individual because of such individual's race, color, religion, sex, or national origin." 42 U.S.C.A. § 2000e-2(a)(1). It is well established that Title VII applies "to governmental and private employers alike." Dothard v. Rawlinson, 433 U.S. 321, 332 n. 14, 97 S.Ct. 2720, 53 L.Ed.2d 786 (1977); Blake v. City of Los Angeles, 595 F.2d 1367, 1372 (9th Cir.1979).
2. Title VII Does Not Apply to the State's Requirement of the CBEST for Potential Teachers Because the CBEST is a Licensing Exam
Defendants argued below that the CBEST was part of the State's licensing process for public school teachers, relying upon the fact that Title VII does not apply to governmental licensing activities. See Haddock v. Board of Dental Exam'rs, 777 F.2d 462, 464 (9th Cir.1985) (holding that Title VII did not apply to licensing activities of California's Board of Dental Examiners).
Although the District Court agreed that Title VII does not apply to governmental licensing activities, AMAE I, 836 F.Supp. at 1549, the District Court concluded that the CBEST was not a licensing exam because it only licensed public school teachers. Id. The District Court observed that one could be a teacher in a private school without having passed the CBEST, and that the CBEST only stood as a barrier to employment in the State's "own schools."
We agree with the District Court that, if the State requires an exam solely for its own employees, such an exam constitutes an employment exam. We also think it evident that Title VII applies even if the purpose of the exam is to improve the quality of the State's service to the public, because virtually any State employment exam could be cast as an attempt to improve the quality of the State's service to the public.
a. The CBEST Is Not an Employment Exam Because the State Is Not the Potential Employer
Nevertheless, we do not agree with the characterization of the CBEST as testing for a "particular employer (the State)." We note that, immediately after determining that the CBEST was an employment exam, the District Court then discussed the fact that teachers are not employed by the Defendants. AMAE I, 836 F.Supp. at 1550. The parties and the lower court agree that teachers are "employees" of the ``~iarious school districts, rather than employees of the State or of the CTC. Id.
As such, we cannot agree that the State is the "employer" in this instance. We recognize that school districts in California are instrumentalities of the State, Belanger v. Madera Unified Sch. Dist., 963 F.2d 248, 251-54 (9th Cir.1992); First Interstate Bank of California v. State, Board of Governors of California, 197 Cal.App.3d 627, 633, 243 Cal.Rptr. 8 (1987), but we view the relationship between school districts and the State as analogous to the parent/subsidiary relationship. It is well established that a parent company will not usually be considered the "employer" under Title VII for the employees of its subsidiary. Watson v. Gulf & Western, 650 F.2d 990, 993 (9th Cir.1981).
b. The CREST Is A Valid Licensing Exam Because The CBEST Is Required Under the State's Police Power and Not Its Proprietary Power
The question still remains whether the CBEST is a valid licensing exam. The District Court was of course cognizant of the fact that the school districts are the direct employers, and not the State. AMAE I, 836 F.Supp. at 1550. Nevertheless, the District Court found that the
We agree with the District Court that the limitation of the examination to public school teachers raises a question as to whether it is a true licensing exam. Nevertheless, we do not think that such a limitation is necessarily dispositive. Although previous federal courts to uphold teacher licensing exams have not discussed the consequences of the fact that such exams were restricted to public employees, see e.g., Fields v. Hallsville Indep. Sch. Dist., 906 F.2d 1017 (5th Cir.1990),
Although a limitation of an examination to public employees will inevitably raise the question of whether the State is exercising its proprietary power, it does not inherently require such a conclusion. For example, imagine that the State were to conclude that criminal courts were frequently convicting indigent citizens because their defense attorneys were insufficiently versed in the law of the Fourth Amendment. Furthermore, imagine that the California Legislature were to pass a law addressed to this problem, requiring that all attorneys employed by public defender offices of the various cities or counties in California were required to pass an exam on the Fourth Amendment as a condition of employment.
We think that such an exam would be an exercise of the State's police power, and would therefore be a valid licensing exam despite the fact that it was not extended to private criminal defense attorneys. At least two factors would support such a conclusion. First, we would consider the fact that the requirements extend beyond State employees to all similar professionals in any public agency to be evidence that the State is employing its police power. Second, we would consider the fact that this requirement was mandated by the Legislature (rather than by an administrator responsible for managing the positions at issue) as providing additional evidence that the State is acting in its sovereign capacity rather than its proprietary capacity.
The District Court found that the CBEST was not a valid licensing exam, and that as such it constituted an actionable interference with the employment relationship. AMAE I, 836 F.Supp. at 1551 (citing Sibley Mem. Hosp. v. Wilson, 488 F.2d 1338 (D.C.Cir.1973)). As we conclude that it is a valid licensing exam, and therefore exempt from liability under Title VII, we need not decide whether Sibley would otherwise apply to this situation.
In sum, we conclude that Title VII does not apply to either the State of California or the CTC as their actions relate to the licensing of public school teachers in the State of California
D. The District Court's Findings That the Test Was Discriminatory
Although our conclusion that Title VI and Title VII do not apply to tile CBEST could resolve the case, we have reviewed the District Court's factual findings in response to Plaintiffs' Appeal and we find no reversible error in those factual findings. As such, we approve the District Court's factual findings as an alternative ground on which we affirm the District Court's judgment.
1. General Requirement of Test Validation
"Discriminatory tests are impermissible unless shown, by professionally acceptable methods, to be predictiv~e of or significantly correlated with important elements of work behavior which comprise or are relevant to the job or jobs for which candidates are being evaluated." Albemarle Paper Co. v. Moody, 422 U.S. 405, 431, 95 S.Ct. 2362, 45 L.Ed.2d 280 (1975). In evaluating tests under Title VII that allegedly have a disparate racial impact,~ we apply a burden-shifting approach: In the first step of the approach, the plaintiff must establish a prima facie case by demonstrating that the test causes a disparate impact on the basis of race. If the plaintiff makes a prima facie case, the burden shifts to the defendant to demonstrate that the test was properly "validated" to be "job related for the position in question and consistent with business necessity." 42 U.S.C. § 2000e-2k(1)(A)(i); see also Albemarle Paper, 422 U.S. at 425.
Steps to Validate Employment Criteria: As we have previously explained, the validation of an employment criteria involves a three-step process:
The employer must first specify the particular trait or characteristic which the selection device is. being used to identify or measure. The employer must then determine that that particular trait or characteristic is an important element of work behavior. Finally, the employer must demonstrate by “professionally acceptable methods” that the selection device is “predictive of or significantly correlated” with the element of work behavior identified in the second step.
Craig v. County of Los Angeles, 626 F.2d 659, 662 (9th Cir.1980) (quoting Albemarle Paper, 422 U.S. at 431, 95 S.Ct. 2362). Subsequently in Clady, we endorsed a slightly different test for determining whether a disparate impact defendant has satisfied the burden of showing job relatedness:
This circuit has held that the employer’s burden is satisfied by showing “by professionally acceptable methods” that the test is “predictive of or significantly correlated with important elements of work behavior which comprise or are relevant to the job or jobs for which candidates are being evaluated.”
Clady v. County of Los Angeles, 770 F.2d 1421, 1430 (9th Cir.1985) (as amended) (quoting Contreras v. City of Los Angeles, 656 F.2d 1267, 1280 (9th Cir.1981)).
Uniform Guidelines and Content Validation: Both the District Court and the parties measure the defendants’ test validation procedures against the EEOC’s Uniform Guidelines on Employee Selection Procedures (“Uniform Guidelines”).
The Uniform Guidelines describe and approve three alternative methods of validating employment tests: 1) content validity studies; 2) criterion-related validity studies; and 3) construct -validation studies.
Content validation establishes whether the content of a test closely approximates the tasks to be performed on the job by the applicant.
2. CI3EST Test Validation Studies
a. Job Relatedness
Plaintiffs contend that the two pre-litigation studies of the CBEST, the 1982 Wheeler & Elias study and the 1985 Practitioner's Review study, failed to undertake any job analyses to identify work behaviors or job duties and thus could not have determined by "professionally acceptable methods" whether the CBEST is "predictive of or significantly correlated" to any job related duties. Plaintiffs also challenge the skills identified in the 1995 Lundquist study, arguing that Dr. Lund-quist erred in her methods for distinguishing skills which are "important" or "critical" from those which are neither. In a detailed and carefully reasoned opinion, the District Court found that all three studies adequately validated the CBEST. As we uphold the District Court's findings for the 1985 Practitioner's Review and the 1995 Lundquist study, we need focus only upon those two studies and we do not need to address the 1982 Wheeler & Elias study.
The 1985 Practitioners' Review
The Practitioners' Review was conducted by Dr. Richard Watkins in 1985. The District Court found that "the Practitioners' Review in 1985 involved the ``pooled judgments of informed persons such as job incumbents' about the relevance of the skills tested on the CBEST to the jobs for which it is required, an appropriate form of job analysis under the professional standards of the time." AMAE II, 937 F.Supp. at 1419.
The Practitioners' Review polled "234 teachers, administrators, teacher educators, and other school employees," thirty-six percent of whom were members of minority groups. AMAE II, 937 F.Supp. at 1413. "The participants took part in nine review panels, in which they judged the relevance of both the skills assessed by the CBEST and the test items themselves." Id. The educators were asked to rate the importance of "skills" according to fairly broad categories. For example, the three CBEST reading skills categories are: "literal comprehension," "logical comprehension," and "critical comprehension." In mathematics, the three CBEST skills are "problem solving skills," "applied problem solution," and "concepts and relationships." Id. Educators were asked to rate how relevant each of the skills tested would be to four jobs: a) elementary school teachers, b) secondary school teachers, c) pupil personnel and librarians, and d) school administrators. Id. These ratings ranged from "not relevant" to "very relevant." Id.
The Practitioner's Review thus took steps to learn from teachers and administrators which categories of skills they
Questions in this category test the understanding of basic concepts, such as the meaning of certain terms (area, for example), order among numbers, relationships shown by graphs, elementary probability, and the like. Questions in this category may be from arithmetic, algebra, or elementary geometry.
It is true that the Practitioner’s Review measured skills at a slightly higher level of abstraction than the Lundquist Study addressed below. Nevertheless, the educators who rated skill categories for job relevance were guided by the specific definitions provided for each category, and were instructed to rate the importance of the skills tested for teaching and non-teaching jobs. These steps are not clearly inadequate under the Craig test, that the employer must “first specify the particular trait or characteristic” and “then determine that that particular trait or characteristic is an important element of work behavior.” Craig, 626 F.2d at 662. Thus, the District Court did not clearly err when it found that the Practitioners’ Review included “an appropriate form of a job analysis under the professional standards of the time.”
1995 Lundquist Study
As we noted above, Plaintiffs do not challenge Dr. Lundquist’s methodology for identifying job-related skills. Plaintiffs do, however, challenge Dr. Lundquist’s methods for distinguishing skills that are “important” or “critical” from those which are neither.
Dr. Lundquist’s validation study polled experts and interviewed and observed teachers to develop a list of 59 activities, 39 reading skills, 27 writing skills, and 37 math skills used by teachers. AMAE II, 937 F.Supp. at 1414. Dr. Lundquist then surveyed 1,100 teachers and 230 administrators, asking each to rate the importance of those skills and activities on a four-point scale from 0 (“not applicable”) to 3 (“critical”). Id.
Plaintiffs focus on the fact that skills were retained with only a mean rating of 1.5 on a scale that designated 1 as “minor” and 2 as “important.” Plaintiffs contend that using the rating of 1.5 thereby retained teacher skills and activities that are less important. The plaintiffs argue that, as a result, the Lundquist study violated the command reflected by Craig and by the Uniform Guidelines that only important or critical skills be tested.
The District Court disagreed with Plaintiffs, finding that “Dr. Lundquist’s decisions reflect manifestly reasonablé professional judgments.... With respect to the 1.5 mean, as Dr. Lundquist testified at trial, a 1.5 rating rounds up to 2.0. It must be remembered that the mean rating of 1.5 was coupled with an 80 percent endorsement criterion, which is quite stringent.” AMAE II, 937 F.Supp. at 1418 n. 35.
We admit that it is possible to conjure up a scenario that illustrates the plaintiffs’ concern. Assume, for example, that 80% of the teachers surveyed agreed that the skill of solving quadratic equations (“skill QE”) is “relevant” to the job of teaching, but that 75% of those surveyed rated the importance of skill QE as only minor. If the remaining 25% rated the skill as “critical,” the mean importance rating of skill QE would be calculated as 1.5 and there
In sum, although Dr. Lunquist's methodology is not free of any possible error, the mere possibility of error does not demonstrate that the District Court's findings were clearly erroneous. As we have previously observed, validation studies "are by their nature difficult, expensive, time consuming and rarely, if ever, free of error." Cleghorn v. Herrington, 813 F.2d 992, 996 (9th Cir.1987). Plaintiffs' challenge rests on the theoretical possibility that error could have existed in the writing and reading sections, and no such error has been, shown. We conclude that the District Court did not commit clear error in upholding Dr. Lundquist's content validation study despite its possible retention of slightly less "important" skills on the reading or writing portions of the exam.
b. Job-Specific Validation
Title VII requires that a defendant using a test with a racially disparate adverse impact demonstrate that the test is "job related for the position in question." 42 U.S.C. § 2000e-2(k)(l)(A)(i). The Uniform Guidelines provide that "[a]ny validity study should be based upon a review &f information about the job for which the selection procedure is to be used." 29 C.F.R. § 1607.14(A).
The 1985 Practitioners' Study
The 1985 study defined the jobs it sought to analyze as 1) elementary school teachers, 2) secondary school teachers, 3) librarians and pupil personnel (counselors ~nd attendance officers), and 4) school administrators. All panel members were asked to judge the relevance of the CBEST skills by category for those jobs, ranking them from "not relevant" to "very relevant." Although one might argue that the job classifications were too broad, we note that teachers are not infrequently called upon to teach outside of their area of primary expertise. As such, we cannot conclude that the District Court clearly erred in finding the job analysis in the Practitioners' Review to be sufficiently particularized.
1995 Lund quist Study
Dr. Lundquist identified teachers' job activities through several means, including literature reviews, observation of teachers on the job, and interviews with teachers regarding their "job activities, their use of reading, writing, and mathematics skills, and other knowledge, skills and abilities used on the job." AMAE II, 937 F.Supp. at 1414. The Lundquist study began with an initial list of 103 specific reading, writing, and mathematics skills. From that list Lundquist created a survey in which 1,100 educators ranked the relevance and importance of those skifis to the job of teaching. According to the District Court, "[a] version of those survey for administrators was also created to determine wheth
Dr. Lundquist’s study reports:
Basic skill ratings were examined for administrators to determine if the same skill sets applied to both teacher and administrator jobs. Results showed all but one skill item (a math item) retained for teachers also applied to the administrator group. Thus the basic skill requirements identified for teachers were found to be job-related for administrators as well, and the same test specifications may be used to test basic skills for teachers and administrators.
Dr. Lundquist classified jobs as either “teacher” or “administrator” and determined that the CBEST, validated for teachers, was also valid for administrative positions. The District Court accepted this validation, concluding that “the CBEST has been adequately validated with respect to non-teaching jobs.” Id. at 1418. Reviewing the record, we find no clear error in that conclusion and we therefore uphold it.
c. Actual Measurement of Skills
Plaintiffs contend that no study has shown that the CBEST actually measures the job skills it purports to measure. “[T]he employer must demonstrate by ‘professionally acceptable methods’ that the s'election device is ‘predictive of or significantly correlated’ with the element of work behavior identified [by the job analysis].” Craig, 626 F.2d at 662 (quoting Albemarle Paper Co., 422 U.S. at 431). Plaintiffs claim that the District Court merely accepted the facial validity of the CBEST without any evidence in support when it concluded that the CBEST has been shown to be a valid measure of the basic skills tested.
The District Court did not explain the basis for its findings but unambiguously concluded that “the CBEST actually measures ... basic skills [in reading, writing, and mathematics]” and repeated later that “the skills tested on the CBEST are job-related, and that the CBEST has been shown to be a valid measure of those basic skills.” AMAE II, 937 F.Supp. at 1411, 1419.
In Contreras, this Court held that “a key requirement of [the] third step [of Craig], a requirement essential to the proof of job relatedness generally, is that the validation method be professionally acceptable.” 656 F.2d at 1282. There is evidence in the record from experts in the field to support the District Court’s conclusions. Dr. William A. Mehrens, whose writings on test validity issues include a section titled “Writing and validating the item” reported that:
ETS personnel wrote some of the original items and assisted the test development committees in writing other items. ETS is well known and respected as a developer of standardized tests. They have well trained item writers and an impressive internal set of guidelines they follow with respect to item writing.
Asked whether “the CBEST development [was] appropriate with respect to writing and evaluating the items,” Dr. Mehrens testified:
It has been. Many of the items came from an existing ETS pool. Others “were written specifically for CBEST by members of the test development committee in concert with ETS test development specialists.” The individuals on the committees
“worked with specialists from ETS to further develop and define the content specifications, to review an existing ETS test item pool, to write new test items, and to review the items submitted by fellow committee members. In addition, the committees studied all of the data from the field testing, made recommendations for revisions as they felt*1078 necessary, and reviewed all of the final test results.”
(citations omitted).
Even if the test items are expertly developed, they still need to be matched to skills shown to be important to the job via a job analysis. The District Court described the “Curriculum Matching project, in which two ETS employees ... matched CBEST test specifications to material found in textbooks purportedly used in California public schools.” AMAE II, 937 F.Supp. at 1412 n. 21. The District Court criticized the study as “unscientific” and “not particularly helpful” but noted that “the study did support the overall conclusion that the kinds of skills tested on the CBEST can be found in elementary and secondary school textbooks.” Id.
Because there was some evidence that the CBEST development was appropriate with respect to writing and evaluating the items, the District Court did not clearly err in finding that the test items had been shown by professionally acceptable methods to be predictive of or significantly correlated with elements of work behavior.
d. Passing Score Standards
The Uniform Guidelines provide: “Where cutoff scores are used, they should normally be set so as to be reasonable and consistent with normal expectations of acceptable proficiency within the work force.:’ 29 C.F.R. § 1607.5(H). We have previously applied that standard in our own cases. See e.g., Craig, 626 F.2d at 665 (upholding a passing score cutoff as “reasonable and consistent with normal expectations of performance in the ... program”).
Courts reviewing cutoff scores on exams with a disparate impact frequently quote from a thorough discussion that appears in the Second Circuit’s decision in Guardians Ass’n of New York City Police Dept., Inc. v. Civil Service Commission of City of New York, 630 F.2d 79, 105 (2d Cir.1980):
When a cutoff score unrelated to job performance produces disparate racial results, Title VII is violated. Consequently, there should generally be some independent basis for choosing the cutoff- [A] criterion-related study is not necessarily required; the employer might establish a valid cutoff score by using a professional estimate of the requisite ability levels, or, at the very least, by analyzing the test results to locate a logical “break-point” in the distribution of scores.
(internal citations omitted).
In Guardians, the Second Circuit rejected a cutoff score when the employer “merely chose as many candidates as it needed, and then set the cutoff score so that the remaining candidates would fail.” Id. The cutoff was derived solely from the employer’s staffing needs, without any reference to the job requirements.
Plaintiffs allege that the District Court erred in upholding a twelve-of-sixteen cutoff score on the reading component of the CBEST when an empirical study demonstrates that the proper, job-related passing score on the CBEST writing sub-test is nine or ten.
The District Court concluded that “the passing scores on the CBEST reflect reasonable judgments about the minimum level of basic skills competence that should be required of teachers.” AMAE II, 937 F.Supp. at 1420. The District Court described in detail the process used to develop passing score cutoffs for the original CBEST. The District Court found that then-California Superintendent of Education Bill Honig, who had the ultimate responsibility for setting the score cutoffs, “had before him the results of the Wheeler and Elias study, the results of the field test, and the recommendations of the [Commission] and the [CBEST] Advisory Board.” Id. at 1421.
Superintendent “Honig testified that he did consider both the results of the Wheeler and Elias study and the [Commission's advice when he made his decision, though he ultimately disagreed with both recommendations.” Id. at 1422. The data show
E. The District Court’s Appointment of a Technical Advisor
Plaintiffs claim that the trial court’s rulings were procedurally tainted by the “unreported influence of Dr. Stephen Klein,” a RAND Corporation scientist who advised the District Court through ex parte communications with the judge but was not appointed by the court as an expert witness, was not subject to cross-examination, and did not supply an expert’s report.
According to the Order Appointing Technical Advisor, the District Court appointed Dr. Klein as a technical advisor, not as an expert witness. Courts have inherent authority to appoint technical ad-visors, although “such appointments should be the exception and not the rule, and should be reserved for truly extraordinary cases where the introduction of outside skills and expertise, not possess by the judge, will hasten ... just adjudication.” Reilly v. United States, 863 F.2d 149, 156 (1st Cir.1988). Recently, in General Electric Co. v. Joiner, Justice Breyer wrote separately to endorse such a practice:
I therefore want specially to note that, as cases presenting significant science-related issues have increased in number ... judges have increasingly found in the Rules of Evidence and Civil Procedure ways to help them overcome the inherent difficulty of making determinations about complicated scientific or otherwise technical evidence. Among these techniques are ... the appointment of special masters and specially trained law clerks.
522 U.S. 136, 118 S.Ct. 512, 520, 139 L.Ed.2d 508 (1997) (Breyer, J., concurring).
This case involves the highly technical field of psychometrics, and presents problems of unusual complexity beyond the normal questions of fact and law with which judges routinely grapple. Under the approach identified by Justice Breyer and applied by the First Circuit in Reilly, this case is a fitting case for the use of a technical advisor. The District Court invited the parties to object to Dr. Klein’s appointment and plaintiffs did not do so.
The District Court advised the parties that, consistent with its usual practice, it expected to put Dr. Klein on the stand towards the end of the trial, ask him his views, and permit the parties to cross-examine him. Had the District Court done so, Dr. Klein would have become an expert witness and his testimony would therefore have become a part of the evidence considered by the Court in its role as the finder of fact. In addition, under Fed.R.Evid. 706(a), the parties could have cross-examined Dr. Klein as a matter of right to test this evidence.
However, the District Court did not call Dr. Klein, and there is no evidence that the District Court relied on Dr. Klein’s opinions as a source of evidence. To the extent that the District Court relied on Dr. Klein to assist the Court in understanding the evidence submitted by the parties, Dr. Klein remained within the role of a technical advisor as defined in Reilly, similar to the role of a specialized law clerk.
F. The District Court's Denial of Costs to the Defendants
1. This Court Reviews the Denial of Costs For An Abuse of Discretion
Pursuant to Rule 54(d)(1) of the Federal Rules of Civil Procedure, "costs shall be allowed as a matter of course to the prevailing party unless the court directs otherwise." F.R.C.P. 54(d)(1). Rule 54 thus creates a presumption in favor of awarding costs to the prevailing party. National Info. Servs., Inc. v. TRW, 51 F.3d 1470, 1471 (9th Cir.1995). The District Court's denial of costs is reviewed by this Court for an abuse of discretion. United States ex rel. Newsham v. Lockheed Missiles & Space Co., Inc., 171 F.3d 1208, 1213 (9th Cir.1999).
2. The District Court Abused Its Discretion When It Entirely Denied Costs to the Defendants
Although the decision to award costs resides within the discretion of the district court, a court "generally must award costs unless the prevailing party is guilty of some fault, misconduct, or default worthy of punishment." National Info. Servs., 51 F.3d at 1472.
In this case, the District Court explicitly found that the Defendants had not committed any misconduct that would require a denial of costs. Order filed Feb. 12, 1997 at Ii 2 ("Order"). Nevertheless, the District Court observed that our holding that a court "generally must award costs" implied that there were exceptional cases in which the court might deny costs. Id. (Emphasis added in original Order). In this case, the District Court found that the suit involved an issue of substantial public importance, that the issues were reasonably close and difficult, and that there was some merit to the Plaintiffs' case. Order, ¶11 3-4, 6-7. The District Court also noted the substantial disparity of resources between the resources of the parties. Order, ¶ 5 (citing National Org. for Women v. Bank of California, 680 F.2d 1291, 1294 (9th Cir.1982) and Moore v. Hughes Helicopters, Inc., 708 F.2d 475, 478 (9th Cir.1983)). On this basis, the District Court concluded that it was ``within its discretion to completely deny costs to Defendants, and thereupon did so. Order, ¶ 8.
We agree with the District Court that our precedent allows a court to consider the limited resources of a Title VII plaintiff when assessing costs. Moore, 708 F.2d at 478; Wrighten v. Metropolitan Hosp., Inc., 726 F.2d 1346, 1358 (9th Cir.1984). However, these precedents must be read in light of our more recent decision in National Info. Servs. We held in National Info. Sen's. that the denial of costs is "by nature a penalty," 51 F.3d at 1472, and that such punitive measures cannot be imposed absent wrong-doing because "a district court cannot punish a party by denying costs unless the party has done something to deserve it." Id. Congress has included nothing in the language of Title VII that would justify the imposition of such a penalty on an exonerated defendant. As a consequence, we conclude that a court may consider the limited resources of a Title VII plaintiff, but may not entirely deny costs to a prevailing defendant as a result.
We also conclude that there is no exception to Rule 54(d) that entitles a court to punish a defendant simply because the case involves an issue of national importance. The District Court relied heavily upon a sliver of language contained in two Seventh Circuit cases, which both mentioned "landmark cases of national importance." Delta Air Lines, Inc. v. Colbert, 692 F.2d 489, 490 (7th Cir.1982) and Popeil Bros., Inc. v. Schick Elec., Inc., 516 F.2d 772, 776 (7th Cir.1975). However,
Turning to the District Court’s remaining grounds for the denial of costs, we observe that National Info. Servs. specifically rejected the denial of costs on the basis that the plaintiffs position had' “ ‘merit.’ ” National Info. Servs., 51 F.3d at 1471. It also specifically held that “ ‘difficulty’ alone does not justify penalizing the prevailing parties.” Id. at 1473. These factors should not be considered in the assessment of costs and it was an abuse of discretion for the District Court to consider those factors.
Finally, none of the precedents relied upon by the District Court involved the complete denial of costs to a prevailing party,
III. Conclusion
For the reasons discussed above, we deny Plaintiffs’ Appeal, and we grant Defendants’ Appeal. The Judgment of the District Court in favor of the Defendants is AFFIRMED, but the case is remanded to the District Court for a determination of the proper costs in light of our discussion.
. The introduction and portions of the factual and procedural history were authored by Judge Boochever, and have been incorporated into this opinion with his permission.
. The name of the CTPL was actually changed on January 1, 1983 to the Commission on Teacher Credentialing (“CTC”). AMAE I, 836 F.Supp. at 1538. The CTC remained responsible for administering the test. Id.
. The full provision reads:
The Public School System shall include all kindergarten schools, elementary schools, secondary schools, technical schools, and State colleges, established in accordance with law, and, in addition, the school districts and the other agencies authorized to maintain them. No school or college or any other part of the Public School System shall be, directly or indirectly, transferred from the Public School System or placed under the jurisdiction of any authority other than one included within the Public School System.
Cal. Const., art. IX, § 6, ¶ 2.
. Indeed, we believe that it is the only term to which any jurisprudence has attached.
. We note that, despite the statute's suggestion that there is only one "State educational agency," this Court has previously found that different State departments and agencies can together constitute a "State educational agency." Los Angeles Branch NAACP v. Los Angeles Unified Sch. Dist., 714 F.2d 946, 951 (9th Cir.1983); see also Upper Valley Ass'n for Handicapped Citizens v. Mills, 928 F.Supp. 429, 432 (D.Vt.1996) (holding that Vermont Board of Education and Department of Education "collectively constitute a State educational agency").
. Even at the Constitutional level, the California State Constitution currently reflects the fact that school districts are the primary administrative units for the schools. In 1972, California modified its State Constitution so that, while public schooling continued to be part of the "Public School System,” the Legislature was authorized "to permit school districts 'to initiate and carry on any programs, activities, or to otherwise act in any manner which is not in conflict with the laws and purposes for which the school districts are established.'” Hartzell v. Connell, 35 Cal.3d 899, 916, 201 Cal.Rptr. 601, 679 P.2d 35 (1984) (quoting Cal. Const., art. IX, § 14). To the extent that the State Constitution before 1972 might have been understood as requiring centralized control, it is clear that after 1972 the State Constitution permitted the school districts to exist as largely autonomous systems. Moreover, the Court notes that California's Education Code § 35160, enacted in 1976, embodies the intent of article IX, § 14 and allows the school districts to "initiate and carry on any program, activity or [ ] otherwise act in any manner which is not in conflict with ... any law and which is not in conflict with the purposes for which school districts are established.” Cal. Ed. Code § 35160; Choice-In-Education League v. Los Angeles Unified Sch. Dist., 17 Cal.App.4th 415, 423, 21 Cal.Rptr.2d 303 (1993).
. We note that we have previously concluded that the California State Board of Education and the California State Department of Education fall within the definition of "State educational agency.” Los Angeles Branch NAACP v. Los Angeles Unified Sch. Dist., 714 F.2d 946, 951 (9th Cir.1983).
. We note that Congress selected the term "local educational agency" rather than the larger and more inclusive term "educational agency," which is defined to include both local educational agencies and "``the state board of education or other agency or officer primarily responsible for the state supervision of public elementary and secondary schools.'" Idaho Migrant Council v. Board of Educ., 647 F.2d 69, 71 (9th Cir.1981) (quoting 20 U.S.C. §§ 1720(a), 881(k)).
. Of course, whether or not an entity refers to itself as a "school system" may be a useful piece of evidence in determining whether or not the schools in that entity are closely enough linked to qualify as a "school system" for the purposes of § 2000d-4a(2)(B). However, while such a self-description would constitute evidence pointing in one direction, it is not necessarily determinative on the question.
. The Court notes that no House Report was submitted for this bill. The Senate Report is therefore the sole Congressional Report.
. This is not to say that a State may not be the proper defendant under a Title VI suit. The plain language of Title VI demonstrates that a State agency or department may be covered by Title VI. 42 U.S.C.A. § 2000d-4a(l)(A-B). To the extent that one would bring Suit against the State for violations by such an agency or a department, the State would be the proper defendant.
As a result, it is clear that an entity need not itself be a "program or activity" to be named as a defendant for Title VI. AMAE I, 836 F.Supp. at 1541-43. This conclusion is confirmed within the statute by the structure of subsections 3(A) and (B) of § 2000d-4a. Whereas subsection 3(A) provides for corporation-wide coverage when funding is extended to the corporation as a whole, subsection 3(B) limits the definition of "program or activity" to a particular plant or comparable facility when assistance is extended directly to the plant. 42 U.S.C.A. § 2000d-4a(3)(A) & (B). In the later case, the "program or activity" would be limited to the plant, but the corporation would nevertheless be the proper defendant. For example, were a Ford plant in Dearborn, MI to receive federal funds, Title VI coverage would be limited to the operations of the Dearborn plant and not thereby
Our conclusion that the State as a whole is not subject to Title VI means only that receipt of federal funds by an agency of the State does not automatically extend Title VI coverage to the entire State government. Of course, the State may nevertheless be sued in the proper circumstances for a violation in a covered program or activity.
. The District Court found that the CTPL (predecessor to the CTC) was created by the Legislature by statute, and that the Governor appoints fifteen of the sixteen voting members of the Commission. AMAE I, 836 F.Supp. at 1538. Moreover, although the CTC is required to notify the Board of Bducation and the Superintendent of any proposed policies and regulations, the CTC is not subject to the authority of either entity. Id.
. We do note that a parent corporation may be liable under Title VII where it interferes with the employment practices of the subsidiary. Watson, 650 F.2d at 993. However, as we discuss below, we do not consider the CBEST to be the State's proprietary involvement with its "subsidiary" reviewable under Title VII but rather an exercise of its licensing power, reviewable only under the Constitution.
. In evaluating the Texas Exam for Current Administrators and Teachers ("TECAT"), the Fifth Circuit held that a state requirement of the TECAT did not make the State of Texas into an employer and rejected a claim that the State of Texas was potentially subject to Title VII liability for any effect of the exam. Fields v. Hallsville Indep. Sch. Dist., 906 F.2d 1017, 1020 (5th Cir.1990). Although the scope of the TECAT is not explicitly discussed in Fields, the teacher's exam upheld in Fields was required only for public school teachers. See State v. Project Principle, Inc., 724 S.W.2d 387, 389-90 (Tex.1987) (holding that the new requirement that existing Texas public school teachers pass the TECAT constituted a licensing requirement and not a change in the contractual relationship between teachers and school districts).
. The dissent questions the viability of the proprietary/regulatoxy distinction, citing J.L. v. Social Sec. Admin., 971 F.2d 260 (9th Cir.1992). While we did acknowledge in that case that "[n]ot all actions may be so easily classified," we nevertheless went on to acknowledge that the dichotomy served a limited function. Id. at 272. In this case, we employ the distinction in a very limited setting: Is a particular exam a licensing exam or a regulatory exam? This question can only arise in a certification context where the State is not the employer.
Finally, we would note that the distinction between proprietary and regulatory actions is a long established distinction, and we believe that the courts will be able to adequately distinguish between such functions. See generally Reeves, Inc. v. Stake, 447 U.S. 429, 436, 100 S.Ct. 2271, 65 L.Ed.2d 244 (1980) ("The basic distinction drawn in Alexandria Scrap between States as market participants and States as market regulators makes good sense and sound law.").
. We do note, of course, that the CBF.ST constitutes State action, and could be challenged were the CBEST to violate Plaintiffs' Constitutional rights. There is, however, no allegation that the CBEST violates any Constitutional right.
. The dissent argues that, having found Title VI and Title VII inapplicable, the remainder of our discussion on the merits is merely dicta. However, our discussion is not dicta where, as here, it constitutes an alternative basis for our decision. " ``[W]here a decision rests on two or more grounds, none can be relegated to the category of obiter dictum.'" Export Group v. Reef Industries, Inc., 54 F.3d 1466, 1471 (9th Cir.1995) (per curiam) (quoting Woods v. Interstate Realty Co., 337 U.S. 535, 537, 69 S.Ct. 1235, 93 L.Ed. 1524 (1949)); see also MacDonald, Sommer & Frates v. Yolo County, 477 U.S. 340, 346 n. 4, 106 S.Ct. 2561, 91 L.Ed.2d 285 (1986).
. If the defendant establishes that the test is job-related, the burden would then shift back to the plaintiff to show that other selection
.The District Court's opinion provides a detailed background on the methodology used in each study, AMAE II, 937 F.Supp. at 1412-16, and we will not repeat that material here except where necessary to a particular issue in the appeal.
. The Uniform Guidelines were jointly adopted by the EEOC, the Civil Service Commission, the Department of Labor, and the Department of Justice in 1978, and are codified at 29 C.F.R. § 1607. They have remained unchanged since that date.
. The Uniform Guidelines do not preclude the use of other validation methods, but rather provide that "[n]ew strategies for showing
. The Uniform Guidelines used the term "content" to describe both the ``content of the job," 29 C.F.R. § l607.14(C)(1), and the "content of the selection procedure." 29 C.F.R. § 1607.5(B).
. We note that the 1982 study raised somewhat different questions than the latter two studies. We explicitly do not reach that study because the fact that the latter two studies survive this appeal makes the 1982 study redundant and relieves us of the additional burden of evaluating the District Court's findings on that study.
. The other two options were 1 ('‘minor”) and 2 ("important”).
. In addition, even if Dr. Lundquist's results were called into question by the initial retention of some skills that were slightly less "important," the mathematics portion of her content validity study was saved by a subsequent step she took. When faced with the prospect that 21 of the 37 math skills would be eliminated, the Commission engaged Dr. Lund-quist to conduct a focused content validity study on the math segment. Lundquist employed a panel of twenty teacher educators who conducted a fresh review of the 37 math skills. For a skill to be retained, 80 percent of the panel had to rate it as "applicable and required at entry, and the skill had to have average and future importance ratings equal to or greater than two (Out of a three-point scale, one being ``minor,' and three being ``critical')." AMAE II, 937 F.Supp. at 1416. Thus, on the math section, only skills rated "important" on average were retained.
. Indeed, both Reilly and the District Court explicitly liken the role of a technical advisor to that of a law clerk.
. Quite recently, we held that a district court abused its discretion by awarding especially high costs without considering that such high costs would render the civil rights plaintiff indigent. Stanley v. University of Southern California, 178 F.3d 1069 (9th Cir.1999). We therefore remanded the case so that the district court could consider the possibility of indigence and the effects of imposing "such high costs" on civil rights litigants. Id. at *9.
Stanley teaches that, in balancing the amount of costs to be awarded, a district court must consider the hardships that extreme costs may impose on the people involved. These considerations will naturally vary from plaintiff to plaintiff, and financial burdens imposed on organizations may create less hardship than similar burdens imposed on natural persons. This balancing will of course depend on the evidence of hardship presented to the district court.
We note only that our holding in Stanley does not eviscerate the holding of National Info. Servs. that the denial of costs is generally punitive. Stanley does require courts in extreme circumstances to reduce costs so as not to render an individual civil rights plaintiff indigent. On remand in this case, the District Court should consider the different hardships that would be imposed on each particular Plaintiff.
. In the only cited appellate case in which costs were completely denied, Pursche v. Atlas Scraper & Eng’g Co., 300 F.2d 467, 489 (9th Cir.1961), we affirmed a finding that neither party would be considered the “prevailing party” where one claim of the plaintiff’s patent was declared invalid. Id. In the current case, the District Court appears to have found that Defendants were the prevailing party.