WReier-Aviles on DSKGBLS3C1PROD with RULES266922 Federal Register / Vol. 75, No. 209 / Friday, October 29, 2010 / Rules and Regulationstest administrator be expanded toinclude test proctors.Discussion: Section 668.142, inpertinent part, defines an independenttest administrator as a test administratorwho administers tests at a location otherthan an assessment center and who hasno current or prior financial orownership interest in the institution, itsaffiliates, or its parent corporation, otherthan the fees earned for administeringapproved ATB tests through anagreement with the test publisher orState, and has no controlling interest inany other institution and has nocontrolling interest in any otherinstitution. We agree that independenttest administrators may obtain a fee forthe administration <strong>of</strong> ATB testsgenerally through a written contractbetween the test publisher or State andthe test administrator. In order to clarifythis single type <strong>of</strong> allowable financialinterest, we have made a change to thelanguage in this definition.On the matter <strong>of</strong> expanding thedefinition <strong>of</strong> the term test administratorto include test proctors, we disagreewith this suggestion. The reason wedisagree with the commenter’ssuggestion is that subpart J <strong>of</strong> part 668specifically restricts the administration<strong>of</strong> ATB tests to test administratorscertified by the test publisher or State toadminister their tests, as defined in theagreement between the Secretary andthe test publisher or State, as applicable.We believe it would be confusing to addtest proctors to the definition <strong>of</strong> a testadministrator because only certified testadministrators can administer ATB testsfor title IV, HEA program purposes. Webelieve certification is an appropriaterequirement because it insures that theapproved tests are administered bytrained, skilled, and knowledgeablepr<strong>of</strong>essions.Changes: We have amended thedefinition <strong>of</strong> the term independent testadministrator by clarifying that anindependent test administrator musthave no current or prior financial orownership interest in the institution, itsaffiliates, or its parent corporation, otherthan the fees earned through theagreement an independent testadministrator has with the testpublisher or State to administer the test.Application for Test Approval(§ 668.144)Comment: One commenter stronglysupported the proposed change in thelanguage regarding the norming groupin §§ 668.144(c)(11)(iv)(B) and668.146(c)(4)(ii) that requires the groupto be a contemporary sample that isrepresentative <strong>of</strong> the population <strong>of</strong>persons who have earned a high schooldiploma in the United States.Discussion: The statute provides thata student who does not have a highschool diploma or its equivalent canbecome eligible for title IV, HEAprogram assistance if the student takesan independently administeredexamination and achieves the scorespecified by the Secretary thatdemonstrates that the student has theability to benefit from the training being<strong>of</strong>fered. As an alternative to obtaining ahigh school diploma, it is appropriatethat the normative group used toestablish the relative placement <strong>of</strong> thetest-taker’s results should be comprised<strong>of</strong> U.S. high school graduates ratherthan a group <strong>of</strong> persons who are beyondthe usual age <strong>of</strong> compulsory schoolattendance in the United States.However, we take this opportunity toremind institutions that a fundamentalcomponent <strong>of</strong> the definition <strong>of</strong> the terminstitution <strong>of</strong> higher education requiresthat an eligible and participatinginstitution may admit as regularstudents only persons who have a highschool diploma (or have the recognizedequivalent) or are beyond the age <strong>of</strong>compulsory school attendance.Therefore, it is clear that for the purpose<strong>of</strong> establishing title IV, HEA programeligibility, approved ATB tests may onlybe provided to students who are beyondthe age <strong>of</strong> compulsory schoolattendance.Changes: None.Comment: Several commenterssupported the proposal to include in thetest publisher’s or State’s screening <strong>of</strong>potential test administrators, theirevaluation <strong>of</strong> a test administrator’sintegrity. In response to our request inthe NPRM for feedback about how a testpublisher or a State will determine—inaccordance with §§ 668.144(c)(16)(i) and668.144(d)(7)(i)—that a testadministrator has the integrity necessaryto administer tests, we received anumber <strong>of</strong> suggestions. These includedthe following—• Requiring a prospective testadministrator to sign, under penalty <strong>of</strong>perjury, an application indicatingwhether he or she had ever beenconvicted <strong>of</strong> fraud, breach <strong>of</strong> fiduciaryresponsibilities, or other illegal conductinvolving title IV, HEA programs;• Including a question on the testadministrator’s application askingwhether the applicant has ever beenconvicted <strong>of</strong> a crime and, if the answerto this question is ‘‘yes’’, requiring theapplicant to provide additional details;• Including a question on the testadminister application asking whetherthe applicant has ever worked at aninstitution <strong>of</strong> higher education, and ifVerDate Mar2010 14:10 Oct 28, 2010 Jkt 223001 PO 00000 Frm 00092 Fmt 4701 Sfmt 4700 E:\FR\FM\29OCR2.SGM 29OCR2the answer to this question is ‘‘yes’’,requiring the applicant to provideadditional details; and• Requiring test publishers and Statesto perform fingerprinting andbackground checks, including a checkfor being included in any lawsuit, aswell as, checking for arrests andconvictions, for each test administer.Discussion: We appreciate thecommenters’ suggestions regarding waystest publishers and States can evaluatewhether a test administrator has theintegrity necessary to administer ATBtests. While test publishers and Statescan adopt any <strong>of</strong> the methods proposedby the commenters, we do not believeit is appropriate to require all testpublishers and States to use thosemethods to evaluate test administratorintegrity. Rather, we believe § 668.144,as proposed, will provide testpublishers and States with theflexibility they need to determine thatthe test administrator will have thenecessary training, knowledge, skillsand integrity to test students inaccordance with subpart J <strong>of</strong> part 668and the requirements <strong>of</strong> the testadministration technical manual. Under§ 668.144, test publishers and States arerequired to disclose how they will goabout making these determinations.When evaluating the informationprovided by test publishers and States,we will be looking at their processesand to what extent informationcollected by the test publisher or Statesupports their determination <strong>of</strong> whethera prospective test administrator candemonstrate his or her training,knowledge, skills and integrity. Inaddition, we will compare therequirements in the test administrationtechnical manual to the other provisionsin § 668.144 that require testadministrators to have both the abilityand facilities to keep the ATB testssecure against disclosure or release andhow those issues are explained toprospective test administrators, how anymonitoring may be achieved to insurethat the tests are being protected.Changes: None.Comment: One commenterrecommended that test publishers andStates should not be required to discloseany proprietary information, such as testanomaly analysis, to the <strong>Department</strong>due to the proprietary nature <strong>of</strong> thestudy techniques. The commenter statedthat, if the <strong>Department</strong> decides that testpublishers and States must provide theirtest anomaly study procedures, the<strong>Department</strong> should provide assurancesthat the information will be keptconfidential.Discussion: It is important that testpublishers and States provide the
Federal Register / Vol. 75, No. 209 / Friday, October 29, 2010 / Rules and Regulations66923WReier-Aviles on DSKGBLS3C1PROD with RULES2<strong>Department</strong> with their test anomalyanalysis because the <strong>Department</strong> needsto understand the specific test anomalyanalysis methodology employed by eachtest publisher or State, as applicable, toinsure that they have established arobust process and procedures toidentify potential test anomalies,methods to investigate test anomalies,due process in the investigation <strong>of</strong> theseanomalies, as well as, the types <strong>of</strong>corrective action plans and the means <strong>of</strong>implementation <strong>of</strong> the corrective actionplans, up to and including thedecertification <strong>of</strong> test administrators.Because the <strong>Department</strong> agrees that testanomaly analyses may be proprietary,the <strong>Department</strong> will not release thisinformation to the public and willotherwise treat the information asconfidential.Changes: None.Comment: One commenter suggestedthat the <strong>Department</strong> define the term‘‘test irregularities’’ and explain thedistinction between test irregularitiesand test score irregularities.Discussion: An ATB test irregularityoccurs when the ATB test isadministered in a manner that does notconform to the established rules for testadministration. An ATB test scoreirregularity is one type <strong>of</strong> ATB testirregularity. For example, improperseating that would allow test-takers tobe so close to one another that each testtakercould observe the test answersheets or test answers on another testtaker’scomputer screen is an example <strong>of</strong>an ATB test score irregularity. We agreewith the commenter that a clearunderstanding <strong>of</strong> proper testadministration is needed to prevent testirregularities. For this reason, we haveadded a definition <strong>of</strong> the term ATB testirregularity to § 668.142. In addition,test publishers and States includeinstructions to the ATB testadministrator in their testadministration manuals. Section§ 668.144(c)(12) requires test publishersto include in their applications themanual they provide to testadministrators. We believe it isappropriate to also require States toinclude their test manuals in theirapplications. Accordingly, we haveadded a new § 668.144(d)(11) to requireStates to include, as part <strong>of</strong> itssubmission to the Secretary, the State’smanual for test administration.Additionally, we have determinedthat in proposed § 668.144(c)(10),regarding test-taking timedeterminations, our reference to§ 668.146(b)(2) was imprecise. Section668.146(b)(2) relates only to samplingthe major content domains, not tosampling the major content domainswith regard to test-taking time.Therefore, we have revised thisparagraph to refer to § 668.146(b)(3),which includes as a requirement for testapproval, the appropriate test-takingtime to permit adequate sampling <strong>of</strong> themajor content domains. We have alsoadded a provision to specify that a testpublisher may include with itsapplication a description <strong>of</strong> the mannerin which test-taking time wasdetermined in relation to the otherrequirements in § 668.146(b) to providethe flexibility for test publishers toinclude a more comprehensivedescription <strong>of</strong> the way in which testtakingtime was determined.Changes: In § 668.142, we havedefined an ATB test irregularity as anirregularity that results from an ATB testbeing administered in a manner thatdoes not conform to the establishedrules for test administration consistentwith the provisions <strong>of</strong> subpart J and thetest administrator’s manual. We alsohave added new § 668.144(d)(12) toinclude a requirement that a State, in itssubmission <strong>of</strong> an ATB test for approval,must include a manual provided to testadministrators containing theprocedures and instructions for testsecurity and administration.In § 668.144(c)(10), we have made atechnical correction to specificallyreference § 668.146(b)(3) rather than§ 668.146(b)(2) and added a provision tospecify that a test publisher may includewith its application a description <strong>of</strong> themanner in which test-taking time wasdetermined in relation to the otherrequirements in § 668.146(b).Test Approval Procedures (§ 668.145)Comment: One commenter requestedthat the <strong>Department</strong> provide examples<strong>of</strong> a substantial change that would causethe <strong>Department</strong> to revoke its approvalconsistent with proposed§ 668.145(d)(1).Discussion: Section 668.144 lists thecomponents <strong>of</strong> an application that testpublishers and States must submit forthe Secretary’s approval <strong>of</strong> an ATB testas an alternative to having a high schooldiploma or its recognized equivalent.The list <strong>of</strong> required items for submissionincludes a summary <strong>of</strong> the preciseeditions, forms, levels, and sub-tests forwhich approval is being sought. Inaddition, we require that a minimum <strong>of</strong>two or more secure, equated, alternateforms <strong>of</strong> the test must be submitted.Moreover, the regulations require that ifa test is being submitted as a revision <strong>of</strong>a previously approved test, the testpublisher or State, as applicable, mustalso submit an analysis <strong>of</strong> the revisions,including the reasons for the revisions,the implications <strong>of</strong> the revisions for theVerDate Mar2010 14:10 Oct 28, 2010 Jkt 223001 PO 00000 Frm 00093 Fmt 4701 Sfmt 4700 E:\FR\FM\29OCR2.SGM 29OCR2comparability <strong>of</strong> scores on the currentlyapproved test to scores on the revisedtest, and the data from validity studies<strong>of</strong> the revised test undertakensubsequent to the revisions. Takentogether, the regulations require the testpublisher and the State to submit theirtests, including all forms or editions <strong>of</strong>those tests, for approval. If the approvedtests are revised, we have addressedhow revised tests along with thesupportive data must be submitted forapproval under §§ 668.144(c)(9) and(d)(12).Examples <strong>of</strong> substantive changes are(1) when a previously approved ATBtest in a pencil and paper format isconverted to a computerized test, and(2) when a previously approved ATBtest in a pencil and paper format isconverted to a voice recorded format. Ineach <strong>of</strong> these examples, the testpublisher or State is required to submitthe list <strong>of</strong> required submissions above.An example <strong>of</strong> a non-substantivechange is a correction <strong>of</strong> a typographicalerror. We will not require analysis <strong>of</strong>and submission for approval for nonsubstantivechanges; however, it isimportant to note that if these changesare documented and shared with theSecretary, we would be able to addressinquiries or comments from the publicregarding these changes. Recognizingthat we cannot provide an exhaustivelist that would cover every situation, weencourage test developers to contact usif they have questions about changes toan approved test and whether theproposed changes would be consideredsubstantive or non-substantive.Changes: None.Criteria for Approving Tests (§ 668.146)Comment: One commenter noted thatthe 1985 American PsychologicalAssociation (APA) edition <strong>of</strong> theStandards for <strong>Education</strong>al andPsychological Testing (Standards)addressed test construction in terms <strong>of</strong>meeting ‘‘primary, secondary andconditional’’ standards. The commenterpointed out that the 1999 revisededition <strong>of</strong> the Standards no longermakes these distinctions and insteadrequires test developers and users toconsider all the standards beforeoperational use and does not continuethe practice <strong>of</strong> designating levels <strong>of</strong>importance. As a result, the commentersuggested that we remove the referenceto the words ‘‘meeting all primary andapplicable conditional and secondarystandards for test construction’’ inproposed in § 668.146(b)(6) becausethey are confusing. The commentersuggested—as an alternative—that weadopt language that the <strong>Department</strong>used in 34 CFR 462.13(c)(1) (i.e., ‘‘The
- Page 1 and 2:
Friday,October 29, 2010Part IIDepar
- Page 3 and 4:
Federal Register / Vol. 75, No. 209
- Page 6 and 7:
66836 Federal Register / Vol. 75, N
- Page 8 and 9:
66838 Federal Register / Vol. 75, N
- Page 10 and 11:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 12 and 13:
66842 Federal Register / Vol. 75, N
- Page 14 and 15:
66844 Federal Register / Vol. 75, N
- Page 16 and 17:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 18 and 19:
66848 Federal Register / Vol. 75, N
- Page 20 and 21:
66850 Federal Register / Vol. 75, N
- Page 22 and 23:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 24 and 25:
66854 Federal Register / Vol. 75, N
- Page 26 and 27:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 28 and 29:
66858 Federal Register / Vol. 75, N
- Page 30 and 31:
66860 Federal Register / Vol. 75, N
- Page 32 and 33:
66862 Federal Register / Vol. 75, N
- Page 34 and 35:
66864 Federal Register / Vol. 75, N
- Page 36 and 37:
66866 Federal Register / Vol. 75, N
- Page 38 and 39:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 40 and 41:
WReier-Aviles on DSKGBLS3C1PROD wit
- Page 42 and 43: 66872 Federal Register / Vol. 75, N
- Page 44 and 45: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 46 and 47: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 48 and 49: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 50 and 51: 66880 Federal Register / Vol. 75, N
- Page 52 and 53: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 54 and 55: 66884 Federal Register / Vol. 75, N
- Page 56 and 57: 66886 Federal Register / Vol. 75, N
- Page 58 and 59: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 60 and 61: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 62 and 63: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 64 and 65: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 66 and 67: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 68 and 69: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 70 and 71: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 72 and 73: 66902 Federal Register / Vol. 75, N
- Page 74 and 75: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 76 and 77: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 78 and 79: 66908 Federal Register / Vol. 75, N
- Page 80 and 81: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 82 and 83: 66912 Federal Register / Vol. 75, N
- Page 84 and 85: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 86 and 87: 66916 Federal Register / Vol. 75, N
- Page 88 and 89: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 90 and 91: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 94 and 95: 66924 Federal Register / Vol. 75, N
- Page 96 and 97: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 98 and 99: 66928 Federal Register / Vol. 75, N
- Page 100 and 101: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 102 and 103: 66932 Federal Register / Vol. 75, N
- Page 104 and 105: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 106 and 107: 66936 Federal Register / Vol. 75, N
- Page 108 and 109: 66938 Federal Register / Vol. 75, N
- Page 110 and 111: 66940 Federal Register / Vol. 75, N
- Page 112 and 113: 66942 Federal Register / Vol. 75, N
- Page 114 and 115: 66944 Federal Register / Vol. 75, N
- Page 116 and 117: 66946 Federal Register / Vol. 75, N
- Page 118 and 119: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 120 and 121: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 122 and 123: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 124 and 125: 66954 Federal Register / Vol. 75, N
- Page 126 and 127: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 128 and 129: 66958 Federal Register / Vol. 75, N
- Page 130 and 131: 66960 Federal Register / Vol. 75, N
- Page 132 and 133: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 134 and 135: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 136 and 137: WReier-Aviles on DSKGBLS3C1PROD wit
- Page 138 and 139: 66968 Federal Register / Vol. 75, N
- Page 140 and 141: 66970 Federal Register / Vol. 75, N
- Page 142 and 143:
66972 Federal Register / Vol. 75, N
- Page 144 and 145:
66974 Federal Register / Vol. 75, N