Assessment Notes, Vol. 1, Issue 1, January 27, 2003

Scope of Work for the Winter and Spring

Points Of Interest

  • Over 60 Teachers, Professors, Administrators, and Consultants convene to begin Grade Level Expectations (GLEs) for Grades 3-8.

  • Deputy Commissioner Bud Meyers is committed to creating assessments that reflect high standards.

  • “All Vermont students ought to feel success in meeting the standards”
    Marc Hull

Inside this issue:
Developing Grade Level Expectations 2
The Contractors for NLCB 3
Question/Concern Corner 4
Glossary Terms/Calendar I1
NCLB Team Participants I2

Scope of Work

As the challenges and deadlines of both NCLB and Act 60 became apparent, the Vermont Department of Education (VT DOE) articulated the first two steps towards meeting the requirements: 1) Developing Grade Level Expectations; and 2) Developing Assessment Specifications and Blueprints. These steps translate into the major scope of work for this winter and spring, and will involve three contractors as well as of many VT educators. The Vermont Institutes has the lead responsibility for NCLB work in math and writing, and all of the Act 60 work; Measured Progress, from Dover, NH, has responsibility for NCLB reading GLEs; and the National Center for Assessment, in Portsmouth, NH, will provide oversight to the NCLB work. (There is more about these contractors in the article “The Contractors for NCLB”).

~ ~


NCLB Assessment
"Kick-Off"

January 14, 2003 was an important day for education in Vermont -- NCLB assessment work officially "kicked off"! More than 60 teachers, professors, administrators and individual consultants met at Vermont College to begin the challenging, exciting, and somewhat daunting task of articulating grade level expectations for grades 3 through 8 in math, reading and writing. After a welcome from Doug Harris, Executive Director of The Vermont Institutes, the group heard from Bud Meyers, Deputy Commissioner of the VT DOE. Bud shared his belief in and commitment to his three guiding principles of assessment: tree graphic

  1. Create assessments that will reflect the high standards that Vermont has for all students;
  2. Maintain Vermont's high academic standards; and
  3. "Do no harm" to any child or school.

Marc Hull, former Commissioner of Education, framed the work in the
context of the history of the Vermont Framework. He cautioned the group to remember that ALL Vermont students ought to feel success in meeting the standards. Marc also emphasized that doing what hasn’t yet been done --setting the grade level expectations that allow students to achieve while also maintaining high quality--will require great thought and determination.

Marc was followed by Marge Petit, [see the article titled “The Contractors…”] who had the difficult job of taking participants through a myriad of resources that had been prepared for them to work with (for example, comparisons of Vermont’s Framework to numerous local, state and national documents), and explaining such parameters as “grain size,” “balance of representation,” and depth and breadth. [Future editions of Assessment Notes will address these concepts in greater detail.]

The content groups then began the work of becoming more familiar with the state, national and local resources. Each group also attempted to write GLEs for one standard. Everyone became much clearer about what the work really involves.

Comments from participants indicate that the preparation of the resource materials was helpful, and would be even more so once they had time to
devour them. On the other hand, many participants expressed concern about the scope of the work, the importance that we “get it right,” and the time constraints that NCLB has imposed. Nevertheless, the overall feeling is one of anticipation that this is an opportunity to provide tools that will help teachers and students.

Here are some additional comments from the first day:

  • “This is a difficult project, but I’m not discouraged. I think we’ll figure out how to do it more effectively and feel better about it.”

  • “I am enjoying the process. Thank you for inviting me. This document is going to be so helpful to classroom teachers and parents.”

  • “An incredibly important process to be done in such a [time] crunch.”

  • “Stressful day…but a good stress.”

  • “Right now it all seems overwhelming.”

White House

Five more days are scheduled for these groups to work on GLEs, after which we are planning to get broad input from educators and other citizens throughout Vermont. The Vermont Standards and Assessment Consortium will be working with the Teacher Quality Networks to plan a process that will enable all educators to review and have input into the draft documents. Stay tuned for more information!

~ ~

Developing Grade Level Expectations

Grade level expectation work for various content areas is currently at slightly different stages.

Science, for example, started work last year on creating two-grade cluster GLEs for the Inquiry Standard (7.1). This work will be reviewed by an oversight committee later in January, and then go out to teachers for use in their classrooms. Revisions will then be made based on feedback from the field. Simultaneously, groups of
science teachers in three different supervisory unions are writing the GLEs for Standard 7.12. These GLEs will eventually go through the same feedback and revision process. This work is being led by Dave White (dwhite@doe.state.vt.us) from the VT DOE, Pam Quinn (pquinn@vermontinstitutes.org) and Gail Hall (ghall@vermontinstitutes.org) from The Vermont Institutes.Comprehensive Social Studies Assessment Project (CSSAP)

Physical Education and Health groups around the state have been working for the last few years to create documents that more clearly explain expectations for each grade cluster. They will continue their work this winter and spring. Ellen Harris (eharris@vermontinstitutes.org) from VI has joined in to help make connections from current and future GLE work to the overall assessment design.

The Arts have also been busy over the years clarifying expectations for music, fine arts, drama and dance. There has already been some excellent work done in designing assessments for these areas. A group is convening this month to discuss how to move this work forward with the intent of defining the two-grade cluster grade level
expectations in each area. Wendy Cohen (wcohen@vermontinstitutes.org) is the VI staff person responsible for coordinating this work.

Sigrid Lumbra (slumbra@vermontinstitutes.org), another Vermont Institutes staff member, will be convening a History and Social Sciences committee in the next month to define upcoming work. As with the other Fields of Knowledge, work on grade-cluster expectations will be a key focus. In addition to this work, over the last few years the DOE has invested time and money for participation in the Comprehensive Social Studies Assessment Project (CSSAP). CSSAP has developed a portfolio assessment process as well as some excellent assessment items. Part of the history and social sciences committee’s job will be to align this national work with the Framework and with the still to-be-developed grade level expectations.

The Math, Reading and Writing groups are on a “fast track” and have additional demands placed on them because of stipulations in the No Child Left Behind Act. They are currently developing grade level expectations for grades 3 through 8. Using these GLEs, assessments for each of these grades will eventually be designed. [For more detailed information about this work, see the article titled NCLB Assessment “Kick Off.”]

Finally, we are continuing to search for districts and schools that are addressing and/or assessing the Vital Results. We are drawing on work from the high schools’ Vital Results Conference as well as following up on any lead we get. We also are considering the ways that the Vital Results should tie into all the fields of knowledge in terms of GLEs and assessments. Wendy, Ellen and Sigrid at VI are all providing the impetus for this work.

Developing Assessment Specifications and Blueprints

This is work scheduled for late in the spring and will be discussed in the next edition of Assessment Notes.

Vermont State Shield

The Contractors for NCLB Assessment Development

"Make New Friends and Keep the Old;
One is Silver and the Other Gold."

In order to complete this GLE work in both a timely and professional manner, the VT DOE has formed a partnership with three highly-respected education groups from in and around Vermont. These three contractors, the Center for Assessment, The Vermont Institutes, and Measured Progress are putting their heads together to help teachers tackle this complex work.

The Center for Assessment, located in Portsmouth, NH, has two “old friends” on their roster who are key players in helping with the Vermont assessment work. Marge Petit has been an integral part of the development of the Vermont Framework and Learning Opportunities, and in her role as Deputy Commissioner provided important leadership for setting up systems for implementing the standards. Now here she is again, this time helping to frame the assessment work. Marge’s role is to provide technical assistance to the VT DOE in terms of oversight of the assessment work. In fact, she is providing strong leadership in helping the contractors come together to accomplish the work in reading, writing and mathematics in a coherent way.

Karin Hess has been a principal and curriculum leader in VT for a number of years, and in a number of capacities. She, too, is back and helping Marge keep tabs on everything. Even more importantly, she is facilitating the writing group work. In this effort she is working closely with The Vermont Institutes writing staff, Marty Gephart (mgephart@vermontinstitutes.org), Karen Kurzman (kkurzman@vermontinstitutes.org), and Joey Hawkins (jhawkins@vermontinstitutes.org).

Marty, Karen and Joey are probably familiar to many of you. They provide consultation and professional development in writing, primarily but not solely in schools that have needed technical assistance. Their long-time commitment to understanding the issues of teaching writing as well as their many connections to Vermont classrooms provides them with a strong foundation to help shape the development of grade level expectations in writing.

The Math team from The Vermont Institutes includes Doug Harris (VI’s Executive Director), Aldo Bianchi (abianchi@vermontinstitutes.org), Deb Armitage (darmitage@vermontinstitutes.org), Sheila Rivers (srivers@vermontinstitutes.org), Pat Buttolph (pbuttolph@vermontinstitutes.org), and Judi Laird (jlaird@vermontstitutes.org). This team brings their knowledge, skills, and deep commitment to strong math opportunities for all Vermont students to the work of developing the grade level expectations that will help create solid math assessments.

Sue Biggam and Pat Halloran of the Vermont READS Institute (and therefore a part of VI) have provided the VT leadership in the review of the field documents in reading and in helping Measured Progress plan for and convene the reading committee. Lyn Haas is the coordinator of the all of VI assessment work, which includes the Vital Results, science, history and the social sciences, health, physical education and the arts [see the article titled “Developing Grade Level Expectations” for more information].

Measured Progress, an educational consulting firm in Dover, NH, brings us a number of new friends--adding the silver to the gold mentioned above. MP has assumed responsibility for the work in reading. Andrew McCarter is directing MP’s effort. His team includes Tim Crockett, the project manager, Dan Cheever, and Duane Small. These folks bring incredible breadth and depth of experience that will enrich the products that are the outcome. MP also has done a thorough job of analyzing a number of national and other state documents in relation to the Vermont Framework.

The three contractors are confident that with the incredible group of Vermont teachers that have agreed to work on the GLEs, they stand a very good chance of creating a foundation for assessments that will help guide curriculum and instruction in positive ways.

~ ~

questions/concerns corner--click this graphic for text version

ASSESSMENT NOTES
GLOSSARY TERMS

Balance of Representation:
Balance of Representation indicates the desired relative emphasis of standards within a Field of Knowledge or content area. The diagram indicates that the relative curriculum emphasis in each content strand will vary from kindergarten to grade 12.

The emphasis in Balance of Representation may be in terms of effort, time, scope, importance, or more quantitatively, numbers of standards, numbers of assessment items, weight of assessment items or scores, and so on. As a part of Vermont GLE development, a series of Balance of Representation studies will be conducted. The actual dimension(s) for which “emphasis” is represented must be made explicit in each Balance of Representation study. A BoR study may help align the quantities with the valued emphasis (if used to guide development), or it may be a means to adjust counts to reflect desired weights.

graph illustrating varying curriculum emphasis in each content strand

Principals and Standards for School Mathematics
(PSSM)
, NCTM, April 2000

Grade Level Expectation:

A GLE is a stated objective associated with a specific grade (e.g., Grade 3) that relates directly to a Vermont Standard, and in most cases specific evidences. A GLE differentiates performance on content knowledge or skills between adjacent grade levels, and as a set, leads to focused, coherent, and developmentally appropriate instruction without narrowing development, and will be further specified, where appropriate, for state assessment purposes.

January 2003

Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31

February 2003

Sun
Mon
Tue
Wed
Thu
Fri
Sat
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28

Important Dates

 

Balance of Representation
Committee Work
January 28 and 29

 

 

 

 

Grade Level Expectations
Committee Work
February 12

NCLBA REQUIREMENTS: STEP 1--DEVELOPING GRADE LEVEL EXPECTATIONS

Back to Top of Page

 

Text version of Questions/Concerns Corner

QUESTIONS/CONCERN CORNER

We will use this opportunity to discuss various questions or concerns that we have heard about this assessment work.

Are the Grade Level Expectations really going to be a state curriculum?

No. The GLEs will give more direction to local curriculum development than the VT Framework currently gives, but there still will be many decisions to be made at the local level (e.g. the topics and units, instructional strategies appropriate to grade, standard, topic). Also, some of the GLEs that we imagine will be developed will be more appropriately assessed at the classroom level, not at the state level.