|
Implementation Strategy
Following an initial approach that addressed learning assessment in the context of five program areas, the College in early 2003 redefined its focus based on practical considerations and a clear emphasis on the general education core. Practically speaking, assessment at the program and course level was both externally mandated and internally-driven, so these two areas are obvious choices for focus. The importance of the general education core skills in the academic and personal growth of our students also made this an obvious choice for focus. It should be noted that any distinction between course, program, and general education assessment becomes blurred when one considers how they often interconnect with one another: for example, when course level assessments serve as quality performance indicators in program assessment, when course-level assessment leads to program changes, or when general education rubrics are applied to course writing assignments either as embedded assignments or in operational studies assessments. Nonetheless, the distinctions allowed Lewis and Clark to organize its resources around fairly definable and logical areas of focus.
General Education Assessment
General education describes the curriculum core courses that are required for transfer degrees and elements of career programs. For transfer students who are here to complete their IAI (Illinois Articulation Initiative) core curriculum, assessment of general education takes on added significance. General education is singular as a cross-curricular program in that it is an element of every degree program offered by Lewis and Clark. In 2003, the Lewis and Clark faculty revised the ten general education outcomes that had been defined in 1995 to provide more measurable characteristics that reflect the skills emphasized in the general education core. Individual faculty representing each of the outcome areas were appointed to one of the College’s assessment committees and tasked with leading the development of general education assessment methods for their assigned outcome areas. These individuals, called “general education outcome leads,” also served as coordinators with the program and course level committees for the outcome areas.
Course Level Assessment
Course level assessment addresses learning assessment from the perspective of individual courses and sections. In the original organizational framework, a separate subcommittee representing course level assessment was assigned. This group represented a mix of transfer and career program courses, and was tasked with leading the effort to collaborate with individual faculty in the development of effective practices for assessment at the course level, as well as serving as the coordination point for course level assessment with the other subcommittees. The course syllabus serves as the unifying standard for course objectives (across sections and instructors) and other key curricular elements. It also includes a section on evaluation that communicates to both transfer institutions and students the performance criteria that will be factored into course grades. In 2003-2004, all course syllabi were reviewed, converted to electronic format, and posted on the College’s website for anyone to view. Faculty complete course outlines using a Lotus Notes web-based data entry tool that automatically transfers data from key syllabus fields to the outline form. The faculty member can then tailor the form to include all of the essential information, including assessment methods and rubrics which are either embedded into the form or included as an attachment. The form asks instructors to include “course assessment materials such as course assessment plans, rubrics, sample tests, study guides, case studies, examples of student work, and other assessment materials.” Course outlines can also be accessed and viewed by students, or anyone else, via the College website. In 2004 the College implemented a standard format for faculty performance objectives and reporting of accomplishments (including course, program, and general education assessment activities).
Program Assessment
While the College was already conducting periodic (a five year cycle for each program) program reviews in compliance with ICCB requirements, the HLC accreditation team in early 2003 recommended that Lewis and Clark place more emphasis on program assessment. In September 2003, the program assessment subcommittee, working with academic affairs and institutional research, developed a model for the continuing assessment of career and transfer programs. The operating assumption was that “program assessment” would provide a more comprehensive and ongoing monitoring of performance than was the case with program review. Working from the program review model, the new assessment strategy addressed standards for quality, need, and cost-effectiveness, with the greatest emphasis on quality. A “data matrix” and set of data definitions were developed as assessment planning aids that program coordinators could tailor and adapt to their particular needs. The committee also developed an “executive summary” report template. This provides a standard synopsis-like format that helps program coordinators condense what were often lengthy and complex details down to the essentials. Program level assessment was then implemented in pilot stages that engaged only those program coordinators whose ICCB program reviews happened to be due that year. Program coordinators were encouraged to identify overlaps and possible redundancies that might occur between internal assessments and reporting required by the ICCB or groups that oversee accreditation, licensure, and certification. Over the course of three years beginning in fall 2003, fifteen program coordinators and faculty have completed program level assessment.
Assessment Goals (2007-2012)
The years 2000 to 2006 marked the formative development of assessment policies and practices that have achieved sustainability and in the process engaged one hundred percent of our faculty in assessment. Certainly challenges remain, but it would be remiss on our part not to acknowledge and perhaps even celebrate what we have accomplished. Looking to the future, we plan in the next six years (2007-2012) to consolidate our gains and advance to the next level of sustainability, a level that includes a higher degree of scholarship and expertise, further refinement of effective practices, and most importantly, many examples of measurable improvements in student learning.
As we look forward, our emphasis from a process standpoint will be on a number of things: maintaining the sustainability we have achieved, strengthening our effective practices, expanding the integration of assessment into other areas of the College, and implementation of a web-based assessment repository. In the process, we plan to implement more standardized reporting and formatting of assessment documents. We also plan to capitalize on the capabilities of our new student system (Datatel), primarily as a repository for assessment data that others can access, but also to perform queries, run custom reports, and extract cohort samples. From a results standpoint, the chief measure of success will be the number of documented improvements in learning obtained from learning assessment. To draw from the AAHE’s principle #8, we believe that we have in fact implemented the “conditions that promote change” and are confident that these conditions will lead to improvements in learning.
HLC Assessment Monitoring Report: September 2006
L&C in September 2006 completed an assessment monitoring report in response to a Higher Learning Commission requirement following the College’s ten-year reaccreditation in 2003. Completing this report was an especially worthwhile endeavor, not only because it was mandated, but more importantly because it compelled us to take a hard and thoughtful look at our goals for assessment, our accomplishments to date, and our goals for the future. This document has become an important primer for new faculty and a reference point for future growth and development of assessment. The following link will take you to an Adobe *.pdf version of this document that provides a much more detailed review of L&C’s assessment history between 2000 and 2006.
|