Showing posts with label Educational intervention. Show all posts
Showing posts with label Educational intervention. Show all posts

Monday, February 15, 2016

A Brief Overview of Key Components in Galileo

Districts and charters across the country have identified Galileo K-12 Online as their clear choice for a high-quality, standards-based, and research supported instructional improvement system with integrated educator effectiveness capabilities. Galileo offers innovative solutions for curriculum development, management, and implementation monitoring combined with comprehensive assessment offerings and support of local educator effectiveness initiatives all in one cost-effective system. Following are just a few highlights of the Digital Curriculum Platform, the comprehensive assessment system, and the instructional effectiveness components found within Galileo K-12 Online.  

Fully-Integrated Digital Curriculum Platform Supporting
  • Integration of standards-based instruction, balanced assessment, and Dashboard reporting 
  • Incorporation of existing curriculum content, development of new content, and modification of curriculum content as needed
  • Access to several thousand instructional resources available from a variety of sources such as the KHAN ACADEMY®**
  • Through included technology, capability to: 
    • develop, disseminate, and manage curriculum 
    • facilitate data-driven differentiated instruction
    • engage students in multimodal interactive learning
    • evaluate curriculum impact on learning outcomes 

Comprehensive Assessment System Providing:
  • Valid and reliable pre-built and customized assessments aligned to Common-Core and local-state standards
  • Research-based measures of student achievement and growth (e.g., Item Response Theory derived Developmental Level scores) at the individual student, group, class, school, and district level
  • Extensive item banks consisting of over 150,000 items in math, English language arts, and science for grades kindergarten through high school, as well as over 10,000 items addressing non-state-tested subjects (e.g. music, foreign languages) developed as part of our Community Assessment and Item Banking (CAIB) initiative*
  • Online testing interface similar to statewide testing interfaces and supporting technology enhanced items
  • Comprehensive assessment options including:
    • Benchmarks
    • Formatives
    • Classroom checkpoint tests
    • Screening and placement tests
    • Interim and final-course examinations
    • Pretests and posttests
    • Technology enhanced early literacy and math assessment series
    • Computerized adaptive tests
    • Instructional effectiveness assessments
    • Customized tests aligned to District curriculum and pacing calendar

Complete Instructional Effectiveness System Providing 
  • Flexible and easy-to-use technology to develop and implement local instructional effectiveness initiatives
  • An individual instructional effectiveness score through Score Compiler technology which compiles and weights data from multiple sources (e.g., student performance data, educator proficiency ratings, surveys) to generate the score
  • Educator rating scales aligned to the Interstate Teacher Assessment and Support Consortium (InTASC) and Interstate School Leaders Licensure Consortium (ISSLC) 
  • Importation capability for other state, local, or with permission, third party rating scales for use in Galileo 
  • Evaluation data that can be used to inform professional development, enhance teaching and leadership skills, and elevate student performance.

Contact our Field Services Coordinators to learn what more Galileo has to offer.

*The repository of community items may vary from state to state.**KHAN ACADEMY® content is available for free at www.khanacademy.org.





Tuesday, June 8, 2010

Interim and End-of-Course Examinations in Standards-Based Education

Interim and end-of-course examinations are among the oldest and most common forms of assessment in education. For as long as they have been in use, interim and end-of-course examinations have been designed to hold students accountable for the mastery of course material. However, these examinations have also been used to guide instruction to promote further learning. With the advent of the education reform movement, the guidance function of course examinations is receiving increased attention. The education reform movement (e.g., Ravitch, 2001) has placed increased responsibility on educators to raise the level of student academic accomplishment. As part of the reform effort, the movement has promoted standards-based assessments including benchmark and formative assessments, which provide information to guide instruction. The contrasting purposes of accountability and guidance require special attention in light of the significant changes that have occurred in assessment practice and instruction promoted through the education reform movement. Historically, the accountability function served by course examinations has focused on identifying and separating able students from those less able. Since its inception, the educational reform movement has been concerned with identifying able teachers and effective educational practices that can raise the level of achievement for all students. In order to achieve the goals of the education reform movement, it is important to reconcile the contrasting purposes of accountability associated with course examinations and guidance associated with standards-based assessments. This post recounts the purposes of course examinations and details the ways in which these types of assessment can be adapted for use in standards-based education to enhance student learning.

Interim and End-of-Course Examinations

The purposes of interim and end-of-course assessments have been understood for a very long time. We revisit them here to differentiate course assessments from standards-based assessments. The discussion of differentiation provides a foundation for integrating the two forms of assessment to promote student learning.

Interim and end-of-course examinations are designed to assess knowledge and skills targeted in course instruction. Interim examinations assess knowledge and skills covered during part of a course. For example, an instructor may decide to administer a mid-term examination half way through a course. The mid-term examination will cover material addressed in the first half of the course. The end-of-course or final examination may cover material reflecting the entire course, or it may cover material presented since the previous interim examination.

Course Examinations and Accountability

Although course examinations have always played a role in guiding instruction, their role in accountability has also been extensive. Moreover, the importance of accountability increases as children progress through school. Interim and end-of-course assessments hold the student accountable for learning what has been taught. As students advance through the grades, teachers place increasing responsibility for learning on student shoulders. The teacher’s responsibility is to provide opportunities to learn the material presented. The student is responsible for learning the material. Interim and end-of-course examinations provide information on the extent to which students have effectively met their responsibility for learning.

As more and more responsibility for learning is assigned to the student, interim and end-of-course examinations increasingly become high stakes assessments. The consequences associated with different performance levels on these assessments significantly impact future instructional options that may be available to the student. Students who fail course examinations will likely fail the course and as a consequence not receive credit for taking the course. Failure may require that the student take the course a second time. In some cases, poor performance on course examinations precludes the opportunity to take certain advanced courses. Poor performance on course examinations may also limit options for higher education. Sometimes failure experiences lead students to conclude that continued pursuit of education is not worth the effort. One consequence associated with this conclusion is an unacceptably large high school dropout rate.

Standards-based educational practice offers an alternative to traditional practice related to course examinations. In standards-based education, high stakes assessment is typically limited to consequences associated with performance on a statewide test. The principal purpose of local standards-based assessments is to provide information that can be used to guide instruction. Data from benchmark and formative assessments are used to plan interventions to promote further learning. The student has the ultimate responsibility for learning. However, the teacher assumes greater responsibility than that typically required in the absence of a standards-based initiative. For example, if a benchmark assessment reveals that a student is at risk for not meeting standards on a statewide test, an intervention may be undertaken to bring the student on course to meet standards. This is in direct contrast to the situation associated with interim and end-of-course assessments, in which the responsibility of mastering material is primarily on the shoulders of the student, and the interim or end-of-course assessment simply indicates to the student whether or not he or she was successful in achieving that goal. The discussion that follows suggests changes in the use of course examinations that make it possible to employ these examinations within the context of standards-based initiatives designed to elevate student achievement.

Standards-Based Course Examinations

Typically interim and end-of-course examinations are informal examinations constructed at the classroom level for the purpose of assessing student proficiency related to material covered in the course and presented in the class. Additional benefits can be derived from these assessments to the extent that they can be linked to standards-based procedures designed to enhance learning.

Informal interim course examinations are like the short formative assessments used in standards-based education in that the psychometric properties of both forms of assessment are generally not examined. In both cases the number of students taking the assessments is generally too small to support statistical analyses necessary to establish the psychometric properties of the instruments. Another similarity is that both forms of assessment are generally constructed by classroom teachers. The fact that the assessments are teacher-constructed helps to ensure that the assessments reflect what has been taught. Major differences include the fact that course examinations are not required to be aligned with standards whereas formative assessments used in standards-based education are required to be aligned to standards. In addition, course examinations are not necessarily used extensively to guide instruction whereas the central purpose of formative assessments is to guide subsequent instructional planning.
In order to apply informal course examinations in standards-based education, it would be necessary to ensure that the assessments were used not only to document what had been learned, but also to inform instructional decisions designed to elevate learning. To make this happen, the items in the examinations would have to be aligned to standards. In addition, instruction would have to be planned based on assessment results. Typically an upcoming course examination is preceded by instruction including a review of material previously presented. This instruction-assessment sequence is consistent with standards-based educational practice. However, in standards-based education, it is also important to ensure that assessment results are used to guide future instruction. Inclusion of this component of the assessment-instruction sequence increases the potential contribution of course examinations to student learning.

In some cases, interim and end-of-course examinations are administered to large numbers of students enrolled in multiple sections of the same course. These examinations are often taken by sufficient numbers of students to support psychometric analyses examining reliability and validity. Interim and end-of-course examinations that are subjected to psychometric analyses are like benchmark assessments used in standards-based education. Benchmarks are designed to provide reliable and valid assessments aligned to standards reflecting the district curriculum. Benchmarks indicate the extent to which standards targeted for instruction at successive time periods have been mastered. They also are used to forecast performance on upcoming statewide assessments. Interim and end-of-course examinations can function as benchmarks if the items included in the examination are aligned to standards and if reliability and validity are established. For example, if an interimor end-of-course assessment is to be used to forecast performance on a statewide assessment, then the assessment must be long enough to achieve acceptable reliability levels, and its validity, or effectiveness in forecasting statewide assessment performance, must be established.

Conclusion

Interim and end-of-course examinations support long-held views regarding the responsibilities of teachers and students related to learning. The responsibility of the teacher is to provide opportunities for students to learn. The responsibility of students is to take advantage of those opportunities in ways that will enable them to achieve their full potential. These views have made a significant contribution to the foundations of American education, and they remain critical components of our educational system. Yet, rapid advances in technology, the explosion of knowledge in the information age, and the advent of the global economy have called for new approaches to education that will lead to elevated achievement necessary to maintain a competitive edge in the new world that confronts us. The challenge of today is not merely to judge the achievements of students who have been given learning opportunities. It is to elevate the achievement of all students.

Standards-based education has clarified the nature of this challenge and the possible approaches that can be taken to meet the challenge. It has provided standards representing valued educational accomplishments. It has produced evolving assessment technology to measure the attainment of standards. It has introduced the power of measurement technology into local assessment programs, and it has made it clear that the national goal of elevating student achievement is attainable. The task ahead related to interim and end-of-course assessments is to link assessment to measure student achievement with assessment to guide instruction in ways that will raise achievement to new levels. This post has described some of the ways in which linking might occur.

Tuesday, January 12, 2010

Elevating Student Achievement Seminar - Submit a Question

ATI is hosting the Elevating Student Achievement Seminar: Exploring What Works on February 3 at the Hyatt Tech Center in Denver. If you’re interested in registering, please visit the seminar website for specific details about the event.

The seminar will be a dialog on instructional interventions and the elevation of student achievement. If you know of any others in your district interested in registering, please feel free to pass the following link on to them - www.ati-online.com/WhatWorks

We’re also encouraging those interested in submitting a question pre-event for seminar panel discussions on the following topics:
  • The benefits of and challenges encountered when implementing an instructional improvement initiative.
  • The benefits of and challenges encountered when managing an instructional improvement initiative.
E-mail your questions to GalileoInfo@ati-online.com and they will be considered for inclusion at the seminar. Questions related to the seminar that we are unable to address at the event will be answered here on the Town Hall Blog.

We look forward to hearing your questions!

Tuesday, February 17, 2009

Focus on Enrichment: What I Learned at the Educational Interventions Forum

The forum was a great success. We ended up having some wonderful conversations with the participants about the kinds of things that are needed for effective intervention efforts.

I wanted to write about one point that was particularly salient for me. During one of the question and answer sessions following one of the papers I presented, a participant asked what the ATI Instructional Dialogs could do for enrichment. I confessed that I tend to focus on identifying students who are in need of extra help and that I tend to forget the enrichment end of the spectrum, even though I know better. After all, Jack (Bergan) is fond of saying that if education in the United States is to improve, we can’t just focus on bringing lower performing students up to acceptable levels of performance. Rather, intervention has to be the “tide that raises all boats,” meaning that we must improve education for the high-performing students as well. State standards should be viewed as minimum requirements. Students should be given the opportunity to exceed these levels to the greatest extent possible.

In response to the participant’s question, I pointed out that the Instructional Dialogs are designed so that they can be used as independent assignments, and that students who have demonstrated proficiency in the regular curriculum can be assigned further dialogs in other topics as well. Jonathan Frank from WestEd expressed gentle disagreement with my response during his presentation. His point was that it’s not good enough to just give students who have mastered the required material “something else to do.” They must be given greater challenges. I whole-heartedly agree. That is why we include recommendations for enrichment on the Intervention Planning Report. These recommendations indicate what the student should learn next to promote learning beyond meeting the standard.

During our breakout session, participants from Pueblo City Schools discussed the success that they’ve been having with enrichment. I think enrichment is a great topic for further discussion on this blog. What kinds of enrichment programs have been successful? What are the challenges associated with enrichment? What additional data or technology would assist in providing effective enrichment programs?

We look forward to everyone’s ideas about how to improve education for higher-performing students.