In a recent hotel stay, my room included free wireless Internet access – a common amenity. After connecting to the hotel’s Wi-Fi network I noticed the setup instructions on the desk placard, listing the URL of a support website. The ‘simple’ instructions did not include a tech support phone number – just the URL. Interesting contradiction, I thought… “how does one request assistance connecting to free Wi-Fi when the only way to request assistance requires connecting to the Wi-Fi?”
Rest assured, your participation in the Galileo K-12 Online and Instructional Dialogs trial offer will not put you in this awkward position. As part of the trial, ATI provides the same level of support we provide to all Galileo clients. ATI support offerings include extensive Galileo online help files, website form submission for general and tech-related questions, email support via support@ati-online.com, and telephone help available at (800) 367-4762 x130.
Support is available for computer and browser-related issues encountered within Galileo K-12 Online, supported eInstruction and Promethean response pad setup and use, and general Galileo K-12 Online and instructional Dialog use.
Thursday, April 30, 2009
Monday, April 20, 2009
Using the Trial Offer to the Fullest
Those who attended the February Educational Interventions Forum hosted by Assessment Technology, Incorporated received an offer to participate in a trial of Instructional Dialogs in Galileo Online that were specifically built for forum participants. Assessment Technology's Instructional Dialogs are interactive, technology-based instructional content, , which involves educators in developing and sharing proven educational strategies through lessons designed to increase student mastery of state and local academic standards.
The Instructional Dialogs created for the Educational Interventions Forum were assembled into customized sets for each of the states involved in the forum. The intent was to offer participants a quick, easy to use set of interventions that would allow for a quick review or a new approach to introduce standards that were likely to appear on the end of year state test. Now as state testing is wrapping up in some states and soon to begin in others there is still an opportunity to use the Instructional Dialogs. The combination of instructional content and immediate feedback provided by the optional test attached to the dialog will allow you to evaluate areas that may still be essential to the completion of the courses the students are finishing this semester.
Accessing the available Instructional Dialogs from the trial offer will allow a quick and simple learning experience focused on one of these important standards. The use of the trial dialogs will also allow teachers to familiarize themselves with the types of activities that are available through the Galileo Instructional Dialogs banks. Districts who already subscribe to Galileo for their educational management and assessment needs will be able to sample these Instructional Dialogs and then move to working with the more than 800 dialogs written for math and English. For districts considering Galileo, the dialogs will provide an indication of the types of instructional content that Assessment Technology is committed to providing through our continuous expansion of the Instructional Dialogs.
To access the trial dialogs, please contact the Field Services department at Assessment Technology, Inc. (520) 323-9033 or 1-800-367-4762.
The Instructional Dialogs created for the Educational Interventions Forum were assembled into customized sets for each of the states involved in the forum. The intent was to offer participants a quick, easy to use set of interventions that would allow for a quick review or a new approach to introduce standards that were likely to appear on the end of year state test. Now as state testing is wrapping up in some states and soon to begin in others there is still an opportunity to use the Instructional Dialogs. The combination of instructional content and immediate feedback provided by the optional test attached to the dialog will allow you to evaluate areas that may still be essential to the completion of the courses the students are finishing this semester.
Accessing the available Instructional Dialogs from the trial offer will allow a quick and simple learning experience focused on one of these important standards. The use of the trial dialogs will also allow teachers to familiarize themselves with the types of activities that are available through the Galileo Instructional Dialogs banks. Districts who already subscribe to Galileo for their educational management and assessment needs will be able to sample these Instructional Dialogs and then move to working with the more than 800 dialogs written for math and English. For districts considering Galileo, the dialogs will provide an indication of the types of instructional content that Assessment Technology is committed to providing through our continuous expansion of the Instructional Dialogs.
To access the trial dialogs, please contact the Field Services department at Assessment Technology, Inc. (520) 323-9033 or 1-800-367-4762.
Thursday, April 2, 2009
Forecasting Risk and Making Predictions about AMOs
If you’re a user of Galileo K-12 Online, or an avid reader of this Blog, you’ll know that one of the primary services Galileo provides is forecasting student risk of not meeting state standards based on their performance on benchmark assessments. The information is designed to help identify students in need of intervention, but it is tempting to use it to get a preview of where the district or school stands with regard to AMOs. The data can be used for this purpose, but I wanted to highlight some points to consider when doing so.
The Aggregate Multitest report can be run in two modes and the choice is made by selecting either the Display risk levels or the Display benchmark performance levels radio button. When the Aggregate Multitest report is run with the benchmark performance levels option, it generates an independent analysis of student performance for each of the selected assessments. Based on their performance on each benchmark assessment, students are categorized into the same classification system that the statewide assessment uses, such as the FAME scale in Arizona or the Advanced, Proficient, Needs Improvement, or Warning categories in Massachusetts. What you’ll see below the bar graph is a display that shows the percent of students in each category, such as this:
The Aggregate Multitest report can be run in two modes and the choice is made by selecting either the Display risk levels or the Display benchmark performance levels radio button. When the Aggregate Multitest report is run with the benchmark performance levels option, it generates an independent analysis of student performance for each of the selected assessments. Based on their performance on each benchmark assessment, students are categorized into the same classification system that the statewide assessment uses, such as the FAME scale in Arizona or the Advanced, Proficient, Needs Improvement, or Warning categories in Massachusetts. What you’ll see below the bar graph is a display that shows the percent of students in each category, such as this:
It is easy to see how this data would tempt a person to try to project where the schools in the district are likely to stand relative to the AMOs at the end of the year. Let’s say that in this example, the AMO for 4th grade math is that 66% of the students must be classified as either Meets or Exceeds on the statewide assessment. Adding these categories together for benchmark #1 indicates that 61.71% fall into these categories. That’s not quite enough. On benchmark #2 the number rises to 65.66%, which is close, and then finally with benchmark #3 the figure of 72.80% surpasses the AMO.
That’s good news, right? Well, maybe. Probably. Our research has indicted that Galileo benchmark assessments are very good at forecasting likely student performance on statewide assessment. But our research also indicates that considering student performance on multiple benchmark assessments yields even more accurate forecasts of student performance on statewide assessments than considering student performance on individual benchmark assessments in isolation. This is true even when the one, isolated benchmark assessment is the one that is administered most recently when statewide testing begins, as would be the case with benchmark #3 in this example. Details of these investigations can be found in the Galileo K-12 Online Technical Manual.
In order to capture the increased accuracy of data from multiple benchmark assessments, the Galileo K-12 Online Risk Assessment report was developed. The Risk Assessment report is accessed via the second mode for generating the Aggregate Multitest report, by selecting the radio button that says display risk levels. The Risk Assessment report provides the same information Kerridan referred to in her recent post (How Can Galileo Assist in Interventions?), except that the data can be aggregated at the school or district level as well as the classroom level, and it yields a display that looks like this:
That’s good news, right? Well, maybe. Probably. Our research has indicted that Galileo benchmark assessments are very good at forecasting likely student performance on statewide assessment. But our research also indicates that considering student performance on multiple benchmark assessments yields even more accurate forecasts of student performance on statewide assessments than considering student performance on individual benchmark assessments in isolation. This is true even when the one, isolated benchmark assessment is the one that is administered most recently when statewide testing begins, as would be the case with benchmark #3 in this example. Details of these investigations can be found in the Galileo K-12 Online Technical Manual.
In order to capture the increased accuracy of data from multiple benchmark assessments, the Galileo K-12 Online Risk Assessment report was developed. The Risk Assessment report is accessed via the second mode for generating the Aggregate Multitest report, by selecting the radio button that says display risk levels. The Risk Assessment report provides the same information Kerridan referred to in her recent post (How Can Galileo Assist in Interventions?), except that the data can be aggregated at the school or district level as well as the classroom level, and it yields a display that looks like this:
Students are classified into the different levels of risk according to their performance on a series of benchmark assessments. This example refers to the same three 4th grade math assessments that were considered earlier. Students are classified as being “On Course” if they scored above the cut score for “meets” (or “proficient” in many other states) on all three benchmark assessments. If they fell below that cut score for one assessment, they are classified as being at “Low Risk”. If they fell below on two of the three assessments, they are at “Moderate Risk”, and students who never scored above the critical cut score are classified as being at “High Risk”. Kerridan’s blog illustrates how to use this information to plan interventions.
This method of projecting student risk of not meeting the standard on the statewide assessment has proven to be very accurate. On average, 96% of students who are classified as being “On Course” after three benchmark assessments go on to demonstrate mastery on the statewide assessment (see the Technical Manual). This is the most accurate approach to projecting student risk for the purposes of identifying students for intervention efforts. It is also the most accurate information a district could have when assessing risk with regard to AMOs. However, because its primary function is to identify groups of students for intervention efforts, its format may not be the most convenient for looking toward AMOs. In this case, only 52% of the students are on course, which is well below the AMO of 66%. But a district can count on a number of students from each of the other risk categories to pass the statewide assessment as well. We have conducted a preliminary investigation, based on 7 large school districts, to see how many students in each risk level category tend to go on to demonstrate mastery on the statewide assessment. The results are presented in the following table.
Subscribe to:
Posts (Atom)