ECO Agenda and Materials
Related Links
Measuring Child and Family Outcomes
Friday, July 30, 2010
7:30 – 4:00 (Regency Foyer)
Registration
8:00 – 9:15 (Regency Foyer)
Breakfast
9:00 – 10:30 (Regency Ballroom AB)
Welcome and Overview to the Conference (S2-000)
Available via iLinc
Presenters:
Kathy Hebbeler, ECO Center at SRI International
Lynne Kahn, ECO Center and NECTAC at FPG/UNC
Julia Martin-Eile, OSEP
Rebecca Walawender, Deputy Director--Monitoring and State Improvement Planning Division (MSIP), OSEP
Opening Plenary
Dr. Jones will greet the meeting participants and provide an update on the shared U.S. Health and Human Services (HHS) and U.S. Department of Education (ED) vision for collaborative and integrated Early Childhood Systems, particularly around the areas of assessment and data systems.
Presenters:
Jacqueline Jones, Senior Advisor to the Secretary for Early Learning
Handouts:
Jones PowerPoint
iLinc Audio Recording: https://tadnet.ilinc.com/join/brwyhxb
10:30 – 11:00
Break
11:00 – 12:15
Concurrent Sessions
- Jefferson Room
Early Childhood Data Collaborative: An Update on Activities (S2-001)
The Early Childhood Data Collaborative (ECDC) is a consortium of national organizations convened to build State policymakers’ understanding and support of aligned early childhood data systems to improve child outcomes and system performance. This session will provide an update on the most current activities of the Collaborative.
Presenters:
Kathy Hebbeler, ECO Center at SRI International, CA
Thomas Schultz, Council of Chief State School Officers, DC
Handout:
Schultz PowerPoint
- Lincoln Room
Looking for Patterns in Child Outcomes Data: An Introductory Workshop on How to Examine Data for Red Flags (S2– 002)
The introductory workshop will give examples of different formats for looking at data, and participants will discuss what patterns would be expected in high quality data. A representative from New York will describe her State’s experiences with analyzing patterns in their child outcomes data as a step in quality assurance and share examples from their findings. Participants will work with sample data in small groups to look for patterns, identify red flags, and determine whether additional analysis or quality assurance activities might be appropriate.
Presenters:
Lauren Barton, ECO Center at SRI International, CA
Donna Noyes, Part C Program, NY
Cornelia Taylor, ECO Center at SRI International, CA
Handouts:
PowerPoint
Noyes PowerPoint
(The handouts listed below will be available at the session.)
Checking Outcome Data for Quality: Looking for Patterns
Introduction to Pattern Checking Workshop
Questions to Answer for Additional Pattern Checking
- Regency Ballroom AB
Part C and 619 – Working Together on Child Outcomes (S2 – 003)
Available via iLinc Presenters from Delaware and Michigan will share experiences, challenges, and benefits from their State Part C and Section 619 collaboration on various child outcomes activities. The session will include opportunities for discussion of experiences related to data sharing, collaborative data interpretation, joint professional development, and other related strategies.
Presenters:
Noel Cole, Section 619 Program, MI
Rosanne Griff-Cabelli, Part C Program, DE
Lynne Kahn, ECO Center at FPG/UNC
Jim Lesko, Section 619 Program, DE
Lisa Wasacz, Part C Program, MI
Handouts:
Cole and Wasacz PowerPoint
Lesko and Griff-Cabelli PowerPoint
Palley Letter
iLinc Audio Recording: https://tadnet.ilinc.com/join/hzstcmv
- Roosevelt Room
Local Assessment Practices: Challenges and Decisions (S2-004)
Good child outcomes data depend on good assessment practices. What tools and methods should local programs use to provide quality assessment and outcomes data? Join in a discussion of the guidance States can provide to improve local assessment practices. Two States will share the challenges and decisions they are addressing in their Part C and 619 programs.
Presenters:
Marcella Franczkowski, Part C Program, MD
Phyllis Mondak, Section 619 Program, VA
Sharon Ringwalt, NECTAC and RRCP, NC
Thomas Stengel, Part C Program, MD
Handouts:
Local Assessment Practices PowerPoint
Assessment Analysis Matrix
Assessment Tool Summary Template
Franczkowski PowerPoint
Maryland's Vision: Assessment
- Arlington Room
Levels of Representativeness: How to Examine and Use Family Survey Data to Plan for Program Improvement (S2-005)
Participants will be provided an opportunity to examine sample data and discuss different aspects of the issue of representativeness. These include: 1) response rates – did everyone who was supposed to respond to the survey actually respond? 2) proportional representation – how close do the response rate percentages match the comparison data for different variables of interest? 3) within subgroups, are respondents “representative” of their group? ; and 4) how do we use this information to target program improvement issues?
Presenters:
Siobhan Colgan, ECO Center and NECTAC at FPG/UNC
Batya Elbaum, DAC, FL
Melissa Raspa, ECO Center at RTI, NC
Handouts:
PowerPoint
- Fairfax Room
Using Data for Program Improvement (S2-006)
In this session, presenters will discuss the use of outcomes data to drive State and local program improvement. Participants will review and analyze sample State data to develop a better understanding of State and local issues and determine what types of improvement activities a State might implement, including changing policies and guidance, and providing targeted training and TA.
Presenters:
Ann Bailey, RRCP, MN
Christina Kasprzak, NECTAC and ECO at FPG/UNC
Handouts:
Using Data for Program Improvement PowerPoint
(The handouts listed below will be available at the session.)
Timely Services Data
Child Outcomes Data
Using Family Outcomes Data
Early Childhood Transition Data
12:15 – 1:45
Lunch on your own
1:45 – 3:00
Regency Ballroom AB
Plenary: The ECO Outcomes Measurement System Framework and its Application in States (S2-007)
Available via iLinc
This plenary will highlight an outcomes measurement system framework developed by ECO in collaboration with seven partner States. The framework includes a scale designed to be used by State agencies to assess progress toward full implementation of a Child Outcomes Measurement System (COMS) for programs serving young children with delays and disabilities. Delaware and Maine will share their experiences implementing this measurement framework within their child outcomes system and the lessons learned therein.
Presenters:
Janna Gregory, Part C and Section 619 Programs, ME
Kathy Hebbeler, ECO Center at SRI International, CA
Jim Lesko, Section 619 Program, DE
Handouts:
PowerPoint
ECO Outcomes Measurement System Framework
iLinc Audio Recording: https://tadnet.ilinc.com/join/yszjfff
3:00 – 3:30
Break
3:30 – 5:00
Concurrent Sessions
- Jefferson Room
Follow-up from Plenary: The ECO Outcomes Measurement System Framework and its Application in States (S2-008)
This session will be a follow-up from the plenary on the ECO Outcomes measurement system framework and its application in States. Participants will discuss and provide feedback on the framework and the self assessment tool, and how States might implement this framework within their own systems.
Presenter:
Kathy Hebbeler, ECO Center at SRI International, CA
- Lincoln Room
New Training Activities and Resources for Child Outcomes Summary Form (COSF) Users (S2-009)
New activities and resources target reliable and valid ratings through written child examples, tools for gathering, understanding, and ‘age anchoring’ children’s functional skills, as well as different ways to conceptualize, describe, and document each of the ratings on the seven-point scale. Participate in a demonstration of these tools, tell us about any new COSF resources your program is using, and help identify next steps for professional development in the use of the COSF.
Presenters:
Norman Allard, Section 619 Program, NC
Robin Rooney, NECTAC and ECO Center at FPG/UNC
Naomi Younggren, Part C Program, Department of Defense
Handouts:
Younggren Skills-Behaviors Exercise
Younggren Skills-Behaviors Exercise Answer Key
Younggren COSF Scale Descriptors
Younggren Matching COSF Ratings
Younggren Matching COSF Ratings with Answer Key
Younggren MEISR COSF Tool
Younggren Rating Activity
Younggren Organizing Framework
COSF Documentation Guidance
New COSF Training Session PowerPoint
(The handouts listed below will be available at the session.)
Allard NC Outcomes Brochure
COSF Documentation Key
Sample Items Worksheet for Session
Development Milestones Ages 2-4
Kim Documentation Activity
- Roosevelt Room
Communicating Effectively with the Media and Public about Child Outcomes Data (S2-010)
In this session, strategies and approaches for crafting messages about the child outcomes reporting and the child outcomes summary statements will be presented and discussed. Hands-on activities will allow participants to (a) anticipate questions they may receive and (b) prepare a media release about the child outcomes data and what the data tell us about the EI and ECSE programs serving infants, toddlers, and preschoolers with disabilities.
Presenters:
Donna Spiker, ECO Center at SRI International, CA
Sharon Walsh, DAC and Walsh Taylor Incorporated, VA
Handouts:
Messaging Activity Sheets
Spiker and Walsh PowerPoint
- Arlington Room
Getting Closer to Right: Strategies for Ensuring Valid and Reliable Results from Standardized Assessment (S2-011)
This round table session will focus on quality assurance related to the collection of data from standardized assessments focusing on the Battelle Developmental Inventory-2. Methods for examining and ensuring the reliability of administration, scoring, and data processing will be discussed.
Presenters:
BDI Outcomes User Group
- Regency Ballroom AB
Promoting Family Outcomes in Early Intervention (S2-012)
Available via iLinc This session will discuss ways to improve family outcomes in early intervention through the use of family-centered practices. Presenters will provide an overview of the ways family-centered practices affect family outcomes, discuss ways to incorporate family-centered practices into different points of a family's journey through early intervention (e.g., referral, assessment, IFSP planning), and provide examples of types of technical assistance and training activities, both system- and practitioner-level, that can lead to better outcomes for families.
Presenters:
Don Bailey, ECO Center at RTI, NC
Chase Bolds, Part C Program, GA
Melissa Raspa, ECO Center at RTI, NC
Dathan Rush, Family, Infant and Preschool Program, NC
M'Lisa Shelden, Family, Infant and Preschool Program, NC
Handouts:
Rush and Shelden PowerPoint
Bolds PowerPoint
Bailey and Raspa PowerPoint
iLinc Audio Recording: https://tadnet.ilinc.com/join/brwyfyz
- Fairfax Room
Using COSF Implementation Surveys to Identify Improvement Activities (S2-013)
Surveys of providers and administrators can help States identify issues that may influence data quality and plan technical assistance and training activities. Examples from Minnesota and Ohio will be presented, including content and methodology of their surveys, key findings, and how they utilized results to develop improvement activities.
Presenters:
Lisa Backer, Section 619 Program, MN
Kim Carlson, Section 619 Program, OH
Handouts:
Backer and Carlson PowerPoint Presentation
6:00 – 7:30 (Virginia Room)
Reception
Come network with colleagues! Participants are invited to share refreshments, information and resources related to their outcomes measurement systems. Display tables will be available for individuals to set up posters and materials.
Saturday, July 31, 2010
7:30 – 4:00 (Regency Foyer)
Registration
8:00 – 9:15 (Regency Foyer)
Breakfast
7:45 – 8:45
Roosevelt Room
Early Bird: Revised ECO Family Outcome Survey (S2-014)
ECO staff will facilitate a discussion of recent updates to the ECO family survey and State sharing about the use of the survey.
Presenters:
Don Bailey, ECO Center at RTI, NC
Melissa Raspa, ECO Center at RTI, NC
Handouts:
Family Outcomes Community of Practice Flyer
Link to: The Family Outcomes Survey-Revised (FOS-R)
9:00 – 10:30
Regency Ballroom AB
Morning Plenary: Integrating Outcomes Measurement with IFSP and IEP Processes (S2-015)
Available via iLinc
States and local programs are making child and family outcomes measurement more efficient and more effective by integrating those processes with IFSP and IEP development and implementation. Presenters will share a generic flow chart of integrated process and describe variations as implemented at State and local levels.
Presenters:
Joicey Hurth, NECTAC, NC
Donna Nylander, Valley View Early Childhood Center, Section 619 Program, IL
Robin Rooney, NECTAC and ECO Center at FPG/UNC
Regina (Mel) Woodcock, Part C Program, WV
Naomi Younggren, Part C Program, Department of Defense
Handouts:
COSF Scale Descriptors
Younggren Organizing Framework
Nylander PowerPoint
Younggren PowerPoint
Woodcock PowerPoint
Rooney and Hurth PowerPoint
(The handouts listed below will be available at the session.)
IEP Outcomes Flow Chart
IFSP Outcomes Flow Chart
Nylander Flow Chart
Younggren Outcomes Flow Chart
Woodcock Flow Chart
iLinc Audio Recording: https://tadnet.ilinc.com/join/swrvxtv
10:30 – 11:00
Break
11:00 – 12:30
Concurrent Sessions
- Regency Ballroom AB
Plenary Follow-Up: Integrating Outcomes Measurement with IFSP and IEP Processes (S2-016)
Available via iLinc A follow-up to the plenary on this topic, this session will feature tools and resources that can help people integrate IFSP and IEP processes with the measurement of child and family outcomes. Hear about the groundbreaking work of local programs and the strategies they are using to sustain the integration of IFSP/IEP and outcomes measurement processes. Presenters will also share activities for introducing and adopting an integrated approach.
Presenters:
Sandi Harrington, Norfolk Infant Development Program, Part C Program, VA
Anne Lucas, NECTAC and RRCP, VA
Donna Nylander, Valley View Early Childhood Center, Section 619 Program, IL
Karen Walker, Part C Program, WA
Handouts:
Nylander Initial Assessment ECO Form
Nylander Annual Report ECO Worksheet
Nylander PowerPoint
Harrington PowerPoint
Walker, Hurth and Lucas PowerPoint
Integrating Outcomes PowerPoint
Individualized Family Service Plan
Child Progress Determination Questions
Suggested Language for Talking with Parents about Child Indicator Ratings
Link to: Online Training Resource
(The handouts listed below will be available at the session.)
Summary Worksheet for IFSP Practices
IFSP Practices
IEP Summary Worksheet
Integrating Outcomes IEP Rating
iLinc Audio Recording: https://tadnet.ilinc.com/join/xyyrpzv
- Jefferson Room
New Professional Development Resource on Child Development (S2-017)
Need a resource to give personnel a solid foundation in child development? A resource to guide expectations for children’s functioning at various ages? Mary Beth Bruder will share newly available modules on child development, which will be especially useful for those providing data on child outcomes.
Presenter:
Mary Beth Bruder, ECO at University of Connecticut
- Roosevelt Room
Discussion on Interpreting Current Data on Children’s Social Relationships (S2-019)
Are young children functioning relatively well in the area of social relationships? Or do we need better understanding and new methods of assessing young children’s social development? Lise Fox, from the TA Center on Social Emotional Interventions for Young Children (TACSEI) will lead a provocative discussion of these and related issues.
Presenter:
Lise Fox, TACSEI, NC
- Arlington Room
Having and Using Quality Outcomes Data (S2-020)
Two States will provide information focused on promoting consistent quality outcome data and the use of outcomes data in the monitoring process. North Dakota Section 619 will share the State’s COSF Quality Assurance Checklist and other outcome resources that have been provided to ND special education units. The Connecticut Part C program will share their Results Based Accountability that includes the child and family outcomes data as selection criteria for focused monitoring.
Presenters:
Linda Goodman, Part C Program, CT
Nancy Skorheim, Section 619 Program, ND
Handouts:
Goodman PowerPoint
Skorheim PowerPoint
Goodman CT Report Card
Skorheim ND COSF Review Checklist
Skorheim ND COSF Checklist Directions
Link to: ND Early Childhood Outcomes Process Age Expectation Milestones
- Fairfax Room
Data Analysis for Program Improvement (S2-021)
This session will address data analysis for program improvement and include opportunities for hands-on data analysis by participants. Data templates will be provided for States using the COSF as well as for States using other assessments for outcomes reporting.
Presenters:
Kathy Hebbeler, ECO Center at SRI International, CA
Cornelia Taylor, ECO Center at SRI International, CA
Handouts:
Hebbeler and Taylor PowerPoint: Part 1
Data Analysis for Program Improvement Handout
2:00 – 3:15
Concurrent Sessions
- Regency Ballroom AB
Reporting Local Child Outcomes Data to the Public (S2-022)
Available via iLinc Beginning 2011, States are required to report local child outcomes data to the public for the first time. How is this reporting requirement the same or different for child outcomes as compared with other SPP indicators? What are implications for local programs and families? Presenters will discuss issues and strategies for sharing data in a meaningful way with local programs, families, and the broader community.
Presenters:
Ardith Ferguson, Part C Program, CO
Joy Markowitz, DAC, MD
Judy Swett, PACER Center, MN
Maureen Whelan, Part C Program, RI
Handouts:
PowerPoint
Link to: Early Intervention Colorado Documents
iLinc Audio Recording: https://tadnet.ilinc.com/join/vbtfcbc
- Jefferson Room
Strategies for Maintaining Data Quality Using Commercial Assessment Systems (S2-023)
Many States use online assessment systems to collect, review, and analyze their child outcomes data. In this session, Nebraska and Colorado will describe methods of monitoring data quality through automatically generated reports and raw data available through the assessment systems. Both States will review how these strategies can be used at each level in the hierarchy (child, teacher, program, State), whether through random spot checks or more targeted, individualized checks.
Presenters:
Barb Jackson, University of NE Medical Center Munroe-Meyer Institute
Nick Ortiz, CO Department of Education
Jan Thelen, 619 Program, NE
Handouts:
Observation Notes Report (A)
Work Sampling Report (B)
Snapshot Report (C)
Progress Report (D)
Assessment Status Report (E)
OSEP Entry Status Report (F)
Ortiz Head Start Report (G)
COR Class Status Report (H)
Strategies for Maintaining Data Quality PowerPoint
Pattern Checking Table
Pattern Checking Tool
- Lincoln Room
Overview of ENHANCE: Research Underway on the Validity of the Child Outcomes Summary Form (COSF) (S2-024)
Are COSF data valid and reliable? This session will provide an overview of a research project underway to investigate the validity of the COSF. Plans for using information learned to provide better guidance about the COSF and implementing the COSF process will be shared. The group will discuss the kinds of validity information needed by States and specific content that might be important to investigate further in the studies.
Presenters:
Lauren Barton, ECO Center at SRI International, CA
Donna Spiker, ECO Center at SRI International, CA
Handouts:
Spiker and Barton PowerPoint
Link to: For more information, please visit the ENHANCE website
- Roosevelt Room
Data Analysis for Program Improvement (S2-025)
This session for experienced data analysts will address data analysis for program improvement and include opportunities for hands-on data analysis by participants using data templates. Data templates will be provided for States using the Child Outcomes Summary Form (COSF) as well as for States using other approaches for outcomes measurement and reporting.
Presenters:
Kathy Hebbeler, ECO Center at SRI International, CA
Cornelia Taylor, ECO Center at SRI International, CA
- Arlington Room
Identifying and Remedying Missing Data Issues (S2-026)
A key step in ensuring reliable and valid data is to make certain all data are reported. In a roundtable format, participants will discuss issues related to how to identify missing child outcomes data as well as strategies for reducing problems of missing data.
Presenters:
Ruth Littlefield, Section 619 Program, NH
Vanya Mabey, Part C Program, UT
Maureen Sullivan, Part C Program, VT
Handouts:
Mabey COSF Scores No Exit 2009
Mabey COSF Scores No Exit 2010
Mabey Early Intervention Summary
Sullivan Region 4 Chart
Sullivan Region 5 Chart
Sullivan Region 11 ECO Table with Highlighted Missing Data
Sullivan Letter with Regional Reports
- Fairfax Room
Connecting the Three OSEP Family Outcomes with IFSP Outcomes and Local Practices (S2-027)
So, you have analyzed your family survey data – what’s next? In this session, presenters will discuss the importance of using family outcomes data to inform State/local program improvement and the connections between the services and supports families receive and the global outcomes reported for accountability purposes. Information will be provided on steps to customize improvement activities to address specific issues and challenges. Family perspectives will be shared with regard to the OSEP family outcomes as well as how Part C services can better empower families and improve family outcomes.
Presenters:
Connie Hawkins, Region 2 PTAC at ECAC, NC
Christina Kasprzak, NECTAC and ECO Center at FPG/UNC
Annette McClure, Parent, NC
Handouts:
Hawkins-Kasprzak-PowerPoint
Knowledge-to-Action Guides: Preparing Families to Be Partners in Making Educational Decisions
Link to: ECAC Parent Center Web site
3:15 – 3:45
Break
3:45 – 5:00
Regency Ballroom AB
Closing Plenary: Now What? From Outcomes to Implementation (S2-028)
Available via iLinc
Our outcomes data collection systems are in place; now what? Let’s celebrate our successes and start thinking about using the data to promote systems change and improve services for children and families. This presentation will focus on how implementation science and systems change concepts can inform the timely and effective use of data to benefit young children with disabilities and their families.
Presenter:
Karen Blase, Co-Director, State Implementation and Scaling of Evidence-Based Practices (SISEP); and Co-Director, National Implementation Research Network (NIRN), NC
Handout:
Blase PowerPoint
iLinc Audio Recording: https://tadnet.ilinc.com/join/ctbhkvt