Magic rocks

3rd Annual Summit on Vocational Rehabilitation Program Evaluation

Pathways to Performance:
Making a Difference through Program Evaluation

Follow evalsummit on Twitter http://www.twitter.com/evalsummit Facebook Logo 3rd Annual Summit on Vocational Rehabilitation Program Evaluation

Survey

Agenda

Downloads of Material

DAY 1
Tuesday, September 21, 2010

Welcome and introductions

Linda Mock, Oregon Commission for the Blind; Kathe Matrone, Director of the Center for Continuing
Education in Rehabilitation (CCER) at the University of Washington

 “Making a Difference through Program Evaluation”

                                     Dr. Michael Quinn PattonConsultant
                                    What the valuation profession has learned from researching
                                    and evaluating evaluations

Powerpoint PDF

PowerPoint RTF

CONCURRENT SESSIONS:


“Quality Assurance in the VR Management Model: ‘The link between measurement & action’”

Sue Foley, Sue Stoddard, Heike Boeltzig and Allison Fleming

The NIDRR Rehabilitation Technical Assistance Center on VR Management (RTAC) is identifying models of management. This panel will discuss how to link measurement to action.

PowerPoint PDF

PowerPoint RTF

“Changing the Culture of Quality Assurance” 

Carol Feuerbacher –

This session will present on the process that Colorado Division of Vocational Rehabilitation (DVR) undertook to change the culture of quality assurance for case file reviews from a negative view among staff to one of training and teaching for a more positive experience.   It will also allow for interaction among participants to share their quality assurance experiences with case file reviews.

(Mine)Often QA & case file reviews are seen as punitive and negative for counselors. This discussion presents a method of using QA as a learning experience and training tool.

PowerPoint PDF

PowerPoint RTF

“Quantifying Case Review Data”

Warren Granfor –

 The presentation will discuss ways to display case
 review data in a graphical form to identify potential
 training needs and best practices.  Topics include:
 selecting a sample, one way to design a case review
 form to obtain measurable data, quantifying the data,
 determining strengths, areas of concern,
 recommendations, and corrective action plans.

PowerPoint PDF

PowerPoint RTF

"Determining the Scope of Assessment Activities, Resource Considerations and Statewide Needs Assessment"

Mark Tucker

Using the statewide needs assessment as a frame of reference, this seminar will focus upon internal and external environmental considerations in determining the scope of assessment efforts.  Strategies employed by VR agencies to address these challenges will also be reviewed

PowerPoint PDF

PowerPoint RTF

CONCURRENT SESSIONS

“Collaborating with a university to enhance your program evaluation efforts”

Cathy Chambless –

Collaborating will improve evaluation approaches. We discuss strategies for developing an effective evaluation team.

PDF Of Presentation

RTF Of Presentation

“Developmental Evaluation: Applying Complexity Concepts to Enhance innovation & Use” 

Dr. Michael Quinn Patton –

PowerPoint PDF

PowerPoint RTF

“A Community of Learners: Program Evaluators in State VR Programs Respond to shared resources”

Darlene Groomes –

Research from the community of learners with the Summit Group.  Through book review and shared reactions, program evaluators discovered ways to expand and improve program evaluation.

PowerPoint PDF

PowerPoint RTF

“Using Focus Groups in Rehabilitation Evaluations” 

Sara McCormick –

Focus groups are an effective tool for collecting qualitative data, which can be used in planning projects and evaluating mplementation

PowerPoint PDF

PowerPoint RTF

CONCURRENT SESSIONS


“Using Readily Available Data to Examine VR’s Long-term Impact on Consumers’ Employment and Earnings”  

Kirsten Rowe and David Dean –

Conducting long-term outcome assessments using readily available state-level administrative data.

PowerPoint PDF

PowerPoint RTF

“Establishing standards of Ethics of PE & QA in VR” 

Discussion Group

   


“The Role of Front Line Supervisors in QA: Exploring Processes of Assessment  & Skills Development”

Jared Schultz –

The essential role in quality assurance process begins with ensuring that high quality services are provided directly to consumers.

PowerPoint PDF

PowerPoint RTF

“Utilization-Focused Evaluation”

Dr. Michael Quinn Patton –

PowerPoint PDF

PowerPoint RTF

DAY TWO
Wednesday, September 22, 2010

GENERAL SESSION
“Summit Group Perspective”
Michael Millington, Scott Sabella, Michael Shoemaker
Panel Discussion

PowerPoint PDF

PowerPoint RTF

“RSA—Processes to System – QA in State VR Agencies” 

Terry Martin, Janette Shell, Brian Miller
This will be a summary description of state VR agency QA system from section 107 monitoring reports. This will be compared and contrasted with QA systems promoting change in agency performance

PowerPoint PDF

PowerPoint RTF

CONCURRENT SESSIONS


“Vendor Performance Management—Oregon OVRS Case Study”

Lisa Gifford and Stephaine Parrish-Taylor

Alliance Enterprises and Oregon OVRS developed a modeling technique to quantify vendor performance.

PowerPoint PDF

PowerPoint RTF

“Quality Transition Services: Using Existing Indicators to Evaluate Outcomes”

Pat Brown

An overview of National Standards and Quality Indicators and the Taxonomy for Transition Programming (Kohler,1996)

PowerPoint PDF

PowerPoint RTF

“The Components of a Comprehensive PE/AQ  System”

Jane McIntosh, Harvalee Hess, Daronne Patterson, Brian Hickman      

Discussion of the components of a program evaluation system and their inter-relationships, which are often difficult for individuals to conceptualize
   
Word PDF Powerpoint PDF

Word RTF Powerpoint RTF

“Approaches to Conducting Comprehensive Needs Assessments” 

Cathy Chambless and Marilyn Campbell, Mark Tucker
 
How comprehensive needs assessments are conducted and incorporated into RSA State Plans

PowerPoint PDF

PowerPoint RTF

CONCURRENT SESSIONS

“Technical Assistance Opportunities from the Disability Statistics Research and Training Center”

Dave Vandergoot

PowerPoint PDF

PowerPoint RTF

“Tough Times—the Water is Rising: How do we cope?”

Discussion Group:
                                
A look at several scenarios: (some examples) RSA monitoring has an increased focus on performance data and quality assurance systems.
Unemployment is up, economy is down, and employment placement is more competitive.
How do we go about obtaining these QA skills and new skills while we still manage our current daily responsibilities?

“The heart of a program evaluator” 

Michael Shoemaker

“Who looks outside, dreams; who looks inside, awakens” –Carl Jung

“Calculation and utilization of a Return on Investment Information for Legislative Leaders”

Steven Collins

In the midst of hard economic hits, Florida legislators are trying to identify government services which can be cut to balance state revenue. Return on investment data from VR is critical to supporting continued funding to improve services to customers

PowerPoint PDF

PowerPoint RTF

CONCURRENT SESSIONS


“If Everyone is Already Doing It, How Come It Never Gets Done?” 

John Halliday, Joseph Marrone, Bob Burns

VR leadership must ensure that QA efforts improve outcomes for stakeholders. How do you get the attention of leadership to embrace QA as a component of change?

PowerPoint PDF

PowerPoint RTF

“How to present information to different audiences such as the SRC, legislature, and other stakeholder”

Discussion Group

“RSA panel on Needs assessment and Monitoring”

Terry Martin, Janette Shell, Brian Miller

A chance for Q & A

PowerPoint PDF Needs Assessment Guilde (pdf) Needs Assessment Appendices (pdf) Session Powerpoint (pdf)

PowerPoint RTF  Needs Assessment Guilde (word) Needs Assessment Appendices (word) Session Powerpoint (word)          

“VESID Supported Employment Information Directory – A Component of Quality Assurance in the Vendor Management System” 

David Burganowski, Sally Siewert, Lisa VanRyn   

VESID (VR in New York state) completed a pilot project allowing stakeholders with accurate information about vendors as well as performance indications—fostering consumer choice

PowerPoint PDF

PowerPoint RTF

Webinars

The National Clearinghouse for Rehabilitation Training Materials at Utah State University is hosting the Webinar of the Keynote Speakers. Follow the link to the full page of information and registration.http://ncrtm.org/mod/resource/view.php?id=1999

Note to Program Evaluation Summit attendees and presenters

We are requesting that everyone attending the Program Evaluation Summit complete an online survey as soon as possible for Dr. Dave Vandergoot.  Dr. Vandergoot will be presenting the results and process at the Program Evaluation Summit on September 21-22, 2010.  See the explanation below:
“This survey is sponsored by the VR Program Evaluation Summit Group. The goal is to identify priorities within State VR agencies for technical assistance and training in areas associated with program evaluation. The results of the survey will be used to identify those components most in need of support at the present time and to identify potential resources that could address such needs. The Program Evaluation Summit Group will take the initiative to match needs with resources wherever possible. Thank you for your careful attention to this survey. Results will be shared with you at the Program Evaluation Summit in Washington State this coming September.”
Here is the link: http://ncrtm.org/mod/questionnaire/view.php?id=2001

Center for Continuing Education in Rehab