>> SLIDE 1 SILC-NET Presents… A National Teleconference & Webinar: Developing an Outcomes-Focused SPIL September 18, 2012; 3:00 PM – 4:30 PM EDT Presenter: Mike Hendricks, Ph.D. >> SLIDE 2 Who am I? -Consultant in outcomes, evaluation, etc. -Have been working closely with NCIL, ILRU for the past 4-5 years -Developed training, TA materials (ILRU website) -Given several webinars and in-person trainings -SILC Congress 2010, 2011; Portland 2011 -All materials vetted and approved by RSA >> SLIDE 3 What does “vetted and approved by RSA” mean? -We want to be very clear about this -RSA has seen all the materials we’ve ever presented -RSA agrees these are good suggestions -However, RSA does NOT require you to do what we’re suggesting -So, these are ideas for you to consider >> SLIDE 4 Caveats -States are different – in lots of ways -There’s no one way to develop a SPIL -Do what works for YOUR state -However, we’ve given this some thought -So please, consider our ideas seriously >> SLIDE 5 SILC-NET’s Online Resources on This Topic http://wiki.ilru.net/index.php?title=SILC-NET_Resources >> SLIDE 6 Three Key Terms We Need to Use in the Same Way: 1. A state’s “IL program” 2. An “outcome” 3. A “logic model” >> SLIDE 7 Graphic: A State’s IL program -Outer circle: local agencies, schools, Councils, service clubs, other state agencies -middle circle: CILs, SILCs, DSUs -inner circle: consumers >> SLIDE 8 Graphic: Essential Components of a Program Inputs lead to activities, activities lead to outputs, outputs lead to outcomes Inputs: Resources dedicated to or consumed by the program -money -staff & staff time -volunteers & volunteer time -facilities -equipment & supplies Activites: What the program does with the inputs to fulfill its mission -feeding and sheltering homeless families -providing job training -educating teachers about signs of child abuse -counseling pregnant women Outputs: The volume of work accomplished by the program -number of classes taught -number of counseling sessions conducted -number of educational materials distributed -number of hours of service delivered -number of participants served Outcomes: -Benefits or changes for participants (or an organization) during or after program activities -new knowledge -increased skills -changed attitudes or values -modified behavior -improved condition -altered status United Way Logo >> SLIDE 9 Outputs vs. Outcomes -- There’s a big difference Comprehensive child care -# child-days of care given -Children are school-ready for kindergarten GED preparation -# tutoring sessions held -Participants obtain their GED certificates Independent Living Services -# consumers served -Consumers have skills to support choices >> SLIDE 10 Why Focus a SPIL on Outcomes? -Why not focus on inputs, activities, or outputs? -Not good enough anymore -What are you trying to achieve? – Desired outcomes -Start from where you want to end up, then figure out the steps to get there -Like a trip -- your destination determines how you’ll get there >> SLIDE 11 Partial Logic Model with Activities This slide contains a chart that is described verbally in the following slides >> SLIDE 12 Our 3-Step Approach Step 1: Decide what you want to achieve -Mission, goals, objectives, partial logic model Step 2: Turn generalities into specifics -Measurable indicators, geographic scope, target performance level for 2016, target progress between 2013 and 2016 Step 3: Develop an action strategy to achieve each Objective -Necessary activities, lead organization, key partners, resources needed, funding sources >> SLIDE 13 Step 1: Decide what you want to achieve A. State your Mission (top row) -But whose mission? Your total IL program’s -"PWDs in our state live independently and participate fully in their community” -Your Mission will be different, but… -Wording is important: --Start with your target group --Follow with a present-tense verb phrase --End however makes sense >> SLIDE 14 Step 1: Decide what you want to achieve, cont’d. B. Develop your Goals (next row down) -Desired outcomes one level below your Mission -What outcomes do you need to achieve first, in order to achieve your Mission? -Outcome “stepping stones” on the way to your Mission -Put each Goal in a box, right below the Mission >> SLIDE 15 Partial Logic Model with Goals Example mission: PWDs in our state live independently and participate fully in their community Example goal: PWDs recieve needed services from the current IL system Example goal: The current IL system operates efficiently Example goal: The IL system is expanding -IF we achieve these three Goals, THEN we can achieve our Mission -Your Goals will almost certainly be different -You may not even agree with these Goals -But this format will be very useful >> SLIDE 16 Step 1: Decide what you want to achieve, cont’d. 2 C. Define your Objectives (next row down) -Typically can’t achieve Goals in 3 years -Make progress, yes; fully achieve, probably not -Need another level of outcomes below Goals…. Objectives -What outcomes do you need to achieve first, in order to achieve your Goals? -This is the key level of outcomes – Focus your efforts on your Objectives >> SLIDE 17 Partial Logic Model with Objectives Example goal: PWDs recieve needed services from the current IL system Example objective: key organizations have sufficient resources Example objective: IL providers are well trained Example objective: IL providers are well equipped Example objective: formerly underserved populations are served IF we achieve these four Objectives, THEN we can achieve this Goal Your Objectives will almost certainly be different – don’t have too many (37 in one SPIL) >> SLIDE 18 Objectives From Some Actual SPILs 1. Formerly underserved populations are served 2. Persons with disabilities (PWDs) have increased employment opportunities 3. Policy makers financially support the IL network 4. PWDs register to vote 5. IL network key partners collaborate to provide delivery of services 6. PWDs can access transportation >> SLIDE 19 What Are Your Questions and Comments about Step 1? >> SLIDE 20 Step 2: Turn Generalities into Specifics -Objectives are the core of your SPIL, but they’re too general -“IL providers are well-trained” – What does this mean – exactly? -Very helpful to think through a SPIL Planning Table >> SLIDE 21 SPIL Planning Table – (first section) Row 1: Specific Objective / Measurable Indicator(s) / Geographic Scope / Target Performance Level for 2016 / Target Progress Between 2013 and 2016 Column 1: IL providers are well-trained / Objective… / Objective… / Objective… >> SLIDE 22 Step 2: Turn Generalities into Specifics, cont’d. A. Develop measurable indicators for each objective -This is an unbelievably important step -What exactly should change in 3 years? -How exactly will we know if we’re being successful on this Objective? -An indicator defines what we mean by an Objective – (Memorize this!) -“# and % of front-line staff who have an up-to-date Prime Provider Certificate (PPC)” >> SLIDE 23 Indicators From Some Actual SPILs PWDs have increased employment -% PWDs desiring to work who have at least half-time paid employment Formerly underserved populations are served -% PWDs who are deaf-blind who access services -% Native American tribal communities having a relationship with the IL network IL network key partners collaborate -# agencies providing services to veterans that collaborate with the IL network >> SLIDE 24 Step 2: Turn Generalities into Specifics, cont’d. 2 B. Specify the geographic scope for each Objective -Statewide? Only rural areas? C. Set 2016 performance targets for each Objective -What an indicator should “read” in 2016, at the end of the 3-year SPIL period -Art & science: your performance right now, your best predictions of progress, other States, national standards, experts, etc. >> SLIDE 25 Step 2: Turn Generalities into Specifics, cont’d. 3 D. Set targets for interim progress between 2013 and 2016 -Please don’t wait 3 years to see how you’re doing -Measure an indicator as often as makes sense (annually, 6 months, 3 months) -Shoot for a trend that makes sense (steady, gathers steam, levels off) >> SLIDE 26 SPIL Planning Table – (first section), cont’d. Specific Objective: IL providers are well-trained Measurable Indicator(s): # and % of front-line staff who have an up-to-date PPC Geographic Scope: Rural counties Target Performance Level for 2016: 2016 = 80% Target Progress Between 2013 and 2016: -2013 = 65% -2014 = 70% -2015 = 75% Specific Objective: Objective… Measurable Indicator(s) -Indicator #1… -Indicator #2… >> SLIDE 27 What Are Your Questions and Comments about Step 2? >> SLIDE 28 Step 3: Develop an action strategy to achieve each Objective -Now you know exactly what you want to achieve – very specifically -But how are you going to achieve each Objective? -Add this information into your SPIL Planning Table >> SLIDE 29 SPIL Planning Table – (second section) Row 1: Specific Objective / Necessary Activities / Lead Organization / Key Partner(s) / Resources Needed / Funding Sources Column 1: IL providers are well-trained / Objective… / Objective… / Objective… >> SLIDE 30 Step 3: Develop an action strategy to achieve each Objective, contd. A. Determine the Activities you need to conduct in order to achieve each Objective -What you will do -- “-ing” words such as training, surveying, disseminating, etc. -One or more activities for each Objective -But each Objective will have different activities -Activities depend almost entirely on the decisions you’ve made in Steps 1 and 2 -Put activities right below Objectives on your logic model (IF-THEN) >> SLIDE 31 Partial Logic Model with Activities, revisited Space for activities is added under each exampe objective >> SLIDE 32 B. Agree on one lead organization for achieving each Objective Graphic: A State’s IL program -Outer circle: local agencies, schools, Councils, service clubs, other state agencies -middle circle: CILs, SILCs, DSUs -inner circle: consumers -Important for the buck to stop some ONE place -SILC, DSU(s), or CILs might usually be the lead -But maybe not always? >> SLIDE 33 Step 3: Develop your action strategy to achieve each Objective, cont’d. 2 C. Agree on key partners for each Objective -Other organizations may need to be involved, too -Important to plan from the beginning D. Document the resources needed to achieve each Objective -Generally in $$ terms –As closely as possible, but may not be perfect >> SLIDE 34 Step 3: Develop an action strategy to achieve each Objective, cont’d. 3 E. Clarify funding sources -Part B? Part C? Chapter 2 – Older Blind? Other sources of funds? >> SLIDE 35 SPIL Planning Table – (second section), cont’d. Specific Objective: IL providers are well-trained Necessary Activities: -Identifying all front-line staff in rural counties -Assessing who has a PPC -Motivating staff without a PPC to get one -Offering PPC courses >> SLIDE 36 Specific Objective: IL providers are well-trained Specifics of Each Objective -Geographic Scope: Rural counties  -Target Performance Level for 2016: 2016=80% -Target Progress Between 2013 and 2016: 2013=65%, 2014=70%, 2015=75% Action Strategy for Achieving Each Objective Necessary Activities: Identifying staff, Assessing who has a PPC, Motivating staff, Offering courses Lead Organization: CILs (?)  Key Partner(s): Provider agencies, Local community colleges Resources Needed: $??? Funding Sources: ?? >> SLIDE 37 Three Important Points About Your Logic Model and SPIL Planning Table 1. Many people think these tools are very helpful for planning 2. However, at this time, RSA’s online MIS system is not able to accept charts or tables. Hopefully this will change, but for now, you cannot upload your logic model or SPIL planning table to RSA 3. Our advice: These tools are too helpful not to use! Develop them for your own purposes (and for your own audiences), then put the key information into text for RSA’s MIS system >> SLIDE 38 What Are Your Questions and Comments About Step 3? What Are Your Questions and Comments About Anything At All? >> SLIDE 39 Contact Mike Hendricks – Mikehendri@aol.com >> SLIDE 40 Wrap Up and Evaluation Please complete an evaluation of today’s program at: https://vovici.com/wsb.dll/s/12291g50e66 >> SLIDE 41 SILC-NET Attribution Support for development of this Webinar/teleconference was provided by the U.S. Department of Education, Rehabilitation Services Administration under grant number H132B070003. No official endorsement of the Department of Education should be inferred. Permission is granted for duplication of any portion of this PowerPoint presentation, providing that the following credit is given to the project: Developed as part of the SILC-NET, a project of the IL-NET, an ILRU/NCIL/APRIL National Training and Technical Assistance Program. >> END PRESENTATION