The challenge is to evaluate major soft skills programs, such as leadership development, culture, or change management at the impact and maybe even the ROI evaluation levels. Although interest in showing the value and measuring ROI is now heightened and much progress has been made, most learning and development professionals do not know how to measure their soft skills programs at the impact and ROI levels. Unfortunately, the perception of calculating ROI is that it is too complicated, time-consuming, and may cause the staff to become overwhelmed. Additionally, many fear the potential for negative results. How can we minimize this? Five specific actions will help:
- Be selective. Select only projects and programs that are very expensive, strategic, consume many resources, or attract a lot of executive attention to measuring Level 5—ROI. This is usually about 5-10% of your programs annually.
- Share the load. Conducting an ROI study should involve not only the evaluation team but every stakeholder. Each person has a role in designing the program, collecting data, and participating in the analysis to drive business results.
- Design for results. Start with why, and the “why” is your business measure. Next, select the right solution to improve the business measures. Then expect success and use that expectation in the form of objectives to design for the results.
- Be proactive. Don’t wait for the request. Drive the evaluation initiative and don’t let executives drive it. When an executive requests ROI unexpectedly, the timeframe for results will be short – causing you to react defensively. You want to keep evaluation on your agenda so you can control the process.
- Be resourceful. Utilize the many tools, templates, and technology related to the ROI Methodology® to help you be successful. It is possible to conduct a successful ROI evaluation on almost any budget.
The ROI Methodology is a scalable and systematic approach to program evaluation. Using a process model, five-level framework, and operating standards to capture performance metrics from simple satisfaction scores to the financial impact, the methodology enables you to collect appropriate data to report the performance of various initiatives and program types. The ROI Methodology generates both qualitative and quantitative data. It provides techniques to isolate the effects of the program from other influences – resulting in credible metrics and ROI reports accepted by financial executives and stakeholders.
With over 6,000 organizations using this process, the ROI Methodology is the most used and implemented evaluation system in the world. The ROI Methodology provides the capability to evaluate program performance and improves the design of programs for optimal impact. A focused, proven, and practical approach – the process is grounded in conservative standards and a cost-effective approach to evaluation.
When an organization implements the ROI Methodology, the concern about the value or payoff of this approach becomes an issue. This process, when used properly, is a functional shift from activity-based to results-based. The activity-based approach focuses on developing programs, counting people involved, and reporting data about activities. The results-based approach requires that programs begin with the end in mind with very specific business measures. It also involves a continuous focus on results throughout the process and creating expectations from all involved to deliver the results. These results include data that are CEO and CFO-friendly.
This shift is often met with resistance from those who are involved in the process. This approach requires program designers, developers, facilitators, and coordinators to think about accountability early and often, and shifts how programs are deployed. For example, it requires them to develop objectives at the application and business impact levels. Thus, the investment in ROI implementation becomes significant, not only in direct costs but also in time and efforts. Sometimes, this is perceived as extra work by the learning and development team instead of an opportunity to show the connection to business value. So, the obvious question is, “Is this worth it?” Although most executives suggest that this approach is necessary, and the “ROI on the ROI” is not needed. However, it is a helpful and recommended exercise.
Programs are evaluated in a variety of ways, and few accepted standards, rules, and processes exist to validate those assumptions and claims. Following a systematic process with conservative, accepted standards (such as those presented here) can create a credible story of program success.