0:03
Hi, everyone, and welcome to today’s webinar, Show the Value of What You Do: Measuring and Achieving Success in ANY Endeavor, hosted by HRDQ-U and presented by Doctors Jack and Patti Phillips.
0:16
My name is Sarah, and I will moderate today’s webinar. The webinar will last around one hour. If you have any questions or comments, please type them into the Questions box on your GoToWebinar control panel. We’ll answer as many questions as we can during our session today, and make sure that you will keep the handout to on your GoToWebinar control panel up, yeah, If you hit that drop-down, you can download that for yourself today.
0:40
Today’s webinar is sponsored by HRDQstore. Training professionals everywhere are feeling the pressure to prove the value and impact, which their training initiatives can bring to the organization Without a premium return on investment or ROI of learning. Management buy in and training budget might be in jeopardy. HRDQstore provides a range of tools for calculating the ROI for your learning initiatives.
1:03
You can learn more at HRDQstore.com. I’d like to welcome our presenters today, doctors Jack and Patti Phillips. Dr. Jack Phillips is Chairman of ROI Institute and a real world renowned expert on accountability, measurement and evaluation, provides consulting services for Fortune 500 companies, non-profit entities and government and non-governmental organizations globally. He is author or editor of more than 100 Books, conducts workshops and presents at conferences, or else why.
1:34
Doctor Patti Phillips is a renowned leader in measurement and evaluation. Helps organizations implement the ROI methodology in more than 70 countries around the world.
1:43
Since 1997, Patti has been a driving force and the global adoption of the ROI methodology and the use of measurement and evaluation to drive change. Thank you both for joining us today.
1:57
Sarah, it’s a pleasure to be here with you today. So, Jack, why don’t you tell us tell them a little bit about what we do here are Away Institute, and then we’ll get into the content?
2:07
Yes. Of Jack Phillips, I’m Chairman.
2:09
As Sarah just mentioned, we’re all about value creation, helping people see the value of what they do and show that value to others.
2:20
We work across industries.
2:22
We have a process called arwa methodology that’s now used in over 70 countries to show the value of any type of project or program.
2:34
We’ve trained about over over 500, excuse me, over 50,000 managers on this methodology.
2:41
An almost 20,000 actually completed an ROI certification where they not only learned how to measure the success of what they do but they actually did it with the actual case study.
2:57
So we’re proud to be, uh, labeled a thought leader, the Thought Leader, Award from ATD, the Association for Talent Development, we’ve received that last year.
3:07
And we also do coaching in our business and we have been recognized as one of the top 50 coaches in the world by the think or 50 organization. So that’s a little bit of what we do, and all those books that we’ve published, I want to mention this.
3:22
one of my personal favorites is this one. It’s called The Business Case for Learning.
3:27
It’s published by …
3:28
DQ, the partners for our session today.
3:33
And so, it’s a great book on how do you show the value of, of talent development. We’ll be talking about that here, because that’s what we do.
3:46
OK, thank you, Jack, and, again, I’m Patti Phillips, and it’s a pleasure to be here with you today to talk about what we do, as Jack said, that’s how to show the value of programs and projects in which organizations are investing.
3:59
So today, our objectives are to provide some content, some insight into our process, and how others have applied this process, to create and demonstrate value for their organizations. And what we hope is that you will use what you learned to change your approach to defining achieving success, while improving your processes.
4:20
And actions and procedures are future success, even greater success down the road.
4:25
Want you to use it to achieve success by delivering outcomes that matter, and how you define outcomes that matter. It really depends on the stakeholders. So we’ll talk a little bit more about that.
4:35
And then we want you to use it to add value to your work, to your organization, and to your community.
4:40
So you, you’ll receive some resources there. You’ll get a copy of the slide deck. A chapter out of our new book. Show The Value of what you do. You should have in, You should have received, and you didn’t, it’s in the handouts, download here in the platform. The actual handout that has a couple of exercises, so you should have that.
5:01
And then, two, if you will wait till the end, we’ll tell you how to get all these resources plus more.
5:07
And then we’re also going to have a drawing at the end. So five lucky winners will receive a copy of the book.
5:14
So that is our plan for today. So we have some pretty straightforward ….
5:18
We have resources for you, stay till the end, So you can get those resources and download your handout if you’d like to work from my handout on the exercises for today’s session.
5:29
So, Jack, let you tell us a little bit about.
5:32
Yes.
5:34
As Sarah said, we’ve written over 50, excuse me, over 75 books that support this methodology, But we decided to, to write this book, that’s sort of the capstone of what we do.
5:47
But we wanted it to be more approachable.
5:50
So many of our books are, like, 400 pages or 500 pages, and it’s got ROI all over the cover.
5:56
Maybe there’s one with the title, Show me the money.
6:01
So that frighten some people sometimes. So this book is a little more approachable.
6:07
It’s full of stories.
6:09
There’s about 20 stories of how individuals have used this methodology to show the value of what they do.
6:16
And it made a big difference in their work, their career, and their lives sometimes.
6:23
And so, we’re going to tell you some of those stories today.
6:28
In the end, the book, It’s It’s about Break it down a little simpler.
6:33
So, we show you six steps that you need to follow this, show the value of what you do to be credible.
6:40
The last point there, the key is to be Accountable for what you’re doing, and be credible with the data that you Show to someone as you show the value of what you do, So We’ll talk about this this this new book, and how you can get a copy of it, if you like, maybe when one.
6:59
But first Patti wants to know here, Where are you in this journey?
7:06
So, if, as you think about your projects and programs, what do you, how do you measure that success now?
7:18
The poll is open, so if everyone will just check all that apply.
7:24
How are you currently measuring it, Success of your programs, projects, initiatives, the work that you do?
7:35
And we have results streaming in here, we will give you 15 more seconds to submit your answer.
7:54
And just five more seconds here, nice catch LHA, first, the first two were the same.
8:03
Oh, my goodness, interesting enough, that not everyone, not everyone check them, but Thanks.
8:13
Oh, yeah, the results up on the screen there, my apologies for that. That wasn’t There was a great test. Who’s paying attention. I said. it’s great. We should have a price for that.
8:25
Yes, and I bought a book for her.
8:28
Right.
8:28
So, for sure, she gets, she gets one, So we’ll give ***, or do the drawing for five, and get six for her.
8:36
It’s interesting, although it’s the same number.
8:39
There was more respond to the second that we’re thinking about maybe what that, what we really mean there.
8:46
Which is, means we’ve got a very intelligent group here.
8:50
In fact, tell us about what you’re, what you’re seeing here, Patti.
8:57
I say that they’re measuring what team members are doing to make it successful was the one most frequently selected. Paula has gone away now, so I don’t see the results now. But, that’s the one that I saw that had the most.
9:10
Yes.
9:11
The fact that we’ve got 58% showing the impact of what you’re doing. You’re right there, where you need to be. It’s amazing.
9:19
And Ann, 17% actually measure the Roi a this is not my mother would say this group is not normal.
9:29
So this is great.
9:31
We need to take you with us because we need we need this kind of success for others.
9:37
You’re doing quite well here.
9:40
Now we’re going to show you how Maybe some of you who are not at that level can get there.
9:47
So, let’s think for a minute about your projects. You know, we all have projects. We have, maybe it’s a program. Maybe it’s an event. It’s a new procedure.
9:58
We got something that we’re implementing in the organization.
10:02
So, how do we go about it?
10:04
Well, we’ve looked at that for a long time in our business since we’ve been running, this organization is for 30 years.
10:11
Unfortunately, so many, kinda start, as you see over on the left side of your screen, on the traditional approach, You just kind of want to get going with it.
10:20
You know, maybe nowhere to go, no end, no system to measure success along the way.
10:30
Unfortunately, we don’t get there.
10:33
So, after as much as we’d like, and our focuses a lot on activities, you know, we’ve got things going. We’re doing things.
10:41
But, what we want to show you is that a value added approach here, show the value of what you do, is: starting with the end in mind.
10:50
We’re going to define the end as an impact that you’re going to have, and you’re going to follow six steps to get there, and you design for the results.
11:00
We know that sometimes, the, the biggest impediment to actually measuring at this level is the fear that it may not be at that level of impact.
11:12
When we don’t deliver it back or we don’t deliver positive, aren’t a lot, you can almost remove. That’s the issue.
11:21
If you design for it and we’ll be talking about that designing your project for the Roi, then we wanna look at how we focus on results own those activities and not the activity’s themselves. So, that’s the big issue here.
11:38
And let’s start with definition of success here.
11:42
I think most of you know that we were, had that in that slide, Olmos, Oh.
11:48
The first one is always reaction, That’s how people are reacting to what we do, back into our project.
11:55
We gotta have the right reaction. If it’s rejected, you know, it goes nowhere, more than likely.
12:01
So we need to have something that’s important to the people involved. It’s relevant maybe to what they do.
12:08
It’s something that they intend to make successful. It’s something that, maybe that would recommend.
12:14
Uh, and then there’s learning, learning what has to be done to make it successful. This breaks down in things, I must know.
12:24
Like knowledge, things I must be able to do, like the scale.
12:28
So you need both in most projects, and then there’s doing things This is a big part, Getting thinks action, that’s a level three, using what you’ve learned.
12:42
So it’s just not what you know. But it’s really what you do with what you know is important.
12:47
And that’s what we, I live in here.
12:49
And that’s going to be often the extent of our use, maybe the frequency of views.
12:55
And maybe the success you’re having as you do this in terms of, Is it working?
13:02
But we do things for purpose. The purpose is an empath.
13:06
That’s a consequence of the application.
13:10
Impact is going to be measure in this system.
13:13
Impacts will be things like sales and reproduction, incidents, accidents, turnover, out of commodity discrepancies.
13:24
Wait time, process time, customer satisfaction. Employee satisfaction, stress, you know, you got all of those.
13:31
Impacts are there and we’re trying to work on those.
13:34
They’re in the system music somewhere and then there’s Roy.
13:40
Roi is a basic question. Is it worth it?
13:43
Do you deliver more value to the organization than it’s costing the organization?
13:49
That’s a key question. That’s what the ROI tells us.
13:52
So we’re going to pick those levels of success and show you how to put them together in it a model.
14:00
Patti, why don’t you tell us about the man, like models, Because models help us.
14:05
They tell us what we’re going to do, right? So, we’re like, process models. I’m sure we’re consistent in our approach. But they also help us explain what we did when it’s done.
14:14
So, when you’re presenting results, you had some reliability in those results.
14:18
And so, our model is simple, 6, 6, simple steps, Start with, why? No, what is the impact that you hope to achieve?
14:26
Now, why is about, how do, what is our opportunity to make money, save money? Avoid costs do greater good.
14:35
So, we look here at the why and we’re looking at from the potential value, we can contribute to the organization. By helping the organization either make money, save, money, avoid cost into greater good, so we start there.
14:48
And then we sort out the how.
14:50
How are we going to do this? What is the right approach?
14:52
What’s the right solution to move the needle on the measures that represent the why of what we’re doing.
14:59
And based on that analysis, then, we’re going to quantify what we find is set up objectives. Expect success.
15:06
Step number three, that’s answering the question, what?
15:09
What can we expect from it, What are the steps? What are the measures that we’re going to take?
15:15
So much of the time, when we’re working with organizations, to demonstrate the value of the big program or project, are some initiative, the first thing we go to are those objectives. And so much of the time, those objectives are vague and nebulous. If exist, at all.
15:30
And so we need those very specific objectives that represent all the levels, Because, as level’s represents, says, from multiple perspectives, those objectives represent the architectural blueprint.
15:44
How are you going to design it?
15:45
Program facilitator. How are you going to roll it out, and how are you going to measure success? So we begin with the why, the how, and the what.
15:52
Then we move on to how much am I should improve?
15:55
Here’s where we’re going to collect data, and we collect data throughout the program.
15:59
Not just the pre programmed day that met through lab. What are people thinking? Are they learning what they need to know? Are they doing what they need to do or the measures improving? And is it paying off?
16:11
And then we look at what’s what’s it work. And that’s where we really get into the payoff.
16:16
That’s the analysis, so that’s where we’re going to isolate the effects of the work, or the program, or the project on improvement in those measures. That may be a control group, trend line analysis, forecasting methods. Maybe it’s ask someone, use estimates.
16:29
This is where we can borrow measures to money to get to that monetary value.
16:33
Can we compare it to the cost?
16:35
Calculate the ROI, so we’re really getting to that worth in terms of that financial impact, that return on investment? And then, last, we’re going to do something about it. Something with the data. So what?
16:48
So, what your program shows up: 25, 35, 45% ROI, so what? What do we do with it?
16:55
Are all leveraged the results, use the data.
16:58
So, it’s these six, these six steps that get us where we want to go.
17:01
Now, many of you know our work and we have a 12 step model, The six steps.
17:07
Just cut to the chase rive it makes it a little bit simpler or more palatable. So where we are in our model is exactly the same thing we’ve been talking about for years.
17:17
We start, those first three steps are critical.
17:19
We put a lot of focus on there because what you do, right, is creating the value and then designing the solution to deliver the value.
17:28
So, we start with the Why. We talk about the how.
17:31
Make it feasible, we set those expectations.
17:35
Those objectives are the first three steps, are the first three steps in that six step approach.
17:41
Then, we collect our data, and, as I said, we’re going to collect data throughout the entire process.
17:48
We’re collecting data during the program.
17:50
We’re checking to see if, in fact, people are doing what we want them to do.
17:54
Are they buying into it, do they perceive it as valuable. Then we follow up to see with our data collection, we follow up safe. In fact, they’re using the Knowledge Skill information inside they’re taking action.
18:06
And then we follow up to see if, in fact, the impact measures are improving, and then the next few steps around the analysis, that data analysis phase, the fifth step, and the earlier model, here, again, is where you really drill down. You isolate the effects of the program, convert measures to money. Some measures you choose not to convert to money, those are the intangibles.
18:25
You bring in the costs. Calculate the ROI.
18:28
That happens in the analysis phase and then the last phase is simply use the data. Leverage the data, tell your story, but then do something about it.
18:37
Take action on those results.
18:40
The ROI and demonstrating the roi is based on how you use the data. It’s like any people, analytics, the value of people, analytics is not the metric.
18:51
It is how people use the data. They use the insights. same thing here. Evaluate a program.
18:57
So what, what are you going to do about it now?
19:01
So that’s the model. Again, start with why.
19:04
Determine the how, set your expectations, go out, collect a little data.
19:09
Do a little analysis, use the results.
19:13
So, Jack, you want to start the process, Talk about Paula?
19:16
Yeah, let’s go back through this six steps.
19:19
We know that’s that six steps.
19:22
Also illustrated on the 12 step.
19:24
But we start with it, back to the six steps.
19:28
Let’s go to the first step. Start with impact.
19:32
Now I want to tell, we’re going to tell you some stories.
19:33
So we’ll be doing some storytelling here, but we want you to think through your projects that you might be facing.
19:41
maybe a particular project you have in mind.
19:44
Open source project you’re working on now.
19:46
It’s a project you’ve already worked on now.
19:49
I mean recently and so think about that as we tell you these stories of individuals.
19:56
So this particular person, Paula Patel, facing something that so many of us face recently.
20:04
She’s with one of the big tech companies and the company says we want you to come back to work after the pandemic.
20:15
Now Paulo was, was very comfortable working at home.
20:20
It struggled first, but got it working. She felt like she was a good collaborators who was engaged in their productivity is up.
20:27
In fact in the coupling into productivity is up overall.
20:32
And and she just didn’t want to get back into that trip to the office every day, or even any days.
20:43
She was contemplating leaving, but she asked, if I can show you the business case, for keeping me here, let me work at home.
20:54
Will you do that?
20:56
They said, Well, show us what you have.
20:58
And she did.
21:00
So, she looked at some studies of of people working at home and looked at some of the impacts, it has, some of them are pretty obvious.
21:08
What she obviously saw unpublished studies in one of those is our study recently published about remote working, showing the roi of that.
21:22
one is the savings for the office.
21:25
If she works at home, you don’t need that office anymore.
21:28
And then it’s turnover and retention.
21:31
Recognizing she would be a turnover statistic.
21:35
If you didn’t get to work at home, and it’s a, it’s an expensive process, because you gotta recruit someone, and get them back up to performance.
21:45
And also, productivity is up.
21:50
They’re actually getting more work done, now.
21:54
And so, she says, OK. I’m going to show you some data, and she put it together.
21:59
And she followed this chain of value, says, Look, first, This is something that, it’s works for me.
22:06
It’s something I’ve made successful, That’s our reaction.
22:12
I’ve learned how to make this work, had to effectively communicate and collaborate and stay engaged, how to keep my boss informed.
22:21
So we’re working remotely.
22:23
Moving to the level three, It’s working, and we all agree, we have collaborations. There were some suggests we have more collaborations now than we did previously. So it’s working for us. And here’s the impacts.
22:39
Here’s a cost of my office to you that you can now give up for something else.
22:45
This is what it’s costing you annually and here’s what it’s costing for turnover in our organization because if I leave, you got a turnover, you’re preventing that here and here is it.
22:56
Here’s the value of the productivity gain that I have.
23:00
So she, she, sorties actually converted those to money.
23:07
You compared it to the, the cost of the copy and to let her work at home, which is almost nothing.
23:13
You can see it’s a huge ROI.
23:16
On top of that, she says, Look at ROI from different perspectives. On your perspective, it is huge.
23:23
If you’re concerned about financial impact, you should want to do this.
23:29
Second, the impact on me is huge. I want this. So it’s up this high Roi for me.
23:37
Also think about the environment, here’s the number of tons of, of carbon that we’re keeping from going into the environment, because you’re letting me work at home.
23:50
Be helping the environment. Think about the congestion in the city, taking what 1 1 transportation offer there.
23:59
So she made a compelling case and she kept her job.
24:07
The key there is to get to those impact measures.
24:10
So she went to some data to see what typically is there.
24:14
Some are obvious, some, maybe surprises are getting that data.
24:18
So, think about what’s the impact, your project, the project you have in mind?
24:24
Would you mind typing that in the chat?
24:27
And we’ve got Patti and Melissa and Sarah all, looking at the chat there, type in there. What’s an impact from a project that you’re working on now?
24:38
See if you’ve thought through that, What impact are you driving?
24:43
Yeah, So, it’s interesting, because I was having a conversation with one participant, and I’ve titled we’re gonna get there, so we’ll get to some of these issues on here.
24:52
But she did A, yeah.
24:55
She’s working with leadership development and motivation and some other factors where the monetary values not so clear.
25:01
But as I was telling her in the chat, and again, we’ll get to it is it’s really about the consequences of those things, yeah, leadership development.
25:08
All these different programs that we work with, many of them, the money’s not so clear, but it’s the consequence of those things you’re looking for.
25:15
So the consequence of leadership development, the consequence of a wellness program. The concepts of BMI, we didn’t get to the money if we have to, but then sometimes you may choose not to.
25:24
You may choose to report the outcome as an intangible, but you still want to get to that outcome.
25:30
So some of the measures that we see in the chat are, went too fast, monetary savings to taxpayers as a great one. I actually work on report right now and stuff like that, so love it.
25:44
Increased collaboration, so we’d look at the consequences of collaboration, Diversified funding.
25:49
Student retention, impact to community, health, and well-being. These are great.
25:57
Sustainability, improvement, sustainability, building bench strength, and the consequence of not having leadership, or whatever that competency you’re looking for.
26:09
And that’s a good one, too, when we think about the impact, It could be you’re avoiding something. So it’s risk management’s avoiding a cost, so you do this, not because you’re gonna get a game, but because you’re avoiding something.
26:22
So we looked at cost avoidance.
26:23
These are all great, Thanks.
26:27
So what you can say you list those.
26:30
Some would be measures that you can convert the money easily.
26:35
Others will be more difficult to convert to money, so we’re going to label these two, the impacts into these two categories.
26:41
Tangible impacts are those that convert the money.
26:45
Intangibles are those that we are not converting the money.
26:49
You see, Paula, in her case, she says, My job satisfaction is up.
26:55
My engagement is up, my collaborations is up check with our boss if you don’t if you don’t believe what I’m telling me.
27:04
So those are impacts there that are, are not easily converted into money. They’re still important.
27:13
So we’re going to be thinking about the two, So we’ve got, it’s a, it’s a great first step there to go with, and the second step is to make sure we get the right solution.
27:23
So we will be talking about leadership here throughout, but I wanted to take the next example, actually, a leadership program.
27:31
Let’s go to step two for a minute, What’s the right solution?
27:35
Now, this is particularly important in light of what we see occurring with police forces like Memphis, those of you who’ve been watching the news, use out display of police force that was unacceptable and horrible.
27:53
Here’s an example: leadership.
27:57
A team I’m I’m a team here facing the same kind of issues.
28:03
Now this team is a SWAT team in the Kansas City Police Department.
28:07
It had A oh, record of having the most comes citizen complaints about excessive force and they put a new leader in charge.
28:18
His name is Chip Huth and it was tau.
28:23
Fix this.
28:25
We have too many complaints.
28:27
When we get a complaint, the commissioner says, it costs us about $70,000, just in the time to do all the investigation and reporting and documentation on the complaint.
28:40
$70,000, this team was Evy, having about 30 to 40 complaints per year.
28:47
You do the math on that, that’s over $2 million, and complaints just for the time it takes to do, take care of the complaint, let alone other impacts that’s happening.
29:00
So, Chip was put in charge, and he, here’s what chip did.
29:06
He began to think through some data.
29:11
It began to, here’s, here’s a little checklist for us, We’re trying to understand is it the right solution.
29:20
It looked at through some of the complaints that we’re having and as he suspected, the complaints were based primarily on their actions and their approach and their behaviors.
29:30
As A executed their missions, this is a SWAT team.
29:34
They go into a house or an apartment.
29:37
Yeah, get the bad guy.
29:39
The bad person, there’s an arrest warrant there.
29:43
usually they’re going after a criminal.
29:48
And so they looked at, says, I think I know C, the problem is our behaviors and approach.
29:56
He had been exposed to something called the Outward Mindset from our Missouri Institute.
30:03
I don’t know if you’ve ever heard of that.
30:04
It’s an interesting book called the Outward Mindset, Scribes at very Clearly spot looking at People.
30:14
People and not as objects.
30:17
Take an outward approach, you respect people, and the fact that they’re human beings.
30:23
If you don’t truly have an inward mindset, you’re all concerned about my situation. What’s good for me? Looking at people as objects. So this changes our hope, concept. You can see what’s, what’s needed there, when you’re in this situation.
30:38
Is it, you’ve got to remember, the family is there, maybe in that apartment or house?
30:44
You have to remember that their neighbors involve their pets involve and the pets belong to someone.
30:51
You gotta be respectful of all of that as you execute your mission. So, he introduce them to the Outward Mindset Training, three days of training.
31:01
How about changing your home mindset in your approach?
31:07
And at the end of that, Training Chip says, Do you think this would make the difference?
31:16
And these complaints, they said, I think so, but you have to role model it for us, you have to show us the way.
31:26
he did that, this case study is one that’s primed for publication in a new book coming out later this year.
31:38
Think about these numbers.
31:40
About 35 complaints per year, go to zero complaints per year.
31:47
For three years, you go from almost three per month, 2, zero, for three years.
31:58
And his complaints just caution you $70,000 per complaint.
32:04
Yet, the solution is pretty low.
32:08
Low cost actually got $35,000, $36,000, so you can see this one worked.
32:18
It worked. And it’s a dramatic story.
32:21
That’s featured in the second edition of the Outward Mindset Book, just a part of the start. We’ve got The Complete Case Study in our book. We’d be happy to send that to you.
32:32
It’s it’s amazing.
32:35
Behavior change of a group can make a dramatic difference.
32:40
But more than that.
32:43
They got very important intangibles. The tangible is the customer is the citizen complaints.
32:50
And that went from again, about 35 per year to 0 For 3 years.
32:57
That’s tangible because we already got a monetary value.
33:00
The Commissioner asked, for calculation of that, so we’d have it understand it.
33:08
The importance of it: you had an intangible.
33:13
Intangible is the public’s trust in the police.
33:18
It had deteriorated.
33:19
It went up the next survey that they did, showed some improvements in that link to this particular SWAT team.
33:28
So it shows you that we can make a big difference here.
33:32
But it starts with the end in mind.
33:35
The end is that impact.
33:37
If they did it, they just changed their behavior, and the complaints were still there.
33:42
There’s no story.
33:44
This is why you gotta have level three.
33:46
To be a leader behavior, and level for the consequences. That’s the story, when you get to the impact. That’s a story, we want to talk about it here.
33:57
And that was there.
33:58
And, by the way, with what’s going on, Patti, and I sent a note.
34:04
Sunday night, says, a chip, they need you in Memphis.
34:09
It says, They do need me. They do need this program.
34:13
Oh, so, think through, how do you validate your solution, how do you have you know that you’d bet the right? So, it may take some more detail. It may take, looking at a case study.
34:27
It may take some discussions So, I wanna go back to the leadership example. Outward mindset, of course, is a leadership approach.
34:36
But if, if you would just improving a group of managers, I want to make them better leaders. But what we have to look at is not really the end goal, is having the behavior. The end goal has to the impact.
34:49
It’s like, so what Executives want great leaders, because they can deliver great results.
34:55
It’s the results from the leadership that they walk, and we gotta remember that as we implement leadership. So think about this, you got a Leadership Program with great competencies that you wanted to put in place.
35:07
Consider doing two things.
35:10
Put these companies out to the team and says, we invite you to come to this program.
35:14
But when you come to this program, would you identify two measures you’d like to improve to KPIs key performance indicators you’d like to change?
35:26
In your sphere of influence and you and your team select two.
35:31
But only if you can improve those using these competencies.
35:38
When they do that.
35:40
Now it’s connected to this measure.
35:42
Just like that Kansas City SWAT team, the team says I think we can do it, but you gotta help us. You gotta support, that’s all you need sometimes.
35:52
So, that’s step to making sure we have the right solution.
35:57
Now, let’s go to Step three.
36:01
How much?
36:03
It’s good to expect success.
36:06
How much is next? After this, expect success? Is that direction we need?
36:12
We need to define success.
36:15
We, we define success as impact. We gotta get to impact. And we do that with very clear objectives.
36:26
I’m going to tell you a story, here, Poverty Stoplights: It’s a program to eliminate poverty space on a bestseller book, Paul, who owns Poverty, Martin Birt.
36:42
Now, Martin is running for President of Paraguay is a very well-known person, but he’s dedicated most of his life to eliminating poverty.
36:52
And that book is a way it works excreta, stoplight He looked all the indicators of poverty. You’re in poverty with income is low.
37:01
Housing is insufficient. Health care is inappropriate.
37:05
Education is not where it needs to be and it keeps them going.
37:09
And it works with families and they have a stoplight you start with Probably be red that means you’ve got an indicator words, shouldn’t be.
37:17
You make the privilege. Go to yellow. You get it out to get you out of poverty. It’s green.
37:24
And the families worked through this process and this set of goals set objectives, very precise objectives, clearly indicating the progress you made, they need that direction. They need that roadmap to get to where they need to be.
37:38
It’s the most in it, impressive success that we’ve seen in terms of making it actually work. And that’s what objectives do.
37:49
This is a very successful program.
37:50
We serve as the evaluators for this, Martin Birt loves this particular methodology, because it shows the value of this kinda program.
38:01
The value always ROI for the governments who must support people, bring them out of poverty, Value for companies who have employees who are in poverty and they work with this probably stoplight program to get them out of poverty. What’s make that program so successful?
38:20
Is the clear direction? The objectives.
38:23
So we invite you to have objectives, or encourage you to have objectives that show the reaction that you expect of the learning that you expect from your project.
38:36
The application that you want to make it successful and the impact, very precise objectives, level 1, 2, 3, and four.
38:46
And Roy, if you go into Roy.
38:49
Now, when you do that, you’re going to have lots of different objectives.
38:55
So, page got a little exercise for you here on objectives, we got it.
39:01
This is a quiz for you to see how well you understand these levels that we’re talking about for reaction learning application impact.
39:11
And Roy Petty, take it away. Yes. I will just give you a practice here, right? Say if you know your objectives and based on where some of you are where most of you are, you likely do.
39:22
So let’s just have a little practice, given one object, it’s at all levels. So grab that piece of paper, just jot it down.
39:29
Read each objective, there are 10 objectives, however well or poorly written they are. They are objectives.
39:35
10 objectives: all you have to do is just jot down to what level you would evaluate that objective. What level does that represent?
39:44
And just remember, when we talk about Level one is, what do people think about this?
39:48
Level two, what are they able to do?
39:52
Participating or engaging? What do they know? What are they able to do?
39:56
Level three: What are they doing, what we expect them to do, Level for, what’s the consequence, or the expected consequence of they’re doing it?
40:05
And then level five. What’s the value? And so we will give you a hint. There’s only 1 level 5 objective on here.
40:11
So just spend a couple of minutes, jot it down, what do you think, and then we’ll show in while they’re doing that, Jack.
40:19
They’d have one person ask how they can get the case study. So I didn’t ask him if he would send Molest an e-mail.
40:26
But I think there’s probably a better approach. So people want that case study, They want chips, case study.
40:33
What’s the best way for us to get get it to them?
40:36
We can practice it, put it.
40:38
I’ve put something on the resources, Melissa can read it.
40:42
It’ll be in the resource portal that they’ll have access to at the end of the session. So, we’ll have at the end of the session.
40:48
Perfect. Thank you very much.
40:50
And, again, this list of 10 statements is in your handout, if you have a chance to pull that up and work on that, or you, by some chance, or printed that out ahead of time.
41:05
Perfect.
41:06
So, if just one more, just a couple more minutes, or seconds, minutes, more more seconds. one more minute.
41:15
Hmm.
41:19
When someone has done without tin, if you’ll just pop in that Q and A So we know at least someone’s done, that would be great.
41:28
Don’t overthink things.
41:30
Intent OK. We do have someone who it’s done.
41:35
Very good. Thank you very much.
41:37
We should have one more prize, but first want to thank you. All right, coming in. So, let’s see how we did.
41:44
So, let’s see what we did with the objectives.
41:46
So, Jack, you are in charge of the slide deck, if you can start clicking them up. Alright, decrease citizen complaints by 20%, one-year level four.
41:57
Got it, I’m gonna say, yes.
42:00
That’s the impact, the so what of the program.
42:03
Number two, use problem solving skills to uncover causes of problems that is level three, got it checked.
42:12
Again, an objective is the intended outcome.
42:15
The intended outcome is based on the needs.
42:19
So here, the intended outcome is to use the problem solving skills.
42:23
Are number three, be able to demonstrate the five steps to determine if there is a food security issue?
42:31
That would be a level two, objective.
42:34
Number four, Write the facilitator four out of five on presentation skills.
42:38
They want, you all probably got that one.
42:41
Number five: decrease the amount of time required to develop a proposal by 25%.
42:49
What we get votes for? So, on this one, some people will put three here.
42:54
But what happens is they implement a new process, They apply the process, and as a result, we see a decrease in time to develop the proposal.
43:04
So, again, it’s the consequence of doing something.
43:07
Number six, achieve a 20% are why, one year after the program.
43:11
What we get, five, it is perceive the content to be relevant to actual situations that would be.
43:22
Want number eight, decrease security breaches in about 25% in six months.
43:29
What level for it is?
43:33
Number nine. Conduct a proper investigation using the seven step process and 95% of template situations quick, Alright?
43:42
And finally, score an average of 75 or better on A new strategy quits.
43:50
That would be cheap.
43:51
So jot them down. Did anyone get them all correct?
43:58
Anyone get them all correct. Me did. Not your name.
44:05
Addressing the.
44:08
I said, name and e-mail in the chat, and we’ll reach out to you, get your address to send you the copy of the book, I bought that. OK, and I think we’ve got that. So, Sarah, are we gonna be able to see all these questions, because I can see their names here? So we can, can we see the Q&A, Sarah?
44:25
Yes, You will have all that.
44:29
All right, good.
44:29
Just to come back to some, you might be wondering, well, who cares what level of the objectives?
44:35
The sponsor, the supporters’, the funders do.
44:39
The people put up the money for the project.
44:42
They, they sort, they know these levels Well, they love impact, and they get excited about an ROI, but they also nope activity, they can sorta activity Level three from Impact Level four, and they also know when they’re doing something versus learning something.
45:01
So they know it quite well.
45:03
They like, the higher levels, of course.
45:06
They’re always asking, Move it to the next level.
45:11
Let’s move to the next step in the process. Betti, why don’t you tell us about this particular story?
45:17
Yeah, So, the next step is how much, and how much the measures improve. And to know that you have to go collect data, right Now, ideally, you’ve collected the data upfront. You have your baseline data. You can collect the data the same way, but that’s not always the case. So, we have to make a decision about data, collection methods and data, collection sources, timing.
45:37
We’ve gotta think about things like, how do we ensure the data are as objective as possible?
45:45
And, that can be a challenge, but there’s always a way to do it.
45:49
If you’ll go to the next slide just real quick, Jack, I just want to show them the benchmarking data, then we can flip back over here. I’ll tell you about renew America together.
45:56
If we look at all the techniques are different ways we can collect data, surveys, and questionnaires.
46:01
So, self administered instrument are still at the top, most frequently used approach, and that is because technology has enabled us to use those tools, making it easier to administer the questionnaire and that survey. They are not easy to design.
46:18
If you’re using questionnaires and surveys, you need to spend time developing a good one. And that’s a little bit of the problem with some of the data that we see coming out of them, because the questions are so poorly read.
46:29
So while people will say we do it, because it’s a net net, it’s not easy to do a questionnaire, to develop a questionnaire and do it well. It’s easy to administer it because of the technology.
46:41
So, we see a lot of that use. They can be very, very powerful. They are not all bad, They can be really powerful, and we make a lot of decisions on those types of data.
46:50
There’s also performance records, where we go get the data from the system, from the operating reports. That’s easy. If you have access to those data. If you don’t have access to those data, but you know the data exist, they’ll make a friend with someone who has access to those data.
47:06
Of course, we have action plans and observations, and tests, and interviews, and focus groups, all types of ways: the keyword data collection.
47:14
And Jack, if you’ll flip back to that previous slide, so I can focus on this program, the key to all of it is building data collection into your program.
47:24
Too much of the time, we wait to show the value.
47:28
When it’s all said and done, now, we’ve got to figure out, how did we get the best data possible.
47:32
But if you will build it into the programming as you go, it is no longer extra effort for anyone to respond to a questionnaire or complete an action plan. It’s no longer effort for you, because you’ve designed it.
47:44
The program, so you can easily get the data. And that’s what Retinue America Together Civility Leadership Institute. It’s done.
47:52
So if anyone ever wants to do a really interesting leadership development program that’s intended to do greater good, their applications are open now are the Renew America Together Stability Leadership Institute.
48:06
We have people of all genders, and races, and nationalities and political leanings.
48:12
The idea is get people in there who are totally diverse along all these demographics and give them the skill to cross over and engage with people who come from a different perspective, and find common ground.
48:27
This is a six month program.
48:29
They go to the program in person for about three days.
48:34
And then every month, we meet for more education, and it is one of those long term problems. And question is how do you collect data for something like that.
48:44
We built it in from the outset on the applications.
48:48
We asked them, Tell us, why are you doing this?
48:52
Why this program? What are you going to try to achieve? What do you plan to do with it?
48:57
What’s the impact you hope to achieve?
48:58
So Jack mentioned that with leadership development, same thing here, that’s what this is, It’s a leadership development program, We ask them on the application to define the measures, they want to improve the best they can, and then we sorted out. We select the participants.
49:14
and then we made, and we made, in person, we collect data that they’re on site, so you’re collecting your reaction, and you’re learning data, they’re on-site, but we leave them with actions to take.
49:26
We ask them to do some things, and then we have them identify their actions.
49:30
Once they lay, we gave it a month, and then we made online that marked The first thing we do, and that meeting has tell us how you’ve used what you’ve learned.
49:41
What is the impact that you’re seeing from that you set the first thing we do when they come back together?
49:47
Then, at the end, the session, we asked them, using Poling, why do you think was it relevant? What do you plan to do with what you learned today?
49:56
The next month, they come back together.
49:58
The first thing we do is tell us how did you use what you learned? And this goes on and on. Is that with data collection, it can be a challenge.
50:07
It can be expensive when we overdo.
50:10
And it can be expensive when we don’t plan for it.
50:12
But if you build it into your process, you can collect the data all the way through it.
50:19
What are people thinking? Are they buying into?
50:22
Do they know what they need to know? Are they doing what they need to do, or what they promise to do?
50:27
Are the measures moving the way we hope to your building that, Ed?
50:33
And no longer, is it a burden? No longer it’s expensive?
50:36
You will have a better program, better design, in terms of a data collection strategy. And then, you’ve just made it easy for everyone and doing that, so that were numerically together, is just one that’s really good projects that we’re working on, where you have to build a then, it is long term data collection, but it just works like clockwork.
50:54
We’re using polling, we use interviews for the storytelling, and then we use questionnaires, and that’s it. And it’s really demonstrating some value.
51:04
So, data collection doesn’t have to be hard, you just have to be thoughtful, build it right in, so, but here’s the fun part.
51:11
Subjects gonna take you through the data analysis, because this is the really fun part of the whole process. So, Jack?
51:17
Well, it’s fun part for some, some might not like this, but because it does require some analytics, it’s, is it worth it, what’s it worth?
51:28
That’s our fifth step, and here’s a case from Jessica Griego.
51:33
At the time of the study, Jessica was an organization development consultant or Oracle, add her pet issue to deal with was how Millennials were antero unfairly labeled.
51:48
She was a millennial or, and, or I should say is a millennial, and she felt that they were unfairly perceived by a lot of people.
51:57
You should got this request inside Oracle, from the managers who are employing participants in their new college graduates program.
52:09
And basically, managers saying, hey, you gotta train these people, because they’re not Black, guys.
52:16
They’re different.
52:17
They don’t seem to want to work.
52:19
Oh, they have some habits that don’t look good to us.
52:23
You got to train them.
52:25
And so, Jessica thought, well, maybe it’s not just the Millennials, it, maybe the managers to so should do some detail analysis to see what was the problem.
52:37
They realize It is not just the Millennials, it’s the managers as well.
52:42
She developer program for both and the program paid off with with our reduction and retention they were losing some of these people and it paid off with more productivity.
52:54
Well, what Jessica faced with her analysis and this is one of the published case studies as well, was how to isolate the effects of this program for other Influenzas.
53:05
Own on turnover and productivity, how to convert it to money, what intangibles are there.
53:13
Besides those two measures that she could connect to and calculating a fully loaded cost and then getting to the ROI because she wanted to show the roi of this one. That brings us into this challenge here.
53:27
How do we sort out the effects of what, what we’re doing and rechecked the three most credible purchase.
53:35
They’ll work most of the time. If not, we’re going to use estimates.
53:39
There’s always someone who can estimate it. That’s our fallback.
53:43
The experimental versus control group is one that we often think about. That’s a comparison group. one gets the program and another group doesn’t.
53:51
But let’s talk about trend line analysis.
53:53
I want to show you the trend line from chip’s case study, Jupp, who, the leader of the Kansas City SWAT team.
54:01
Here’s the complaints before the Outward Mindset Program was implemented.
54:06
You can see these complaints are going up and down, but hovering around a trend that’s flat and it’s too high.
54:17
But, following that trend, you can say if they if they continued, if they did nothing, it shouldn’t be here.
54:24
But it actually went to zero, and remain there, not over a year, but three years, 3.5 years.
54:33
Yeah, For this to work, two, to be able to say, we can use this difference as the improvement of this program.
54:43
The 2.7 per month, zero, is 2.7. To use that, we have to ask two conditions.
54:52
one of those conditions is here.
54:55
This trend is flat, and it’s high. What’s causing that?
54:59
And then the team spoke up and said, that number is, is driven by two factors, how many admissions we have, and the type of missions.
55:13
And so we asked, OK, during this year, after this program, did that stay the same? The answer was yes.
55:21
We actually interviewed these, this team, and they told us yes, we said, how do you know?
55:26
They said, Well, because we couldn’t believe that this improvement is all caused by what we changed, our own approach.
55:38
So dramatic, but we couldn’t see anything else.
55:42
Our missions didn’t change the type of emissions and that, so Wicket claimed that, Then we asked our second condition, just to make sure, we ask, is there anything else that the city did?
55:57
Anything else occur that would cause us to, to improve?
56:02
So, did you have something like a high profile incident that made the evening news?
56:07
Or, did you have the police commissioner saying, next, next time you get a complaint regarding farler old team?
56:13
No, those two things could affect it, but they both, They all set old seventies team members.
56:20
No, Nothing else Is there?
56:22
How do you know?
56:24
We know?
56:27
Because it’s our approach that was causing this, if something would have changed our approach and our behavior, we’d know about it.
56:34
It’s not there. So given that nothing else is there, we can claim this.
56:39
And that’s, that’s how this works.
56:42
We’re going to come back to, to this in a few minutes and show you the arawak calculation. This is one step, the process here.
56:49
Then, we go conversion.
56:52
How did you get it to money?
56:53
This is easier than we think. We use this term, standard value, is that means it’s already calculated and reported in the organization.
57:01
They had a $70,000 costs for a complaint that’s already calculated by request of the commissioner, it was there.
57:10
They call it a standard value, because we call it that because it’s already there.
57:15
If not, there’s often the people who capture the data.
57:19
That’s internal experts or maybe we could use external data in policing we can see this.
57:27
And then, or maybe estimate by someone. So, the point is, we can get there. That’s some money.
57:33
Then, we put all of the cost and to get the Roi all of the costs for the program.
57:40
The monetary benefits, I wanted to think about this calculation for a minute.
57:46
Oh, we calculate the benefits to be $70,000.
57:53
Excuse me.
57:56
$70,000 per complaint is two point one million dollars, Is the savings cost of this program is $36,055.
58:05
This is what it looks like.
58:08
You calculate, this is the calculation that’s in this case study.
58:13
You put these together, you get these numbers.
58:16
That’s a 58 to 1 cost benefit ratio of 5724% arawak.
58:23
That’s the highest roi we’ve ever seen. That’s one reason we want to report this, but it’s so credible.
58:29
It is so believable. This is based on one year.
58:32
That’s our standard when it’s a short-term solution.
58:35
It really drove more than this.
58:38
It’s incredible that passes muster of the chief financial officer.
58:43
It’s unbelievable all months, but just shows how behavior change we’ve connected to an impact measure that’s important, makes a difference.
58:52
Now, when you do all of this, you want to leverage it so quickly, Patti.
58:56
What does what how can we leverage the results of the Roi?
59:01
Well, we can do it in a number of ways. And so, one of the stories, we actually open the book up with this story, and we share this story. Everyone, can. It goes back to the first question, to ask.
59:10
It is, How do you work with programs that are honest, so intangible you just can’t see the value. Well, that’s the case of chaplaincy.
59:20
And so, Doug Stewart is the Chief Chaplain Memorial Health and Bellville, Illinois.
59:26
And he came to us when we started working with the chaplain’s back in 2006.
59:31
And we met the first workshop, or 50 or so chaplains, but Doug was one that really understood the processing and grasp the process.
59:40
And he knew that funding for chaplain’s at the organization was at risk.
59:47
So, he set up, gotta share the value.
59:49
He appreciated our approach, our methodology, and he did just that.
59:54
He actually looked at the value of having chaplain’s in the ICU and did a comparison group, 80 did it such a way that the decision makers and that organization bought it, they understood it. They viewed it as credible. He communicated.
1:00:11
How is approach?
1:00:12
The approach it communicated, what people thought, what people knew about it, what they learn from it, how the process worked, the impact to the hospital, and that impact was length of stay of these patients in the ICU. So, get them, get them help. They get them going.
1:00:28
He knew that engagement by the chaplain’s with the patient and the family.
1:00:34
It’s important that he convinced that the health care staff, surgical staff to integrate chaplaincy, not just as a stand-by. Now, not just to somebody over here.
1:00:45
No, in the event they need you, but really, a part of the team.
1:00:48
It was such an amazing approach and such an important factor, and not only protecting the budget and knowing that are really changing their approach to leveraging chaplains.
1:01:01
So, he told this story in such a way senior executives bought in.
1:01:06
Got it, understood that he’s leveraged that result, those results.
1:01:10
And he and I today, he’s Atlas Baker Circuit.
1:01:13
And then he cannot today go to many, many conferences where other chaplains attend and help them learn how they can demonstrate the value of their work in terms that resonate with those people or those entities finding their work. So, it’s just an amazing example of what you can do when you can tell your story in a way that resonates with the audiences that you’re trying to influence.
1:01:40
So, with that, do you want to go back to that, Jack?
1:01:44
That’s a life step, the bottom-up process.
1:01:47
But, it’s one that’s sometimes overlooked leveraging what you’re doing here.
1:01:51
So, let’s close out by asking, how will you use what you’ve gain today?
1:01:56
So, another poll, if you could, I’ll quickly see the results here, What you will do use as a result of your participation today, and we have the poll launched here, will give you a few seconds here to submit your answer, and then we’ll get the results up on the screen.
1:02:18
You see those results streaming in here, NaN.
1:02:35
This is? again, what? you have those Results.
1:02:46
Do you see those on your side?
1:02:50
Yes.
1:02:52
Yes, OK, good, nice.
1:02:57
So, Pat, do you want to comment on those?
1:02:59
Yeah, it’s, it’s, it’s great, There’s a lot going on, so, um, know, planning projects, designing for impact, was the one most frequent I selected, which is terrific, because you’re gonna have a better program, Easier evaluation when you do that.
1:03:16
Improve the objectives and use the objectives as they’re intended to be used.
1:03:20
A lot of times, we just couldn’t do it, because you think you’re supposed to have that, but actually right, good objectives. And then build the program around it.
1:03:28
And then evaluate programs to impact. So, what’s going on, this is great. We’d love to hear how it goes for you.
1:03:35
So here’s some next steps for you you might want to consider.
1:03:41
We’ve got We encourage you to order the book.
1:03:44
If you if if you want to order the book and you’re not satisfied with it, we’ll be happy to Refund all your costs for the book, cost plus shipping, and you keep the book.
1:03:59
If you, if your budget cannot Ford Books at this time, let us know, We can send you a copy of the book. We have a one day workshop around this book, its own, actually on March 23rd.
1:04:10
You might want to consider certification. That’s really the deep dive into this, or, if you need some help along the way, some coaching and consulting.
1:04:18
They’re all available.
1:04:20
Now, we’ve got some winners from the group.
1:04:22
So Melissa and CERA, tell us who the winners are.
1:04:31
Yes, we have Timothy B, Michel de, …, …, and Sage, who are all the winners of the book, drown today.
1:04:44
Aren’t regulations everyone. Lucky Draw with some winners.
1:04:48
So that’s good news.
1:04:49
We’ll be getting that out to you, and you got the resources here.
1:04:53
You remember you got a chapter in this book. You got the slides.
1:04:58
And you’ve got the handout.
1:05:01
That goes along with the workshop, as well.
1:05:04
And if you do want certification, this is available.
1:05:08
Live, virtual, in person, on Demand, all kinds of different ways, you can go there, and we will give 10% for.
1:05:17
people who are signing up for today’s webinar, So it’s chance to get HR, the Cube, remembers a discount here, as well.
1:05:27
CERA wrap it up with this.
1:05:30
Well, thanks, Jack and Patti, and thank you all for participating in today’s webinar. If you stuck around with us until the end of today’s event, you do qualify for SHRM recertification provider credit. And you’ll receive follow-up messaging: if you do qualify for hiking, receive your activity ID, and make sure that you join me for next week’s session. Same day, same time, “What TikTok Can Teach Us About Learning and Development”. Thank you so much for your time today and for a really informative session.
1:06:02
Thank you, Sarah. So it’s great to have worked with you, Sarah, and thank everyone for staying with us. We appreciate you.
1:06:07
If you need anything, please reach out OK, thank you, Have a good day.
1:06:13
Yes, Thank you all for participating in today’s webinar.