Posts »

Evaluation and Learning

SAIE has always been committed to evaluating its work, independent of stakeholder accountability issues, because of its interest in learning and improving practice. A summary of the main reasons and goals for evaluation for SAIE are:

To learn
To be accountable to all stakeholders
To improve practice and the impact of interventions
To understand the impact SAIE is having
To understand what triggers or programme elements are most effective for helping participants
Generous SAIE donors have supported a range of evaluations for the organisation, including a pilot schools’ evaluation using rigorous quasi-experimental methods as well as a wider roll out evaluation using this methodology that was reported on in the 2005 Global Entrepreneurship Monitor (GEM Report) done by the UCT Graduate School of Business’ Centre for Entrepreneurship and Innovation

SAIE’s overall evaluation approaches, and especially approaches for impact evaluation, were outlined in last year’s annual report. While the two evaluations mentioned above showed positive impact results, they also raised important questions about appropriate evaluation methodologies for SAIE’s purposes. Reflecting on this process led us on a journey towards more comprehensive evaluation processes that include both quantitative and qualitative methods, and more specifically our efforts to develop our EntrEval framework. The exciting possibilities for EntrEval emerged after learning of three organisations’* struggles to measure the effectiveness and impact of leadership development programmes. Leadership development is an area of practice that shares with entrepreneurship development the problem of trying to facilitate change in complex, open-system environments. It too grapples with the complex challenges of evaluating the evidence and impact of this change.

Briefly, the EntrEval framework is guiding SAIE to gather hard evidence and more evocative stories and examples of programme impact at the levels of individuals, partner organisations and wider communities or society. These various forms of evidence will also be organised around three result types or levels of change:

Immediate or episodic: more predictable, tangible, short term results discernible immediately after programme intervention
Developmental: more open-ended, less predictable and less controllable changes that occur over time and represented as sequences in a dynamic process. They show differences in pace or rhythm among different individuals.
Transformative: fundamental shifts in values and perspective preceding fundamental shifts in behaviour and or performance; often the prize which programs aim for.
EntrEval progress in 2007 and early 2008 consisted mainly of undertaking rigorous assessment of SAIE’s current evidence collection processes and content. This has lead to significant reviews of indicators for each of SAIE’s programmes and to the development of a master list of key indicators. We have explored a range of appropriate data gathering methodologies and selected some to pilot test. Some questions and the gathering personal stories and examples of programme impact have been field-tested.

We have clarified the core importance of tracking changes in individuals. This has lead us to identify these as trainers or facilitators we equip to use our programmes and then of ‘end-user’ participants in SAIE programmes. The overall EntrEval framework has been changed to make it 4 levels instead of 3 (which take into consideration the splitting of the individual impact level into one for facilitators and one for participants).

An exciting element has been the establishment and holding of meetings with an excellent expert reference team to critique the emerging framework. These have lead to fruitful discussions around the core of entrepreneurship.

Major EntrEval development plans for 2008 are to:

Develop core reports and reporting options
Visit active programmes (field visits) to test the various data gathering methods
Get feedback from regular meetings of the expert reference team
Embed the emerging EntrEval framework into all SAIE forms and programmes
Train and support SAIE staff and partner organisations in the use of EntrEval
Start to embed EntrEval into the Management Information System.
We are acutely aware of the need to be able to give our donors feedback on the impact of their investments into entrepreneurship education development particularly. Many of the projects are long term with participants often starting as young as six years old. Our goal is to ensure that from as young as this, right through to adults, we can inculcate innovation and creative entrepreneurial, action-oriented mindsets. EntrEval is being designed to ensure that we are collecting evidence early enough to be able to make meaningful assessments as to the efficacies of our efforts.

*The Sustainable Leadership Institute, WK Kellogg Foundation and USAID developed a ‘best practice’ evaluation approach in the field of leadership development, EvaluLEAD, and, with permission, SAIE is adapting and contextualizing this approach for entrepreneurship development under the name EntrEval.


33 Comments

  • bbuy cheap jerseys china cheap football jerseys china cheap kobe jersey

  • It?s hard to find educated people for this topic,
    however, you sound like you know what you?re talking about!
    Thanks

  • cheap mlb jerseys fгom usa seattle seahawks jersey
    cheap cheap jerseys 2 үοu

  • baseball uniforms fоr sale chea plain soccer jerseys

  • Loving the info on this site, you have done outstanding job on the blog posts.

  • I like this site very much, Its a really nice place to read and incur information. “God cannot alter the past, but historians can.” by Samuel Butler.

  • Thanks for another informative website. Where else could I get that kind of information written in such a perfect way? I have a project that I am just now working on, and I have been on the look out for such information.

  • Good info. Lucky me I reach on your website by accident, I bookmarked it.

  • see here now says:

    I wish to express some thanks to this writer for rescuing me from this particular problem. Right after searching throughout the the net and meeting ideas which are not powerful, I thought my entire life was gone. Being alive devoid of the answers to the difficulties you have fixed as a result of the write-up is a critical case, and those that might have badly damaged my entire career if I hadn’t noticed the blog. The mastery and kindness in taking care of every aspect was very useful. I don’t know what I would’ve done if I hadn’t come across such a subject like this. I can at this point look forward to my future. Thanks so much for your professional and results-oriented help. I won’t think twice to suggest your web blog to any individual who will need assistance about this subject.

  • I’m truly enjoying the design and layout of your site. It’s a very easy on the eyes which makes it much more pleasant for me to come here and visit more often. Did you hire out a developer to create your theme? Exceptional work!

  • What’s Going down i’m new to this, I stumbled upon this I have found It absolutely useful and it has aided me out loads. I’m hoping to contribute & assist other users like its helped me. Great job.

  • I like what you guys are up also. Such clever work and reporting! Keep up the superb works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site 🙂

  • I have been exploring for a little for any high-quality articles or weblog posts in this sort of area . Exploring in Yahoo I finally stumbled upon this site. Reading this information So i’m happy to convey that I have a very just right uncanny feeling I came upon exactly what I needed. I most certainly will make certain to don’t forget this site and give it a look regularly.

  • Hiya very cool site!! Man .. Beautiful .. Superb .. I’ll bookmark your web site and take the feeds also?KI am happy to seek out a lot of useful information here within the publish, we need develop extra strategies on this regard, thanks for sharing. . . . . .

  • Currently it appears like Movable Type is the preferred blogging platform available right now. (from what I’ve read) Is that what you’re using on your blog?

  • Simply want to say your article is as surprising. The clearness on your post is simply excellent and that i could suppose you are knowledgeable in this subject. Fine together with your permission let me to clutch your RSS feed to keep up to date with drawing close post. Thank you a million and please carry on the rewarding work.

  • You are a very capable person!

  • I reckon something really interesting about your web site so I saved to my bookmarks.

  • Hello, i think that i saw you visited my website thus i came to “return the favor”.I’m attempting to find things to enhance my site!I suppose its ok to use a few of your ideas!!

  • Hello, Neat post. There is an issue with your site in web explorer, could test thisK IE nonetheless is the marketplace leader and a huge portion of other people will leave out your excellent writing due to this problem.

  • Pretty nice post. I just stumbled upon your weblog and wished to say that I’ve really enjoyed browsing your weblog posts. In any case I’ll be subscribing to your rss feed and I am hoping you write once more soon!

  • Hello. excellent job. I did not expect this. This is a impressive story. Thanks!

  • The root of your writing while sounding agreeable initially, did not really sit well with me personally after some time. Someplace within the sentences you were able to make me a believer unfortunately just for a short while. I still have a problem with your jumps in logic and one would do nicely to fill in those gaps. In the event you can accomplish that, I could undoubtedly be fascinated.

  • neck tie says:

    It¦s actually a nice and useful piece of information. I am glad that you shared this helpful info with us. Please keep us informed like this. Thanks for sharing.

  • Thank you for the sensible critique. Me and my neighbor were just preparing to do some research on this. We got a grab a book from our area library but I think I learned more clear from this post. I’m very glad to see such wonderful info being shared freely out there.

  • I conceive other website owners should take this internet site as an model, very clean and superb user pleasant pattern.

  • What i do not understood is actually how you are not actually much more well-liked than you might be right now. You’re very intelligent. You realize therefore significantly relating to this subject, produced me personally consider it from numerous varied angles. Its like men and women aren’t fascinated unless it is one thing to do with Lady gaga! Your own stuffs outstanding. Always maintain it up!

  • Glad to be one of the visitants on this awe inspiring site : D.

  • vpn翻墙 says:

    Wow! This blog looks exactly like my old one! It’s on a totally different topic but it has pretty much the same page layout and design. Superb choice of colors!

  • content says:

    I beloved as much as you’ll obtain performed proper here. The cartoon is tasteful, your authored material stylish. however, you command get got an impatience over that you want be turning in the following. sick without a doubt come more formerly once more as exactly the similar nearly a lot regularly inside case you shield this increase.

  • Some times its a pain in the ass to read what website owners wrote but this internet site is rattling user genial! .

  • this article says:

    As a Newbie, I am permanently exploring online for articles that can aid me. Thank you

Leave a Reply

Your email address will not be published.