A service provided by the WU Library and the WU IT-Services

SROI as a Method for Evaluation Research: Understanding Merits and Limitations

Maier, Florentine and Schober, Christian and Simsa, Ruth and Millner, Reinhard (2015) SROI as a Method for Evaluation Research: Understanding Merits and Limitations. voluntas, 26 (5). pp. 1805-1830. ISSN 09578765

[img]
Preview
PDF
Download (224Kb) | Preview

Abstract

NPOs and their funders are increasingly drawn to the Social Return on Investment (SROI) method to evaluate the social impact of programs, organizations or organization networks. While many claims about the benefits of SROI have been expressed, various points of criticism have also been raised. On the basis of both current research and our own experience in conducting SROI analyses, we develop a comprehensive assessment of this method, which is structured along two dimensions: the observer's paradigmatic perspective, on the one hand, and positive or negative valuation, on the other. We identify two major merits: SROI analysis can provide legitimacy to NPOs or their funders, and it can assist in allocating resources. We identify limitations from three perspectives: From an interpretative-sociological perspective, criticism of commensuration and utilitarianism calls the method as a whole into question. From a technical-instrumental perspective, there are a number of difficulties that could however be overcome as the method matures. From an intermediary perspective, a number of limitations become apparent that, while inherent to SROI analysis, are no reason for abandoning it, as long as they are thoroughly understood. We conclude by providing suggestions for the responsible use of SROI analysis. (authors' abstract)

Item Type: Article
Additional Information: To see the final version of this paper please visit the publisher's website. Access to the published version may require a subscription. The original publication is available at http://link.springer.com/ .
Keywords: SROI analysis / Evaluation / Methodology / Impact measurement / Social impact / Social Return on investment
Divisions: Departments > Management > Nonprofit Management
Version of the Document: Draft
Variance from Published Version: Minor
Depositing User: ePub Administrator
Date Deposited: 03 Sep 2014 13:26
Last Modified: 19 Aug 2016 11:41
Related URLs:
FIDES Link: https://bach.wu.ac.at/d/research/results/67972/
URI: http://epub.wu.ac.at/id/eprint/4289

References

Antonaras, A., Iacovidou, M., & Memtsa, C. 2011. Measuring social return on investment using the EBEN GR Business Ethics Excellence Model. Verslo ir teisis aktualijos / Current Issues of Business and Law, 6(1): 69-89.

Arvidson, M., & Lyon, F. forthcoming. Social Impact Measurement and Non-profit Organisations: Compliance, Resistance, and Promotion. Voluntas: 1-18.

Arvidson, M., Lyon, F., McKay, S., & Moro, D. 2010. The ambitions and challenges of SROI. Working Paper. TSRC Third Sector Research Centre, 49.

Balser, D., & McClusky, J. 2005. Managing stakeholder relationships and nonprofit organization effectiveness. Nonprofit Management and Leadership, 15(3): 295-315.

Cheney, A. L., Merchant, K. E., & Killins, R. 2013. Impact Investing: A 21st Century Tool to Attract and Retain Donors. The Foundation Review, 4(4): 45-56.

Chmelik, E. R. 2012. Measures of performance in the context of international social enterprise. Unpublished Master Thesis, San Diego State University.

Christensen, R. A., & Ebrahim, A. 2006. How does accountability affect mission? The case of a nonprofit serving immigrants and refugees. Nonprofit Management & Leadership, 17(2): 195-209.

Dees, J. G. 2012. A Tale of Two Cultures: Charity, Problem Solving, and the Future of Social Entrepreneurship. Journal of Business Ethics, 111(3): 321-334.

Ebrahim, A. 2005. Accountability Myopia: Losing Sight of Organizational Learning. Nonprofit and Voluntary Sector Quarterly, 34(1): 56-87.

Ebrahim, A., & Rangan, V. K. 2010. The Limits of Nonprofit Impact: A Contingency Framework for Measuring Social Performance, Harvard Business School Working Papers: Harvard Business School.

Edwards, R., Smith, G., & Büchs, M. 2010. Mainstreaming the environment through performance management?, NCVO/VSSN.

Emerson, J., & Cabaj, M. 2000. Social return on investment. Making Waves, 11(2): 10-14.

Emerson, J., Wachowicz, J., & Chun, S. 2000. Social return on investment: Exploring aspects of value creation in the nonprofit sector. The Box Set: Social Purpose Enterprises and Venture Philanthropy in the New Millennium, 2: 130-173.

Espeland, W. N., & Stevens, M. L. 1998. Commensuration as a social process. Annual review of sociology: 313-343.

Fulbright-Anderson, K., & Auspos, P. (Eds.). 2006. Community Change: Theories, Practice, and Evidence. Washington, D.C.: The Aspen Institute Roundtable on Community Change.

Gair, C. 2002. A report from the good ship SROI. San Francisco: The Roberts Foundation.

Gair, C. 2009. SROI Act II: A Call to Action for Next Generation SROI. San Francisco: REDF.

Gordon, M. 2009. Accounting for making a difference, Social Enterprise Magazine. November. Hall, M. forthcoming. Evaluation logics in the third sector. Voluntas: 1-30.

Jardine, C., & Whyte, B. 2013. Valuing Desistence? A Social Return on Investment Case Study of a Throughcare Project for Short-Term Prisoners. Social and Environmental, Accountability Journal, 33(1): 20-32.

Kant, I. 1994. Ethical Philosophy (second ed.). Indianapolis, Indiana: Hackett Publishing Company.

Kara, H. 2013. Research and Evaluation for Busy Practitioners: A Time-saving Guide: The Policy Press.

Kehl, K., & Then, V. 2009. Analytischen Tiefgang wagen!-Vom "Social Return on Investment "zur sozioökonomsichen Mehrwertanalyse. BBE-Newsletter, 15: 1-14.

Keynes, J. M. 1965. The General Theory of Employment, Interest, and Money. Orlando: First Harvest/Harcourt.

Klausner, M. 2003. When time isn't money: Foundation payouts and the time value of money. Stanford Social Innovation Review,, 1(1): 51-59.

Laskowski, W., & Kellem, R. 2008. Social Return on Investment (SROI)-Ein Vergleich von Modellen zur Darstellung sozialer und ökonomischer Leistungen in sozialen Diensten.

In R. Schauer, B. Helmig, R. Purtschert, & D. Witt (Eds.), Steuerung und Kontrolle in Nonprofit-Organisationen: 379-396. Wiesbaden: DUV-Gabler.

Lingane, A., & Olsen, S. 2004. Guidelines for Social Return on Investment. California Management Review, 46(3): 116-135.

Luke, B., Barraket, J., & Eversole, R. 2013. Measurement as legitimacy versus legitimacy of measures-Performance evaluation of social enterprise. Qualitative Research in Accounting & Management, 10(3/4): 234-258.

Manetti, G. forthcoming. The Role of Blended Value Accounting in the Evaluation of Socio-Economic Impact of Social Enterprises. Voluntas: 1-22.

Meldrum, B. 2011. An African model of Social Impact Measurement: testing European knowledge in the context of social innovations in the Western Cape region of South Africa, The Business of Social and Environmental Innovation Conference. Cape Town.

Mildenberger, G., & Münscher, R. 2009. "Social Return on Investment"-Ein vielversprechender Ansatz zur Wirkungsmessung im Dritten Sektor. BBE-Newsletter, 15: 2009.

Millar, R., & Hall, K. 2013. Social Return on Investment (SROI) and Performance Measurement: The Opportunities and Barriers for Social Enterprises in Health and Social Care. Public Management Review, 15(6): 923-941.

More-Hollerweger, E., Pervan Al-Soqauer, I., & Pervan, E. 2013. Studie zum gesellschaftlichen und ökonomischen Nutzen der staatlich anerkannten Schuldenberatungen in Österreich mittels einer SROI-Analyse, Projektendbericht:NPO&SE Kompetenzzentrum der WU Wien.

Nicholls, J., Lawlor, E., Neitzert, E., & Goodspeed, T. 2012. A guide to Social Return on Investment: The SROI Network.

Olsen, S., & Lingane, A. 2003. Social return on investment: Standard guidelines: Center for Responsible Business.

Pawson, R. 2002. Does Megan's Law Work?: A Theory-driven Systematic Review, ESRC UK Centre for Evidence Based Policy and Practice London, Working Paper 8.

Pawson, R. 2006. Evidence-based policy: A realist perspective. London: Sage.

Pervan-Al Soqauer, I., Pervan, E., & Rauscher, O. 2013. SROI-Analyse des Projekts "Footprint" für Betroffene von Frauenhandel, Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Pervan-Al Soqauer, I., Schober, C., Peric, N., & Gosch, T. 2013. Studie zum gesellschaftlichen und ökonomischen Nutzen der Miteinander leben - Organisation für Betreutes Wohnen GmbH mittels SROI-Analyse, Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Polonsky, M., & Grau, S. L. 2011. Assessing the social impact of charitable organizationsfour alternative approaches. International Journal of Nonprofit & Voluntary Sector Marketing, 16(2): 195-211.

Rauscher, O., & Pervan-Al Soqauer, I. 2012. SROI-Analyse "Starthilfe Wohnen", Projektendbericht. NPO&SE Kompetenzzentrum der WU Wien.

Rauscher, O., Schober, C., More-Hollerweger, E., & Pervan-Al Soqauer, I. 2011. Social Return on Investment (SROI)-Analyse für das Projekt "Casa Abraham", Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Rauscher, O., & Sprajcer, S. 2012. SROI-Analyse des Projekts "Das gute Holz. Mit sozialem Engagement gegen den Klimawandel", Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

REDF. 2000. SROI Methodology. San Francisco: Roberts Enterprise Development Fund.

Ryan, P. W., & Lyne, I. 2008. Social enterprise and the measurement of social value: methodological issues with the calculation and application of the social return on investment. Education, Knowledge & Economy, 2(3): 223-237.

Schober, C., More-Hollerweger, E., & Rauscher, O. 2012. SROI-Analyse der Feuerwehren in Oberösterreich, Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Schober, C., & Rauscher, O. 2011. SROI-Analyse des "Ideen gegen Armut"-Siegerprojekts 2009: "Spenden Sie ihre alte Waschmaschine! Die öko-soziale Umverteilung von Waschmaschinen und Geschirrspülern", Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Schober, C., Schober, D., Peric, N., & Pervan, E. 2012. Studie zum gesellschaftlichen und ökonomischen Nutzen der mobilen Pflege- und Betreuungsdienste in Wien mittels einer SROI-Analyse, Projektendbericht: NPO&SE Kompetenzzentrum der WU Wien.

Steinke, I. 2004. Quality criteria in qualitative research. In U. Flick, E. Kardoff, & I. Steinke (Eds.), A companion to qualitative research: 184-190. London et al.: Sage.

Stevenson, N., Taylor, M., Lyon, F., & Rigby, M. 2010. Joining the dots: Social Impact Measurement, commissioning from the Third Sector and supporting Social Enterprise Development: mutual advantage, EEDA, Social Enterprise East of England, Improvement East, The Guild, Middlesex University.

Actions

View Item