The evaluation of open source software innovativeness
Keywords:
open source, logiciel libre, innovation, innovation utilisateurs, innovation distribuée, multiméthodologieAbstract
Product innovation assessment in software sector is a timely topic. Nevertheless, research on that subject is particularly scant. As a result there is a lack of criteria to measure software innovativeness. In a context of theoretical and practical controversy in the open source field, this article assesses open source software innovativeness. Based on almost 500 cases studies and with the collaboration of 125 experts from industry, services and research fields, it suggests an innovation typology supported by the notion of functional added value. It provides also an innovation modelling framework that combines main evaluation methodologies. By showing the shortcomings of widely used innovation metrics, this research supports a new approach of innovativeness assessment specialized in each sector.References
Afuah, Allan. (2000) "How much do your co-opetitors' capabilities matter in the face of technological change?" Strategic Management Journal, Vol. 21, n°3: p. 397-404.
Agerfalk, Pär J. et Brian Fitzgerald. (2008) "Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy." MIS Quarterly, Vol. 32, n°2: p. 385-409.
Allen, Robert C. (1983) "Collective Invention." Journal of Economic Behavior and Organization, Vol., n°4: p. 1-24.
Beaudry, Anne et Alain Pinsonneault. (2005) "Understanding User Responses to Information Technology: A Coping Model of User Adaptation." MIS Quarterly, Vol. 29, n°3: p. 493-524.
Benkeltoum, Nordine. (2011) Gérer et comprendre l'open source. Paris: Presses des Mines.
Benlian, Alexander. (2011) "Is traditional, open-source, or on-demand first choice[quest] Developing an AHP-based framework for the comparison of different software models in office suites selection." European Journal of Information Systems, Vol. 20, n°5: p. 542-559.
Bitzer, Jürgen et Philip J. H. Schröder. (2005) "Bug-fixing and code-writing: the private provision of open source software." Information Economics and Policy, Vol. 17, n°3: p. 389-406.
Bogers, Marcel, Allan Afuah, et Bettina Bastian. (2010) "Users as Innovators: A Review, Critique, and Future Research Directions." Journal of Management, Vol. 36, n°4: p. 857-875.
Bonaccorsi, Andrea, Silvia Giannangeli, et Cristina Rossi. (2006) "Entry Strategies Under Competing Standards: Hybrid Business Models in the Open Source Software Industry." Management Science, Vol. 52, n°7: p. 1085-1098.
Burns, Robert et Richard Burns. (2008) Business Research Methods and Statistics Using SPSS. London: Sage Publications Ltd.
Capiluppi, Andrea, Cornelia Boldyreff, et Klaas-Jan Stol. (2011) "Successful Reuse of Software Components: A Report from the Open Source Perspective Open Source Systems: Grounding Research." Pp. 159-176, vol. 365, IFIP Advances in Information and Communication Technology, edited by S. Hissam, B. Russo, M. de Mendonça Neto, and F. Kon: Springer Boston.
Capra, Eugenio, Chiara Francalanci, Francesco Merlo, et Cristina Rossi-Lamastra. (2011) "Firms’ involvement in Open Source projects: A trade-off between software structural quality and popularity." Journal of Systems and Software, Vol. 84, n°1: p. 144-161.
Chandy, Rajesh K. et Gerard J. Tellis. (1998) "Organizing for Radical Product Innovation: The Overlooked Role of Willingness to Cannibalize." Journal of Marketing Research, Vol. 35, n°November: p. 474-487.
Chen, Daoyi, Shahriar Shams, César Carmona-Moreno, et Andrea Leone. (2010) "Assessment of open source GIS software for water resources management in developing countries." Journal of Hydro-environment Research, Vol. 4, n°3: p. 253-264.
Christensen, Clayton M. (1997) The Innovator's Dilemma: When New Technologies Cause Great Firms to Fail. Boston, Massachusetts: Harvard Business School Press.
—. (2006) "The Ongoing Process of Building a Theory of Disruption." Journal of Product Innovation Management, Vol. 23: p. 39-55.
Christensen, Clayton M. et Michael Overdorf. (2000) "Meeting the Challenge of Disruptive Change." Harvard Business Review, Vol. March–April: p.
Christensen, Clayton M. et Michael E. Raynor. (2003) The Innovator’s Solution: Creating and sustaining successful growth. Boston, Massachusetts: Harvard Business School Press.
CIGREF. (2011) "Maturité et gouvernance de l’Open Source - La vision des grandes entreprises." CIGREF, Paris.
Dahlander, Linus et Martin W. Wallin. (2006) "A man on the inside: Unlocking Communities as complementary assets." Research Policy, Vol. 35, n°7: p. 1243-1259.
Danneels, Erwin. (2004) "Disruptive Technology Reconsidered: A Critique and Research Agenda." Journal of Product Innovation Management, Vol. 21: p. 246-258.
—. (2006) "From the Guest Editor Dialogue on the Effects of Disruptive Technology on Firms and Industries." Journal of Product Innovation Management, Vol. 23: p. 2-4.
Deek, Fadi P. et James A. McHugh. (2007) Open Source: Technology and Policy. New York: Cambridge University Press.
del Bianco, Vieri , Luigi Lavazza, Sandro Morasca, et Davide Taibi. (2009) "Quality of Open Source Software: The QualiPSo Trustworthiness Model." Pp. 199-212 in Open Source Ecosystems: Diverse Communities Interacting, 13th International Conference on Open Source Systems, IFIP, edited by C. Boldyreff, K. Crowston, B. Lundell, and A. I. Wasserman. Skövde, Sweden: Springer.
Dewar, Robert D et Jane E. Dutton. (1986) "The Adoption of Radical and Incremental Innovations: an Empirical Analysis." Management Science, Vol. 32, n°11: p. 1422-1433.
Dhanaraj, Thakur. (2012) "A limited revolution — The distributional consequences of Open Source Software in North America." Technological Forecasting and Social Change, Vol. 79, n°2: p. 244-251.
Ebert, Christof. (2007) "Open Source Drives Innovation." IEEE Software, Vol. 24, n°3: p. 105-109.
—. (2008) "Open Source Software in Industry." IEEE Software, Vol. 25, n°3: p. 52-53.
Eisenhardt, Kathleen M. (1989) "Building Theories from Case Study Research." The Academy of Management Review, Vol. 14, n°4: p. 532-550.
Eisenhardt, Kathleen M. et Melissa E. Graebner. (2007) "Theory building from cases: opportunities and challenges." Academy of Management Journal, Vol. 50, n°25-32: p.
Ettlie, John E., William P. Bridges, et Robert D. O'Keefe. (1984) "Organization strategy and structural differences for radical versus incremental innovation." Management Science, Vol. 30, n°6: p. 682-695.
Fearon, C. et G. Philip. (1998) "Self assessment as a means of measuring strategic and operational benefits from EDI: the development of a conceptual framework." European Journal of Information Systems, Vol. 7, n°1: p. 5-16.
Feller, Joseph, Patrick Finnegan, Brian Fitzgerald, et Jeremy Hayes. (2008) "From Peer Production to Productization: A Study of Socially Enabled Business Exchanges in Open Source Service Networks." Information Systems Research, Vol. 19, n°4: p. 475-493.
Fitz-Gerald, Stuart. (2010) "K. Vadera, B. Gandhi, Open Source Technology (2009) University Science Press, Laxmi Publications, New Delhi, pp. 173." International Journal of Information Management, Vol. 30, n°4: p. 374.
Fitzgerald, B. (1997) "The use of systems development methodologies in practice: a field study." Information Systems Journal, Vol. 7, n°3: p. 201-212.
Fitzgerald, Brian. (2006) "The Transformation of Open Source Software." MIS Quarterly, Vol. 30, n°3: p. 587-598.
Franke, Nikolaus, Martin Schreier, et Ulrike Kaiser. (2009) "The “I Designed It Myself” Effect in Mass Customization." Management Science, Vol., n°Article in advance: p. 125-140.
Franke, Nikolaus et Eric von Hippel. (2003) "Satisfying heterogeneous user needs via innovation toolkits: the case of Apache security software." Research Policy, Vol. 32: p. 1199-1215.
Free Software Foundation. (2007) "Announcing ncurses 5.6."
http://www.gnu.org/software/ncurses/ncurses.html
Fuggetta, Alfonso. (2003) "Controversy Corner: Open source software an evaluation." The Journal of Systems and Software, Vol., n°66: p. 77-90.
Gallupe, Brent, Alan Dennis, William Cooper, Joseph Valacich, Lana Bastianutti, et Jay Nunamaker. (1992) "Electronic Brainstorming and Group Size." The Academy of Management Journal, Vol. 35, n°2: p. 350-369.
Garcia, Rosanna et Roger Calantone. (2002) "A critical look at technological innovation typology and innovativeness terminology: a literature review." Journal of Product Innovation Management, Vol. 19: p. 110-132.
Gary, Kevin, Andinet Enquobahrie, Luis Ibanez, Patrick Cheng, Ziv Yaniv, Kevin Cleary, Shylaja Kokoori, Benjamin Muffih, et John Heidenreich. (2011) "Agile methods for open source safety-critical software." Software: Practice and Experience, Vol. 41, n°9: p. 945-962.
Glaser, Barney G. et Anselm L. Strauss. (1967) The discovery of grounded theory: strategies for qualitative research: Transaction Publishers.
Haefliger, Stefan, Georg von Krogh, et Sebastian Spaeth. (2008) "Code Reuse in Open Source Software." Management Science, Vol. 54, n°1: p. 180-193
Hamerly, Jim, Tom Paquin, et Susan Walton. (1999) "Freeing the Source: The Story of Mozilla." Pp. 197-206 in Open Sources: Voices from the Open Source Revolution, edited by C. DiBona, S. Ockman, and M. Stone. Sebastapol, CA: O'Reilly.
Hars, Alexander et Shaosong Ou. (2002) "Working for Free? Motivations for Participating in Open-Source Projects." International Journal of Electronic Commerce, Vol. 6., n°3: p. 25-39.
Hicks, Christian et Dessislava Pachamanova. (2007) "Back-propagation of user innovations: The open source compatibility edge." Business Horizons, Vol. 50: p. 315–324.
Irani, Z. et P. E. D. Love. (2001) "Information systems evaluation: past, present and future." European Journal of Information Systems, Vol. 10, n°4: p. 183-188.
Janamanchi, Balaji, Evangelos Katsamakas, Wullianallur Raghupathi, et Wei Gao. (2009) "The State and Profile of Open Source Software Projects in health and medical informatics." International Journal of Medical Informatics, Vol. 78, n°7: p. 457-472.
Jeppesen, Lars Bo et Lars Frederiksen. (2006) "Why Do Users Contribute to Firm-Hosted User Communities? The Case of Computer-Controlled Music Instruments." Organization Science, Vol., n°17: p. 45-63.
Klincewicz, Krzysztof. (2005) "Innovativeness of open source software projects." Pp. 11-31: School of Innovation Management, Tokyo Institute of Technology.
Kogut, Bruce et Anca Metiu. (2001) "Open-Source Software Development and Distributed Innovation." Oxford Review of Economic Policy, Vol. 17, n°2: p. 248-263.
Kozinets, Robert V. (2002) "The Field Behind the Screen: Using Netnography for Marketing Research in Online Communities." Journal of Marketing Research, Vol. XXXIX p. 61-72.
—. (2006) "Click to Connect: Netnography and Tribal Advertising." Journal of Advertising Research, Vol., n°September: p. 279-288.
Lakhani, Karim et Eric von Hippel. (2003) "How open source software works: "free" user-to-user assistance." Research Policy, Vol. 32, n°6: p. 923-943.
Le Masson, Pascal , Benoit Weil, et Armand Hatchuel. (2010) Strategic Management of Innovation and Design. New York: Cambridge University Press.
Le Texier, Thomas et David W. Versailles. (2009) "Open Source Software Governance Serving Technological Agility: The Case of Open Source Software within the DoD." International Journal of Open Source Software and Processes (IJOSSP), Vol. 1, n°2: p. 14-27.
Lee, Gwendolyn K. et Robert E. Cole. (2003) "From a Firm-Based to a Community-Based Model of Knowledge Creation: The Case of the Linux Kernel Development." Organization Science, Vol. 14, n°6: p. 633-649.
Lee, Mae Lyn et Joseph Davis. (2003) "Evolution of Open Source Software: A Study on the Samba Project." Système d'Information et Management, Vol. 8, n°1: p. 43-62.
Lee, Sang-Yong Tom, Hee-Woong Kim, et Sumeet Gupta. (2009) "Measuring open source software success." Omega, Vol. 37, n°2: p. 426-438.
Lindman, Juho, Matti Rossi, et Anna Puustell. (2011) "Matching Open Source Software Licenses with Corresponding Business Models." IEEE Software, Vol. 28, n°4: p. 31-35.
Lisein, Olivier, François Pichault, et James Desmecht. (2009) "Les business models des sociétés de services actives dans le secteur Open Source." Systèmes d'Information et Management, Vol. 14, n°2: p. 7-38.
Livari, Netta. (2010) "Discursive construction of ‘user innovations’ in the open source software development context." Information and Organization, Vol. 20, n°2: p. 111-132.
Lundell, Björn, Brian Lings, et Edvin Lindqvist. (2010) "Open source in Swedish companies: where are we?" Information Systems Journal, Vol. 20, n°6: p. 519-535.
MacCormack, Alan, John Rusnak, et Carliss Y. Baldwin. (2006) "Exploring the Structure of Complex Software Designs: An Empirical Study of Open Source and Proprietary Code." Management Science, Vol. 52, n°7: p. 1015-1030.
Midha, Vishal et Prashant Palvia. (Forthcoming) "Factors affecting the success of Open Source Software." Journal of Systems and Software, Vol.: p.
Miles, Matthew B. et A. Michael Huberman. (1994) Qualitative Data Analysis: SAGE Publications, Inc.
Mingers, John. (2000) "Variety is the spice of life: combining soft and hard OR/MS methods." International Transactions in Operational Research, Vol. 7, n°6: p. 673-691.
—. (2003) "The paucity of multimethod research: a review of the information systems literature." Information Systems Journal, Vol. 13, n°3: p. 233-249.
—. (2011) "Ethics and OR: Operationalising discourse ethics." European Journal of Operational Research, Vol. 210, n°1: p. 114-124.
Mingers, John et John Brocklesby. (1997) "Multimethodology: Towards a framework for mixing methodologies." Omega, Vol. 25, n°5: p. 489-509.
MinGW Team. (2008) "Minimalist GNU for Windows"
Miralles, Francesc, Sandra Sieber, et Josep Valor. (2006) "An Exploratory Framework for Assessing Open Source Software Adoption." Système d'Information et Management, Vol. 11, n°1: p. 85-103.
Nambisan, Satish , Ritu Agarwal, et Mohan Tanniru. (1999) "Organizational mechanisms for enhancing user innovation in information technology." MIS Quarterly, Vol. 23, n°3: p. 365-395.
Nuvolari, Alessandro. (2004) "Collective invention during the British Industrial Revolution: the case of the Cornish pumping engine." Cambridge Journal of Economics, Vol. 28, n°3: p. 347-363.
Osterloh, Margit et Sandra Rota. (2007) "Open source software development: Just another case of collective invention?" Research Policy, Vol. 36: p. 157-171.
Paulson, James W., Giancarlo Succi, et Armin Eberlein. (2004) "An Empirical Study of Open-Source and Closed-Source Software Products." IEEE Trans. Softw. Eng., Vol. 30, n°4: p. 246-256.
Pinsonneault, Alain et Kenneth L. Kraemer. (1993) "Survey Research Methodology in Management Information Systems: An Assessment." Journal of Management Information Systems, Vol. 10, n°2: p. 75-105.
Rossi, Cristina. (2009) "Software innovativeness. A comparison between proprietary and Free/Open Source solutions offered by Italian SMEs." R&D Management, Vol. 39, n°2: p.
Rowe, Gene et George Wright. (1999) "The Delphi technique as a forecasting tool: issues and analysis." International Journal of Forecasting, Vol. 15: p. 353–375.
Rowe, Gene et George Wright. (1996) "The impact of task characteristics on the performance of structured group forecasting techniques." International Journal of Forecasting, Vol. 12, n°1: p. 73-89.
Shah, Sonali K. (2006) "Motivation, Governance, and the Viability of Hybrid Forms in Open Source Software Development." Management Science, Vol. 52, n°7: p. 1000-1014.
Sigfridsson, Anders et Anne Sheehan. (2011) "On qualitative methodologies and dispersed communities: Reflections on the process of investigating an open source community." Information and Software Technology, Vol. 53, n°9: p. 981-993.
Spaeth, Sebastian, Matthias Stuermer, et Georg von Krogh. (2010) " Enabling Knowledge Creation Through Outsiders: Towards a Push Model of Open Innovation." International Journal of Technology Management, Vol. 52, n°3/4: p. 411-431.
Spiller, Dorit et Thorsten Wichmann. (2002) "FLOSS Final Report - Part 3: Basics of Open Source Software Markets and Business Models." Berlecon Research GmbH.
Spinellis, Diomidis, Georgios Gousios, Vassilios Karakoidas, Panagiotis Louridas, Paul J. Adams, Ioannis Samoladas, et Ioannis Stamelos. (2009) "Evaluating the Quality of Open Source Software." Electronic Notes in Theoretical Computer Science, Vol. 233: p. 5-28.
Stallman, Richard. (1983) "Free Unix"
http://www.gnu.org/gnu/initial-announcement.html
—. (2002) "Obstructing Custom Adaptation of Programs." Pp. 124-125 in Free Software, Free Society: Selected Essays of Richard M. Stallman, edited by J. Gay. Boston: Gnu Press.
Stewart, Katherine J. et Sanjay Gosain. (2006) "The impact of ideology on effectiveness in open source software development teams." MIS Quarterly, Vol. 30, n°2: p. 291-314.
Stuermer, Matthias. (2009) "How Firms Make Friends: Communities in Private-Collective Innovation, Doctoral Dissertation." Chair of Strategic Management and Innovation, Department of Management, Technology, and Economics, ETH Zürich, Zürich.
Stuermer, Matthias, Spaeth Sebastian, et Georg von Krogh. (2009) "Extending private-collective innovation: a case study." R&D Management, Vol. 39, n°2: p. 2009.
Taibi, Davide, Luigi Lavazza, et Sandro Morasca. (2007) "OpenBQR: a framework for the assessment of OSS." Pp. 173-186 in Open Source Development, Adoption and Innovation, vol. 234, Open Source Development, Adoption and Innovation, edited by IFIP. Boston: Springer.
Ulhoi, John P. (2004) "Open source development: a hybrid in innovation and management theory." Management Decision, Vol. 42, n°9: p. 1095-1114.
Veryzer Jr., Robert W. (1998) "Key factors affecting customer evaluation of discontinuous new products." Journal of Product Innovation Management, Vol. 15, n°2: p. 136-150.
von Hippel, Eric. (2005) Democratizing Innovation. Cambridge: MIT Press.
—. (2010) "Chapter 9 - Open User Innovation." Pp. 411-427 in Handbook of the Economics of Innovation, vol. Volume 1, edited by B. H. Hall and N. Rosenberg: North-Holland.
von Hippel, Eric et Georg von Krogh. (2003) "Open Source Software and the “Private-Collective” Innovation Model: Issues for Organization Science." Organization Science, Vol. 14, n°2: p. 209-223.
von Krogh, Georg et Sebastian Spaeth. (2007) "The open source software phenomenon: Characteristics that promote research." Journal of Strategic Information Systems, Vol. 16: p. 236-253.
von Krogh, Georg, Sebastian Spaeth, et Karim Lakhani. (2003) "Community, Joining, and Specialization in Open Source Software Innovation: a case study." Research Policy, Vol. 32: p. 1217-1241.
West, Joel et Siobhán O’Mahony. (2005) "Contrasting Community Building in Sponsored and Community Founded, Open Source Projects." Pp. 1-10 in Proceedings of the 38th Annual Hawaii International Conference on System Sciences. Waikoloa, Hawaii IEEE.
Published
How to Cite
Issue
Section
License
The author bears the responsibility for checking whether material submitted is subject to copyright or ownership rights (e.g. figures, tables, photographs, illustrations, trade literature and data). The author will need to obtain permission to reproduce any such items, and include these permissions with their final submission.
It is our policy to ask all contributors to transfer for free the copyright in their contribution to the journal owner. There are two broad reasons for this:
- ownership of copyright by the journal owner facilitates international protection against infringement of copyright, libel or plagiarism;
- it also ensures that requests by third parties to reprint or reproduce a contribution, or part of it, in either print or electronic form, are handled efficiently in accordance with our general policy which encourages dissemination of knowledge within the framework of copyright.
In conformity with the French law, the author keeps the 'moral rights' related to the article:
- The 'authorship right': It is the author's right to have his name associated with each publication and exploitation of the article.
- The 'integrity right': It can be claimed by the author if he finds that during an exploitation, his work has been distorted (cutting, reassembly...).
