Ecosystem Evaluation System
Ecosystem is used to describe the health status of open source community standing from ecology context. We create a three-dimensional space for the evaluation system, including the open source ecosystem, "collaboration, people, software" and evaluation models.
Dimensions
Collaboration - Productivity
Definition: The efficiency with which an ecosystem or project converts inputs into output.
| Metrics Model Names | Descriptions |
|---|---|
| Collaboration Development Index | Use proxy metrics to evaluate how well the development process is managed and how well the community is doing with collaborative development. |
| Community Service and Support | It measures the quality of services and support provided by the community as directly perceived by a developer during the contribution process. |
Collaboration - Robustness
Definition: The capability of an ecosystem or project to face and survive disruptions.
| Metrics Model Names | Descriptions |
|---|---|
| Activity | Community Activity is used to describe how active an open source community is. |
Collaboration - Niche Creation
Definition: The capacity to create and recognize meaningful diversity and thereby new capabilities.
| Metrics Model Names | Descriptions |
|---|---|
| Organizations Activity | It is used to describe how active organizations are in a community. |
People-Productivity
定义：The efficiency with which an ecosystem or project converts inputs into output.
| Metrics Model Names | Descriptions |
|---|---|
| Contributor Domain Persona | |
| Contributor Milestone Persona | |
| Contributor Role Persona |
References:
- Open Source Community Health: Analytical Metrics and Their Corresponding Narratives 2021, Sean Goggins; Kevin Lumbard; Matt Germonprez
- Measuring the health of open source software ecosystems: Beyond the scope of project health 2014, SlingerJansen
- Defining and Evaluating a Measure of Open Source Project Survivability 2012, Uzma Raja; Marietta J. Tretter
- The Health Measurement of a Business Ecosystem 2006, Erik den Hartigh, Michiel Tol and Wouter Visscher
- Strategy as Ecology 2004, Marco Iansiti and Roy Levien
- Predators and prey: a new ecology of competition 1993, James F. Moore