Community Contribution Scores

chevron-icon
Back
project-presentation-img
Completed 👍
Kenric Nelson
Project Owner

Community Contribution Scores

Funding Awarded

$37,472 USD

Expert Review
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0
Community
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0 (0)

Status

  • Overall Status

    🥳 Completed & Paid

  • Funding Transfered

    $37,492 USD

  • Max Funding Amount

    $37,472 USD

Funding Schedule

View Milestones
Milestone Release 1
$6,245 USD Transfer Complete TBD
Milestone Release 2
$12,491 USD Transfer Complete TBD
Milestone Release 3
$12,491 USD Transfer Complete TBD
Milestone Release 4
$6,265 USD Transfer Complete TBD

Project AI Services

No Service Available

Overview

We support the processes around Deep Funding by developing a Contribution Score and community engagement process for users of SingularityNET. These scores are also known as Reputation Scores. In this Round 2 - Pool E: Tooling proposal we also establish the groundwork for creating a more general tool to benefit other organizations and make a user’s contribution score heritable across multiple platforms.

Proposal Description

Compnay Name

Photrek

Service Details

Proof of Concept Solution

As Proof of Concept (PoC), we will develop a software tool to immediately support the Deep Funding team in the analysis of user activity on its SWAE Community Portal. The goal is to automatically detect how members of the SingularityNET community engage constructively on the portal, both in regular Deep Funding rounds as well as Governance rounds. Community members can currently create project proposals, governance proposals, comments (strengths, risks, questions), reactions (a restricted set of emojis to express sentiments) and ratings (a numerical quality indicator for proposals). So far, all these interactions have been analyzed manually in spreadsheets by the Deep Funding team, which is both a time-consuming and error-prone process that is better suited to be done by a robust data integration and analysis pipeline. The aim of an initial software tool is therefore

  • to automate the process that was performed manually in spreadsheets, 

  • to introduce configurability to the performed calculations in order to enable experimentation with different evaluation approaches, and 

  • to make the chosen calculation process and retrieved results transparent to both the Deep Funding team and the SingularityNET community.

On its way to become a full-fledged DAO, SingularityNET continually tries to improve its approach towards community-driven governance, which requires continuous experimentation and analysis. Two methods that are currently used in Deep Funding are 1) incentivization of constructive community involvement by distributing AGIX rewards to members for their activity on SingularityNET's Community Portal on SWAE and 2) providing greater weight to the voices of engaged community members in voting rounds on SingularityNET's Voting Portal. The software tool proposed here will support both these approaches by providing quick and reliable analytics of community activity on SingularityNET's Community Portal, which will in turn influence the voting weights applied to results from SingularityNET's Voting Portal. As a Proof of Concept (PoC), it shall demonstrate that a configurable software tool for automated analysis has immediate practical value to both the Deep Funding team and the SingularityNET community by 1) increasing the ease and speed of experimentation in community-driven governance, 2) ensuring correctness and transparency in the applied calculation processes, and 3) in future enabling more complex experiments such as “liquid reputation”, where for example receiving positive feedback from a highly-engaged community member counts more than if the same is received from a newly created account.

The goal of this Proof of Concept (PoC) is to replace the current manual calculation of contribution scores in spreadsheets with an automated process that is reliable and transparent. The project scope is therefore given by the set of functionality required to replicate the results of previous rounds and then support future rounds. The following user-centered requirements and corresponding solutions are derived from this description: 

  • The Deep Funding team shall be enabled to automatically calculate contribution scores from data exported from the SWAE portal. The PoC will therefore be implemented as a web application with the following functionality: The front-end allows non-technical users to provide one or several tabular source files together with a set of configuration options that influence the downstream calculations. The back-end performs data inspection, pre-processing, calculation of scores and correctness checks. The resulting contribution scores are displayed on the front-end in the form of a table together with a description of the used configuration options. As an optional and experimental feature, the output may also contain a graph visualization similar to those that Robert Haas produced for Deep Funding round 1 and Governance round 1. It could provide an overview of all community interactions in a round and potentially highlight scores in the form of node and edge sizes. The feasibility and usefulness of such a visualization has to be tested on the actual data.

  • Results and methods of the calculation of contribution scores will be clearly communicated to community members of SingularityNET. The current practice by the Deep Funding team has been to communicate via blog posts and accompanying video presentations. To support this approach, the results from the front-end will be structured in such a way that they can be embedded directly into a blog post or hosted as a self-contained HTML site that can be referred to in an article. 

  • We will work with the Deep Funding team to reproduce the current manual calculation of contribution scores and then introduce desired variations. Please note that these scores reflect the activity of community members on SingularityNET’s Community portal on SWAE, but not their AGIX holdings or their activity on SingularityNET’s Voting portal. This means that the Deep Funding team will still need to perform some manual calculations, for example to derive voting power, which depends both on contributions scores and AGIX holdings. Future extensions of the tool might also automate these tasks by incorporating further data sources.

  • We will also work with the SWAE team to design the best format for the exported data in order to support the analysis desired by SingularityNET.

  • We will use a project structure that maximizes modularity, so it can be easily grown over time. This includes the choice of mature and scalable libraries to withstand expectable growth of both the community and desired features.

Specification of Future Product

The ultimate goal of this project is to develop a modular solution that supports other projects within the SingularityNET ecosystem, as well as external decentralized communities that use reputation-based mechanisms for their governance processes. This will be achieved through an iterative approach, paired with extensive user research, both for the potential users of the platform and the communities producing these scores. 

We develop specifications for a second phase project which detail the requirements and design considerations for a software tool to enable SingularityNET and other communities to collect contribution scores based on custom configurations. The specifications will outline ideas for extending the tool to involve additional stakeholders and generate value for a wider range of potential users. These specifications will be adaptive to allow for new use cases and the requirements of a more complete, sophisticated product including conceptual user interfaces.

We will produce a set of long term goals and a road map for achieving them. Through community engagement and user feedback, we ensure that the tool designs are continuously meeting the needs of its users and that ethical issues are well thought through and addressed.

Score Research and Community Engagement

The practice of rating users, corporations, and other entities is employed in a number of contexts. For example, Experian uses reputation scores to help businesses understand and contextualize their online reputation with scores on a 1,000 point scale. Other companies help businesses manage their reputations. Some scores, such as the reputation equation,  are simple

Reputation = Trust * Credibility + Time

Others, such as the

(CSRR) score are based on robust theoretical foundations and can be quite complicated. 

Credit Scores, for example Fair, Isaac, and Company (FICO) may have a proprietary construction based upon payment history, debt burden,  length of credit history or "time in file", types of credit used, and recent searches for credit. Nations also have rating systems, for example China Social Credit Scores.

We will conduct a thorough exploration of relevant reputation and contribution scores, explore best practices, and determine a set of principles and a procedure for the SingularityNET community to establish a framework for contribution scores. We will determine a list of potentially important variables, winnow to a more compact list of variables that contribute to the goal we are seeking to achieve, and develop a model that uses these variables to produce a score.

We will build a process for meaningful community input into the design of contribution scores. This will ensure transparency and help to develop community endorsement of the score. We do this in an environment mindful of clearly articulated ethical considerations. This will increase the ease and speed of experimentation in community-driven governance and ensure correctness and transparency in the applied calculation processes. The community will contribute to the development of values exposition, goals refinement, and contribute user knowledge. We will determine what can be meaningfully crowdsourced and what will be better designed by this team.

Program Management

Photrek is utilizing the principles of Sociocracy in completing the proposal and execution of the project. Sociocracy, invented by a Dutch entrepreneur, operates on three principles: a) formation of governance circles, b) decisions by group consent, and c) double linking of circles with both an appointed leader and an elected representative. John Buck, an American social scientist, has been an influential consultant with the Cardano Catalyst program. His book with Sharon Villines, “We the People: Consenting to a Deeper Democracy” will be used as a guide in the program management of Community Contribution Scores.

Photrek has formed a governance circle for its company, consisting of the current owner/employee, Kenric Nelson, and three contractors working with Nelson toward transitioning to an employee/owner model; William Thistleton, Megan Hess, and Blake Anderton. Likewise, the project team (Nelson, Thistleton, Haas, and Attieh) worked with our Advisor, Jan Horlings by group consent in completing the proposal. This was particularly valuable when Haas raised concerns about the scope and budget of the Proof of Concept. We were able to modify as a team the scope and budget of this part of the project to increase the probability of success and focus on the most critical capabilities.

One of the principles of sociocracy is that the full team shares in the profits of a project. Our budget includes a 5% management reserve. The team members have provided fixed prices for each of the deliverables but if unexpected issues arise requiring additional requirements the reserves will be used for this purpose. The remaining reserve will be split between the team members (proportional to their direct cost)  and Photrek (proportional to indirect costs) if it is not required to complete the project milestones. 

The facilitation of effective communication within the team and with the SingularityNET will be a priority. Thus, in addition to the milestone reporting, Photrek will host regular team meetings and participate in SingularityNET community meetings.

Problem Description

Organizations often need to make decisions and allocate resources based upon input from their users. A user’s engagement history and record of positive participation can be used to tailor their influence on these processes. In a flat system, members would have identically weighted votes. However, it is often useful to allocate influence based upon user attributes, such as a history of constructive community participation or the magnitude of assets within an organization. 

For example, within SingularityNET, users vote on proposals and invest in the community as reflected by their crypto-wallet. In particular, SingularityNET currently has two main use cases in which reputation or contribution scores play a role. 

  • In Deep Funding, users vote on proposals by giving them numerical grades from 1 to 10. Proposals must attract sufficient points to be eligible for funding. Funds are distributed to proposals in order of their aggregate grade until exhaustion of available resources. The voting power of users is influenced by their AGIX holdings on Ethereum and Cardano as well as their activity on the SWAE portal.

  • In Governance, users vote on questions regarding the direction of Deep Funding by selecting one out of multiple predefined answers. The voting power of users is again influenced by their AGIX holdings and their activity on the SWAE portal. 

The inspiration for this proposal comes from a desire to improve the current process of calculating user reputation scores for Deep Funding. The current system uses Quadratic Voting under which the square root of a user's balance partially determines the weight of the vote. High reputation on the portal is also given weight. This is an important consideration since it reduces the effect of wallet splitting, an inherent risk in quadratic voting.  The voting power calculation and analysis is currently done manually in spreadsheets. This process becomes increasingly tedious and error-prone as the number of participants grows. It is also susceptible to human error and lacks optimal transparency and explainability for the community.

From an organizational perspective, it is challenging to accurately track and calculate contribution scores across multiple platforms and topics. There doesn’t exist a tool where platforms can easily import data and calculate contribution scores based on different configurations. Also, users can not adjust their behaviors to be rewarded by adhering to the values of the community as reflected in voting power since the calculation is currently opaque. 

We will design a system informed by effectively managed input from the SingularityNET community. The system will allocate influence and quantify positive engagement for users in a transparent and reliable way consistent with SingularityNET community values.

Solution Description

Photrek solves the problem of designing transparent, best practice contribution scores by first building a Proof of Concept (PoC) product to solve SingularityNET’s most pressing needs. We also develop a Specification of Future Product through Score Research into best practices supported by a solid theoretical grounding based on current research literature. Execution of the project is supported by Program Management utilizing group consent to actively listen to concerns and collaboratively develop solutions. By engaging the SingularityNET Community for suggestions and guidance we will build valid and useful contribution or reputation scores and ensure that these scores reflect SingularityNET community values.

Milestone & Budget

This is a 4 month project, with milestones approximately evenly distributed in this time frame. For each milestone, the Program Management will include team and community meetings conducted using the principles of Sociocracy as well as written reports of milestone accomplishments.

Related Links

Blog articles that present previous manual calculations and graph visualizations:

 

Long Description

We support the processes around Deep Funding by developing a Contribution Score and community engagement process for users of SingularityNET. These scores are also known as Reputation Scores. In this Round 2 - Pool E: Tooling proposal we also establish the groundwork for creating a more general tool to benefit other organizations and make a user’s contribution score heritable across multiple platforms.

Many communities need to allocate attention and credibility to users based upon how they engage within the community. Some scores are descriptive of aggregate behavior (Redditmetis) and others seek to provide a quantitative rating (Metacritic and Fair Isaac Corporation, or FICO). This proposal will create the design for a Contribution Score based upon current industry wide best practices, academic research, and SingularityNET experience. These sorts of Contribution or Reputation Scores are vital for SingularityNET to support Deep Funding decisions and other areas where positive engagement can help determine a user’s level of organizational influence.

In this first stage proposal, we are focused on the needs of SingularityNET and will develop a process that engages the SingularityNET community as contributors to the creation of these Contribution Scores. This project will include a Proof of Concept (Poc) that the community can utilize immediately; specifications for a Future Product that will establish the requirements for an API and include partners such as SWAE; and Score Research that will provide a solid foundation for the communities knowledge-base. Future work will also design an adaptive tool so that multiple communities can tailor the Contribution Score approach to better reflect their own values and needs.

The Photrek team will work closely with our advisors, Jan Horlings, SingularityNET VP of Product, and Soushiant Zanganehpour, SWAE CEO.

AI Services

Proposal Video

Community Contribution Scores

13 February 2023
  • Total Milestones

    4

  • Total Budget

    $37,472 USD

  • Last Updated

    8 Mar 2024

Milestone 1 - Kick-off

Status
😀 Completed
Description

Meetings with the Deep Funding team to specify the current calculation process and desired variations. Communication with the SWAE team about the required content and structure of data exports. Specification of future product: Design first iteration of the product document including outlining the product vision, identifying stakeholders, defining scope, identifying high level requirements and roadmap. The team will also gather input and feedback from SingularityNET Deep Funding and other potential users to validate the product's design and ensure it meets their needs. Score research and community engagement: Identification of existing reputation and contribution scores in current use outside of SingularityNET, produce report summarizing literature review and the results of environmental scanning, including a description of best practices and how these may be integrated into a second phase project.

Deliverables

Budget

$6,245 USD

Link URL

Milestone 2 - Design

Status
😀 Completed
Description

Creation of a data model that fits to current requirements and can be extended for future demands. Beginning implementation of the contribution score calculation on example data. Specification of future product: This phase will focus on gathering requirements for the Minimum Viable Product (MVP). To accomplish this, the team will work closely with the Deep Funding team to understand the calculations performed using the voting portal data, and how they can be integrated within the tool. The team will also investigate the desired outputs and explore ways to enhance the tool to support more advanced calculations and experiments. Score research and community engagement: Build robust plan for community engagement specifying target group of users (the sampling frame), processes for engaging these users, and the desired feedback from the community.

Deliverables

Budget

$12,491 USD

Link URL

Milestone 3 - Implementation

Status
😀 Completed
Description

Finished implementation of the contribution score calculation. Unit and integration tests against manually created input-output pairs to ensure correctness of different calculation variants. Specification of future product: This phase will focus on the design of the Minimum Viable Product (MVP). To achieve this, the team will work closely with the Deep Funding team to understand user flows and evaluate design artifacts. Additionally, the team will conduct user research by reaching out to other platforms within the SNET ecosystem. This will allow the team to create designs that are future-proof and able to adapt to the evolving needs of stakeholders with agile processes for development. Score research and community engagement: Begin to enhance second phase designs based upon the results of the information obtained from community engagement.

Deliverables

Budget

$12,491 USD

Link URL

Milestone 4 - Launch & Report

Status
😀 Completed
Description

Creation of a web application with a simple front-end and contribution score calculation in the back-end. Deployment of the final tool on a server of SingularityNET, so the Deep Funding team can access and use the PoC tool. Specification of future product: This phase will focus on designing the iterations that will be developed beyond the MVP, based on the user research and feedback gathered in previous stages. The team will also work on creating effective processes for collecting community feedback once the PoC is live and the contribution score calculations are transparent. This will ensure that the tool is continuously meeting the needs of its users and can be adapted to new use cases and requirements as they arise. Score research and community engagement: Finalize community contributions to MVP and report to SingularityNET community about PoC processes.

Deliverables

Budget

$6,265 USD

Link URL

Join the Discussion (0)

Reviews & Rating

New reviews and ratings are disabled for Awarded Projects

Sort by

0 ratings

Summary

Overall Community

0

from 0 reviews
  • 5
    0
  • 4
    0
  • 3
    0
  • 2
    0
  • 1
    0

Feasibility

0

from 0 reviews

Viability

0

from 0 reviews

Desirabilty

0

from 0 reviews

Usefulness

0

from 0 reviews