Risk-aware Assessments of AI Algorithms

chevron-icon
Back
project-presentation-img
Completed 👍
Kenric Nelson
Project Owner

Risk-aware Assessments of AI Algorithms

Funding Awarded

$35,000 USD

Expert Review
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0
Community
Star Filled Image Star Filled Image Star Filled Image Star Filled Image Star Filled Image 0 (0)

Status

  • Overall Status

    🥳 Completed & Paid

  • Funding Transfered

    $25,000 USD

  • Max Funding Amount

    $35,000 USD

Funding Schedule

View Milestones
Milestone Release 1
$5,000 USD Transfer Complete TBD
Milestone Release 2
$1,000 USD Transfer Complete TBD
Milestone Release 3
$6,000 USD Transfer Complete TBD
Milestone Release 4
$5,500 USD Transfer Complete TBD
Milestone Release 5
$7,500 USD Transfer Complete TBD

Status Reports

Jan. 19, 2023

Status
😀 Excellent
Summary

The Data Generator project is on pause until the integration to the SingularityNET Publisher is resolved for the Risk Assessment project.

Full Report

Dec. 17, 2022

Status
😀 Excellent
Summary

Our team is on track. We delivered our first report in mid-July and plan to deliver our second report on August 12th.

Full Report

Dec. 6, 2022

Status
😀 Excellent
Summary

During the month of November our projects got stalled regarding the integration with SingularityNET. Our approach to resolving this problem has been two-fold. We reached back to SNET and got a commitment from Serguey Shalyapin for support and a data scientist new hire has agreed to review the issues.

Full Report

Oct. 26, 2022

Status
😀 Excellent
Summary

Doing terrific. We have submitted our third report describing the performance capabilities and limitations of the Assessment and Data Generator services.

Full Report

Video Updates

Photrek – Team Meeting 9.2

31 October 2023

Photrek – Team meeting 8

31 March 2023

Photrek – Team meeting 7

16 March 2023

Photrek team meeting 8

15 March 2023

Photrek – Team meeting 7

15 March 2023

Photrek – Team meeting 3

15 March 2023

Photrek – Team meeting 1

15 March 2023

Kickoff – Photrek

15 March 2023

Project AI Services

No Service Available

Overview

Photrek will provide risk-aware assessments of ML/AI algorithms. The assessments will use a generalization of information theory that incorporates a measure of risk tolerance. The SingularityNET community will benefit from the service by having access to tools that enhance SingularityNET applications and by the revenue generated by other users.

Proposal Description

Compnay Name

provides services to improve machine intelligence for complex systems. Photrek's current projects include environmental detection systems, decentralized governance, and development of risk-aware machine learning algorithms.

Problem Description

Machine Learning and Artificial Intelligence (ML/AI) algorithms are typically assessed using classification and information-theoretic techniques. These traditional methods do not account for the nonlinear risk tolerances required for real-life applications and so lead to overconfident forecasting.

Solution Description

Photrek will provide a service to the SingularityNet community by performing risk tolerance assessments of ML/AI algorithms. These Risk-Aware Assessments will be completed using the Nonlinear Statistical Coupling (NSC) generalization of information. NSC is a suite of methods designed to model the statistics of complex systems, including the risks associated with incomplete data, overfit models, unanticipated scenarios, and other factors degrading the tolerance of risk.

Project Benefits for SNET AI platform

The Photrek team will host on the SingularityNet marketplace a suite of assessment tools to assure that AI algorithms effectively manage risk. The Photrek team held problem-identifying meetings with SingularityDOA, SingularityNet, and Rejuve. These discussions identified a variety of applications that would benefit from a risk assessment. Examples include improved volatility metrics for financial markets, causality models used to assess the effects of climate change, and medical health affecting longevity.

Photrek’s services are guided by the NIST Risk Management Framework and other international guidelines in risk management. We focus our services on generalized information-theoretic metrics and fit within the broader issues of categorizing, implementing, and monitoring risk controls. We are committed to reducing ethical risks and are engaged in projects to strengthen environmental justice and promote financial liberty.

Competitive Landscape

As described in Nelson's lecture on Reduced Perplexity, Photrek offer’s a unique perspective on probabilistic metrics, which build from information theory but stay grounded in the use of probabilities rather than entropy and expand to generalizations of information theory that incorporate risk.  The purpose is twofold, a) to reduce the confusion in utilizing information-theoretic measures and b) to enable development teams to improve the accuracy and robustness of their algorithms. The competition continues to be focused on entropic measures.  While these are technically correct, their utilization is poorly understood even by experts. The extensions to incorporating risk involve a large variety of proposals, each of which involves complex mathematics.

Marketing & Competition

Robust, accurate forecasts are crucial for a variety of markets. As one example, Photrek recently completed an analysis of the severe weather forecasting market. The global weather forecasting systems market is anticipated to grow to $4 - $10 B by 2028 at a Compound Annual Growth Rate (CAGR) of between 5% to 8%, according to Emergen of British Columbia and Grand View Research of San Francisco, respectively (Grand View Research, 2020; Emergen, 2021). Both marketing reports cite big data analytics and the development of Internet-of-Things (IoT) and Artificial Intelligence (AI) capabilities as drivers of this growth. However, they indicate inconsistent and incomplete data along with the complexities of modeling and forecasting as limiting factors. 

To initiate our marketing efforts within the SingularityNET community, Photrek discussed modeling, data generation, and forecasting needs with three teams within the SingularityNET community, the Climate Sustainability team (Matt Ikle), the Singularity DOA team working on financial forecasting (Nejc Znidar), and the Rejuve on longevity (Deborah Duong). There was high interest in the ability to quantify not just the accuracy but the robustness of forecasts. In May, Photrek is scheduled to brief Ben Goertzel on the DC-VAE technology and we will be keen to leverage his guidance on working with developers in the SingularityNet community to measure the robustness of their algorithmic forecasts.

AI Services

Proposal Video

Placeholder for Spotlight Day Pitch-presentations. Video's will be added by the DF team when available.

  • Total Milestones

    5

  • Total Budget

    $35,000 USD

  • Last Updated

    11 Mar 2024

Milestone 1 - Project start

Status
😀 Completed
Description

Signed Contract

Deliverables

Budget

$5,000 USD

Link URL

Milestone 2 - Service Reqs

Status
😀 Completed
Description

Integration Design

Deliverables

Budget

$1,000 USD

Link URL

Milestone 3 - Service Integration

Status
😀 Completed
Description

Deliverables

Budget

$6,000 USD

Link URL

Milestone 4 - Report & Marketing

Status
😀 Completed
Description

Presentation & Paper

Deliverables

Budget

$5,500 USD

Link URL

Milestone 5 - Hosting Costs

Status
😀 Completed
Description

Collaboration with SNET

Deliverables

Budget

$7,500 USD

Link URL

Join the Discussion (0)

Reviews & Rating

New reviews and ratings are disabled for Awarded Projects

Sort by

0 ratings

Summary

Overall Community

0

from 0 reviews
  • 5
    0
  • 4
    0
  • 3
    0
  • 2
    0
  • 1
    0

Feasibility

0

from 0 reviews

Viability

0

from 0 reviews

Desirabilty

0

from 0 reviews

Usefulness

0

from 0 reviews