Evolving Knowledge Structures

chevron-icon
RFP Proposals
Top
chevron-icon
project-presentation-img
evolveai
Project Owner

Evolving Knowledge Structures

Expert Rating

n/a

Overview

The best use of the evolutionary process is to reward and evolve meaningful structure within complex systems. The proposed research will explore the development of new evolutionary processes for evolving DNNs with intrinsic functional and semantic decomposition. This will support rapid development of novel DNN architectures that are composable, extensible and able to be grounded to the real world, while being naturally transparent rather than opaque.

RFP Guidelines

Evolutionary algorithms for training transformers and other DNNs

Internal Proposal Review
  • Type SingularityNET RFP
  • Total RFP Funding $40,000 USD
  • Proposals 8
  • Awarded Projects n/a
author-img
SingularityNET
Aug. 12, 2024

Explore and demonstrate the use of evolutionary methods (EMs) for training various DNNs including transformer networks. Such exploration could include using EMs to determine model node weights, and/or using EMs to evolve DNN/LLM architectures. Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is an example of one very promising evolutionary method among others.

Proposal Description

Proposal Details Locked…

In order to protect this proposal from being copied, all details are hidden until the end of the submission period. Please come back later to see all details.

Proposal Video

Not Avaliable Yet

Check back later during the Feedback & Selection period for the RFP that is proposal is applied to.

  • Total Milestones

    2

  • Total Budget

    $40,000 USD

  • Last Updated

    8 Dec 2024

Milestone 1 - Interim report

Description

The interim report will present the results of the research conducted and methods developed with a focus on evolving architecture.

Deliverables

Report on progress

Budget

$20,000 USD

Success Criterion

Show clear translation of research concepts into MeTTa, with results from preliminary experiments demonstrating feasibility of operators for decomposition and composition of DNNs and leveraging prior training.

Milestone 2 - Final Report and demonstration

Description

Final report and associated demonstration summarizing the research performed with an additional emphasis compared to the first milestone on localized evolution of network weights and the exploration of grounding methods

Deliverables

Report and demonstration of working code performing evolution of DNN within Hyperon.

Budget

$20,000 USD

Success Criterion

Evolutionary process within Hyperon shows tangible benefits in either evolution of architecture or localized evolution of weights, ideally in both. Establish potential feasibility of grounding methods, though prototyping and testing of semantic grounding are out of scope due to computational resources required.

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

    No Reviews Avaliable

    Check back later by refreshing the page.

feedback_icon