Question of Semantics

chevron-icon
RFP Proposals
Top
chevron-icon
project-presentation-img
evolveai
Project Owner

Question of Semantics

Expert Rating

n/a

Overview

Assessment of solution quality at a semantic level is limited in current MOSES approach. In order to support the long-term vision of AGI, the proposed effort will enhance MOSES to use LLMs to integrate qualitative assessments of individual solutions and solution sets. Several methods will be explored to augment classic fitness assessment and meta-optimization with search suggestions that will enable MOSES to identify and explore high-value areas in a complex, multi-objective and subjective space.

RFP Guidelines

Utilize LLMs for modeling within MOSES

Internal Proposal Review
  • Type SingularityNET RFP
  • Total RFP Funding $150,000 USD
  • Proposals 10
  • Awarded Projects n/a
author-img
SingularityNET
Oct. 9, 2024

This RFP invites proposals to explore the integration of LLMs into the MOSES evolutionary algorithm. Researchers can pursue one of several approaches, including generation modeling, fitness function learning, fitness estimation, investigation into domain-independent “cognitively motivated” fitness functions, or propose new innovative ways to leverage LLMs to enhance MOSES's capabilities within the OpenCog Hyperon framework.

Proposal Description

Proposal Details Locked…

In order to protect this proposal from being copied, all details are hidden until the end of the submission period. Please come back later to see all details.

Proposal Video

Not Avaliable Yet

Check back later during the Feedback & Selection period for the RFP that is proposal is applied to.

  • Total Milestones

    2

  • Total Budget

    $80,000 USD

  • Last Updated

    8 Dec 2024

Milestone 1 - Integrate LLM for Domain-Specific Fitness Eval

Description

Integrate the LLM to enhance the fitness evaluation function by incorporating domain-specific factors into the evaluation process.

Deliverables

Demonstration of integration

Budget

$40,000 USD

Success Criterion

Evolutionary process produces solutions that incorporate desired quantitative and qualitative characteristics.

Milestone 2 - Meta-Optimization with LLM Feedback

Description

Refine the meta-optimization process by integrating LLM feedback into the evolutionary search. The aim is to ensure that the search process is guided toward more meaningful solutions leveraging domain-specific insights from the LLM.

Deliverables

Recommendations for making targeted use of LLMs in future MOSES applications with strategies for incorporating domain-specific factors and optimizing multi-objective search. Performance benchmarks comparing MOSES’s performance with and without LLM guidance including computational costs and solution quality. Demonstration of best practices for balancing competing objectives using LLM-driven insights with an emphasis on effective integration. Open-source release of functional code for methods developed.

Budget

$40,000 USD

Success Criterion

Evolutionary process adapts to produce solutions that effectively balance multiple quantitative and qualitative factors. Ideally, solutions are more effective, more appropriate qualitatively, and achieved with low additional computational cost.

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

    No Reviews Avaliable

    Check back later by refreshing the page.

feedback_icon