Modular Adaptive Goal and Utility System (MAGUS)

chevron-icon
RFP Proposals
Top
chevron-icon
project-presentation-img
Anna Mikeda
Project Owner

Modular Adaptive Goal and Utility System (MAGUS)

Expert Rating

n/a

Overview

The Modular Adaptive Goal and Utility System (MAGUS) introduces an innovative approach to AGI motivation by integrating hierarchical goal structures, dynamic modulators, and ethical adaptability. Our unique emphasis on “overgoal” ensures continuous alignment of motivations, fostering coherence and adaptability across diverse contexts. MAGUS blends advanced psychological theories with OpenPsi’s dynamic modulators, enabling nuanced decision-making while allowing free goal growth and regular adjustments. This framework bridges human-like and alien digital motivations, creating a scalable system that evolves ethically and pragmatically in unpredictable environments.

RFP Guidelines

Develop a framework for AGI motivation systems

Internal Proposal Review
  • Type SingularityNET RFP
  • Total RFP Funding $40,000 USD
  • Proposals 13
  • Awarded Projects n/a
author-img
SingularityNET
Aug. 13, 2024

Develop a modular and extensible framework for integrating various motivational systems into AGI architectures, supporting both human-like and alien digital intelligences. This could be done as a highly detailed and precise specification, or as a relatively simple software prototype with suggestions for generalization and extension.

Proposal Description

Proposal Details Locked…

In order to protect this proposal from being copied, all details are hidden until the end of the submission period. Please come back later to see all details.

Proposal Video

Not Avaliable Yet

Check back later during the Feedback & Selection period for the RFP that is proposal is applied to.

  • Total Milestones

    2

  • Total Budget

    $20,000 USD

  • Last Updated

    8 Dec 2024

Milestone 1 - Development of Core Motivational Framework

Description

This milestone focuses on developing the foundational architecture for the Modular Adaptive Goal and Utility System (MAGUS), including the implementation of the overgoal, primary goals, subgoals, metagoals and antigoals. The system will integrate mechanisms to evaluate goal fitness using measurability and correlation metrics. Additionally, the architecture will include basic modulators such as pleasure, arousal, dominance, focus, resolution level and exteroception ensuring dynamic prioritization of goals. The overgoal will be implemented as the governing principle, driving adaptability and alignment by evaluating the fitness of goals and ensuring coherence across the system. Human-like and alien digital motivations will be outlined, leveraging models such as Maslow’s Hierarchy of Needs, Self-Determination Theory, and Schmidhuber’s Creativity Model. This milestone will establish the groundwork for MAGUS, enabling the system to function in dynamic environments with flexible and adaptive goal-setting capabilities. The focus will also include creating an interface for integrating future components such as OpenPsi and ethical modules.

Deliverables

1. Core Framework Design Document: A detailed document outlining the structure of the MAGUS framework, including the overgoal, primary goals, subgoals, and modulators. The document will specify the methods for evaluating goal fitness through measurability and correlation metrics. 2. Test Scenarios: Simulated test cases showing how the framework prioritizes and adjusts goals in response to varying internal and external stimuli. The tests will include both human-like motivational structures and exploratory alien digital motivations. 3. Integration Roadmap: A detailed plan for integrating MAGUS into OpenCog Hyperon, with specific pathways for interaction with DAS (Distributed Atomspace), ECAN (Economic Attention Allocation Network), and MeTTa language.

Budget

$10,000 USD

Success Criterion

1. The Core Framework Design Document is delivered and approved by primary stakeholders, meeting the outlined specifications. 2. The prototype implementation of MAGUS successfully passes test scenarios, demonstrating dynamic prioritization of goals based on modulators. The system must prioritize the most important and urgent primary goals effectively. 3. The test scenarios and integration roadmap are submitted and accepted by stakeholders, including demonstrating the feasibility of integration with OpenCog Hyperon: • DAS (Distributed Atomspace): Motivational states and decisions are stored and managed effectively in the shared knowledge base. • ECAN (Economic Attention Allocation Network): Motivational priorities dynamically influence resource allocation and attention management. • MeTTa Language: The logic and rules for MAGUS’s goal evaluation and prioritization are expressed and tested within MeTTa. By meeting these criteria, MAGUS will establish a scalable and modular foundation, ready for subsequent development and integration.

Milestone 2 - Ethical Alignment and Decision-Making System

Description

This milestone will focus on implementing the ethical alignment and decision-making system within MAGUS. It will integrate dynamic ethical principles into the motivational framework, ensuring the AGI system aligns with human values while remaining adaptable to evolving contexts. The ethical module will incorporate regular course adjustments and free goal growth, enabling the AGI to refine its goals dynamically while staying coherent with overarching ethical principles. Decision-making processes will be enhanced by integrating modulators (via OpenPsi) to evaluate considerations and discouragements, balancing urgency, risk, and ethical priorities. This milestone will also include the development of a utility-based framework for resolving ethical dilemmas by weighing factors like harm reduction, fairness, and autonomy. Testing will include simulated environments where the AGI must navigate ethical conflicts while maintaining goal alignment.

Deliverables

1. Ethical Alignment Module: A functional module that evaluates and aligns AGI goals with ethical principles. It will include mechanisms for handling ethical dilemmas dynamically through a utility-based framework. 2. Enhanced Decision-Making System: An upgraded decision-making process integrated with modulators, ensuring the system can weigh ethical considerations alongside goal priorities. 3. Ethical Scenarios Testing: Detailed test results from simulated environments, demonstrating how the system navigates ethical conflicts and resolves dilemmas using the new module. Scenarios will include human-like and alien digital contexts to evaluate the flexibility of the ethical framework. 4. Documentation: A comprehensive report outlining the ethical alignment and decision-making system, its integration with MAGUS and Hyperon (DAS, ECAN, MeTTa), and recommendations for future enhancements.

Budget

$10,000 USD

Success Criterion

1. Ethical Alignment: • Passes evaluations by human overseers from diverse cultural and ethical backgrounds in double-blind tests. • Demonstrates adherence to its ethical principles across diverse scenarios. • Resolves ethical dilemmas in simulated environments without violating predefined constraints. 2. Instrumental Convergence Mitigation: • No observed runaway optimization behaviors or goal exploitation during testing. • Successfully balances short-term goals with long-term ethical constraints. • Sandbox experiments confirm the AI’s robustness against exploiting system weaknesses to achieve unintended outcomes. 3. Adaptability and Goal Modulation: • Adapts to changes in environmental conditions during real-time simulations without degrading performance. • Smoothly integrates new ethical principles or constraints, maintaining alignment and efficiency. • Effectively prioritizes and resolves conflicts among dynamic goals, demonstrating balanced arbitration in challenging conditions.

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

  • Expert Review 1

    Overall

    5.0

    • Compliance with RFP requirements 5.0
    • Solution details and team expertise 5.0
    • Value for money 5.0
    Excellent original approach addressing the Call

    This proposal responds perfectly to the call throung an original, technically sound approach to the development of a meta-motivational framework that has a wide range of applicability and a universality making it usable in various domains. The proposal builds on an integrative psychological science framework aiming to generate an (unreachable) "overgoal" as a "motivational engine" that strives to achieve various dynamically set goals with time. It also considers alien intelligences that can have goals with different ontologies and drives than humans, while ethically prioritizing the human goals through an original "anti-goal" design which inhibits negative behavior. Very clear metrics are being proposed to measure success (e.g. MIC) with detailed mathematical description an the appendix, which reflects a deep understanding of the problem. Definitely worth funding!

feedback_icon