HDC Neural-Symbolic Integration POCs

chevron-icon
RFP Proposals
Top
chevron-icon
project-presentation-img
Expert Rating 3.8
simuliinc
Project Owner

HDC Neural-Symbolic Integration POCs

Expert Rating

3.8

Overview

The proposal outlines the integration of Hyperdimensional Computing (HDC) for neural-symbolic integration within Hyperon. We plan for 4 POCs developed in Python compatible with Hyperon. The project spans 6 months with a $80,000 budget across 5 milestones: HDC core implementation, PyNeuraLogic integration, AIRIS, and KANs framework development, and final framework integration. The solution promises better scalability and flexibility than competing approaches while maintaining interpretability.

RFP Guidelines

Neuro-symbolic DNN architectures

Complete & Awarded
  • Type SingularityNET RFP
  • Total RFP Funding $160,000 USD
  • Proposals 9
  • Awarded Projects 2
author-img
SingularityNET
Oct. 4, 2024

This RFP invites proposals to explore and demonstrate the use of neuro-symbolic deep neural networks (DNNs), such as PyNeuraLogic and Kolmogorov Arnold Networks (KANs), for experiential learning and/or higher-order reasoning. The goal is to investigate how these architectures can embed logic rules derived from experiential systems like AIRIS or user-supplied higher-order logic, and apply them to improve reasoning in graph neural networks (GNNs), LLMs, or other DNNs.

Proposal Description

Company Name (if applicable)

Simuli Inc.

Project details

Performance Metrics

  • 4 demos for HDC use in neurosymbolic DNNs

  • Benchmark comparative analysis of different HDC approaches

  • Published Literature Review

  • Hyperon benefits and integration roadmap

  • Successful integration with both PyNeuraLogic, AIRIS, and KANs architectures

  • Demonstration of higher order reasoning in HDC enable neuro-symbolic DNN

Usefulness

This project addresses a critical need in AGI development by providing an efficient mechanism to combine neural and symbolic approaches with hyperdimensional computing (HDC). By leveraging HDC, we enable:

  • Seamless integration of multiple AI models through symbolic gluing

  • Efficient memory representations for large-scale knowledge

  • Dynamic adaptation and online learning capabilities

  • Interpretable representations of neural network decisions

  • Reduced computational overhead for model integration

Problem Description

Hyperon requires effective mechanisms to integrate diverse neural architectures like PyNeuraLogic and KANs while maintaining symbolic reasoning capabilities. Current approaches face challenges in:

  • Scalable integration of multiple neural networks

  • Efficient memory representation of learned knowledge

  • Combining symbolic rules with neural processing

  • Real-time adaptation and learning

  • Maintaining interpretability across integrated systems

Solution Description

We propose integrating HDC-based neural-symbolic integration into Hyperon using three approaches:

  1. HD-Glue: A proven technique for combining neural networks and rule bases systems through hyperdimensional representations (e.g. to attach models to hyperon DAS efficiently)

  2. Hyperdimensional Computing Infrastructure: enabling symbolic-reasoning integration using HDC engine couped to logic based rule systems

  3. A novel fully neuro-symbolic HDC based approach for higher-order reasoning and experiential learning rule embedding with symbolic reasoning capabilities.

Key components:

  • Analysis of approaches in relation to solutions for Hyperon

     

  • Literature review publication of current neuro-symbolic methods, related technologies, and analysis tools for data-driven vs symbolic reasoning abilities
  • 4 documented, benchmarked, demo, and code library POCs integrating KANs, AIRIS, PyNeurologic, and novel HDC model
  • Report on challenges and opportunities of HDC enabled neurosymbolic DNNs, scalability, explainability, and Hyperon integration roadmap

Longer Description

The solution leverages recent advances in hyperdimensional computing to evaluate neural-symbolic integration approaches. Building on published research showing HDC's effectiveness in model combination and memory efficiency, we will:

  1. Create a literature review

    • in depth analysis of rule bases systems with DNNs for symbolic reasoning

  2. Integrate with Existing Components:

    • Interface with PyNeuraLogic for logic programming integration

    • Interface with KANs for continuous function approximation

    • Interface with AIRIS

  3. Develop Supporting Infrastructure:

    • design a fully HDC novel approach for symbolic reasoning with rule based logic

       

  4. Explore how Hyperon could use such an approach to connect rule based systems to the atom space
    • analysis of approaches for Hyperon purposes
    • integration roadmap

Competition and USP

Unique Selling Points:

  • First implementation of HDC rule and symbolic model

  • Benchmark performance improvements in 3 HDC symbolic reasing engine for rule systems approaches

  • Efficient memory utilization through hyperdimensional representations

  • Support for both experiential and higher-order learning rule embeddings in symbolic embeddngs

  • Able to solve Hyperon integration challenges

Competitive Advantages:

  • More efficient than traditional ensemble methods

  • Better scalability than direct neural-symbolic integration

  • Lower memory footprint than competing approaches

  • More flexible adaptation to new data

  • Stronger theoretical foundation in hyperdimensional computing

Open Source Licensing

GNU GPL - GNU General Public License

Proposal Video

Not Avaliable Yet

Check back later during the Feedback & Selection period for the RFP that is proposal is applied to.

  • Total Milestones

    5

  • Total Budget

    $80,000 USD

  • Last Updated

    8 Dec 2024

Milestone 1 - HDC Neural-Symbolic Core Implementation

Description

Development of the core hyperdimensional computing infrastructure for neural-symbolic integration including implementation of HDC-Glue for combining neural networks and basic symbolic operations. This foundation will enable the efficient representation and manipulation of both neural network outputs and symbolic rules in hyperdimensional space. Construct scientific methods for design and testing of HDC enabled neuro-symbolic DNNs.

Deliverables

Literature review suitable for peer reviewed publication of current neuro-symbolic DNNs in relation to experiential rule vs higher-order reasoning abilities with comparative analysis of explainability learning efficiency (data operations) structured learning application as well as a comparative analysis of scalability challenges and technical details between logic based rule systems. We will describe and motivate with prior literature two approaches that can be achieved with HDC. First that HDC can act as a symbolic-reasoning engine to rule based systems to bridge the gap between data-driven and symbolic reasoning models. Secondly an approach to a novel neruo-symbolic model using HDC. Performance benchmarking framework/methods for benchmarking efficiency including tracking amount of learning operations per data unit as well as design of analysis methods of in depth capabilities of the system for logic rule embedding POC designs for integrating KANs AIRIS and PyNeurologic with metrics plan for higher order reasoning and efficiency improvements of current methods Documentation of existing and possible solutions using HDC as a core symbolic engine for rule-based systems POC design for a new neuro-symbolic DNN using HDC cable of experiential learning and higher-order reasoning

Budget

$20,000 USD

Success Criterion

Submission of literature review to peer reviewed journal Documentation of POC designs for using HDC as the symbolic reasoning engine to enable logic rule based systems for AIRIS, KANs, and PyNeurologic reviewed by AIRIS, KANs, PyNeurologic, and HDC experts Benchmark analysis tools and report framework template Documentation of POC design for novel HDC model data-driven and symbolic reasoning model

Milestone 2 - PyNeuraLogic HDC Integration Layer

Description

Development of the interface layer between PyNeuraLogic and the HDC core enabling the translation of differentiable logic programming constructs into hyperdimensional representations. This includes mechanisms for encoding logical rules and their gradients in hypervector space.

Deliverables

PyNeuraLogic-HDC interface library Logic rule encoding modules Gradient translation mechanisms Integration test suite Documentation on technical and practical use of the model Example implementations

Budget

$15,000 USD

Success Criterion

Demo of the POC Code and tools for the POC Documentation of the POC including graphics and tutorials Benchmarks reported Reviewed by PyNeurologic expert

Milestone 3 - KANs Hyperdimensional Framework

Description

Implementation of the HDC integration layer for Kolmogorov Arnold Networks focusing on representing continuous functions in hyperdimensional space while preserving KANs' mathematical properties and learning capabilities.

Deliverables

KANs-HDC interface library Continuous function encoding modules Learning rule translation layer Comprehensive test suite Integration examples Technical documentation

Budget

$15,000 USD

Success Criterion

Demo of the POC Code and tools for the POC Documentation of the POC including graphics and tutorials Benchmarks reported Reviewed by KAN expert

Milestone 4 - AIRIS HDC Integration Layer

Description

Implementation of the HDC integration layer for AIRIS system focusing on representing higher-order reasoning in hyperdimensional space while preserving efficiency and probabilistic causality rule based learning.

Deliverables

AIRIS-HDC interface library Rule based embedding layer A-priori knowledge synthesis layer Integration examples Technical documentation

Budget

$15,000 USD

Success Criterion

Demo of the POC Code and tools for the POC Documentation of the POC including graphics and tutorials Benchmarks reported Reviewed by AIRIS expert

Milestone 5 - Novel Neural-Symbolic POC

Description

Final integration of all components into a cohesive neural-symbolic framework including comprehensive testing optimization and documentation of the complete system. POC of new HDC based DNN demonstrating both experiential and higher-order reasoning learning.

Deliverables

Complete integrated system Performance analysis and tools User documentation Integration guides Benchmark results Comparative analysis of HDC approaches Hyperon integration roadmap plan

Budget

$15,000 USD

Success Criterion

Demo of the POC Code and tools for the POC Documentation of the POC including graphics and tutorials Benchmarks reported Report on the POCs in relation to HDCs role in challenges and opportunities in neuro-symbolic DNNs Roadmap for how HDC can be useful in Hyperon with a plan of integration verified by Hyperon team

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

Group Expert Rating (Final)

Overall

3.8

  • Compliance with RFP requirements 4.0
  • Solution details and team expertise 3.8
  • Value for money 3.8

Proposal received high ratings from reviewers but experts ultimately selected another winner for strategic relevance. Potential interest in funding this work in a subsequent round.

  • Expert Review 1

    Overall

    3.0

    • Compliance with RFP requirements 3.0
    • Solution details and team expertise 2.0
    • Value for money 0.0
    Does not provide much details only provides 2 references.

    The proposal does not provide much details onto how the AIRIS rules will be represented. It only provides generic explanation and 2 references to the publication and some document.

  • Expert Review 2

    Overall

    5.0

    • Compliance with RFP requirements 5.0
    • Solution details and team expertise 5.0
    • Value for money 0.0
    Very strong

    Strong alignment with RFP goals, focusing on scalable neuro-symbolic integration using HDC. Clear milestones with well-defined deliverables, including POCs, benchmarks, and roadmap. Promises efficient memory use, dynamic learning, and explainable reasoning. Concerns about HDC scalability and technical complexity in integrating diverse architectures like PyNeuraLogic and KANs. Credible team. High potential for funding.

  • Expert Review 3

    Overall

    2.0

    • Compliance with RFP requirements 2.0
    • Solution details and team expertise 2.0
    • Value for money 0.0
    HD-Glue for neuro-symbolic integration

    The proposal outlines the integration of Hyperdimensional Computing (HDC) for neural-symbolic integration within Hyperon. It could be promising as it includes integration of HD vectors with symbolic processing, which is a possibility and should also be explored. However the proposal lacks key technical details, hence this project might not be a good way to explore this topic. Naive ways of encoding rules as HD vectors will not lead to benefits and make it hard to develop a working AI agent which makes use of the representations. HD-Glue makes it easier to integrate with ANN's, however in practice it is difficult to obtain latent codes as hypervectors which compose well with each other using HD vector operations. Recent works like DreamerV3 successfully learn discrete latent representations but not yet of a kind that HD vector operations would make sense, meaning HD vector encoders using latent feature is still subject to handcrafting, making HD vectors less useful in practice. Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2023). Mastering diverse domains through world models. arXiv preprint arXiv:2301.04104.

  • Expert Review 4

    Overall

    5.0

    • Compliance with RFP requirements 5.0
    • Solution details and team expertise 5.0
    • Value for money 0.0
    It's an innovative and practical response to the RFP, which looks both interesting/novel and achievable...

    The basic proposal is to use hypervectors as glue btw neural and symbolic in a Hyperon context... and to flesh this out via a series of experiments w/ different sorts of neural systems. It makes sense, it's explained clearly, and Simuli clearly has capability to do it...

  • Expert Review 5

    Overall

    4.0

    • Compliance with RFP requirements 5.0
    • Solution details and team expertise 5.0
    • Value for money 0.0

    Solid, detailed proposal based upon creating and using symbolic logic rules coupled with HDC.

Welcome to our website!

Nice to meet you! If you have any question about our services, feel free to contact us.