Semi-Manual LeetCode and Similar Examples in MeTTa

chevron-icon
RFP Proposals
Top
chevron-icon
project-presentation-img
Expert Rating 3.3
firefly_ross
Project Owner

Semi-Manual LeetCode and Similar Examples in MeTTa

Expert Rating

3.3

Overview

Develop a corpus of 10,000 programming problems rewritten in MeTTa, derived from existing LeetCode and similar interview-style coding problems. This corpus will include solutions, test cases, and varying levels of complexity (low, medium, and hard) to facilitate training and evaluation of a MeTTa coding assistant. Test cases will be reused to save time and verify correctness.

RFP Guidelines

Create corpus for NL-to-MeTTa LLM

Complete & Awarded
  • Type SingularityNET RFP
  • Total RFP Funding $70,000 USD
  • Proposals 10
  • Awarded Projects 1
author-img
SingularityNET
Aug. 13, 2024

Develop a MeTTa language corpus to enable the training or fine-tuning of an LLM and/or LoRAs aimed at supporting developers by providing a natural language coding assistant for the MeTTa language.

Proposal Description

Project details

This proposal aims to create a high-quality corpus of 10,000 programming problems translated into MeTTa.

The project will reuse existing test cases and problem descriptions from LeetCode and other interview problem platforms while tailoring solutions to the MeTTa syntax and paradigms.

The dataset will focus on three complexity tiers—low, medium, and hard—and will align with typical problem domains like data structures, algorithms, and real-world scenarios. Each problem will include:

  1. Problem Description: The original problem rewritten to reflect the MeTTa context.
  2. Solution in MeTTa: A functional, verified solution using MeTTa syntax.
  3. Reusable Test Cases: Adapted to ensure correctness and save development time.

Open Source Licensing

GNU GPL - GNU General Public License

Proposal Video

Not Avaliable Yet

Check back later during the Feedback & Selection period for the RFP that is proposal is applied to.

  • Total Milestones

    5

  • Total Budget

    $35,000 USD

  • Last Updated

    8 Dec 2024

Milestone 1 - Low-Complexity Problems (5,000 Problems)

Description

Focus on basic programming tasks like loops, conditionals, and simple data structures (arrays, linked lists, stacks). Reuse and adapt test cases to validate correctness. Ensure alignment with foundational MeTTa features.

Deliverables

5,000 rewritten problems with test cases and solutions.

Budget

$12,000 USD

Success Criterion

5,000 rewritten problems with test cases and solutions.

Milestone 2 - Medium-Complexity Problems (3,000 Problems)

Description

Address more complex algorithms and structures, such as trees, graphs, sorting, searching, and dynamic programming. Develop modular solutions that highlight MeTTa’s declarative and functional programming strengths. Incorporate edge cases in test sets for robust validation.

Deliverables

3,000 rewritten problems with enhanced test cases.

Budget

$10,000 USD

Success Criterion

3,000 rewritten problems with enhanced test cases.

Milestone 3 - High-Complexity Problems (2,000 Problems)

Description

Cover advanced algorithms, optimization problems, metagraph operations, and real-world scenarios such as distributed systems and scheduling. Integrate reusable templates for recurring problem types. Highlight unique MeTTa features in solutions (e.g., knowledge metagraph traversal).

Deliverables

2,000 rewritten problems with comprehensive test cases.

Budget

$8,000 USD

Success Criterion

2,000 rewritten problems with comprehensive test cases.

Milestone 4 - Verification and Quality Assurance

Description

Conduct systematic validation of solutions and test cases. Peer-review a subset of problems to ensure compliance with MeTTa paradigms.

Deliverables

A verified and debugged corpus

Budget

$3,000 USD

Success Criterion

A verified and debugged corpus

Milestone 5 - Documentation and Tutorials

Description

Create extensive documentation on how the problems were adapted, best practices for using MeTTa, and instructions for adding new problems. Develop tutorials based on the low, medium, and high-complexity problems to help users learn MeTTa progressively.

Deliverables

Comprehensive documentation and onboarding materials.

Budget

$2,000 USD

Success Criterion

Comprehensive documentation and onboarding materials.

Join the Discussion (0)

Expert Ratings

Reviews & Ratings

Group Expert Rating (Final)

Overall

3.3

  • Feasibility 3.0
  • Desirabilty 3.7
  • Usefulness 2.7
  • Expert Review 1

    Overall

    4.0

    • Compliance with RFP requirements 4.0
    • Solution details and team expertise 3.0
    • Value for money 2.0
    Team credibility not established by proposal

    Fair proposal with minimal detail. No clear methodology for adapting problems to MeTTa paradigms. Team credibility unclear — links provided but no description of relevance. Milestones lack technical depth or differentiation.

  • Expert Review 2

    Overall

    3.0

    • Compliance with RFP requirements 3.0
    • Solution details and team expertise 5.0
    • Value for money 3.0
    Proposal is to hand-code all 10K examples, which may not be feasible given the time/$$ allotted

  • Expert Review 3

    Overall

    3.0

    • Compliance with RFP requirements 2.0
    • Solution details and team expertise 3.0
    • Value for money 3.0

    The proposal aims to use programming problems rewritten in MeTTa that are "derived from existing LeetCode and similar interview-style coding problems." While this process makes sense for most generic problems, they largely exclude the rather unique program types for which we have developed MeTTa. How will the proposer ensure inclusion of program types for which we explicitly designed MeTTa, e.g. programs involving multiparadigmality, non-determinism, explicit parallelization, atomspace representation, self-modification, etc.?

feedback_icon