mirror of https://github.com/johndoe6345789/metabuilder.git synced 2026-04-25 06:14:59 +00:00

Files

johndoe6345789 48135c81e6 feat: Propagate workflow plugins to Go, Rust, C++, and Mojo

Multi-language workflow plugin system following Python's structure:
- Each plugin in its own directory with implementation + package.json
- Category-level package.json manifests listing all plugins
- Consistent interface: run(runtime, inputs) -> outputs

Languages added:
- Go: math, string, logic, list, dict, var, convert (25+ plugins)
- Rust: math, string, logic, list, convert, var (50+ functions)
- C++: header-only math, string, logic, var, convert (30+ plugins)
- Mojo: math, string, list with systems programming features

Python structure fixed:
- Reorganized flat files into plugin subdirectories
- Added package.json metadata to all 120+ plugins
- Added missing backend category (15 plugins)
- Category manifests with plugin lists

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-21 18:42:14 +00:00

2.5 KiB

Raw Blame History

C++ Workflow Plugins

High-performance C++ plugins for MetaBuilder workflow engine.

Plugin Interface

// All plugins implement this signature
PluginResult pluginName(Runtime& runtime, const json& inputs);

The runtime object provides:

store - Workflow state storage (persists between nodes)
context - Shared context (clients, configuration)

Category	Plugins	Purpose
convert	to_string, to_number, to_boolean, to_json, parse_json, to_list, to_object	Type conversion
list	concat, length, slice, reverse, first, last, at, contains, index_of, unique	List operations
logic	and, or, not, xor, equals, gt, gte, lt, lte, in	Boolean logic
math	add, subtract, multiply, divide, modulo, power, abs, round, min, max	Arithmetic
string	concat, split, replace, upper, lower, trim, length, contains, starts_with, ends_with	String manipulation
var	get, set, delete, exists, keys, clear	Variable management

Structure

Header-only library matching Python plugin structure:

cpp/
├── plugin.hpp              # Core types (Runtime, PluginResult)
├── math/
│   ├── package.json        # Category manifest with plugin list
│   ├── math_add/
│   │   ├── math_add.hpp    # Plugin implementation
│   │   └── package.json    # Plugin metadata
│   └── ...
└── string/
    └── ...

Usage

Include the header-only plugin you need:

#include <nlohmann/json.hpp>
#include "workflow/plugins/cpp/math/math_add/math_add.hpp"

// Use the plugin
metabuilder::workflow::Runtime runtime;
auto result = metabuilder::workflow::math::add(runtime, {{"numbers", {1, 2, 3}}});

Example Usage

In Workflow JSON

{
  "version": "2.2.0",
  "nodes": [
    {
      "id": "bulk-process",
      "type": "operation",
      "op": "cpp.list.unique",
      "params": {
        "list": "{{ $largeDataset }}"
      }
    }
  ]
}

Performance

C++ plugins offer:

100-1000x faster than Python for CPU-bound operations
Zero overhead for number crunching
Native SIMD support for vectorized operations
Direct memory access for large datasets

Best for:

Bulk data processing (1M+ items)
Complex aggregations
Performance-critical paths
Memory-intensive operations

Integration

The plugin library compiles to a shared library that can be:

Loaded via FFI from TypeScript/Python
Linked directly into C++ executors
Called via workflow engine's native executor

2.5 KiB Raw Blame History