mirror of https://github.com/johndoe6345789/metabuilder.git synced 2026-04-25 06:14:59 +00:00

Files

johndoe6345789 5ac579a2ed feat: Add Python plugins from AutoMetabuilder + restructure workflow folder

Restructure workflow/ for multi-language plugin support:
- Rename src/ to core/ (engine code: DAG executor, registry, types)
- Create executor/{cpp,python,ts}/ for language-specific runtimes
- Consolidate plugins to plugins/{ts,python}/ by language then category

Add 80+ Python plugins from AutoMetabuilder in 14 categories:
- control: bot control, switch logic, state management
- convert: type conversions (json, boolean, dict, list, number, string)
- core: AI requests, context management, tool calls
- dict: dictionary operations (get, set, keys, values, merge)
- list: list operations (concat, find, sort, slice, filter)
- logic: boolean logic (and, or, xor, equals, comparisons)
- math: arithmetic operations (add, subtract, multiply, power, etc.)
- string: string manipulation (concat, split, replace, format)
- notifications: Slack, Discord integrations
- test: assertion helpers and test suite runner
- tools: file operations, git, docker, testing utilities
- utils: filtering, mapping, reducing, condition branching
- var: variable store operations (get, set, delete, exists)
- web: Flask server, environment variables, JSON handling

Add language executor runtimes:
- TypeScript: direct import execution (default, fast startup)
- Python: child process with JSON stdin/stdout communication
- C++: placeholder for native FFI bindings (Phase 3)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-21 16:08:08 +00:00

2.1 KiB

Raw Blame History

C++ Plugin Executor

High-performance native runtime for C++ workflow plugins.

Status

Phase 3 - Framework ready, implementation pending.

Architecture

┌─────────────────────────────────────────┐
│  TypeScript (Node.js)                   │
│  - DAGExecutor calls native binding     │
└─────────────────┬───────────────────────┘
                  │ node-ffi / node-addon-api
                  ↓
┌─────────────────────────────────────────┐
│  C++ Shared Library (.so/.dylib/.dll)   │
│  - Native plugin execution              │
│  - Direct memory access                 │
│  - Parallel processing                  │
└─────────────────────────────────────────┘

Build System

Uses CMake for cross-platform builds:

mkdir build && cd build
cmake ..
cmake --build . --config Release

Interface

// executor.h
extern "C" {
    // Execute a plugin and return JSON result
    const char* execute_plugin(
        const char* plugin_name,
        const char* inputs_json,
        const char* context_json
    );

    // Free result memory
    void free_result(const char* result);

    // List available plugins
    const char* list_plugins();
}

Planned Plugins

dbal-aggregate - High-performance data aggregation (1000x faster)
dbal-bulk-operations - Bulk insert/update operations
s3-upload - Native S3 upload with multipart
redis-cache - Native Redis client
kafka-producer - Native Kafka producer
bulk-process - Parallel data processing
stream-aggregate - Streaming aggregation

Performance Targets

Operation	TypeScript	C++ Target
Large aggregation	1.0x	100-1000x
Bulk operations	1.0x	50-100x
JSON parsing	1.0x	10-50x
Memory usage	1.0x	0.1-0.3x

2.1 KiB Raw Blame History