Files
metabuilder/workflow/executor/README.md
johndoe6345789 5ac579a2ed feat: Add Python plugins from AutoMetabuilder + restructure workflow folder
Restructure workflow/ for multi-language plugin support:
- Rename src/ to core/ (engine code: DAG executor, registry, types)
- Create executor/{cpp,python,ts}/ for language-specific runtimes
- Consolidate plugins to plugins/{ts,python}/ by language then category

Add 80+ Python plugins from AutoMetabuilder in 14 categories:
- control: bot control, switch logic, state management
- convert: type conversions (json, boolean, dict, list, number, string)
- core: AI requests, context management, tool calls
- dict: dictionary operations (get, set, keys, values, merge)
- list: list operations (concat, find, sort, slice, filter)
- logic: boolean logic (and, or, xor, equals, comparisons)
- math: arithmetic operations (add, subtract, multiply, power, etc.)
- string: string manipulation (concat, split, replace, format)
- notifications: Slack, Discord integrations
- test: assertion helpers and test suite runner
- tools: file operations, git, docker, testing utilities
- utils: filtering, mapping, reducing, condition branching
- var: variable store operations (get, set, delete, exists)
- web: Flask server, environment variables, JSON handling

Add language executor runtimes:
- TypeScript: direct import execution (default, fast startup)
- Python: child process with JSON stdin/stdout communication
- C++: placeholder for native FFI bindings (Phase 3)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-21 16:08:08 +00:00

2.3 KiB

Workflow Executor Runtimes

This folder contains language-specific runtime executors for the workflow engine.

Structure

executor/
├── cpp/        # C++ runtime (high-performance)
├── python/     # Python runtime (AI/ML capabilities)
└── ts/         # TypeScript runtime (default, orchestration)

Purpose

Each runtime provides the execution environment for plugins written in that language:

TypeScript Runtime (ts/)

  • Default runtime for orchestration
  • Direct JavaScript/TypeScript execution
  • Full type safety
  • Fastest startup time

Python Runtime (python/)

  • Child process execution
  • AI/ML library access (TensorFlow, PyTorch, transformers)
  • Data science capabilities (pandas, numpy)
  • NLP processing (spaCy, NLTK)

C++ Runtime (cpp/)

  • Native FFI bindings
  • 100-1000x faster than TypeScript
  • Low memory footprint
  • Ideal for bulk data processing

How It Works

┌─────────────────────────────────────────┐
│  DAGExecutor (TypeScript Core)          │
│  - Orchestrates workflow execution      │
│  - Resolves dependencies                │
│  - Manages execution state              │
└─────────────────┬───────────────────────┘
                  │
        ┌─────────┼─────────┐
        │         │         │
        ↓         ↓         ↓
    ┌────────┬────────┬────────┐
    │   TS   │  C++   │ Python │
    │Runtime │Runtime │Runtime │
    └────────┴────────┴────────┘
        │         │         │
        ↓         ↓         ↓
    ┌────────┬────────┬────────┐
    │Direct  │Native  │Child   │
    │Import  │FFI     │Process │
    └────────┴────────┴────────┘

Adding a New Runtime

  1. Create folder: executor/{language}/
  2. Implement PluginLoader interface
  3. Register loader in core/registry/node-executor-registry.ts
  4. Add plugins to plugins/{language}/