mirror of
https://github.com/johndoe6345789/metabuilder.git
synced 2026-04-24 13:54:57 +00:00
johndoe6345789
5ac579a2ed
Restructure workflow/ for multi-language plugin support:
- Rename src/ to core/ (engine code: DAG executor, registry, types)
- Create executor/{cpp,python,ts}/ for language-specific runtimes
- Consolidate plugins to plugins/{ts,python}/ by language then category
Add 80+ Python plugins from AutoMetabuilder in 14 categories:
- control: bot control, switch logic, state management
- convert: type conversions (json, boolean, dict, list, number, string)
- core: AI requests, context management, tool calls
- dict: dictionary operations (get, set, keys, values, merge)
- list: list operations (concat, find, sort, slice, filter)
- logic: boolean logic (and, or, xor, equals, comparisons)
- math: arithmetic operations (add, subtract, multiply, power, etc.)
- string: string manipulation (concat, split, replace, format)
- notifications: Slack, Discord integrations
- test: assertion helpers and test suite runner
- tools: file operations, git, docker, testing utilities
- utils: filtering, mapping, reducing, condition branching
- var: variable store operations (get, set, delete, exists)
- web: Flask server, environment variables, JSON handling
Add language executor runtimes:
- TypeScript: direct import execution (default, fast startup)
- Python: child process with JSON stdin/stdout communication
- C++: placeholder for native FFI bindings (Phase 3)
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Workflow Executor Runtimes
This folder contains language-specific runtime executors for the workflow engine.
Structure
executor/
├── cpp/ # C++ runtime (high-performance)
├── python/ # Python runtime (AI/ML capabilities)
└── ts/ # TypeScript runtime (default, orchestration)
Purpose
Each runtime provides the execution environment for plugins written in that language:
TypeScript Runtime (ts/)
- Default runtime for orchestration
- Direct JavaScript/TypeScript execution
- Full type safety
- Fastest startup time
Python Runtime (python/)
- Child process execution
- AI/ML library access (TensorFlow, PyTorch, transformers)
- Data science capabilities (pandas, numpy)
- NLP processing (spaCy, NLTK)
C++ Runtime (cpp/)
- Native FFI bindings
- 100-1000x faster than TypeScript
- Low memory footprint
- Ideal for bulk data processing
How It Works
┌─────────────────────────────────────────┐
│ DAGExecutor (TypeScript Core) │
│ - Orchestrates workflow execution │
│ - Resolves dependencies │
│ - Manages execution state │
└─────────────────┬───────────────────────┘
│
┌─────────┼─────────┐
│ │ │
↓ ↓ ↓
┌────────┬────────┬────────┐
│ TS │ C++ │ Python │
│Runtime │Runtime │Runtime │
└────────┴────────┴────────┘
│ │ │
↓ ↓ ↓
┌────────┬────────┬────────┐
│Direct │Native │Child │
│Import │FFI │Process │
└────────┴────────┴────────┘
Adding a New Runtime
- Create folder:
executor/{language}/ - Implement
PluginLoaderinterface - Register loader in
core/registry/node-executor-registry.ts - Add plugins to
plugins/{language}/