mirror of
https://github.com/johndoe6345789/metabuilder.git
synced 2026-04-25 14:25:02 +00:00
johndoe6345789
5ac579a2ed
Restructure workflow/ for multi-language plugin support:
- Rename src/ to core/ (engine code: DAG executor, registry, types)
- Create executor/{cpp,python,ts}/ for language-specific runtimes
- Consolidate plugins to plugins/{ts,python}/ by language then category
Add 80+ Python plugins from AutoMetabuilder in 14 categories:
- control: bot control, switch logic, state management
- convert: type conversions (json, boolean, dict, list, number, string)
- core: AI requests, context management, tool calls
- dict: dictionary operations (get, set, keys, values, merge)
- list: list operations (concat, find, sort, slice, filter)
- logic: boolean logic (and, or, xor, equals, comparisons)
- math: arithmetic operations (add, subtract, multiply, power, etc.)
- string: string manipulation (concat, split, replace, format)
- notifications: Slack, Discord integrations
- test: assertion helpers and test suite runner
- tools: file operations, git, docker, testing utilities
- utils: filtering, mapping, reducing, condition branching
- var: variable store operations (get, set, delete, exists)
- web: Flask server, environment variables, JSON handling
Add language executor runtimes:
- TypeScript: direct import execution (default, fast startup)
- Python: child process with JSON stdin/stdout communication
- C++: placeholder for native FFI bindings (Phase 3)
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
74 lines
2.1 KiB
Markdown
74 lines
2.1 KiB
Markdown
# C++ Plugin Executor
|
|
|
|
High-performance native runtime for C++ workflow plugins.
|
|
|
|
## Status
|
|
|
|
**Phase 3** - Framework ready, implementation pending.
|
|
|
|
## Architecture
|
|
|
|
```
|
|
┌─────────────────────────────────────────┐
|
|
│ TypeScript (Node.js) │
|
|
│ - DAGExecutor calls native binding │
|
|
└─────────────────┬───────────────────────┘
|
|
│ node-ffi / node-addon-api
|
|
↓
|
|
┌─────────────────────────────────────────┐
|
|
│ C++ Shared Library (.so/.dylib/.dll) │
|
|
│ - Native plugin execution │
|
|
│ - Direct memory access │
|
|
│ - Parallel processing │
|
|
└─────────────────────────────────────────┘
|
|
```
|
|
|
|
## Build System
|
|
|
|
Uses CMake for cross-platform builds:
|
|
|
|
```bash
|
|
mkdir build && cd build
|
|
cmake ..
|
|
cmake --build . --config Release
|
|
```
|
|
|
|
## Interface
|
|
|
|
```cpp
|
|
// executor.h
|
|
extern "C" {
|
|
// Execute a plugin and return JSON result
|
|
const char* execute_plugin(
|
|
const char* plugin_name,
|
|
const char* inputs_json,
|
|
const char* context_json
|
|
);
|
|
|
|
// Free result memory
|
|
void free_result(const char* result);
|
|
|
|
// List available plugins
|
|
const char* list_plugins();
|
|
}
|
|
```
|
|
|
|
## Planned Plugins
|
|
|
|
- `dbal-aggregate` - High-performance data aggregation (1000x faster)
|
|
- `dbal-bulk-operations` - Bulk insert/update operations
|
|
- `s3-upload` - Native S3 upload with multipart
|
|
- `redis-cache` - Native Redis client
|
|
- `kafka-producer` - Native Kafka producer
|
|
- `bulk-process` - Parallel data processing
|
|
- `stream-aggregate` - Streaming aggregation
|
|
|
|
## Performance Targets
|
|
|
|
| Operation | TypeScript | C++ Target |
|
|
|-----------|------------|------------|
|
|
| Large aggregation | 1.0x | 100-1000x |
|
|
| Bulk operations | 1.0x | 50-100x |
|
|
| JSON parsing | 1.0x | 10-50x |
|
|
| Memory usage | 1.0x | 0.1-0.3x |
|