mirror of https://github.com/johndoe6345789/metabuilder.git synced 2026-04-25 06:14:59 +00:00

Files

johndoe6345789 c670b8f911 refactor: Move core engine into executor/ts

The TypeScript core engine now lives inside executor/ts/ alongside the
TypeScript runtime, creating a cleaner structure where each executor
folder is self-contained.

Structure:
  executor/ts/         # TypeScript runtime + core engine
    ├── executor/      # DAG executor
    ├── registry/      # Plugin registry
    ├── utils/         # Priority queue, template engine
    ├── types.ts       # Type definitions
    └── index.ts       # Main exports
  executor/python/     # Python runtime
  executor/cpp/        # C++ runtime (Phase 3)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-21 16:10:33 +00:00

2.6 KiB

Raw Blame History

Workflow Executor Runtimes

This folder contains language-specific runtime executors for the workflow engine.

Structure

executor/
├── cpp/        # C++ runtime (high-performance)
├── python/     # Python runtime (AI/ML capabilities)
└── ts/         # TypeScript runtime + core engine
    ├── executor/   # DAG executor
    ├── registry/   # Plugin registry
    ├── utils/      # Priority queue, template engine
    ├── types.ts    # Type definitions
    └── index.ts    # Main exports

Purpose

Each runtime provides the execution environment for plugins written in that language:

TypeScript Runtime (`ts/`)

Contains the core engine (DAG executor, registry, utils)
Default runtime for orchestration
Direct JavaScript/TypeScript execution
Full type safety
Fastest startup time

Python Runtime (`python/`)

Child process execution
AI/ML library access (TensorFlow, PyTorch, transformers)
Data science capabilities (pandas, numpy)
NLP processing (spaCy, NLTK)

C++ Runtime (`cpp/`)

Native FFI bindings
100-1000x faster than TypeScript
Low memory footprint
Ideal for bulk data processing

How It Works

┌─────────────────────────────────────────┐
│  DAGExecutor (TypeScript Core)          │
│  - Orchestrates workflow execution      │
│  - Resolves dependencies                │
│  - Manages execution state              │
└─────────────────┬───────────────────────┘
                  │
        ┌─────────┼─────────┐
        │         │         │
        ↓         ↓         ↓
    ┌────────┬────────┬────────┐
    │   TS   │  C++   │ Python │
    │Runtime │Runtime │Runtime │
    └────────┴────────┴────────┘
        │         │         │
        ↓         ↓         ↓
    ┌────────┬────────┬────────┐
    │Direct  │Native  │Child   │
    │Import  │FFI     │Process │
    └────────┴────────┴────────┘

Adding a New Runtime

Create folder: executor/{language}/
Implement PluginLoader interface
Register loader in ts/registry/node-executor-registry.ts
Add plugins to plugins/{language}/

2.6 KiB Raw Blame History