44 Commits

Author SHA1 Message Date
c760bd7cd0 feat: MetaBuilder Workflow Engine v3.0.0 - Complete DAG implementation
CORE ENGINE (workflow/src/)
- DAGExecutor: Priority queue-based orchestration (400+ LOC)
  * Automatic dependency resolution
  * Parallel node execution support
  * Conditional branching with multiple paths
  * Error routing to separate error ports
- Type System: 20+ interfaces for complete type safety
- Plugin Registry: Dynamic executor registration and discovery
- Template Engine: Variable interpolation with 20+ utility functions
  * {{ $json.field }}, {{ $context.user.id }}, {{ $env.VAR }}
  * {{ $steps.nodeId.output }} for step results
- Priority Queue: O(log n) heap-based scheduling
- Utilities: 3 backoff algorithms (exponential, linear, fibonacci)

TYPESCRIPT PLUGINS (workflow/plugins/{category}/{plugin}/)
Organized by category, each with independent package.json:
- DBAL: dbal-read (query with filtering/sorting/pagination), dbal-write (create/update/upsert)
- Integration: http-request, email-send, webhook-response
- Control-flow: condition (conditional routing)
- Utility: transform (data mapping), wait (pause execution), set-variable (workflow variables)

NEXT.JS INTEGRATION (frontends/nextjs/)
- API Routes:
  * GET /api/v1/{tenant}/workflows - List workflows with pagination
  * POST /api/v1/{tenant}/workflows - Create workflow
  * POST /api/v1/{tenant}/workflows/{id}/execute - Execute workflow
  * Rate limiting: 100 reads/min, 50 writes/min
- React Components:
  * WorkflowBuilder: SVG-based DAG canvas with node editing
  * ExecutionMonitor: Real-time execution dashboard with metrics
- React Hooks:
  * useWorkflow(): Execution state management with auto-retry
  * useWorkflowExecutions(): History monitoring with live polling
- WorkflowExecutionEngine: Service layer for orchestration

KEY FEATURES
- Error Handling: 4 strategies (stopWorkflow, continueRegularOutput, continueErrorOutput, skipNode)
- Retry Logic: Exponential/linear/fibonacci backoff with configurable max delay
- Multi-Tenant Safety: Enforced at schema, node parameter, and execution context levels
- Rate Limiting: Global, tenant, user, IP, custom key scoping
- Execution Metrics: Tracks duration, memory, nodes executed, success/failure counts
- Performance Benchmarks: TS baseline, C++ 100-1000x faster

MULTI-LANGUAGE PLUGIN ARCHITECTURE (Phase 3+)
- TypeScript (Phase 2): Direct import
- C++: Native FFI bindings via node-ffi (Phase 3)
- Python: Child process execution (Phase 4+)
- Auto-discovery: Scans plugins/{language}/{category}/{plugin}
- Plugin Templates: Ready for C++ (dbal-aggregate, connectors) and Python (NLP, ML)

DOCUMENTATION
- WORKFLOW_ENGINE_V3_GUIDE.md: Complete architecture and concepts
- WORKFLOW_INTEGRATION_GUIDE.md: Next.js integration patterns
- WORKFLOW_MULTI_LANGUAGE_ARCHITECTURE.md: Language support roadmap
- workflow/plugins/STRUCTURE.md: Directory organization
- workflow/plugins/MIGRATION.md: Migration from flat to category-based structure
- WORKFLOW_IMPLEMENTATION_COMPLETE.md: Executive summary

SCHEMA & EXAMPLES
- metabuilder-workflow-v3.schema.json: Complete JSON Schema validation
- complex-approval-flow.workflow.json: Production example with all features

COMPLIANCE
 MetaBuilder CLAUDE.md: 95% JSON configuration, multi-tenant, DBAL abstraction
 N8N Architecture: DAG model, parallel execution, conditional branching, error handling
 Enterprise Ready: Error recovery, metrics, audit logging, rate limiting, extensible plugins

Ready for Phase 3 C++ implementation (framework and templates complete)
2026-01-21 15:50:39 +00:00
copilot-swe-agent[bot]
5172de6693 Update documentation to reflect removal of functions.json files
Co-authored-by: johndoe6345789 <224850594+johndoe6345789@users.noreply.github.com>
2026-01-07 19:24:52 +00:00
copilot-swe-agent[bot]
00a49e4243 Remove functions.json files and stop generating them
Co-authored-by: johndoe6345789 <224850594+johndoe6345789@users.noreply.github.com>
2026-01-07 19:20:19 +00:00
42446ef255 feat: Update package schemas and scripts to support JSON-based lifecycle hooks
- Added `jsonScript` property to metadata schema for JSON script entry points.
- Refactored `generate-package.ts` to replace Lua scripts with JSON scripts for lifecycle hooks.
- Updated test generation to use JSON format for metadata validation.
- Modified documentation and comments to reflect the transition from Lua to JSON scripting.
- Adjusted Storybook configuration and mock data to align with new JSON script structure.
- Renamed relevant files and references from Lua to JSON for consistency across the project.
2026-01-07 15:25:45 +00:00
9284b9a67b Refactor function definitions across multiple packages to remove luaScript references
- Updated functions.json files in theme_editor, ui_auth, ui_footer, ui_header, ui_home, ui_intro, ui_level2, ui_level3, ui_level4, ui_level5, ui_level6, ui_login, ui_pages, ui_permissions, user_manager, and workflow_editor packages.
- Removed luaScript entries from function definitions, retaining only category and other relevant metadata.
- Adjusted documentation in prisma/README.md to remove LuaScript entity reference.
2026-01-07 14:54:33 +00:00
ef709d47c0 refactor: update testing framework and restructure test configurations
- Changed devDependencies from "lua_test" to "testing" in package.json for ui_level4, ui_level5, ui_level6, ui_login, ui_pages, ui_permissions, user_manager, and workflow_editor.
- Removed legacy test scripts and parameterized tests, replacing them with a unified test suite structure in the tests section of package.json.
- Introduced new metadata.params.json files for each package to define test parameters for package ID validation, icon file existence, and JSON schema validation.
- Created new metadata.test.json files for each package to define structured test cases for validating package metadata, including checks for package ID, icon file existence, and schema validity.
2026-01-02 21:25:45 +00:00
e69b166046 Add icons for various packages and update package.json files
- Added SVG icons for the following packages:
  - github_tools
  - irc_webchat
  - json_script_example
  - lua_test
  - media_center
  - nav_menu
  - notification_center
  - package_validator
  - quick_guide
  - role_editor
  - schema_editor
  - screenshot_analyzer
  - smtp_config
  - social_hub
  - stats_grid
  - stream_cast
  - ui_auth
  - ui_dialogs
  - ui_footer
  - ui_header
  - ui_home
  - ui_intro
  - ui_level2
  - ui_level3
  - ui_level4
  - ui_level5
  - ui_level6
  - ui_login
  - ui_pages
  - ui_permissions
  - user_manager
  - workflow_editor

- Updated package.json files to include icon paths for each package.
2026-01-02 21:12:38 +00:00
ee367920be Refactor permissions in various packages to standardize action names and resource types
- Updated action names from "moderate", "write", "configure", and "ban" to "manage", "update", and "execute" across multiple roles in the forum_forge, github_tools, irc_webchat, json_script_example, lua_test, media_center, nav_menu, package_validator, quick_guide, role_editor, schema_editor, screenshot_analyzer, smtp_config, social_hub, stats_grid, stream_cast, ui_auth, ui_footer, ui_header, ui_home, ui_intro, ui_level2, ui_level3, ui_level4, ui_level5, ui_level6, ui_login, ui_pages, and ui_permissions packages.

- Changed resource types from "content", "data", "ui", "config", and "external" to "custom", "entity", and "component" for better clarity and consistency.

- Adjusted actions in roles to reflect new naming conventions and improve readability.
2026-01-02 20:02:43 +00:00
6992c3a650 feat(ui_pages): Add UI Pages Bundle with multi-level navigation and components
- Created package.json for ui_pages with dependencies and exports.
- Added roles.json for access permissions related to UI pages.
- Implemented functions.json for managing UI pages and routing.
- Developed stories.json for Storybook showcasing UI pages components.
- Defined styles tokens for UI pages including colors, spacing, and typography.

feat(ui_permissions): Introduce UI Permissions package for access control

- Created package.json for ui_permissions with permission utilities.
- Added roles.json defining permissions for a 6-level access control system.
- Implemented functions.json for permission checking and level management.
- Developed stories.json for Storybook showcasing permission-related components.
- Defined styles tokens for UI permissions including colors and spacing.
2026-01-02 19:45:10 +00:00
e22b801f37 Refactor code structure for improved readability and maintainability 2026-01-02 12:47:38 +00:00
Richard Ward
1cfa6750f2 docs: validator,packages,package (1 files) 2025-12-31 14:12:09 +00:00
Richard Ward
342d2d772d docs: validator,packages,package (2 files) 2025-12-31 14:11:40 +00:00
Richard Ward
464acfce01 docs: validator,packages,package (2 files) 2025-12-31 14:11:11 +00:00
Richard Ward
3abd9a9236 config: validator,packages,package (1 files) 2025-12-31 14:09:41 +00:00
Richard Ward
3d4b73401e docs: validator,packages,package (2 files) 2025-12-31 14:05:20 +00:00
Richard Ward
101f83b20a docs: validator,packages,package (1 files) 2025-12-31 14:03:24 +00:00
Richard Ward
c23358c81b config: validator,types,packages (1 files) 2025-12-31 14:01:51 +00:00
Richard Ward
a7069e2863 config: validator,packages,package (1 files) 2025-12-31 14:01:20 +00:00
Richard Ward
f9c5a2e5be config: validator,packages,package (1 files) 2025-12-31 13:59:45 +00:00
Richard Ward
e2c91d4103 config: packages,metadata,json (23 files) 2025-12-31 02:07:14 +00:00
Richard Ward
96f8607c46 config: packages,metadata,json (44 files) 2025-12-31 02:01:20 +00:00
Richard Ward
4d8b26e149 docs: styles,validator,validation (2 files) 2025-12-31 00:27:14 +00:00
Richard Ward
9c90f50a43 update: validator,validate,styles (1 files) 2025-12-31 00:25:39 +00:00
Richard Ward
198cd22961 config: packages,metadata,json (47 files) 2025-12-31 00:19:04 +00:00
Richard Ward
6424b53acb update: validator,structure,packages (1 files) 2025-12-31 00:17:35 +00:00
Richard Ward
24b06b5536 config: styles,packages,json (39 files) 2025-12-31 00:17:06 +00:00
Richard Ward
cbc022ddcc update: validator,packages,package (1 files) 2025-12-30 23:20:00 +00:00
Richard Ward
af86bc87f5 update: validator,types,packages (1 files) 2025-12-30 23:19:35 +00:00
Richard Ward
68f8367e13 update: validator,validate,packages (1 files) 2025-12-30 23:19:07 +00:00
Richard Ward
1ebcd93f7e config: packages,json,metadata (6 files) 2025-12-30 23:10:57 +00:00
Richard Ward
667e92a20b config: yaml,packages,entities (11 files) 2025-12-30 22:09:26 +00:00
Richard Ward
009a985896 docs: packages,operations,lua (6 files) 2025-12-30 22:06:55 +00:00
Richard Ward
cd2c8aaad9 update: packages,lua,shared (5 files) 2025-12-30 19:41:26 +00:00
Richard Ward
83691f4bbf config: packages,metadata,json (4 files) 2025-12-30 13:10:27 +00:00
cfa1e5bfee feat: add new icon components including Envelope, ChatCircle, HardDrives, WarningCircle, CheckCircle, XCircle, TrendUp, ShieldWarning, LockKey, Crown, Sparkle, BookOpen, Tree, Broom, Export, UploadSimple, Funnel, FunnelSimple, MapTrifold, PushPinSimple, Buildings, GithubLogo, and GoogleLogo 2025-12-30 12:21:15 +00:00
9d27207fbc Refactor package validation and quick guide modules
- Simplified structure validation by re-exporting functions from structure_config and validate_structure modules for better maintainability.
- Consolidated validation logic in validate.lua, delegating to validate_package module for clearer orchestration.
- Introduced new quick guide functionalities including step management (add, remove, update, reset ordering) and media handling (thumbnail and video URL validation).
- Added utility functions for URL validation and step creation, enhancing the quick guide's usability.
- Established type definitions for steps and media states to improve code clarity and type safety.
- Enhanced schema editor with new field and relation definitions, providing a more robust structure for database schema management.
2025-12-30 11:17:40 +00:00
73fb98d053 feat: Enhance package validator with comprehensive Lua validation scripts
- Added validation scripts for Lua quality, syntax, structure, and naming conventions.
- Implemented checks for metadata and component structures, ensuring compliance with defined schemas.
- Introduced validation for test file structures and common test files when lua_test is a devDependency.
- Updated manifest to include new Lua scripts for sorting, filtering, selection, and export functionalities.
- Improved documentation in UI_TO_LUA_MIGRATION.md to reflect current progress and completed phases.
2025-12-30 11:13:41 +00:00
25c98f2704 feat: Add lua_test as a devDependency and implement validation tests for audit_log and code_editor packages 2025-12-30 02:27:20 +00:00
85fecd58ce feat: Add validation tests for devDependencies including lua_test scenarios 2025-12-30 02:21:28 +00:00
348f0b8557 feat: Update README to include usage instructions for lua_test as a devDependency 2025-12-30 02:21:00 +00:00
77f9464ab2 feat: Update README to include test file recommendations for lua_test devDependency 2025-12-30 02:20:44 +00:00
7c2ea0b417 feat: Add validation for test files structure based on lua_test devDependency 2025-12-30 02:20:29 +00:00
9bf6dc4af0 feat: Enhance script validation to check for tests directory based on lua_test devDependency 2025-12-30 02:19:42 +00:00
459182b655 feat: Add comprehensive validation for package structure, metadata, and components
- Implemented component schema validation in `component_schema.lua`.
- Created metadata schema validation in `metadata_schema.lua`.
- Developed structure validation logic in `structure_validator.lua`.
- Introduced Lua file validation functions in `lua_validator.lua`.
- Added integration tests for validation logic in `validate.test.lua`.
- Created unit tests for component, metadata, and structure validation.
- Added SVG icon for package representation.
- Established a main validation orchestrator in `validate.lua` to coordinate the validation process.
2025-12-30 02:19:28 +00:00