[PR #21] [CLOSED] feat: Self-improvement runner + User-Collaborative Validation Gates #96

New issue

Closed

opened 2026-02-27 10:22:12 +03:00 by kerem · 0 comments

kerem commented

2026-02-27 10:22:12 +03:00

Owner

📋 Pull Request Information

Original PR: https://github.com/mikeyobrien/ralph-orchestrator/pull/21
Author: @krzemienski
Created: 1/3/2026
Status: ❌ Closed

Base: main ← Head: feat/validation-complete

📝 Commits (6)

461d7d4 feat: Self-improvement runner + User-Collaborative Validation Gates
c36f96c feat(tui): complete TUI implementation with 149 tests, 87% coverage
744a1b9 chore: cleanup artifacts and add env example
93ea869 docs: update README with TUI feature and test counts
6b7086a fix(tests): correct test mocking for ACP adapter availability
4a21192 feat(config): add enable_validation to RalphConfig with validators

📊 Changes

63 files changed (+10428 additions, -941 deletions)

View changed files

➕ .env.example (+76 -0)
📝 .gitignore (+14 -0)
➕ .playwright-mcp/ralph-web-ui-no-auth.png (+0 -0)
➕ .playwright-mcp/ralph-web-ui-working.png (+0 -0)
➖ PROMPT.md (+0 -914)
📝 README.md (+73 -11)
➕ docs/future-features.md (+21 -0)
➕ docs/guide/validation.md (+298 -0)
➕ examples/ralph-self-improvement.yml (+58 -0)
➕ examples/run_self_improvement.py (+267 -0)
➕ prompts/ONBOARDING_PROMPT.md (+820 -0)
➕ prompts/VALIDATION_FEATURE_PROMPT.md (+1231 -0)
📝 pyproject.toml (+8 -0)
📝 ralph.yml (+19 -1)
➕ scripts/self_improve.py (+395 -0)
📝 src/ralph_orchestrator/__main__.py (+224 -5)
📝 src/ralph_orchestrator/main.py (+27 -0)
📝 src/ralph_orchestrator/orchestrator.py (+260 -3)
➕ src/ralph_orchestrator/tui/__init__.py (+17 -0)
➕ src/ralph_orchestrator/tui/app.py (+272 -0)

...and 43 more files

📄 Description

Summary

Two major features produced by Ralph improving itself:

1. Self-Improvement Runner

scripts/self_improve.py - Pure-Python runner using Ralph's SDK directly.

python scripts/self_improve.py -P prompts/MY_FEATURE.md
python scripts/self_improve.py -P prompts/PROMPT.md --with-web-ui

2. User-Collaborative Validation Gates

Opt-in validation following "propose, don't prescribe" philosophy.

Three validation targets:

iOS apps → Simulator screenshots
Web apps → Playwright browser automation
CLI tools → Terminal output capture

CLI flags:

ralph run -P PROMPT.md --enable-validation
ralph run -P PROMPT.md --enable-validation --no-validation-interactive  # CI mode

What's Included

Category	Files
Self-improvement runner	`scripts/self_improve.py`
Validation core	`orchestrator.py`, `__main__.py`
Tests	`test_validation_feature.py` (26 tests)
Documentation	`docs/guide/validation.md`
Evidence	`validation-evidence/` (screenshots, logs)
Prompts	`VALIDATION_FEATURE_PROMPT.md`, `ONBOARDING_PROMPT.md`

Meta Note

This PR was partially produced by Ralph running on itself:

python scripts/self_improve.py -P prompts/VALIDATION_FEATURE_PROMPT.md

Relates to Issue #17.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/mikeyobrien/ralph-orchestrator/pull/21 **Author:** [@krzemienski](https://github.com/krzemienski) **Created:** 1/3/2026 **Status:** ❌ Closed **Base:** `main` ← **Head:** `feat/validation-complete` --- ### 📝 Commits (6) - [`461d7d4`](https://github.com/mikeyobrien/ralph-orchestrator/commit/461d7d46c25d4eda4af13f9f22227ee3624707d3) feat: Self-improvement runner + User-Collaborative Validation Gates - [`c36f96c`](https://github.com/mikeyobrien/ralph-orchestrator/commit/c36f96cdc021a5456c8f2059bf9b363cf4822969) feat(tui): complete TUI implementation with 149 tests, 87% coverage - [`744a1b9`](https://github.com/mikeyobrien/ralph-orchestrator/commit/744a1b9769f5326d90e09f1a1a67fdf3e27b30af) chore: cleanup artifacts and add env example - [`93ea869`](https://github.com/mikeyobrien/ralph-orchestrator/commit/93ea8691dcbd7d5ca6a9c393a13779c82c258eb2) docs: update README with TUI feature and test counts - [`6b7086a`](https://github.com/mikeyobrien/ralph-orchestrator/commit/6b7086a87e798ab3b1f1ef3fcc6eeaabdeb43a86) fix(tests): correct test mocking for ACP adapter availability - [`4a21192`](https://github.com/mikeyobrien/ralph-orchestrator/commit/4a21192c4018d65745c68ec182b4a7b05ddd264a) feat(config): add enable_validation to RalphConfig with validators ### 📊 Changes **63 files changed** (+10428 additions, -941 deletions) <details> <summary>View changed files</summary> ➕ `.env.example` (+76 -0) 📝 `.gitignore` (+14 -0) ➕ `.playwright-mcp/ralph-web-ui-no-auth.png` (+0 -0) ➕ `.playwright-mcp/ralph-web-ui-working.png` (+0 -0) ➖ `PROMPT.md` (+0 -914) 📝 `README.md` (+73 -11) ➕ `docs/future-features.md` (+21 -0) ➕ `docs/guide/validation.md` (+298 -0) ➕ `examples/ralph-self-improvement.yml` (+58 -0) ➕ `examples/run_self_improvement.py` (+267 -0) ➕ `prompts/ONBOARDING_PROMPT.md` (+820 -0) ➕ `prompts/VALIDATION_FEATURE_PROMPT.md` (+1231 -0) 📝 `pyproject.toml` (+8 -0) 📝 `ralph.yml` (+19 -1) ➕ `scripts/self_improve.py` (+395 -0) 📝 `src/ralph_orchestrator/__main__.py` (+224 -5) 📝 `src/ralph_orchestrator/main.py` (+27 -0) 📝 `src/ralph_orchestrator/orchestrator.py` (+260 -3) ➕ `src/ralph_orchestrator/tui/__init__.py` (+17 -0) ➕ `src/ralph_orchestrator/tui/app.py` (+272 -0) _...and 43 more files_ </details> ### 📄 Description ## Summary Two major features produced by Ralph improving itself: ### 1. Self-Improvement Runner `scripts/self_improve.py` - Pure-Python runner using Ralph's SDK directly. ```bash python scripts/self_improve.py -P prompts/MY_FEATURE.md python scripts/self_improve.py -P prompts/PROMPT.md --with-web-ui ``` ### 2. User-Collaborative Validation Gates Opt-in validation following "propose, don't prescribe" philosophy. **Three validation targets:** - iOS apps → Simulator screenshots - Web apps → Playwright browser automation - CLI tools → Terminal output capture **CLI flags:** ```bash ralph run -P PROMPT.md --enable-validation ralph run -P PROMPT.md --enable-validation --no-validation-interactive # CI mode ``` ## What's Included | Category | Files | |----------|-------| | Self-improvement runner | `scripts/self_improve.py` | | Validation core | `orchestrator.py`, `__main__.py` | | Tests | `test_validation_feature.py` (26 tests) | | Documentation | `docs/guide/validation.md` | | Evidence | `validation-evidence/` (screenshots, logs) | | Prompts | `VALIDATION_FEATURE_PROMPT.md`, `ONBOARDING_PROMPT.md` | ## Meta Note This PR was partially produced by Ralph running on itself: ```bash python scripts/self_improve.py -P prompts/VALIDATION_FEATURE_PROMPT.md ``` Relates to Issue #17. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>