Skip to content

feat: import Promptologia prompts with eval and property suite - #7

Merged
marcialwushu merged 1 commit into
mainfrom
feat/gh-016-promptologia-evals
Oct 10, 2026
Merged

marcialwushu merged 1 commit into
mainfrom
feat/gh-016-promptologia-evals

Conversation

@marcialwushu

Copy link
Copy Markdown
Member

Summary

  • imports and adapts the 10 executable Promptologia artifacts into the versioned packed catalog
  • adds 20 deterministic local eval cases covering happy paths and boundary/security behavior
  • adds FsCheck properties for argument ordering, sandbox non-re-evaluation, required variables, stable hashes, and redaction
  • runs the suite in the validation workflow used by pull requests, main, and package gates
  • records upstream commit, full license notice, GH-016 task status, index, README, and changelog

Eval strategy

Candidate outputs are curated local golden fixtures. CI does not call an external provider, so results stay deterministic. The dataset format supports replacing a fixture with reviewed output from a local model later.

Verification

  • Release solution build: 0 warnings, 0 errors
  • 66 tests passed (including 5 FsCheck properties with 100 generated cases each)
  • DevComputaria.Prompts.Cli validate passed
  • end-to-end consumer sample passed
  • actionlint passed

SemVer

minor: additive prompts and test infrastructure; existing prompt versions remain unchanged.

@marcialwushu marcialwushu added the semver:minor Backward-compatible feature release impact label Oct 10, 2026 — with ChatGPT Codex Connector
@marcialwushu marcialwushu removed the semver:minor Backward-compatible feature release impact label Oct 10, 2026
@marcialwushu marcialwushu added the semver:minor Backward-compatible feature release impact label Oct 10, 2026 — with ChatGPT Codex Connector
@marcialwushu
marcialwushu merged commit ea0f30e into main Oct 10, 2026
5 of 9 checks passed
@marcialwushu
marcialwushu deleted the feat/gh-016-promptologia-evals branch October 10, 2026 20:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

semver:minor Backward-compatible feature release impact

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant