Skip to content

feat(marketplace): dedicated git repositories view and persistent caching (#180) - #186

Merged
RealZST merged 62 commits into
RealZST:mainfrom
tazztone:feat/dedicated-repositories
Nov 19, 2026
Merged

RealZST merged 62 commits into
RealZST:mainfrom
tazztone:feat/dedicated-repositories

Conversation

@tazztone

@tazztone tazztone commented Nov 7, 2026 •

Copy link
Copy Markdown
Contributor

Closes #180

Summary

Introduces dedicated Git repository management and persistent local caching to resolve upstream skill discovery limitations and replace ephemeral post-update popups with a first-class catalog view under Marketplace.

image image
  • SQLite Schema v11: Dedicated repositories and repository_items tables with auto-seeding from existing Git extension metadata (install_meta).
  • Persistent Local Caching (~/.harnesskit/repos/): Hardened shallow clone/fetch with http.lowSpeedLimit, low-speed timeout, GIT_TERMINAL_PROMPT=0, and reset/clean recovery.
  • Security: Repository auth_token uses #[serde(skip_serializing, default)] to prevent PAT leakage over IPC/HTTP JSON payloads.
  • Marketplace Integration: Unified "Community Registry" and "Git Repositories" source tabs, live update indicators, search filters, collapsible cards, and deeplinks from ExtensionDetail.
  • Install & Ignore Workflows: Per-agent install dialog with Hermes category support, status badging (available / installed / ignored), and item restore actions.

Evidence

  • Before:
  • After:
    • Dedicated "Git Repositories" tab in Marketplace tracks all upstream repositories and caches.
    • Live agent badges show install status per scope; items can be ignored or restored.
    • Test suites: 828 Rust tests, 44 Vitest test files (375 tests), Biome lint and formatting, and cargo fmt clean.

Merge Danger

Door: two-way

Schema migration automatically backfills existing Git installs into repositories on first launch; database migration drops temporary v10 test tables if present. Local repo caches reside in user data dir (~/.harnesskit/repos/) and can be safely deleted or re-synced at any time.

Blast Radius: contained

Marketplace navigation and Git installation flows. Existing extension scanning, agent adapters, kit syncing, and CLI operations are untouched.

…y with ignore list, and ignore management endpoints
@tazztone
tazztone marked this pull request as draft November 7, 2026 22:04
@tazztone
tazztone marked this pull request as ready for review November 14, 2026 20:44
@RealZST

RealZST commented Nov 15, 2026

Copy link
Copy Markdown
Owner

Thanks for the PR! I'll take a look in the next few days.

@tazztone

Copy link
Copy Markdown
Contributor Author

hope it makes sense and isn't too much work for you. or maybe you wanna reimplement some similar feature yourself

tazztone and others added 8 commits November 16, 2026 14:17
Marketplace gets a Discover | Following switch. Following lists the Git
repositories the user follows: each keeps a shallow checkout under
~/.harnesskit/repos/ and shows the skills it holds, which are installed
and on which agents, and the ones added since the last refresh.

- Follow, refresh and unfollow a repository; refresh all runs four at a
  time and queues the rest. Opening Following refreshes the repositories
  not refreshed within a day.
- Filters (all, not installed, installed, hidden) and search across every
  repository; skills that appear in a later refresh are marked new.
- Install one skill to chosen agents and a scope, hide or show a skill.
- Install from Git can follow the repository it installs from, taking its
  clone over as the checkout.
- A skill's detail panel, on the Extensions page and in Discover, links
  to its repository or offers to follow it.
- On upgrade, the repositories of skills installed from Git are listed.

Each checkout is guarded by a file lock shared by the desktop app and
hk serve, git only ever works on the checkout itself, and a git command
that hangs is stopped after five minutes. A failed refresh keeps the last
good list. Schema v10 adds two tables.

Also fixes post_install_sync: installing a skill for several agents now
records its source for every agent that shares a skill folder with any
of them, not only with the first.

Closes RealZST#180

Co-authored-by: RealZST <53246001+RealZST@users.noreply.github.com>
- Repository cards show their counts (new, skills, installed) as small
  tags beside the name; the address and the refresh time share the line
  below.
- Expand all / Collapse all in the toolbar.
- A dot on the Following switch says a refresh brought skills the user
  has not seen yet; it goes away once Following is opened. Stale
  repositories are refreshed when the Marketplace opens, so the dot is
  current from Discover too.
- The card a "View repository" link points at is outlined.
- Skill rows highlight on hover, and Escape clears the search field.
- The empty state has a title.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@RealZST
RealZST merged commit 015a341 into RealZST:main Nov 19, 2026
5 checks passed
@RealZST

RealZST commented Nov 19, 2026

Copy link
Copy Markdown
Owner

Thanks for the PR! The branch had grown too large to review line by line, so I rebuilt it on current main, keeping your design, and pushed it here (4f1a01c, 44c1461). It will be in the next release.

What is in

Marketplace has a Discover | Following switch. Following is your repositories view: follow, refresh and unfollow a repository, filter by All / Not installed / Installed / Hidden, search, and install each skill. Install from Git can follow the repository it installs from, and a skill's detail panel links to its repository.

2-following

Installed skills show the agents that have them:

5-installed

What I changed

  • Names: Following, Refresh, Hide, Unfollow. "Sync" read as if it changed installed skills.
  • New skills are marked New and listed first, with a dot on the Following switch. Repositories not refreshed within a day refresh when the Marketplace opens, so nothing has to prompt, which is what ux(extensions): hide stale repo banner + clarify Update All scope #61 was closed over.
  • Hidden skills are listed under Hidden only, and installing one unhides it.

The dot on the switch, and the link from a skill's detail panel:

1-discover

What I left out

  • Removing the Git and local install dialogs. They are still the fastest path for a one-off install.
  • Access tokens. They were stored in plain text in SQLite. Private repositories use your own Git credentials.
  • Branch selection. Check Updates only follows the default branch, so a skill from another branch would show an update forever.
  • Update inside the view. It compared against the last sync, so it could offer an older commit than the one installed. Extensions stays the one place that decides what is out of date.

One bug worth knowing about: the new commands sent snake_case keys through Tauri invoke, so install, hide and restore failed in the desktop app while the web build worked.

Merged. Thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Proposal]: Sync & discover new skills from installed Git repositories

2 participants