smallevals — CPU-fast, GPU-blazing fast offline retrieval evaluation for RAG systems with tiny QA models.
-
Updated
Dec 4, 2025 - Python
smallevals — CPU-fast, GPU-blazing fast offline retrieval evaluation for RAG systems with tiny QA models.
Local decision recorder and offline policy evaluation for coding agents. Advisory tooling with explicit evidence and authority boundaries.
Lightweight Python library for interactive demo and inspection of recommender systems in Streamlit.
【协同过滤推荐算法 | UserCF/ItemCF 实现】 搞定 UserCF+ItemCF 协同过滤推荐算法~ 数据集:(本人懒癌首选10标签/4w条):https://tianchi.aliyun.com/dataset/216549 备选数据集(30 + 标签 / 10 万条):https://tianchi.aliyun.com/dataset/215680 .核心:行为加权(pv/fav/cart/buy)→ 余弦相似度 → KNN 邻居 → Top-N → 离线评估,Precision 0.96 / 0.99、覆盖率 1.0,附 12 张可视化与双算法流程图,并落地「臻享云牧」云养殖平台。基于天池真实数据集。
Support-ticket dedup & resolution finder — pgvector semantic retrieval evaluated with Netflix XP-style offline replay (recall@k / MRR). Shares a domain-agnostic similarity engine with its sibling repo 'clause'. Next.js 15 · Supabase · HF embeddings.
Local reproduction of Dream-RSI: model weights stay frozen while an executable search policy evolves, via persistent discovery trees and an offline replay engine that scores candidate policies at zero extra inference cost.
Offline prototype for intent-aware queue adaptation in music recommendation systems
Evaluation-driven MovieLens-1M recommender with temporal holdouts, NeuMF/MF/CF/content baselines, full-candidate ranking, fusion, popularity trade-offs, and controlled metric-audit experiments.
Recommend Signal — temporal offline evaluation for recommendation policies, with explicit causal boundaries.
CTR/ranking fundamentals practice with feature crossing, Logistic Regression baselines, AUC/LogLoss/nDCG notes and reproducible evaluation scripts.
Algorithm Intern Candidate | Recommendation / Search Retrieval / Ranking | PyTorch + Faiss | Offline Evaluation / Negative Sampling / Badcase Analysis
Offline RAG retrieval-quality harness. Recall@k, nDCG, MRR, chunking diagnostics, regression diffs. No LLM-as-judge required. CI-friendly.
Local contract-review workflow with cited proposals, amendment coverage, exact approvals and authored outcome evaluation.
Offline security investigation agent with scoped evidence, cited dispositions, simulated review and independent state verification.
轻量级终端 AI Agent Harness:手写状态机、能力审批、Checkpoint 恢复与增量审计;仅 1 个直接运行依赖,500+ 项测试与 10 项离线 Evals。
Offline finance reconciliation agent with evidence-backed matching, unposted review proposals and independent ledger-state checks.
可复现的中文离线内容推荐应用原型,覆盖合成行为数据、动态兴趣画像、双路召回、个性化排序、多样性重排、推荐解释与离线评估。
Production-ready recommender system suite: serving API, pipelines, algorithm SDK, and evaluation tooling.
Python and Java support workflow with reviewed returns, versioned policy, SQLite state and independent offline outcome tests.
End-to-end joke recommendation system with offline evaluation, FastAPI serving, Docker, and model artifacts.
To associate your repository with the offline-evaluation topic, visit your repo's landing page and select "manage topics."