datacomp

Star

Here are 3 public repositories matching this topic...

MingliangLiang3 / DynamiCS

Star

Dynamic cluster-based data sampling for efficient and long-tail-aware vision-language model pre-training.

dynamics data-sampling dataset-curation openclip laion400m datacomp vision-language-models long-tail-learning

Updated Jul 7, 2026
Python

vincentzed / decon

Star

`decon`, but with python API binding.

nlp data-science benchmark evaluation data-processing deduplication data-pipeline synthetic-data pretraining llm llms instruction-tuning llm-eval llm-evaluation datacomp lm-evaluation decontaminate

Updated Jul 29, 2026
Rust

backblaze-b2-samples / datacomp-image-text-filtering

Star

DataComp-style image-text dataset filtering on Backblaze B2: stream WebDataset shards from object storage, score image-text alignment with CLIP (open_clip), write filtered shards + quality metrics back to B2 — no local staging, no database. Full-stack Next.js + FastAPI sample for VLM-pretraining data curation

python machine-learning nextjs sample-app clip object-storage backblaze-b2 cloudstorage fastapi s3-compatible webdataset dataset-curation vision-language-model datacomp b2-labs

Updated Aug 18, 2026
TypeScript

Add this topic to your repo

To associate your repository with the datacomp topic, visit your repo's landing page and select "manage topics."

Learn more