iykyka/poc
Claude 699ba68f49
Add PoC #1 base-corpus preprocessing pipeline
Consolidates the AI-Hub "한국어 SNS 멀티턴 대화" TL/VL zip parts into
clean train/val JSONL (142,575 dialogues), with a QA cross-check
against the raw TS/VS source. Script and docs only -- the dataset
itself stays out of git per .gitignore, both for size and because
AI-Hub's terms restrict redistribution.
2026-07-29 08:00:31 +00:00
..
tone-corpus Add PoC #1 base-corpus preprocessing pipeline 2026-07-29 08:00:31 +00:00