Meta tags:
description=GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects.;

Headings (most frequently used words):

corpus, this, repositories, saved, searches, tools, navigation, to, your, topic, footer, adbar, bitextor, nathanduran, search, code, users, issues, pull, requests, provide, feedback, menu, use, filter, results, more, quickly, here, are, 107, public, matching, improve, page, add, repo, trafilatura, blkserene, wordless, flairnlp, fundus, opendatalab, mineru, html, grammarly, ua, gec, simplemma, ynop, audiomate, helsinki, nlp, opusfilter, czcorpus, kontext, switchboard, koskenni, beta, lennes, spect, johentsch, ms3, nickduran, align, linguistic, alignment, languagemachines, piccl, silenterus, deepspeech, cleaner, m4t1ss, parallel, corpora, uma, pi1, opiec, mrda,

Text of the page (most frequently used words):
#corpus (69), code (28), tools (27), python (23), updated (22), issues (22), pull (21), requests (21), star (21), language (19), processing (17), for (17), and (15), github (13), nlp (13), data (11), translation (11), 2026 (10), dataset (10), your (9), the (9), machine (9), all (9), security (8), extraction (8), speech (8), analysis (8), text (8), dialogue (7), open (7), natural (7), corpora (7), linguistics (7), jul (7), search (7), scraping (7), html (7), topic (6), datasets (6), parser (6), web (6), crawler (6), news (6), enterprise (6), view (6), you (5), this (5), with (5), topics (5), parallel (5), music (5), support (5), information (4), community (4), more (4), act (4), filtering (4), audio (4), xml (4), spect (4), documentation (4), source (4), switchboard (4), bitextor (4), stars (4), explore (4), can (3), that (3), manage (3), navigation (3), page (3), add (3), image (3), jan (3), wikipedia (3), resources (3), from (3), 2023 (3), cleaning (3), neural (3), deepspeech (3), creation (3), correction (3), linguistic (3), alignment (3), library (3), tsv (3), praat (3), beta (3), advanced (3), lemmatizer (3), tokenizer (3), multilingual (3), gec (3), rag (3), extractor (3), discussions (3), most (3), repositories (3), another (3), tab (3), window (3), refresh (3), session (3), reload (3), sign (3), saved (3), use (3), feedback (3), grade (3), features (3), copilot (3), platform (3), solutions (3), footer (2), learn (2), repo (2), developers (2), 2021 (2), dialogues (2), utilities (2), nathanduran (2), java (2), jun (2), interface (2), opiec (2), manager (2), recognition (2), mozilla (2), multi (2), cleaner (2), ocr (2), workflow (2), workflows (2), sheet (2), files (2), generator (2), musescore (2), 2025 (2), toolkit (2), lennes (2), benny (2), brodda (2), string (2), typescript (2), opusfilter (2), simple (2), sponsor (2), adbar (2), 2024 (2), ukrainian (2), grammatical (2), error (2), trafilatura (2), article (2), mineru (2), powered (2), content (2), agents (2), rss (2), very (2), name (2), literature (2), tool (2), recently (2), fewest (2), forks (2), sort (2), 107 (2), filter (2), sponsors (2), events (2), collections (2), trending (2), signed (2), appearance (2), settings (2), cancel (2), see (2), available (2), searches (2), business (2), developer (2), customer (2), services (2), devops (2), app (2), quality (2), merge (2), perform, action, time, not, share, personal, cookies, contact, docs, status, privacy, terms, inc, associate, repository, visit, landing, select, curate, description, links, easily, about, improve, load, meeting, recorder, mrda, 2019, understanding, dump, wiki, reading, uma, pi1, php, dec, nmt, science, monolingual, other, tasks, m4t1ss, may, multilanguage, learning, creator, framework, silenterus, sep, 2022, folia, computational, set, building, through, post, normalisation, piccl, languagemachines, conversation, ngram, notebooks, nltk, word2vec, extracting, quantitative, reproducible, metrics, level, between, speakers, naturalistic, align, nickduran, musescore4, musescore3, musescore2, format, scores, score, parsing, annotated, ms3, johentsch, aug, conversational, spoken, transcription, transcript, annotation, https, rewriting, manipulation, hyphenation, reimplementation, koskenni, user, extensible, front, end, manatee, engine, kontext, czcorpus, 115, helsinki, loader, noise, handling, 139, audiomate, ynop, low, resource, identification, lemmatization, tokenization, lemmatiser, morphological, wordlist, detection, especially, useful, speed, efficiency, 209, simplemma, macaulay2, feb, fluency, 270, grammarly, mar, webagent, slm, main, outputs, clean, bodies, perfect, deep, research, applications, training, generation, 277, opendatalab, nov, bleualign, bicleaner, document, aligner, hunalign, sentence, segmentation, statistical, tmx, warc, apertium, wget, dictionaries, generates, memories, websites, 299, commoncrawl, classification, scraper, sitemap, funny, 468, fundus, flairnlp, oct, stopword, statistics, dependency, tagger, integrated, study, 759, wordless, blkserene, llm, preprocessing, builder, html2text, tei, readability, feed, aggregator, markdown, mining, command, line, gather, metadata, crawling, output, csv, json, txt, least, options, jupyter, notebook, javascript, here, are, public, matching, message, dismiss, alert, switched, accounts, out, resetting, focus, create, qualifiers, our, query, results, quickly, submit, include, email, address, contacted, read, every, piece, take, input, seriously, provide, syntax, tips, clear, users, jump, pricing, premium, ons, archive, program, accelerator, maintainer, lab, programs, fund, partners, trust, center, forum, skills, insights, ebooks, reports, webinars, stories, type, software, development, industries, government, manufacturing, financial, healthcare, industry, cases, devsecops, modernization, case, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, changelog, blog, why, stop, leaks, before, they, start, secret, protection, secure, build, find, fix, vulnerabilities, application, enforce, changes, review, plan, track, work, instant, dev, environments, codespaces, automate, any, actions, integrate, external, mcp, registry, new, direct, issue, write, better, toggle, menu, skip,

Text of the page (random words):
corpus tools github topics github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes code quality enforce quality at merge application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message explore topics trending collections events github sponsors corpus tools star here are 107 public repositories matching this topic language all filter by language all 107 python 55 html 4 java 4 typescript 4 c 3 go 3 javascript 3 jupyter notebook 3 c 2 r 2 sort most stars sort options most stars fewest stars most forks fewest forks recently updated least recently updated adbar trafilatura sponsor star 6 3k code issues pull requests discussions python command line tool to gather text and metadata on the web crawling scraping extraction output as csv json html md txt xml nlp crawler text mining html to markdown scraping news aggregator text extraction web scraping rss feed readability tei html2text news crawler corpus builder corpus tools article extractor text cleaning rag text preprocessing llm updated jul 18 2026 python blkserene wordless star 759 code issues pull requests discussions an integrated corpus tool with multilingual support for the study of language literature and translation translation tokenizer corpus linguistics tagger literature dependency parser corpus linguistics lemmatizer corpus tools corpus processing corpus search corpus statistics stopword corpus analysis updated oct 30 2025 python flairnlp fundus star 468 code issues pull requests a very simple news crawler with a funny name python nlp rss sitemap crawler scraper corpus text extraction web scraping image classification datasets news crawler corpus tools commoncrawl web corpus news scraping cc news image extraction updated jul 19 2026 python bitextor bitextor star 299 code issues pull requests discussions bitextor generates translation memories from multilingual websites crawler dictionaries tokenizer machine translation wget apertium neural machine translation warc tmx statistical machine translation corpus generator sentence segmentation corpus tools corpus processing hunalign parallel corpora document aligner bicleaner bleualign bitextor updated nov 11 2024 python opendatalab mineru html star 277 code issues pull requests mineru html an slm powered html main content extractor that outputs clean html bodies perfect for deep research agents rag applications and training data generation nlp scraping text extraction web scraping corpus tools article extractor rag trafilatura webagent updated mar 27 2026 python grammarly ua gec star 270 code issues pull requests ua gec grammatical error correction and fluency corpus for the ukrainian language natural language processing corpus dataset corpus data corpus tools gec nlp datasets grammatical error correction ukrainian language updated feb 11 2024 macaulay2 adbar simplemma sponsor star 209 code issues pull requests simple multilingual lemmatizer for python especially useful for speed and efficiency nlp tokenizer language detection wordlist lemmatizer morphological analysis lemmatiser tokenization lemmatization corpus tools language identification low resource nlp updated jul 21 2026 python ynop audiomate star 139 code issues pull requests python library for handling audio datasets audio music speech speech recognition dataset filtering noise dataset creation dataset manager corpus tools data loader audio datasets updated jul 6 2023 python helsinki nlp opusfilter star 115 code issues pull requests opusfilter parallel corpus processing toolkit nlp natural language processing machine translation parallel corpus corpus tools corpus processing updated jul 1 2026 python czcorpus kontext star 80 code issues pull requests an advanced extensible web front end for the manatee open corpus search engine user interface corpora corpus linguistics corpus tools updated jul 15 2026 typescript nathanduran switchboard corpus star 73 code issues pull requests utilities for processing the switchboard dialogue act corpus dialogue corpus corpus data corpus tools switchboard dialogues corpus processing dialogue data switchboard corpus dialogue act updated jan 24 2021 python koskenni beta star 63 code issues pull requests an open source reimplementation of benny brodda s beta in python open source hyphenation beta linguistics string manipulation corpus tools string rewriting benny brodda updated jan 11 2026 python lennes spect star 57 code issues pull requests spect speech corpus toolkit for praat documentation https lennes github io spect annotation analysis speech transcript corpus linguistics transcription spoken language praat corpus tools speech analysis conversational speech speech corpus spect updated aug 20 2025 praat johentsch ms3 star 56 code issues pull requests a parser for annotated musescore 3 files tsv parser corpus xml parsing xml parser corpus data music score sheet music musescore music scores corpus generator corpus tools xml parser library corpus processing tsv format musescore2 tsv files musescore3 sheet music parser musescore4 updated jul 7 2026 python nickduran align linguistic alignment star 55 code issues pull requests python library for extracting quantitative reproducible metrics of multi level alignment between speakers in naturalistic language corpora python word2vec text analysis nltk notebooks ngram analysis corpus tools conversation analysis linguistic analysis linguistic alignment updated jun 29 2026 python languagemachines piccl star 50 code issues pull requests a set of workflows for corpus building through ocr post correction and normalisation nlp workflow ocr computational linguistics corpus linguistics folia corpus tools updated sep 7 2022 python silenterus deepspeech cleaner star 48 code issues pull requests multi language dataset cleaner creator for mozilla s deepspeech framework machine learning mozilla speech recognition dataset filtering dataset creation dataset manager multilanguage corpus tools deepspeech audio datasets updated may 22 2023 python m4t1ss parallel corpora tools star 42 code issues pull requests tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks nlp language data science natural language processing translation machine machine translation natural language neural machine translation corpora nmt filtering data processing neural language processing cleaning corpus tools updated dec 19 2023 php uma pi1 opiec star 39 code issues pull requests reading the data from opiec an open information extraction corpus nlp natural language processing wiki wikipedia corpus information extraction dataset corpora corpus data nlp resources wikipedia dump corpus tools natural language understanding open information extraction dataset interface wikipedia corpus corpus processing nlp datasets updated jun 12 2019 java nathanduran mrda corpus star 38 code issues pull requests utilities for processing the meeting recorder dialogue act corpus dialogue corpus corpus data corpus tools dialogues corpus processing dialogue act updated jan 24 2021 python load more improve this page add a description image and links to the corpus tools topic page so that developers can more easily learn about it curate this topic add this topic to your repo to associate your repository with the corpus tools topic visit your repo s landing page and select manage topics learn more footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time