Meta tags:
description=A Python parser for MediaWiki wikicode. Contribute to earwig/mwparserfromhell development by creating an account on GitHub.;

Headings (most frequently used words):

uh, oh, navigation, saved, searches, mwparserfromhell, files, footer, search, code, repositories, users, issues, pull, requests, provide, feedback, earwig, menu, use, to, filter, your, results, more, quickly, folders, and, latest, commit, history, repository, installation, usage, limitations, integration, about, releases, 26, packages, contributors, languages, topics, resources, license, stars, watchers, forks,

Text of the page (most frequently used words):
#mwparserfromhell (31), the (31), code (26), and (22), text (21), template (20), this (17), foo (17), bar (16), github (15), page (15), print (15), you (14), parse (13), can (12), for (11), wikicode (11), get (11), with (11), security (10), parser (10), python (9), filter_templates (9), spam (9), mediawiki (8), templates (8), all (8), reload (7), name (7), your (7), date (7), baz (7), view (7), that (6), not (6), while (6), requests (6), import (6), are (6), has (6), cleanup (6), value (6), enterprise (6), navigation (5), license (5), params (5), tag (5), more (5), syntax (5), 2012 (5), july (5), eggs (5), earwig (5), from (5), commit (5), search (5), community (4), there (4), was (4), error (4), loading (4), please (4), latest (4), readme (4), readthedocs (4), title (4), using (4), pywikibot (4), like (4), since (4), settings (4), would (4), bold (4), source (4), stub (4), str (4), includes (4), explore (4), see (4), available (4), documentation (4), use (4), yaml (4), actions (4), quality (4), issues (4), support (4), docs (3), version (3), stars (3), resources (3), topics (3), content (3), main (3), query (3), headers (3), format (3), site (3), objects (3), treated (3), file (3), links (3), pass (3), other (3), cannot (3), contents (3), example (3), end (3), object (3), uncategorized (3), add (3), false (3), recursive (3), nodes (3), run (3), package (3), development (3), x86_64 (3), install (3), files (3), changelog (3), workflows (3), open (3), insights (3), pull (3), signed (3), another (3), tab (3), window (3), refresh (3), session (3), sign (3), saved (3), feedback (3), grade (3), features (3), copilot (3), platform (3), solutions (3), action (2), manage (2), footer (2), releases (2), repository (2), forks (2), 890 (2), mit (2), wikipedia (2), return (2), revision (2), revisions (2), res (2), json (2), req (2), api_url (2), def (2), https (2), api (2), library (2), any (2), developed (2), have (2), method (2), recognized (2), tags (2), names (2), regular (2), specific (2), may (2), include (2), occurs (2), formatting (2), users (2), plain (2), true (2), when (2), elements (2), because (2), ordinary (2), instead (2), treat (2), case (2), only (2), properly (2), external (2), com (2), way (2), foobar (2), acts (2), direct (2), back (2), replace (2), matches (2), remove (2), they (2), also (2), which (2), contain (2), additional (2), usage (2), reinstall (2), pytest (2), extension (2), git (2), pypi (2), tokenizer (2), environments (2), arm64 (2), lock (2), setup (2), pyproject (2), toml (2), rst (2), pre (2), config (2), gitignore (2), coveragerc (2), clang (2), tests (2), src (2), scripts (2), 007 (2), commits (2), last (2), message (2), menu (2), discussions (2), appearance (2), cancel (2), searches (2), repositories (2), business (2), advanced (2), developer (2), customer (2), services (2), devops (2), app (2), merge (2), perform, time, share, personal, information, cookies, contact, status, privacy, terms, 2026, inc, shell, languages, contributors, packages, jul, 2025, report, watching, watchers, activity, about, slots, pages, bot, user, agent, formatversion, titles, rvlimit, rvslots, rvprop, prop, org, php, following, might, look, used, originally, essentially, calls, earwigbot, integration, anything, looks, xml, even, list, valid, depends, loaded, extensions, localized, namespace, aren, such, wikilinks, supported, linktrail, rules, language, word, ending, additionally, lacks, awareness, certain, wiki, future, multiple, parsing, modes, around, restriction, sensibly, commonly, often, interest, treats, skip_style_tags, workaround, different, cross, over, each, gets, confused, represented, tree, will, first, construct, italic, parsed, echo, hello, world, adjacent, considered, part, link, reality, depend, http, produced, transclusion, detected, imagine, hypothetical, contained, correctly, understand, translates, examining, unfinished, possibly, extending, further, down, generates, html, access, among, things, interface, several, implications, limitations, then, convert, into, saving, calling, easily, modified, alter, lists, comparing, takes, care, capitalization, whitespace, insert, append, manually, possible, getting, nested, trivial, some, extra, methods, normal, rather, straightforward, where, comprehensive, test, suite, updates, module, tested, clone, sync, __version__, prebuilt, wheels, fast, compiled, most, linux, macos, windows, x86, building, built, fall, slower, pure, implementation, setting, environment, variable, installing, with_extension, easiest, release, pip, installation, contributions, others, full, legoktm, provides, easy, outrageously, powerful, supports, hell, items, history, folders, branches, options, star, fork, must, change, notification, notifications, public, dismiss, alert, switched, accounts, out, resetting, focus, create, qualifiers, our, filter, results, quickly, submit, email, address, contacted, read, every, piece, take, input, very, seriously, provide, tips, clear, jump, pricing, premium, ons, powered, collections, trending, archive, program, accelerator, maintainer, lab, programs, fund, developers, sponsors, partners, trust, center, forum, skills, ebooks, reports, events, webinars, stories, type, software, topic, industries, government, manufacturing, financial, healthcare, industry, cases, devsecops, modernization, nonprofits, startups, small, medium, teams, enterprises, company, size, marketplace, blog, why, stop, leaks, before, start, secret, protection, secure, build, find, fix, vulnerabilities, application, enforce, changes, review, plan, track, work, instant, dev, codespaces, automate, workflow, integrate, tools, mcp, registry, new, agents, issue, write, better, creation, toggle, skip,

Text of the page (random words):
github earwig mwparserfromhell a python parser for mediawiki wikicode github skip to content navigation menu toggle navigation sign in appearance settings platform ai code creation github copilot write better code with ai github copilot app direct agents from issue to merge mcp registry new integrate external tools developer workflows actions automate any workflow codespaces instant dev environments issues plan and track work code review manage code changes code quality enforce quality at merge application security github advanced security find and fix vulnerabilities code security secure your code as you build secret protection stop leaks before they start explore why github documentation blog changelog marketplace view all features solutions by company size enterprises small and medium teams startups nonprofits by use case app modernization devsecops devops ci cd view all use cases by industry healthcare financial services manufacturing government view all industries view all solutions resources explore by topic ai software development devops security view all topics explore by type customer stories events webinars ebooks reports business insights github skills support services documentation customer support community forum trust center partners view all resources open source community github sponsors fund open source developers programs security lab maintainer community accelerator github stars archive program repositories topics trending collections enterprise enterprise solutions enterprise platform ai powered developer platform available add ons github advanced security enterprise grade security features copilot for business enterprise grade ai features premium support enterprise grade 24 7 support pricing search or jump to search code repositories users issues pull requests search clear search syntax tips provide feedback we read every piece of feedback and take your input very seriously include my email address so i can be contacted cancel submit feedback saved searches use saved searches to filter your results more quickly name query to see all available qualifiers see our documentation cancel create saved search sign in sign up appearance settings resetting focus you signed in with another tab or window reload to refresh your session you signed out in another tab or window reload to refresh your session you switched accounts on another tab or window reload to refresh your session dismiss alert message earwig mwparserfromhell public notifications you must be signed in to change notification settings fork 87 star 890 code issues 81 pull requests 8 discussions actions security and quality 0 insights additional navigation options code issues pull requests discussions actions security and quality insights earwig mwparserfromhell main branches tags go to file code open more actions menu folders and files name name last commit message last commit date latest commit history 1 007 commits 1 007 commits github workflows github workflows docs docs scripts scripts src mwparserfromhell src mwparserfromhell tests tests clang format clang format coveragerc coveragerc gitignore gitignore pre commit config yaml pre commit config yaml readthedocs yaml readthedocs yaml changelog changelog license license readme rst readme rst pyproject toml pyproject toml setup py setup py uv lock uv lock view all files repository files navigation readme mit license more items mwparserfromhell mwparserfromhell the mediawiki parser from hell is a python package that provides an easy to use and outrageously powerful parser for mediawiki wikicode it supports python 3 9 developed by earwig with contributions from σ legoktm and others full documentation is available on readthedocs development occurs on github installation the easiest way to install the parser is from pypi you can install the latest release with pip install mwparserfromhell prebuilt wheels are available on pypi with a fast compiled c tokenizer extension for most environments linux x86_64 and arm64 macos x86_64 and arm64 windows x86 and x86_64 if building from source and the c tokenizer cannot be built you can fall back to the slower pure python implementation by setting the environment variable with_extension 0 when installing to get the latest development version with uv git clone https github com earwig mwparserfromhell git cd mwparserfromhell uv sync uv run python c import mwparserfromhell print mwparserfromhell __version__ the comprehensive test suite can be run with pytest if using uv pass reinstall package so updates to the extension module are properly tested uv run reinstall package mwparserfromhell pytest usage normal usage is rather straightforward where text is page text import mwparserfromhell wikicode mwparserfromhell parse text wikicode is a mwparserfromhell wikicode object which acts like an ordinary str object with some extra methods for example text i has a template foo bar baz eggs spam see it wikicode mwparserfromhell parse text print wikicode i has a template foo bar baz eggs spam see it templates wikicode filter_templates print templates foo bar baz eggs spam template templates 0 print template name foo print template params bar baz eggs spam print template get 1 value bar print template get eggs value spam since nodes can contain other nodes getting nested templates is trivial text foo bar baz spam mwparserfromhell parse text filter_templates foo bar baz spam bar baz spam spam you can also pass recursive false to filter_templates and explore templates manually this is possible because nodes can contain additional wikicode objects code mwparserfromhell parse foo this includes a template print code filter_templates recursive false foo this includes a template foo code filter_templates recursive false 0 print foo get 1 value this includes a template print foo get 1 value filter_templates 0 includes a template print foo get 1 value filter_templates 0 get 1 value template templates can be easily modified to add remove or alter params wikicode objects can be treated like lists with append insert remove replace and more they also have a matches method for comparing page or template names which takes care of capitalization and whitespace text cleanup foo is a bar uncategorized code mwparserfromhell parse text for template in code filter_templates if template name matches cleanup and not template has date template add date july 2012 print code cleanup date july 2012 foo is a bar uncategorized code replace uncategorized bar stub print code cleanup date july 2012 foo is a bar bar stub print code filter_templates cleanup date july 2012 bar stub you can then convert code back into a regular str object for saving the page by calling str on it text str code print text cleanup date july 2012 foo is a bar bar stub text code true limitations while the mediawiki parser generates html and has access to the contents of templates among other things mwparserfromhell acts as a direct interface to the source code only this has several implications syntax elements produced by a template transclusion cannot be detected for example imagine a hypothetical page template end bold that contained the text b while mediawiki would correctly understand that b foobar end bold translates to b foobar b mwparserfromhell has no way of examining the contents of end bold instead it would treat the bold tag as unfinished possibly extending further down the page templates adjacent to external links as in http example com foo are considered part of the link in reality this would depend on the contents of the template when different syntax elements cross over each other as in echo hello world the parser gets confused because this cannot be represented by an ordinary syntax tree instead the parser will treat the first syntax construct as plain text in this case only the italic tag would be properly parsed workaround since this commonly occurs with text formatting and text formatting is often not of interest to users you may pass skip_style_tags true to mwparserfromhell parse this treats and as plain text a future version of mwparserfromhell may include multiple parsing modes to get around this restriction more sensibly additionally the parser lacks awareness of certain wiki specific settings word ending links are not supported since the linktrail rules are language specific localized namespace names aren t recognized so file links such as file are treated as regular wikilinks anything that looks like an xml tag is treated as a tag even if it is not a recognized tag name since the list of valid tags depends on loaded mediawiki extensions integration mwparserfromhell is used by and originally developed for earwigbot page objects have a parse method that essentially calls mwparserfromhell parse on page get if you re using pywikibot your code might look like this import mwparserfromhell import pywikibot def parse title site pywikibot site page pywikibot page site title text page get return mwparserfromhell parse text if you re not using a library you can parse any page with the following python 3 code using the api and the requests library import mwparserfromhell import requests api_url https en wikipedia org w api php def parse title params action query prop revisions rvprop content rvslots main rvlimit 1 titles title format json formatversion 2 headers user agent my bot name 1 0 req requests get api_url headers headers params params res req json revision res query pages 0 revisions 0 text revision slots main content return mwparserfromhell parse text about a python parser for mediawiki wikicode mwparserfromhell readthedocs io topics python parser mediawiki wikipedia resources readme license mit license uh oh there was an error while loading please reload this page activity stars 890 stars watchers 33 watching forks 87 forks report repository releases 26 version 0 7 2 latest jul 1 2025 25 releases packages 0 uh oh there was an error while loading please reload this page uh oh there was an error while loading please reload this page contributors uh oh there was an error while loading please reload this page languages python 68 7 c 30 7 shell 0 6 footer 2026 github inc footer navigation terms privacy security status community docs contact manage cookies do not share my personal information you can t perform that action at this time