{"id":80,"date":"2023-12-11T19:11:36","date_gmt":"2023-12-11T19:11:36","guid":{"rendered":"https:\/\/mingmingzi.com\/?p=80"},"modified":"2023-12-15T23:34:20","modified_gmt":"2023-12-15T23:34:20","slug":"regex","status":"publish","type":"post","link":"https:\/\/mingmingzi.com\/index.php\/2023\/12\/11\/regex\/","title":{"rendered":"Regex Riddles: Puzzles and Perils of Patterns"},"content":{"rendered":"\n
Regular Expressions, commonly known as Regex or Regexp, are powerful tools for pattern matching and text manipulation. They have a rich history and find applications across various fields. In this tutorial, we'll explore the history, categories, grammar, and practical applications of Regular Expressions.<\/code><\/pre>\n\n\n\n
History of Regular Expressions<\/strong><\/h2>\n\n\n\n
1950s: The concept of regular expressions was first formalized by mathematician Stephen Cole Kleene. He used regular expressions to describe the syntax of formal languages.
1960s: Ken Thompson, the creator of Unix, implemented regular expressions in the QED text editor. This marked the introduction of regex into the world of computing.
1980s: Henry Spencer developed one of the first regex libraries, widely used in Unix systems.
1990s: Perl, a popular programming language, integrated regex as a core feature, making it accessible to a broader audience.
2000s: Regex support expanded to numerous programming languages, including Python, JavaScript, and Ruby.<\/p>\n\n\n\n
Grammar of Regular Expressions<\/strong><\/h2>\n\n\n\n
Elements<\/strong><\/p>\n\n\n\n
Literal Characters: Any character not listed as a metacharacter matches itself (e.g., ‘a’ matches ‘a’).
Metacharacters: Special characters with reserved meanings (e.g., ‘.’ matches any character).
Character Classes: Define sets of characters (e.g., ‘[aeiou]’ matches any vowel).
Quantifiers: Indicate the number of times a character or group should be repeated (e.g., ‘*’ matches zero or more times).
Anchors: Specify positions within the text (e.g., ‘^’ matches the start of a line).
Groups and Alternation: Use parentheses to group expressions and ‘|’ to denote alternatives (e.g., ‘(cat|dog)’ matches ‘cat’ or ‘dog’).
For a comprehensive understanding of regex grammar and operations, you can refer to the Wikipedia page on Regular Expressions.<\/p>\n\n\n\n
Common Regex Operations<\/strong><\/p>\n\n\n\n
Boolean “or” (|): Separates alternatives. For example, gray|grey can match “gray” or “grey.”
Grouping (()): Groups a series of pattern elements to a single element. Allows referencing matched patterns using variables (e.g., $1, $2).
Quantification (?, *, +, {M}, {M,}, {,max}, {min,max}): Specifies how many times the preceding element is allowed to repeat.
Wildcard (.): Matches any character.
Character Classes ([\u2026]): Denotes a set of possible character matches.
Alternation (|): Separates alternate possibilities.
Word Boundary (\\b): Matches a zero-width boundary between a word-class character and either a non-word class character or an edge.
Whitespace (\\s) and Non-Whitespace (\\S) Matches: For spaces and non-spaces.
Digit (\\d) and Non-Digit (\\D) Matches: For digits and non-digits.
Line Begin (^) and Line End ($) Matches: For the beginning and end of a line or string.
These operations provide powerful tools for constructing complex patterns.<\/p>\n\n\n\n
Applications of Regular Expressions<\/strong><\/h2>\n\n\n\n
    \n
  1. Text Search and Manipulation
    Searching for specific patterns or keywords in text documents.
    Replacing text with desired formats (e.g., date formatting, email address extraction).<\/li>\n\n\n\n
  2. Data Validation and Extraction
    Validating user input (e.g., email validation, password strength checks).
    Extracting data from structured text (e.g., log files, CSV data).<\/li>\n\n\n\n
  3. Web Development
    Form validation and input sanitization in web applications.
    URL routing and parameter extraction.<\/li>\n\n\n\n
  4. Programming and Scripting
    Pattern matching and data extraction in programming languages.
    Log file parsing and analysis.<\/li>\n\n\n\n
  5. Data Science and Natural Language Processing
    Tokenization and text preprocessing in NLP tasks.
    Data extraction and transformation in data pipelines.<\/li>\n<\/ol>\n\n\n\n
    Some Application Examples (in Trados Studio):<\/strong><\/h2>\n\n\n\n
    \n
    Identify HTML tag elements
    Regex: <(\\\/?)([a-zA-Z]+)([^>]*?)>
    Use Case: Ensure consistency in XML\/HTML tags within the content, especially for website localization.
    Scenario: Suppose linguists are presented with raw HTML elements in their translation interface, a situation that is not uncommon in platforms like Crowdin. The primary objective is to ensure that these HTML tags remain unchanged during translation. However, we encounter several issues: In the source text, the linguist has mistakenly translated the ‘id’ attribute of a ‘div’ tag on line 1. On line 3, the tag is altered, leading to corruption. By line 6, the closing part of a tag is missing. This scenario underscores the importance of selecting and highlighting all tag elements, which can significantly aid a Quality Assurance Manager in identifying such errors. Ensuring the integrity of HTML tags is crucial for the smooth functioning of a localized website and to prevent it from crashing upon initial launch.<\/p>\n<\/div>
    \"\"<\/figure><\/div>\n\n\n\n
    \"\"<\/figure>
    \n
    Removing Extra Whitespaces
    In Trados
    Find \\s{2,}
    Replace with a single whitespace.
    \\s or a simple whitespace<\/p>\n\n\n\n
    \"\"<\/figure>\n<\/div><\/div>\n\n\n\n
    <\/p>\n","protected":false},"excerpt":{"rendered":"
    History of Regular Expressions 1950s: The concept of regular expressions was first formalized by mathematician Stephen Cole Kleene. He used regular expressions to describe the syntax of formal languages.1960s: Ken Thompson, the creator of Unix, implemented regular expressions in the QED text editor. This marked the introduction of regex into the world of computing.1980s: Henry …<\/p>\n
      Regex Riddles: Puzzles and Perils of Patterns<\/span> Read More »<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"categories":[1],"tags":[],"class_list":["post-80","post","type-post","status-publish","format-standard","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/posts\/80","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/comments?post=80"}],"version-history":[{"count":3,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/posts\/80\/revisions"}],"predecessor-version":[{"id":203,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/posts\/80\/revisions\/203"}],"wp:attachment":[{"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/media?parent=80"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/categories?post=80"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mingmingzi.com\/index.php\/wp-json\/wp\/v2\/tags?post=80"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}