regex

https://regex101.com/r/9n9yhW/1
https://regex101.com/r/nnseOW/2

https://sourceforge.net/p/omegat/wiki/Filtering%20Segments/
(add ttt-docs too)
also the expressions to find source and target...

tags in omegat:
https://regex101.com/library?orderBy=RELEVANCE&search=omegat
https://regex101.com/r/A2aDKJ/1
https://regex101.com/r/l5zSWX/1

regular

expressions

reg

ex

https://regexr.com/5giai

what is a regex?

regular

that define a
search pattern

expression

A sequence of characters

Matches text that follows a pattern :Not a pattern in the sense of a sequence, but in the sense of having something in common. What do these pair of strings have in common?
- test - test

- abc - xyz

- 123 - 456

- 1 - 99999999

- 1 - a

- a23 - =,&

A sequence of characters
that define a search pattern.

regular

expressions

what are regexes useful for?

Purposes of regex

  • Searching for a match (finding stuff in text)
    • Segmentation
    • Validating input
    • QA automation
  • Replacing part of the text
    • Automatic or manual fixes
  • Entity extraction

Goals of this training

  • Make you less scared of using a computer to handle text (if you were!)
  • Make you more independent
  • Make you more capable (a bit closer to a power user)
  • Make you more aware of what can be done even if you're not sure how it's done
    • Ask for help

Non-goals

  • Turn you into regex champs

everything is a character

characters form strings

literal characters

metacharacters

backslash

literal characters

literal matches

metacharacters

pattern matching

backslash

escaping

two exercises

  • find asterisk in text
  • find text "\n"

 

examples

the dot

the dot

  • Matches any character
    • including the line break, or not

character classes

character class shortcuts

quantifiers

Title Text

{n,m}

?

+

*

 

exercise

  • find figures: [0-9]+

negation

Title Text

  • [^...]
  • negative lookaround
  • capital case \S, \D, \W

execise

  • find text between parenthesis
  • find text between angle brackets

alternatives

Exercise after \d and |

  • michael, Michael, Mike, mike
  • Addresses: digit words Road or Street or abbrev

group constructs

anchors

metasequences

replacements

lookarounds

exercise

  • remove the angle brackets

https://www.evernote.com/shard/s431/nl/80602844/684f56b9-74a7-4281-8dfd-705c49128f4b/

Blocks, example

\p{InArabic}\(

find an opening parenthesis preceded by an Arabic character

flags

case sensitive

https://unicodelookup.com/#letter%20a/1

e.g. A and a are different characters! (different code points)

global

Subtitle

Named groups

(?<token>[\d]*)

(?P<year>(?:19|20)\d\d)(?P<delimiter>[- /.])(?P<month>0[1-9]|1[012])\2(?P<day>0[1-9]|[12][0-9]|3[01])

https://pythex.org/

Exercises

  • [Qq]uestionnaire.*\.docx?$ <- add a list of files to the text sample
  • Bullet Two
  • Bullet Three
  •  

References

Books

  • Bullet One
  • Bullet Two
  • Bullet Three
  abc… Letters
  123… Digits
  \d Any Digit
  \D Any Non-digit character
  . Any Character
  \. Period
  [abc] Only a, b, or c
  [^abc] Not a, b, nor c
  [a-z] Characters a to z
  [0-9] Numbers 0 to 9
  \w Any Alphanumeric character
  \W Any Non-alphanumeric character
  {m} m Repetitions
  {m,n} m to n Repetitions
  * Zero or more repetitions
  + One or more repetitions
  ? Optional character
  \s Any Whitespace
  \S Any Non-whitespace character
  ^…$ Starts and ends
  (…) Capture Group
  (a(bc)) Capture Sub-group
  (.*) Capture all
  (abc|def) Matches abc or def

if all that was unfathomable...

here's one last technique:

do not forget to cover examples sent by Valentina in a Word file (same as found in OmegaT's regex page)

Technical

  • https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Regular_Expressions
  • https://www.regular-expressions.info/quickstart.html

General public

  • https://www.theguardian.com/technology/2012/dec/04/ict-teach-kids-regular-expressions
  • https://regexcrossword.com/ <- want to play?