http://okapiframework.org/wiki/index.php?action=history&feed=atom&title=Cleanup_StepCleanup Step - Revision history2026-04-21T16:20:19ZRevision history for this page on the wikiMediaWiki 1.38.2http://okapiframework.org/wiki/index.php?title=Cleanup_Step&diff=764&oldid=prevOkapifra: /* Limitations */2018-10-29T12:34:08Z<p><span dir="auto"><span class="autocomment">Limitations</span></span></p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 08:34, 29 October 2018</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l25">Line 25:</td>
<td colspan="2" class="diff-lineno">Line 25:</td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Does not work with Asian or bi-directional languages.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Does not work with Asian or bi-directional languages.</div></td></tr>
<tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr>
<tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>[[Category:Steps]]</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>[[Category:Steps<ins style="font-weight: bold; text-decoration: none;">]] [[Category:TMX</ins>]]</div></td></tr>
</table>Okapifrahttp://okapiframework.org/wiki/index.php?title=Cleanup_Step&diff=429&oldid=prevYsavourel: 1 revision imported2016-06-04T23:20:02Z<p>1 revision imported</p>
<table style="background-color: #fff; color: #202122;" data-mw="interface">
<tr class="diff-title" lang="en">
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td>
<td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 19:20, 4 June 2016</td>
</tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div>
</td></tr></table>Ysavourelhttp://okapiframework.org/wiki/index.php?title=Cleanup_Step&diff=428&oldid=prevAmake: /* Overview */2013-11-22T06:00:43Z<p><span dir="auto"><span class="autocomment">Overview</span></span></p>
<p><b>New page</b></p><div>{{Steps Header}}<br />
__TOC__<br />
==Overview==<br />
<br />
This step cleans strings by normalizing quotes, punctuation, etc. ready for further processing.<br />
<br />
Takes: Filter events. Sends: Filter events.<br />
<br />
By default, all whitespace is normalized before any further processing is performed; all multiple space, tab, etc. characters are replaced with a single instance.<br />
<br />
==Parameters==<br />
<br />
<cite>Normalize quotation marks</cite> &mdash; Set this option to replace all quotation marks with straight double quotes (&quot;) and all apostrophes with single straight quotes (&#39;).<br />
<br />
<cite>Mark segments matching default regular expressions for removal</cite> &mdash; This option is not currently used.<br />
<br />
<cite>Mark segments matching user defined regular expressions for removal</cite> &mdash; Set this option to remove text units that contain text that matches the user defined regular expression.<br />
<br />
<cite>Check for corrupt or unexpected characters</cite> &mdash; Set this option to detect and remove text units that contain common corrupt character strings.<br />
<br />
<cite>Remove unnecessary segments from text unit</cite> &mdash; Set this option to remove text units that have been marked for removal or have no target text.<br />
<br />
==Limitations==<br />
<br />
Does not work with Asian or bi-directional languages.<br />
<br />
[[Category:Steps]]</div>Amake