javapersianutils.core.normalizer

Class AggressiveEditing

java.lang.Object

javapersianutils.core.normalizer.AggressiveEditing

public class AggressiveEditing
extends Object

replace all more than one ! or ? marks with just one or removes all extra kashida and spaces

Method Summary

Modifier and Type	Method and Description
static String	convertArabic1256ToUtf8(String text) Convert an ASCII Arabic text to Unicode
static String	normalizeAllKashida(String text) Removes all kashida
static String	normalizeExtraMarks(String text) replaceAlls more than one ! or ? mark with just one
static String	normalizeOutsideInsideSpacing(String text) Fixes outside and inside spacing for () [] {} “” «»
static String	normalizeSpacingAndLineBreaks(String text) replaceAlls more than one space or line break with just a single one
static String	normalizeUnderLines(String text) Clean UnderLines
static String	removeHexadecimalSymbols(String text) There are a lot of symbols which can't be in xml code.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

normalizeAllKashida

public static String normalizeAllKashida(String text)

Removes all kashida

Parameters:

text - Text to process

Returns:

Processed Text

normalizeExtraMarks

public static String normalizeExtraMarks(String text)

replaceAlls more than one ! or ? mark with just one

Parameters:

text - Text to process

Returns:

Processed Text

normalizeOutsideInsideSpacing

public static String normalizeOutsideInsideSpacing(String text)

Fixes outside and inside spacing for () [] {} “” «»

Parameters:

text - Text to process

Returns:

Processed Text

normalizeSpacingAndLineBreaks

public static String normalizeSpacingAndLineBreaks(String text)

replaceAlls more than one space or line break with just a single one

Parameters:

text - Text to process

Returns:

Processed Text

normalizeUnderLines

public static String normalizeUnderLines(String text)

Clean UnderLines

Parameters:

text - Text to process

Returns:

Processed Text

removeHexadecimalSymbols

public static String removeHexadecimalSymbols(String text)

There are a lot of symbols which can't be in xml code.

Parameters:

text - Text to process

Returns:

Processed Text

convertArabic1256ToUtf8

public static String convertArabic1256ToUtf8(String text)
                                      throws UnsupportedEncodingException

Convert an ASCII Arabic text to Unicode

Parameters:

text - the text

Returns:

string

Throws:

UnsupportedEncodingException - the unsupported encoding exception