Preprocessing

The texthero.preprocess module allow for efficient pre-processing of text-based Pandas Series and DataFrame.

clean(s[, pipeline])	Pre-process a text-based Pandas Series.
drop_no_content(s)	Drop all rows without content.
get_default_pipeline()	Return a list contaning all the methods used in the default cleaning pipeline.
has_content(s)	Return a Boolean Pandas Series indicating if the rows has content.
remove_angle_brackets(s)	Remove content within angle brackets <> and the angle brackets.
remove_brackets(s)	Remove content within brackets and the brackets itself.
remove_curly_brackets(s)	Remove content within curly brackets {} and the curly brackets.
remove_diacritics(input)	Remove all diacritics and accents.
remove_digits(input[, only_blocks])	Remove all digits and replace it with a single space.
remove_html_tags(s)	Remove html tags from the given Pandas Series.
remove_punctuation(input)	Replace all punctuation with a single space (” “).
remove_round_brackets(s)	Remove content within parentheses () and parentheses.
remove_square_brackets(s)	Remove content within square brackets [] and the square brackets.
remove_stopwords(input, stopwords, …[, …])	Remove all instances of words.
remove_urls(s)	Remove all urls from a given Pandas Series.
replace_urls(s, symbol)	Replace all urls with the given symbol.
remove_whitespace(input)	Remove any extra white spaces.
replace_punctuation(input, symbol)	Replace all punctuation with a given symbol.
replace_stopwords(input, symbol, stopwords, …)	Replace all instances of words with symbol.
tokenize(s)	Tokenize each row of the given Series.