preprocess 구현하기

[eubinean]

What?

전처리 로직 구현하기. TODO 표기된 부분만 구현하면 된다!

storyteller/storyteller/preprocess.py

Lines 6 to 35 in 501a4de

	def augment(df: pd.DataFrame) -> pd.DataFrame:
	# TODO implement augmentation.
	return df
	def parse(df: pd.DataFrame) -> pd.DataFrame:
	"""
	parse <em> ...</em> to [WISDOM].
	:param df:
	:return:
	"""
	# TODO: implement parsing
	return df
	def normalise(df: pd.DataFrame) -> pd.DataFrame:
	"""
	1. normalise the emoticons.
	2. normalise the spacings.
	3. normalise grammatical errors.
	:param df:
	:return:
	"""
	# TODO: implement normalisation
	return df
	def upsample(df: pd.DataFrame) -> pd.DataFrame:
	# TODO: implement upsampling
	return df

Why?

...

To-do's

• preprocess.cleanse 구현하기 #44
• preprocess.augment 구현하기 #37
• preprocess.parse 구현하기 #27
• preprocess.normalise 구현하기 #28
• preprocess.upsample 구현하기 #29