Missing values should not be False at dataframe construction

[epogrebnyak]

Missing values should not be False at dataframe construction

[epogrebnyak]

False appears for example in https://github.com/mini-kep/parser-rosstat-kep/blob/dev/data/processed/2017/12/dfq.csv

2017-12-31,2017,4,False,False,False,False,False,False,False,False,False,-21679.7,-11191.2,-7080.8,-22069.0,-10971.5,-7584.3,219.8,-503.5,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False,False

[liepieshov]

In parser.py line 189 you use the function to_float with argument "", which returns False

[epogrebnyak]

Test nededed:

parser-rosstat-kep/src/kep/csv2df/parser.py

Lines 193 to 200 in 3de737c

	# TODO: need a test on really a minimal setup for method below
	# write test setting and asserts in this file before test
	def extract_values(self):
	"""Use ._extract_values() stream and filter None values from it.
	"""
	def has_value(d):
	return d['value'] is not None
	return filter(has_value, self._extract_values())

[epogrebnyak]

And another test needed:

parser-rosstat-kep/src/kep/csv2df/parser.py

Lines 113 to 119 in 3de737c

	# TODO: convert to unit test
	progress = HeaderParsingProgress([['abc', 'zzz'], ['def', '...']])
	assert progress.is_parsed() is False
	progress.set_as_known('abc')
	progress.set_as_known('def')
	assert progress.is_parsed() is True
	assert '<abc>' in str(progress)

[liepieshov]

#160 @epogrebnyak , both Done