icane/etlstat

Python package that contains extract-transform-load utils for statistical offices data processing

etlstat's Issues

Simplificación de la funcion xls y solucion al fallo de la libreria xlrd

La solución consiste en eliminar el xlrd.open_workbook() para abrir los excel y usar solamente pd.read_excel() tanto para abrir los excel, como para leerlos.

for excel in os.listdir('.'):
        if fnmatch.fnmatch(excel, data_extension):
            data[excel] = dict()
            data[excel] = pd.read_excel(open(dir_path + excel,
                                                            'rb'),
                                                   sheet_name=None,
                                                   na_values=na_values
                                                   )
            for sheet in data[excel]:
                data[excel][sheet].name = sheet
    return data

extractor.xls() 'encoding' parameter TypeError

Recent changes in latest versions of etlstat have removed encoding parameter from the definitions of xls() and xlsx() functions of module extractor.py.

Packages already developed that call these functions with encoding as argument will fail upon update.

For backwards compatibility with packages depending on this library, this should be fixed, or at least add a warning about the changes.

White spaces are not preserved in extractor.txt

White spaces at the beginning and ending are removed. When a field is parsed after loading in a Dataframe, those white spaces are necessary.