data loading error in 2019 at Balancing inter-provincial trade

[rehananis]

data loading error in 2019 at Balancing inter-provincial trade

[rehananis]

thanks for your help. Your openIO is very useful for me to understand the IO Tables and do some analysis. thank you again for your quick response.

[MaximeAgez]

Hi @rehananis. Do you have the pandas package to the specified version in the requirements.txt file? I believe this error arises with newer version of pandas.

[MaximeAgez]

Was the issue resolved?

[rehananis]

Yes, but i stuck at some other point. I am trying to produce demo results, I used 2019 data. I tried to export tables using the export function from OpenIO file in jupyter notebook but the export file is empty. Later I start calculating the QC household consumption command but it said data doesn’t exist Best regards RehanOn Sep 10, 2023, at 1:36 AM, Maxime Agez ***@***.***> wrote: Was the issue resolved? —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>

[MaximeAgez]

Yeah the export function is outdated. You can use the pickle format to store all dataframes from the system and reload everything

import pickle
import gzip

with gzip.open("path_where_to_store_the_data","rb") as f:
     pickle.dump(self, f)

You can then reimport the saved system with:

with gzip.open("path_where_to_store_the_data","wb") as f:
     self = pickle.load(f)

[rehananis]

Hi, thanks for your help but I am still unable to export results.
File "", line 4
with gzip.open("F:\carbon","rb") as f:
^
SyntaxError: EOL while scanning string literal

[MaximeAgez]

When using the \ instead of the /, you need to add r in front of the path. Also you should create a .gz.pickle file so add .gz.pickle at the end of your file path such as:
with gzip.open(r"F:\carbon\openio.gz.pickle","rb") as f:

[rehananis]

import pickle
import gzip
​
with gzip.open("F:/carbon/openio.gz.pickle", 'rb') as f:
pickle.dump(self, f)

FileNotFoundError Traceback (most recent call last)
in
2 import gzip
3
----> 4 with gzip.open("F:/carbon/openio.gz.pickle", 'rb') as f:
5 pickle.dump(self, f)

c:\users\rehan\appdata\local\programs\python\python39\lib\gzip.py in open(filename, mode, compresslevel, encoding, errors, newline)
56 gz_mode = mode.replace("t", "")
57 if isinstance(filename, (str, bytes, os.PathLike)):
---> 58 binary_file = GzipFile(filename, gz_mode, compresslevel)
59 elif hasattr(filename, "read") or hasattr(filename, "write"):
60 binary_file = GzipFile(None, gz_mode, compresslevel, filename)

c:\users\rehan\appdata\local\programs\python\python39\lib\gzip.py in init(self, filename, mode, compresslevel, fileobj, mtime)
171 mode += 'b'
172 if fileobj is None:
--> 173 fileobj = self.myfileobj = builtins.open(filename, mode or 'rb')
174 if filename is None:
175 filename = getattr(fileobj, 'name', '')

FileNotFoundError: [Errno 2] No such file or directory: 'F:/carbon/openio.gz.pickle'

[MaximeAgez]

Try to first create the file on the C disk. That might be the reason

[rehananis]

I solve it to save use

import pickle
import gzip

with gzip.open("F:/carbon/openio1.gz.pickle", 'wb') as f:
pickle.dump(tables, f)

[rehananis]

I use this to reload in another file sucessfully
import sys
sys.path.append('F://carbon/')
import openIO
import pandas as pd
import numpy as np

with gzip.open("F:/carbon/openio.gz.pickle", 'rb') as f:
tables = pickle.load(f)