gaulinmp/pyedgar

Python library for interacting with EDGAR.

pyedgar's Issues

Temp directory CACHE ROOT default doesn't exist

Running pyedgar.EDGARIndex(force_download = True) on a fresh install with no config file results in trying to download index files to a temp directory that doesn't exist:

FileNotFoundError('Trying to write to non-existant directory: /var/folders/1m/z793d_z546db544bwmxrq9dw0000gn/T/pyedgar/indices')

Index downloader doesn't check if df exists

pyedgar/pyedgar/utilities/indices.py

Line 128 in d297e72

df["Date Filed"] = pd.to_datetime(df["Date Filed"])

Add error checking if no cached files exist to be loaded/parsed.

Web used if local cache is False

pyedgar/pyedgar/filing.py

Line 188 in 8156d0c

if self._local_cache:

Doesn't check use_webcache if local_cache is False. Come on, Mac.

extract sections

Hi,

Nice python tool to download and parse the SEC forms. Can you extract individual sections too, for instance, item 1, item 1A, etc. in form 10-K?

Thanks!

Trouble opening up .data_manipulation and .basis after installation

Hello there!

I am running pyedgar on Linux redhat using python 3.6. I followed the instructions for download using pip3 install pyedgar and pip3 install -e . after downloading it from github. Even when I tried running my notebook through google colab, I keep getting an error saying that

from pyedgar.data_manipulation import tlist_to_flat, flat_to_tlist
ModuleNotFoundError: No module named 'pyedgar.data_manipulation'

I'm not sure if I have done something wrong during the installation. Any help is appreciated! Thank you!

Update logging format

Per: https://stackoverflow.com/a/36294984/1959876

index downloader downloading partial compressed files

I am running this to get started and create index files.

python -m pyedgar.downloader -i --log-level INFO

However, looks like some compressed index files get downloaded partially (just 5kb in size). Attaching screenshot here - https://snipboard.io/ojnBHy.jpg . I tried uninstalling the package from pip and reinstalling from github and I see similar results. Is there any reason this could be happening? I see the entire file present on the url location being downloaded.

FileNotFoundError

I am running this simple code to get started:

import pyedgar

all_indices = pyedgar.EDGARIndex(force_download = True)

I get the following error message:

Traceback (most recent call last):
  File "edgar_test.py", line 5, in <module>
    all_indices = pyedgar.EDGARIndex(force_download = True)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pyedgar/index.py", line 49, in __init__
    self.IndexMaker.extract_indexes()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/pyedgar/utilities/indices.py", line 121, in extract_indexes
    dfi["Accession"] = dfi.Filename.str.slice(start=-24, stop=-4)
UnboundLocalError: local variable 'dfi' referenced before assignment

I installed this package with ! pip install pyedgar. The version is 0.1.6. I am running it on a Mac.

Is this a bug, or have I missed an installation step? Thanks in advance.