Giter Site home page Giter Site logo

Comments (1)

JustAnotherArchivist avatar JustAnotherArchivist commented on July 24, 2024

Also happens when downloading more than one URL, e.g. wpull --output-file foo URL0 URL1.

A very similar error happens on retries:

> wpull --output-document foo --tries 3 https://httpbingo.org/status/500
INFO Fetching ‘https://httpbingo.org/status/500’.

INFO Fetched ‘https://httpbingo.org/status/500’: 500 Internal Server Error. Length: 0 [unspecified].
.../lib/python3.6/site-packages/wpull/protocol/http/client.py:185: UserWarning: HTTP session did not complete.
  warnings.warn(_('HTTP session did not complete.'))
INFO Fetching ‘https://httpbingo.org/status/500’.

INFO Fetched ‘https://httpbingo.org/status/500’: 500 Internal Server Error. Length: 0 [unspecified].
ERROR Fatal exception.
Traceback (most recent call last):
  File ".../lib/python3.6/site-packages/wpull/application/app.py", line 157, in run
    yield from pipeline.process()
  File ".../lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 194, in process
    yield from self._process_one_worker()
  File ".../lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 215, in _process_one_worker
    task.result()
  File ".../lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 119, in process
    item = yield from self.process_one(_worker_id=worker_id)
  File ".../lib/python3.6/site-packages/wpull/pipeline/pipeline.py", line 103, in process_one
    yield from task.process(item)
  File ".../lib/python3.6/site-packages/wpull/application/tasks/download.py", line 492, in process
    yield from session.app_session.factory['Processor'].process(session)
  File ".../lib/python3.6/site-packages/wpull/processor/delegate.py", line 29, in process
    return (yield from processor.process(item_session))
  File ".../lib/python3.6/site-packages/wpull/processor/web.py", line 92, in process
    return (yield from session.process())
  File ".../lib/python3.6/site-packages/wpull/processor/web.py", line 186, in process
    yield from self._process_loop()
  File ".../lib/python3.6/site-packages/wpull/processor/web.py", line 245, in _process_loop
    exit_early, wait_time = yield from self._fetch_one(cast(Request, self._item_session.request))
  File ".../lib/python3.6/site-packages/wpull/processor/web.py", line 309, in _fetch_one
    action = self._handle_response(request, response)
  File ".../lib/python3.6/site-packages/wpull/processor/web.py", line 436, in _handle_response
    self._file_writer_session.discard_document(response)
  File ".../lib/python3.6/site-packages/wpull/writer.py", line 519, in discard_document
    response.body.flush()
  File ".../lib/python3.6/site-packages/wpull/writer.py", line 490, in flush
    self._stream.flush()
ValueError: flush of closed file
CRITICAL Sorry, Wpull unexpectedly crashed.
CRITICAL Please report this problem to the authors at Wpull's issue tracker so it may be fixed. If you know how to program, maybe help us fix it? Thank you for helping us help you help us all.
INFO Exiting with status 1.

from wpull.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.