Support managing Scrapyd servers with https enabled

[my8100]

Support managing Scrapyd servers with https enabled

[my8100]

1. Adding Scrapyd servers via web UI is not an urgent feature as they don't change often.
   Managing Scrapyd servers with https enabled would be supported in a future release.
2. There is no plan yet to support multi-language.
3. Currently, any network request to Scrapyd servers has a timeout of 60 seconds, and no retrying,
   though Timer Tasks would retry one time anyway.
   In general, it seems no need to custom these configs.

[cgleiyucun]

安装完成之后，输入scrapydweb命令，出现这个报错，请问如何解决：

Traceback (most recent call last):
  File "D:\fenxihuanjing\lib\logging\config.py", line 389, in resolve
    self.importer(used)
ModuleNotFoundError: No module named 'flask.logging.wsgi_errors_stream'; 'flask.logging' is not a package

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "D:\fenxihuanjing\lib\logging\config.py", line 562, in configure
    handler = self.configure_handler(handlers[name])
  File "D:\fenxihuanjing\lib\logging\config.py", line 733, in configure_handler
    kwargs = {k: config[k] for k in config if valid_ident(k)}
  File "D:\fenxihuanjing\lib\logging\config.py", line 733, in <dictcomp>
    kwargs = {k: config[k] for k in config if valid_ident(k)}
  File "D:\fenxihuanjing\lib\logging\config.py", line 324, in __getitem__
    return self.convert_with_key(key, value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 290, in convert_with_key
    result = self.configurator.convert(value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 461, in convert
    value = converter(suffix)
  File "D:\fenxihuanjing\lib\logging\config.py", line 400, in ext_convert
    return self.resolve(value)
  File "D:\fenxihuanjing\lib\logging\config.py", line 396, in resolve
    raise v
  File "D:\fenxihuanjing\lib\logging\config.py", line 389, in resolve
    self.importer(used)
ValueError: Cannot resolve 'flask.logging.wsgi_errors_stream': No module named 'flask.logging.wsgi_errors_stream'; 'flask.logging' is not a package

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "run.py", line 11, in <module>
    from scrapydweb import create_app
  File "D:\fenxihuanjing\lib\site-packages\scrapydweb\__init__.py", line 36, in <module>
    'handlers': ['wsgi']
  File "D:\fenxihuanjing\lib\logging\config.py", line 799, in dictConfig
    dictConfigClass(config).configure()
  File "D:\fenxihuanjing\lib\logging\config.py", line 570, in configure
    '%r' % name) from e
ValueError: Unable to configure handler 'wsgi'

[my8100]

@cgleiyucun
Try pip install --upgrade flask

[cgleiyucun]

@my8100
very thanks

[cgleiyucun]

file模块下的items功能页面出现这种报错，请问要如何解决？
Oops! Something went wrong.
http://127.0.0.1:6800/items/
status_code: 404

<title>404 - No Such Resource</title>

No Such Resource

No such child resource.

Tip Click the above link to make sure your Scrapyd server is accessable.

[my8100]

See https://scrapyd.readthedocs.io/en/latest/config.html#items-dir

[cgleiyucun]

thanks

[cgleiyucun]

@my8100
就是说这个页面不用去处理它，一旦启用会覆盖掉scrapy的items设置？

[my8100]

Yes, you can also hide the menu by setting SHOW_SCRAPYD_ITEMS to False.

scrapydweb/scrapydweb/default_settings.py

Lines 156 to 160 in 8104386

	############################## Page Display ###################################
	# The default is True, set it to False to hide the Items page, as well as
	# the Items column in the Jobs page.
	SHOW_SCRAPYD_ITEMS = True

[cgleiyucun]

thanks

[MrDHY]

@my8100 do you finished this feature?

[MrDHY]

I love this pro, also I need this ability

[imba-tjd]

The tip is trying to access hard-coded 127.0.0.1:6800

All of the blue link (for example Monitor and control all of your Scrapyd servers.) also have this issue.