Boto DEBUG output floods mrun logs

[materialsproject]

Boto DEBUG output floods mrun logs

[sivonxay]

I noticed this as well. I believe the offending lines are the following (the latter for serial running within a jupyter notebooks):

maggma/src/maggma/cli/__init__.py

Lines 70 to 71 in 9e037d7

	root = logging.getLogger()
	root.setLevel(level)

maggma/src/maggma/core/builder.py

Lines 127 to 128 in 672c6ae

	root = logging.getLogger()
	root.setLevel(log_level)

Not sure what's the best way to deal with it, but that depends on whether or not it is wanted. In the case that they aren't wanted, I would have no issue silencing them with something like this (as per github issue on boto3):

def silence_boto3_logger():
    logging.getLogger('boto3').setLevel(logging.CRITICAL)
    logging.getLogger('botocore').setLevel(logging.CRITICAL)
    logging.getLogger('nose').setLevel(logging.CRITICAL)
    logging.getLogger('s3transfer').setLevel(logging.CRITICAL)
    logging.getLogger('urllib3').setLevel(logging.CRITICAL)

root = logging.getLogger()
root.setLevel(level)
silence_boto3_logger()

alternatively, the log level update should be applied to the builder logs, not the root logger

for builder in builders:
    logger = logging.getLogger(type(builder).__name__)
    logger.setLevel(level)

[munrojm]

Having that information has been useful for me in the past when debugging connections to S3 for different builders. Not sure what the best course of action is.