File "metrica_logs_api.py" ValueError: <exception str() failed>

[yndx-metrika]

File "metrica_logs_api.py" ValueError:

from logs_api_integration.

[miptgirl]

Добрый день, Людмила!

Поделитесь, пожалуйста, конфигом, который вы используете для выгрузки. Сейчас недостаточно данных для воспроизведения проблемы.

[poberezhnaya]

`{
"token" : " ",
"counter_id": " ",
"visits_fields": [
"ym:s:counterID",
"ym:s:dateTime",
"ym:s:date",
"ym:s:dateTimeUTC",
"ym:s:clientID",
"ym:s:visitID",
"ym:s:watchIDs",
"ym:s:isNewUser",
"ym:s:startURL",
"ym:s:endURL",
"ym:s:pageViews",
"ym:s:visitDuration",
"ym:s:bounce",
"ym:s:ipAddress",
"ym:s:params",
"ym:s:goalsID",
"ym:s:goalsSerialNumber",
"ym:s:goalsDateTime",
"ym:s:goalsPrice",
"ym:s:goalsOrder",
"ym:s:goalsCurrency",
"ym:s:lastTrafficSource",
"ym:s:lastAdvEngine",
"ym:s:lastReferalSource",
"ym:s:lastSearchEngineRoot",
"ym:s:lastSearchEngine",
"ym:s:lastSocialNetwork",
"ym:s:lastSocialNetworkProfile",
"ym:s:referer",
"ym:s:UTMCampaign",
"ym:s:UTMContent",
"ym:s:UTMMedium",
"ym:s:UTMSource",
"ym:s:UTMTerm",
"ym:s:openstatAd",
"ym:s:openstatCampaign",
"ym:s:openstatService",
"ym:s:openstatSource",
"ym:s:hasGCLID",
"ym:s:regionCountry",
"ym:s:regionCity",
"ym:s:browserLanguage",
"ym:s:browserCountry",
"ym:s:deviceCategory",
"ym:s:mobilePhone",
"ym:s:mobilePhoneModel",
"ym:s:operatingSystemRoot",
"ym:s:operatingSystem",
"ym:s:browser",
"ym:s:cookieEnabled",
"ym:s:javascriptEnabled",
"ym:s:screenWidth",
"ym:s:screenHeight",
"ym:s:purchaseID",
"ym:s:purchaseDateTime"

],
"hits_fields": [
    "ym:pv:counterID",
    "ym:pv:dateTime",
    "ym:pv:date",
    "ym:pv:clientID",
    "ym:pv:watchID",
	"ym:pv:title",
	"ym:pv:URL",
	"ym:pv:referer",
	"ym:pv:UTMCampaign",
	"ym:pv:UTMContent",
	"ym:pv:UTMMedium",
	"ym:pv:UTMSource",
	"ym:pv:UTMTerm",
	"ym:pv:browser",
	"ym:pv:browserLanguage",
	"ym:pv:cookieEnabled",
	"ym:pv:deviceCategory",
	"ym:pv:hasGCLID",
	"ym:pv:ipAddress",
	"ym:pv:javascriptEnabled",
	"ym:pv:mobilePhone",
	"ym:pv:mobilePhoneModel",
	"ym:pv:openstatAd",
	"ym:pv:openstatCampaign",
	"ym:pv:openstatService",
	"ym:pv:openstatSource",
	"ym:pv:operatingSystem",
	"ym:pv:regionCity",
	"ym:pv:regionCountry",
	"ym:pv:screenWidth",
	"ym:pv:windowClientHeight",
	"ym:pv:windowClientWidth",
	"ym:pv:params",
	"ym:pv:lastTrafficSource",
	"ym:pv:lastSearchEngine",
	"ym:pv:lastSearchEngineRoot",
	"ym:pv:lastAdvEngine",
	"ym:pv:artificial",
	"ym:pv:pageCharset",
	"ym:pv:link",
	"ym:pv:download",
	"ym:pv:notBounce",
	"ym:pv:lastSocialNetwork",
	"ym:pv:httpError",
	"ym:pv:networkType",
	"ym:pv:lastSocialNetworkProfile",
	"ym:pv:goalsID",
	"ym:pv:shareService",
	"ym:pv:shareURL",
	"ym:pv:shareTitle",
	"ym:pv:iFrame"
],
"log_level": "INFO",
"retries": 1,
"retries_delay": 60,
"clickhouse": {
	"host": "http://...my host", 
	"user": "",
	"password": "",
	"visits_table": "visits_all",
	"hits_table": "hits_all",
	"database": "test"
}

}
`

[miptgirl]

Исправила, проблема была в типе данных для поля ym:pv:params (Array(String) вместо String). Сейчас должно работать, только перед повторной попыткой удалите таблицу test.hits_all из базы, чтобы она пересоздалась с правильным типом поля.

[poberezhnaya]

2017-04-27 15:32:55 MainProcess CRITICAL Iteration #1 failed Traceback (most recent call last): File "metrica_logs_api.py", line 127, in <module> integrate_with_logs_api(config, user_request) File "metrica_logs_api.py", line 107, in integrate_with_logs_api raise e ZeroDivisionError: integer division or modulo by zero

[poberezhnaya]

еще пробую скачать данные за несколько месяцев в табл visits
python metrica_logs_api.py -source visits -start_date 2017-01-01 -end_date 2017-04-23

и падает ошибка
2017-04-27 15:53:40 MainProcess CRITICAL Iteration #1 failed Traceback (most recent call last): File "metrica_logs_api.py", line 127, in <module> integrate_with_logs_api(config, user_request) File "metrica_logs_api.py", line 107, in integrate_with_logs_api raise e ValueError: Code: 27, e.displayText() = DB::Exception: Cannot parse input: expected \t before: \n1\t\t29557\t28261\t1483260254171002202\t1\t183891\t2017-01-01\t2017-01-01 11:44:13\t2017-01-01 11:44:13\t1\thttp://bernatska.com/\t[]\t[]\t[]\t[]\t[]\t0\t2a02:6b8:0:1a33::xxx\t1\t, e.what() = DB::Exception