Comments (5)
Добрый день, Людмила!
Поделитесь, пожалуйста, конфигом, который вы используете для выгрузки. Сейчас недостаточно данных для воспроизведения проблемы.
from logs_api_integration.
`{
"token" : " ",
"counter_id": " ",
"visits_fields": [
"ym:s:counterID",
"ym:s:dateTime",
"ym:s:date",
"ym:s:dateTimeUTC",
"ym:s:clientID",
"ym:s:visitID",
"ym:s:watchIDs",
"ym:s:isNewUser",
"ym:s:startURL",
"ym:s:endURL",
"ym:s:pageViews",
"ym:s:visitDuration",
"ym:s:bounce",
"ym:s:ipAddress",
"ym:s:params",
"ym:s:goalsID",
"ym:s:goalsSerialNumber",
"ym:s:goalsDateTime",
"ym:s:goalsPrice",
"ym:s:goalsOrder",
"ym:s:goalsCurrency",
"ym:s:lastTrafficSource",
"ym:s:lastAdvEngine",
"ym:s:lastReferalSource",
"ym:s:lastSearchEngineRoot",
"ym:s:lastSearchEngine",
"ym:s:lastSocialNetwork",
"ym:s:lastSocialNetworkProfile",
"ym:s:referer",
"ym:s:UTMCampaign",
"ym:s:UTMContent",
"ym:s:UTMMedium",
"ym:s:UTMSource",
"ym:s:UTMTerm",
"ym:s:openstatAd",
"ym:s:openstatCampaign",
"ym:s:openstatService",
"ym:s:openstatSource",
"ym:s:hasGCLID",
"ym:s:regionCountry",
"ym:s:regionCity",
"ym:s:browserLanguage",
"ym:s:browserCountry",
"ym:s:deviceCategory",
"ym:s:mobilePhone",
"ym:s:mobilePhoneModel",
"ym:s:operatingSystemRoot",
"ym:s:operatingSystem",
"ym:s:browser",
"ym:s:cookieEnabled",
"ym:s:javascriptEnabled",
"ym:s:screenWidth",
"ym:s:screenHeight",
"ym:s:purchaseID",
"ym:s:purchaseDateTime"
],
"hits_fields": [
"ym:pv:counterID",
"ym:pv:dateTime",
"ym:pv:date",
"ym:pv:clientID",
"ym:pv:watchID",
"ym:pv:title",
"ym:pv:URL",
"ym:pv:referer",
"ym:pv:UTMCampaign",
"ym:pv:UTMContent",
"ym:pv:UTMMedium",
"ym:pv:UTMSource",
"ym:pv:UTMTerm",
"ym:pv:browser",
"ym:pv:browserLanguage",
"ym:pv:cookieEnabled",
"ym:pv:deviceCategory",
"ym:pv:hasGCLID",
"ym:pv:ipAddress",
"ym:pv:javascriptEnabled",
"ym:pv:mobilePhone",
"ym:pv:mobilePhoneModel",
"ym:pv:openstatAd",
"ym:pv:openstatCampaign",
"ym:pv:openstatService",
"ym:pv:openstatSource",
"ym:pv:operatingSystem",
"ym:pv:regionCity",
"ym:pv:regionCountry",
"ym:pv:screenWidth",
"ym:pv:windowClientHeight",
"ym:pv:windowClientWidth",
"ym:pv:params",
"ym:pv:lastTrafficSource",
"ym:pv:lastSearchEngine",
"ym:pv:lastSearchEngineRoot",
"ym:pv:lastAdvEngine",
"ym:pv:artificial",
"ym:pv:pageCharset",
"ym:pv:link",
"ym:pv:download",
"ym:pv:notBounce",
"ym:pv:lastSocialNetwork",
"ym:pv:httpError",
"ym:pv:networkType",
"ym:pv:lastSocialNetworkProfile",
"ym:pv:goalsID",
"ym:pv:shareService",
"ym:pv:shareURL",
"ym:pv:shareTitle",
"ym:pv:iFrame"
],
"log_level": "INFO",
"retries": 1,
"retries_delay": 60,
"clickhouse": {
"host": "http://...my host",
"user": "",
"password": "",
"visits_table": "visits_all",
"hits_table": "hits_all",
"database": "test"
}
}
`
from logs_api_integration.
Исправила, проблема была в типе данных для поля ym:pv:params
(Array(String)
вместо String
). Сейчас должно работать, только перед повторной попыткой удалите таблицу test.hits_all
из базы, чтобы она пересоздалась с правильным типом поля.
from logs_api_integration.
2017-04-27 15:32:55 MainProcess CRITICAL Iteration #1 failed Traceback (most recent call last): File "metrica_logs_api.py", line 127, in <module> integrate_with_logs_api(config, user_request) File "metrica_logs_api.py", line 107, in integrate_with_logs_api raise e ZeroDivisionError: integer division or modulo by zero
from logs_api_integration.
еще пробую скачать данные за несколько месяцев в табл visits
python metrica_logs_api.py -source visits -start_date 2017-01-01 -end_date 2017-04-23
и падает ошибка
2017-04-27 15:53:40 MainProcess CRITICAL Iteration #1 failed Traceback (most recent call last): File "metrica_logs_api.py", line 127, in <module> integrate_with_logs_api(config, user_request) File "metrica_logs_api.py", line 107, in integrate_with_logs_api raise e ValueError: Code: 27, e.displayText() = DB::Exception: Cannot parse input: expected \t before: \n1\t\t29557\t28261\t1483260254171002202\t1\t183891\t2017-01-01\t2017-01-01 11:44:13\t2017-01-01 11:44:13\t1\thttp://bernatska.com/\t[]\t[]\t[]\t[]\t[]\t0\t2a02:6b8:0:1a33::xxx\t1\t, e.what() = DB::Exception
from logs_api_integration.
Related Issues (20)
- Divison by zero when estimation returns max_possible_day_quantity = 0 HOT 1
- Ошибка TypeError при выгрузке данных HOT 3
- Missing fields in ch_types.json
- Oauth token must be passed in headers (not just in url) HOT 1
- Ошибка 'map' object is not subscriptable HOT 1
- Некорректная работа с запросами без поля Date
- Starting new HTTPS connection (1)
- Где найти значение "host"
- LastDirectClickOrder, OfflineCallFirstTimeCaller - Типы неверны.
- max_possible_day_quantity < 0 HOT 7
- 'map' object is not subscriptable
- raise ConnectionError(e, request=request)
- 'ascii' codec can't encode characters in position HOT 1
- Cannot parse input: expected [ before: "[\' for array with Cyrillic strings HOT 1
- Unknown field found in TSV header: 'ym:s:clientID' HOT 3
- Нужно изменить на UInt64, потому что в директе id группы пошли уже больше UInt32
- Ошибка Cannot parse input: expected '[' before: '"[\'
- Ошибка 117, DB::Exception: Unknown field found in TSV header: '1613536812404233133' at position 0 HOT 3
- Code: 130. DB::ParsingException: Cannot read array from text, expected comma or end of array HOT 1
- Другая ошибка а разборе данных HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logs_api_integration.