activitywatch/aw-client

Client library for ActivityWatch

Records what you do so that you can know how you've spent your time.
All in a secure way where you control the data.

Website — Forum — Documentation — Releases
Contributor stats — CI overview

Do you want to receive email updates on major announcements?
Signup for the newsletter!

Table of Contents

• About
  • Screenshots
  • Is this yet another time tracker?
    • Feature comparison
  • Installation & Usage
• About this repository
  • Server
  • Watchers
  • Libraries
• Contributing

About

The goal of ActivityWatch is simple: Enable the collection of as much valuable lifedata as possible without compromising user privacy.

We've worked towards this goal by creating an application for safe storage of the data on the user's local machine and as well as a set of watchers which record data such as:

• Currently active application and the title of its window
• Currently active browser tab and its title and URL
• Keyboard and mouse activity, to detect if you are AFK ("away from keyboard") or not

It is up to you as user to collect as much as you want, or as little as you want (and we hope some of you will help write watchers so we can collect more).

Screenshots

You can find more (and newer) screenshots on the website.

Installation & Usage

Downloads are available on the releases page.

For instructions on how to get started, please see the guide in the documentation.

Interested in building from source? There's a guide for that too.

Is this yet another time tracker?

Yes, but we found that most time trackers lack one or more important features.

Common dealbreakers:

• Not open source
• The user does not own the data (common with non-open source options)
• Lack of synchronization (and when available: it's centralized and the sync server knows everything)
• Difficult to setup/use (most open source options tend to target programmers)
• Low data resolution (low level of detail, does not store raw data, long intervals between entries)
• Hard or impossible to extend (collecting more data is not as simple as it could be)

To sum it up:

• Closed source solutions suffer from privacy issues and limited features.
• Open source solutions aren't developed with end-users in mind and are usually not written to be easily extended (they lack a proper API). They also lack synchronization.

We have a plan to address all of these and we're well on our way. See the table below for our progress.

Feature comparison

Basics

	User owns data	GUI	Sync	Open Source
ActivityWatch	✅	✅	WIP, decentralized	✅
Selfspy	✅	❌	❌	✅
ulogme	✅	✅	❌	✅
RescueTime	❌	✅	Centralized	❌
WakaTime	❌	✅	Centralized	Clients

Platforms

	Windows	macOS	Linux	Android	iOS
ActivityWatch	✅	✅	✅	✅	❌
Selfspy	✅	✅	✅	❌	❌
ulogme	❌	✅	✅	❌	❌
RescueTime	✅	✅	✅	✅	Limited functionality

Tracking

	App & Window Title	AFK	Browser Extensions	Editor Plugins	Extensible
ActivityWatch	✅	✅	✅	✅	✅
Selfspy	✅	✅	❌	❌	❌
ulogme	✅	✅	❌	❌	❌
RescueTime	✅	✅	✅	❌	❌
WakaTime	❌	✅	✅	✅	Only for text editors

For a complete list of the things ActivityWatch can track, see the page on watchers in the documentation.

About this repository

This repo is a bundle of the core components and official modules of ActivityWatch (managed with git submodule). Its primary use is as a meta-package providing all the components in one repo; enabling easier packaging and installation. It is also where releases of the full suite are published (see releases).

Server

aw-server is the official implementation of the core service which the other ActivityWatch services interact with. It provides a REST API to a datastore and query engine. It also serves the web interface developed in the aw-webui project (which provides the frontend part of the webapp).

The REST API includes:

• Access to a datastore suitable for timeseries/timeperiod-data
• A query engine and language for such data

The webapp includes:

• Data visualization & browser
• Query explorer
• Export functionality

Watchers

ActivityWatch comes pre-installed with two watchers:

• aw-watcher-afk tracks the user active/inactive state from keyboard and mouse input
• aw-watcher-window tracks the currently active application and its window title.

There are lots of other watchers for ActivityWatch which can track more types of activity. Like aw-watcher-web which tracks time spent on websites, multiple editor watchers which track spent time coding, and many more! A full list of watchers can be found in the documentation.

Libraries

• aw-core - core library, provides no runnable modules
• aw-client - client library, useful when writing watchers

Folder structure

Contributing

Want to help? Great! Check out the CONTRIBUTING.md file!

Questions and support

Have a question, suggestion, problem, or just want to say hi? Post on the forum!

aw-client's Issues

Failed events queue grows exponentially

Below is the log from which where I found some disturbing activity (failed events queue doubling in size repeatedly). The bad stuff starts at 2017-03-13 11:29:56.

2017-03-10 11:28:17,236 [INFO ]: Loaded 0 failed events from file (client.py:146)
2017-03-10 11:28:17,246 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-10 11:28:17,246 [INFO ]: Adding 1 failed events to queue to send (client.py:165)
2017-03-10 11:51:39,147 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 11:51:40,151 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:17:52,627 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:17:54,638 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:25:36,372 [WARNING]: Can't connect to aw-server, will queue events until connection is available: HTTPConnectionPool(host='localhost', port=5666): Max retries exceeded with url: /api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f26d0800c88>: Failed to establish a new connection: [Errno 111] Connection refused',)) (client.py:193)
2017-03-10 19:25:47,610 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:26:16,424 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-10 19:26:16,426 [INFO ]: Adding 39 failed events to queue to send (client.py:165)
2017-03-10 19:31:04,186 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:31:05,195 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:31:06,200 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:31:07,203 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:31:08,207 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:32:16,503 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:32:17,508 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:32:18,517 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:32:19,521 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:47:46,032 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:47:47,036 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 19:47:48,040 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 20:52:35,946 [WARNING]: Can't connect to aw-server, will queue events until connection is available: HTTPConnectionPool(host='localhost', port=5666): Max retries exceeded with url: /api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f26cff72668>: Failed to establish a new connection: [Errno 111] Connection refused',)) (client.py:193)
2017-03-10 20:53:16,022 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-10 20:53:16,024 [INFO ]: Adding 40 failed events to queue to send (client.py:165)
2017-03-10 21:07:51,884 [WARNING]: Can't connect to aw-server, will queue events until connection is available: HTTPConnectionPool(host='localhost', port=5666): Max retries exceeded with url: /api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f26d07e6198>: Failed to establish a new connection: [Errno 111] Connection refused',)) (client.py:193)
2017-03-10 21:08:31,904 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-10 21:08:31,905 [INFO ]: Adding 40 failed events to queue to send (client.py:165)
2017-03-10 21:38:22,536 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 21:38:23,545 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 21:38:27,633 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 21:38:28,641 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-10 21:38:30,654 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 09:43:08,186 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 12:55:19,120 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 12:55:20,130 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 12:55:21,135 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 12:55:22,139 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 12:55:23,142 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 22:44:32,740 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 22:44:33,745 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 22:44:34,754 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:11:57,770 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:14:48,236 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:14:49,247 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:14:50,257 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:21:14,044 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:21:15,048 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:49:58,270 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-11 23:49:59,274 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-12 09:43:26,211 [WARNING]: Can't connect to aw-server, will queue events until connection is available: HTTPConnectionPool(host='localhost', port=5666): Max retries exceeded with url: /api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f26d07da588>: Failed to establish a new connection: [Errno 111] Connection refused',)) (client.py:193)
2017-03-12 09:46:06,683 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 09:46:06,684 [INFO ]: Adding 160 failed events to queue to send (client.py:165)
2017-03-12 09:47:14,067 [WARNING]: Can't connect to aw-server, will queue events until connection is available: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) (client.py:193)
2017-03-12 09:47:54,144 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 09:47:54,144 [INFO ]: Adding 40 failed events to queue to send (client.py:165)
2017-03-12 09:55:58,726 [WARNING]: Can't connect to aw-server, will queue events until connection is available: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',)) (client.py:193)
2017-03-12 09:55:59,211 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 09:55:59,211 [INFO ]: Adding 1 failed events to queue to send (client.py:165)
2017-03-12 10:28:49,847 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-12 10:39:54,208 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-12 11:35:38,616 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 11:35:38,734 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 11:35:38,735 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 12:08:17,600 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 12:08:17,735 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 12:08:17,736 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 12:16:02,915 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 12:16:03,435 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 12:16:03,435 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 12:56:50,601 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 12:56:51,219 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 12:56:51,219 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-12 16:43:44,483 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 16:43:44,611 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 16:43:44,611 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 16:50:30,226 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 16:50:30,822 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 16:50:30,823 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 17:13:57,117 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 17:13:57,256 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 17:13:57,256 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 17:42:14,381 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 17:42:14,496 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 17:42:14,496 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 18:05:39,779 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 18:05:41,078 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 18:05:41,078 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 18:14:21,931 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 18:14:22,043 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 18:14:22,044 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 18:43:44,152 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 18:43:44,257 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 18:43:44,257 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 18:52:42,027 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 18:52:42,145 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 18:52:42,146 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 19:00:09,224 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:00:09,393 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:00:09,394 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-12 19:14:56,946 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:14:57,053 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:14:57,053 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 19:19:05,719 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:19:06,946 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:19:06,946 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 19:21:09,527 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:21:10,023 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:21:10,023 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 19:27:14,169 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:27:14,788 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:27:14,789 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-12 19:38:23,501 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 19:38:23,637 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 19:38:23,637 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-12 20:03:58,916 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 20:03:59,063 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 20:03:59,063 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 20:30:44,645 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 20:30:44,767 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 20:30:44,767 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 20:36:53,429 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 20:36:53,725 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 20:36:53,725 [INFO ]: Adding 4 failed events to queue to send (client.py:165)
2017-03-12 21:06:18,180 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:06:18,330 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:06:18,330 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 21:13:23,046 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:13:23,180 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:13:23,180 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-12 21:17:56,542 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:17:56,658 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:17:56,659 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 21:19:59,037 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:19:59,682 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:19:59,683 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 21:31:57,833 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:31:57,954 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:31:57,954 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 21:45:05,268 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 21:45:06,504 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 21:45:06,504 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 22:47:26,884 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 22:47:27,025 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 22:47:27,025 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 23:13:29,064 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:13:29,231 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:13:29,231 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-12 23:24:58,852 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:24:58,952 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:24:58,953 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 23:31:15,668 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:31:15,822 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:31:15,822 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 23:34:26,589 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:34:27,285 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:34:27,286 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 23:47:49,430 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:47:50,909 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:47:50,910 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-12 23:58:10,459 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-12 23:58:10,610 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-12 23:58:10,611 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 00:02:14,085 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:02:14,214 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:02:14,214 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 00:20:39,414 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:20:40,719 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:20:40,720 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 00:30:28,715 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:30:28,816 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:30:28,816 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 00:34:12,123 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:34:13,731 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:34:13,731 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 00:36:38,460 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:36:38,706 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:36:38,706 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 00:50:29,712 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:50:29,847 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:50:29,847 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 00:53:23,812 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 00:53:23,943 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 00:53:23,943 [INFO ]: Adding 4 failed events to queue to send (client.py:165)
2017-03-13 01:00:41,272 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 01:00:41,449 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 01:00:41,449 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 01:02:44,988 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 01:02:45,800 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 01:02:45,800 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 01:39:01,715 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 01:39:01,836 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 01:39:01,837 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 01:45:48,926 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 01:45:49,059 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 01:45:49,059 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 02:06:42,990 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:06:43,130 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:06:43,131 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 02:11:06,889 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:11:07,013 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:11:07,013 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 02:12:58,367 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:12:59,565 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:12:59,565 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 02:16:14,896 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:16:15,493 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:16:15,493 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 02:18:00,665 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:18:01,170 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:18:01,170 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 02:32:33,040 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:32:33,198 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:32:33,198 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 02:36:33,347 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:36:35,000 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:36:35,001 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 02:50:37,175 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 02:50:37,321 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 02:50:37,321 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 03:05:08,442 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:05:08,611 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:05:08,611 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 03:33:59,691 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:33:59,858 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:33:59,858 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 03:36:46,464 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:36:46,669 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:36:46,669 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 03:40:18,381 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:40:18,491 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:40:18,491 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 03:53:22,214 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:53:22,362 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:53:22,362 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 03:54:59,655 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 03:55:00,252 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 03:55:00,252 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:00:25,829 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:00:25,943 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:00:25,944 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:02:43,004 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:02:43,803 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:02:43,804 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:05:52,946 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:05:53,301 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:05:53,302 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:13:21,444 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:13:22,751 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:13:22,752 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:14:40,870 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:14:41,119 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:14:41,120 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 04:19:17,458 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:19:17,600 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:19:17,600 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:22:02,226 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:22:02,721 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:22:02,721 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:26:27,175 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:26:27,671 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:26:27,671 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:28:30,043 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:28:30,669 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:28:30,670 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 04:33:21,369 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:33:28,431 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:33:28,432 [INFO ]: Adding 10 failed events to queue to send (client.py:165)
2017-03-13 04:54:43,431 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 04:54:43,597 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 04:54:43,597 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 05:26:41,809 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 05:26:41,931 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 05:26:41,931 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 05:53:22,815 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 05:53:23,045 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 05:53:23,046 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 06:06:55,721 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:06:55,855 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:06:55,855 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 06:11:52,807 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:11:52,948 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:11:52,948 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:13:26,588 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:13:27,298 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:13:27,298 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 06:19:12,083 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:19:12,584 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:19:12,584 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:24:07,325 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:24:07,881 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:24:07,881 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:26:55,667 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:26:56,262 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:26:56,263 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:37:57,528 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:37:57,646 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:37:57,646 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:40:00,009 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:40:00,908 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:40:00,909 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:53:24,022 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:53:24,187 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:53:24,187 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 06:59:38,686 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 06:59:38,836 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 06:59:38,836 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 07:16:55,067 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 07:16:55,185 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 07:16:55,186 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 07:24:30,501 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 07:24:30,624 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 07:24:30,624 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 07:31:48,355 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 07:31:48,950 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 07:31:48,950 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 07:38:19,406 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 07:38:19,586 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 07:38:19,587 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 07:54:55,409 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 07:54:55,532 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 07:54:55,532 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 08:05:08,549 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 08:05:09,776 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 08:05:09,776 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 08:18:21,365 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 08:18:22,661 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 08:18:22,662 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 08:37:12,015 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 08:37:12,141 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 08:37:12,141 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 08:41:47,560 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 08:41:48,156 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 08:41:48,157 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 08:44:18,271 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 08:44:18,407 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 08:44:18,408 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:08:30,796 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:08:30,931 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:08:30,931 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:16:48,301 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:16:49,629 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:16:49,629 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 09:21:32,286 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:21:33,188 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:21:33,188 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:24:13,701 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:24:15,098 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:24:15,098 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:34:08,402 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:34:08,591 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:34:08,591 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:34:34,640 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:34:34,833 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:34:34,833 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 09:35:35,865 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:35:37,462 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:35:37,463 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:45:39,319 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:45:39,675 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:45:39,675 [INFO ]: Adding 7 failed events to queue to send (client.py:165)
2017-03-13 09:50:27,547 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:50:27,734 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:50:27,735 [INFO ]: Adding 6 failed events to queue to send (client.py:165)
2017-03-13 09:54:05,837 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 500 Server Error: INTERNAL SERVER ERROR for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 09:54:07,469 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 09:54:07,470 [INFO ]: Adding 5 failed events to queue to send (client.py:165)
2017-03-13 10:43:21,255 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:23,267 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:32,328 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:33,331 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:35,342 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:36,346 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:37,349 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:39,360 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:43:40,364 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:45:20,197 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:45:21,205 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:45:35,388 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:47:28,325 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:48:19,158 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 10:48:44,384 [WARNING]: Failed to find active window, id found was 0x0 (lib.py:21)
2017-03-13 11:29:56,859 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,867 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,867 [INFO ]: Adding 1 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,869 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,874 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,874 [INFO ]: Adding 2 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,876 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,880 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,880 [INFO ]: Adding 4 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,882 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,887 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,887 [INFO ]: Adding 8 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,890 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,896 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,896 [INFO ]: Adding 16 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,898 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,903 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,904 [INFO ]: Adding 32 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,907 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,912 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,913 [INFO ]: Adding 64 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,916 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,922 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,925 [INFO ]: Adding 128 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,928 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,933 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,934 [INFO ]: Adding 256 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,938 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,945 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,948 [INFO ]: Adding 512 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,951 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,960 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,964 [INFO ]: Adding 1024 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,968 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:56,981 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:56,992 [INFO ]: Adding 2048 failed events to queue to send (client.py:165)
2017-03-13 11:29:56,998 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:57,020 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:57,041 [INFO ]: Adding 4096 failed events to queue to send (client.py:165)
2017-03-13 11:29:57,049 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:57,088 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:57,140 [INFO ]: Adding 8192 failed events to queue to send (client.py:165)
2017-03-13 11:29:57,156 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:57,228 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:57,301 [INFO ]: Adding 16384 failed events to queue to send (client.py:165)
2017-03-13 11:29:57,330 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:57,461 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:57,645 [INFO ]: Adding 32768 failed events to queue to send (client.py:165)
2017-03-13 11:29:57,699 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:57,959 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:58,325 [INFO ]: Adding 65536 failed events to queue to send (client.py:165)
2017-03-13 11:29:58,428 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:29:59,022 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:29:59,788 [INFO ]: Adding 131072 failed events to queue to send (client.py:165)
2017-03-13 11:30:00,005 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:30:01,011 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:30:02,592 [INFO ]: Adding 262144 failed events to queue to send (client.py:165)
2017-03-13 11:30:03,000 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:30:05,045 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:30:08,383 [INFO ]: Adding 524290 failed events to queue to send (client.py:165)
2017-03-13 11:30:09,253 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:30:13,489 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:30:19,998 [INFO ]: Adding 1048584 failed events to queue to send (client.py:165)
2017-03-13 11:30:21,707 [WARNING]: Can't connect to aw-server, will queue events until connection is available: 405 Client Error: METHOD NOT ALLOWED for url: http://localhost:5666/api/0/buckets/aw-watcher-window-testing_erb-main2-arch/heartbeat?pulsetime=2.0 (client.py:193)
2017-03-13 11:31:16,024 [WARNING]: Connection to aw-server established (client.py:181)
2017-03-13 11:31:29,024 [INFO ]: Adding 2097210 failed events to queue to send (client.py:165)

Make API surface clearer about sync, async and queue

We should make it clearer to users of the API what is offered as (a)synchronous calls (there are no async calls in the current version) and what is offered as queued calls (á la heartbeats).

I propose a new more flexible API that would contain two notable classes.

class ActivityWatchAPI:
    """Offers synchronous calls to the entire API. 
    All its methods should have at least some tests.
    Also has a member variable `queued` that is an ActivityWatchQueuedAPI object."""

class ActivityWatchQueuedAPI:
    """Offers failover queues for certain endpoints (specifically heartbeat). 
    Uses the synchronous API together with a queue thread underneath."""

This will make it a lot clearer what actually happens when you call awapi.queued.heartbeat instead of the then synchronous awapi.heartbeat (which we currently have no way of calling using the library). It should probably send of a warning if you're using the synchronous version awapi.heartbeat since that's an unlikely usecase for anything else than testing and debugging.

Versioning confusion

https://aur.archlinux.org/packages/aw-client
How is this outdated package at 0.8.3 when the latest version is 0.5.9?

Need help understanding client.py

Sorry if this should be asked somewhere else. If so, please make a note about that.

In ActivityWatchClient a function call is made to self.request_queue.start(), yet in the RequestQueue class I don't find this function, only RequestQueue.run() (which seems to get triggered though). Is this just a typo, or do I miss something?

Here are the related code lines:
self.request_queue = RequestQueue(self)
self.request_queue.start()
RequestQueue.run

Integrate JSON datastore for uncommittable data

Depends on the JSON datastore issue here: ActivityWatch/aw-core#3

Cannot create_bucket with queued=True

When using queued=True the client doesn't send the create_bucket request to the server.

Steps to reproduce:

1. Start aw-server in testing mode: aw-server --testing --verbose

2. Run following python script:

from aw_client import ActivityWatchClient
client = ActivityWatchClient("test-client", True)
client.create_bucket('test-bucket_{}'.format(client.hostname), event_type='test-event-type', queued=True)

Expected behaviour

A bucket is created.

Context

• Ubuntu 18.04 LTS
• python3
• Versions: unknown (can look up if necessary)

Failed queue is never sent

Events that have failed to be sent are saved in the failed_queue, but events in failed_queue are never sent

get_events(b, limit = None) returns only 100 events.

import aw_client
ac = aw_client.ActivityWatchClient("_")
ac.connect()
afk_events = ac.get_events("aw-watcher-afk_ker")
print(len(afk_events))
# returns 100, same as 8h ago.

I think these 100 are the latest events, but I would like to get them all.
I would expect limit=None (the current default value) to not put a limit, and return them all.

I can get them all with limit = 10**6 because apparently I have 430 of them total.

Return response data from insert_event(s) methods

Perhaps there are more cases where this makes sense but this one in particular would be great to have.

Implement some "wait for queue to empty" call

Currently the example watcher waits for 1 second to make sure that the events are dispatched from the queue, would be nice if we could have a "wait for queue to empty" function which waits for the queue to empty if connected and instantly return if queue isn't running.

Crashes if no space left on device

I got an OSError at line 166 and 146 when diskspace ran out temporarily.

Better support systems running with a proxy

Should we add a config option for proxy or should we ignore the systems default proxy?

ActivityWatch/activitywatch#266

Many heartbeats and a unavailable server might lead to queue clogging

See discussion here: #6 (comment)

Unavailable server led to unordered events

I had killed aw-server accidentally with a filechange before leaving for bed. In the morning I tried to restart aw-server but the >25000 window events somehow got stuck in the queue due to it sending off a recent event (last 10 minutes) before the other events (up to 8h old) leading to a barrage of Inserting event that has older timestamp than previous event that just kept retrying over and over (it seemed).

I guess ensuring the queue is sorted would be one way to solve this, haven't had time to look into what caused it.

Example file not working (working_hours.py)

For me this example file just crashes. (working_hours.py)

Traceback (most recent call last):
  File "/home/example/.local/lib/python3.8/site-packages/aw_client/client.py", line 301, in query
    assert _dt_is_tzaware(start)
AssertionError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/example/working_hours.py", line 122, in <module>
    query()
  File "/home/example/working_hours.py", line 64, in query
    res = aw.query(
  File "/home/example/.local/lib/python3.8/site-packages/aw_client/client.py", line 304, in query
    raise ValueError("start/stop needs to have a timezone set")
ValueError: start/stop needs to have a timezone set

aw-cli does not parse "host" arg properly

The aw-cli utility currently doesn't parse the '--host' arg correctly. Per the help message 0, the arg should be in form "hostname:port".
aw-cli passes this 'host' arg to 'aw_client.ActivityWatchClient' 1, which expects 'host' and 'port' as separate parameters.

Currently, this means that specifying port for aw-cli (e.g. for hitting the test server) results in an exception as ActivityWatchClient adds '5600' as the port if none is specified:

 ./cli.py --host=localhost:5666 buckets
Traceback (most recent call last):
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/models.py", line 379, in prepare_url
    scheme, auth, host, port, path, query, fragment = parse_url(url)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/urllib3/util/url.py", line 234, in parse_url
    raise LocationParseError(url)
urllib3.exceptions.LocationParseError: Failed to parse: http://localhost:5666:5600/api/0/buckets/

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "./cli.py", line 94, in <module>
    main()
  File "./cli.py", line 66, in main
    buckets = client.get_buckets()
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/aw_client/client.py", line 208, in get_buckets
    return self._get('buckets/').json()
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/aw_client/client.py", line 39, in g
    r = f(*args, **kwargs)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/aw_client/client.py", line 91, in _get
    return req.get(self._url(endpoint), params=params)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/api.py", line 75, in get
    return request('get', url, params=params, **kwargs)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/api.py", line 60, in request
    return session.request(method=method, url=url, **kwargs)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/sessions.py", line 519, in request
    prep = self.prepare_request(req)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/sessions.py", line 462, in prepare_request
    hooks=merge_hooks(request.hooks, self.hooks),
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/models.py", line 313, in prepare
    self.prepare_url(url, params)
  File "/Users/REDACTED/.local/share/virtualenvs/activitywatch-hfS15L7q/lib/python3.7/site-packages/requests/models.py", line 381, in prepare_url
    raise InvalidURL(*e.args)
requests.exceptions.InvalidURL: Failed to parse: http://localhost:5666:5600/api/0/buckets/

Add method for caching next expected event to be sent (in case of program/machine failure)

Some function, perhaps to_send_later(event) that the watcher can use to set an event which is not yet finalized but will at some point be sent.

This event will be cached to a file (persistent storage) which will be read upon next start (if present and not empty).

The problem it solves is to prevent that in the case of machine failure, long-duration events will not be lost. This function will have to be used by watchers for them to not have the problem we are out to solve by this bugfix/feature.

Discussed with @exoji2e

type for start and end should be Optional[datetime]

Not a major issue, but currently the function signature for client.get_events reads

(method) def get_events(
    bucket_id: str,
    limit: int = -1,
    start: datetime = None,
    end: datetime = None
) -> List[Event]

but despite the value of start and end being assigned to None by default, if you try to pass in parameters for start and end that are either None or a datetime, this causes Pylance to interpret that as an issue if type checking is set to basic or strict in vscode.

This can be fixed by using the Optional type:

from typing import Optional, List
...
def get_events(
    bucket_id: str,
    limit: int = -1,
    start: Optional[datetime] = None,
    end: [datetime] = None
) -> List[Event]

I could probably open a PR for this next week, though I'm currently under a time crunch.

Send heartbeats from queue as batches

Will improve performance greatly when the queue is long

Failed to run examples and tests

SK@SK-Desktop MINGW64 /d/Users/Documents/GitHub/aw-client (master)
$ D:/Users/user/AppData/Local/Programs/Python/Python310/python.exe d:/Users/Documents/GitHub/aw-client/examples/working_hours.py
Querying events...
  Day offset: 4:00:00

500 Server Error: Internal Server Error for url: http://127.0.0.1:5600/api/0/query/
Error message received: {'message': 'ParsingError("(None, \\"expected `Bool`, `Ident`, `LBrace`, `LBracket`, `LParen`, `Number`, or `String`\\")")'}
Traceback (most recent call last):
  File "d:\Users\Documents\GitHub\aw-client\examples\working_hours.py", line 137, in <module>
    query()
  File "d:\Users\Documents\GitHub\aw-client\examples\working_hours.py", line 90, in query
    res = aw.query(query, timeperiods)
  File "D:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\aw_client\client.py", line 339, in query
    response = self._post(endpoint, data, params=params)
  File "D:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\aw_client\client.py", line 55, in g
    raise e
  File "D:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\aw_client\client.py", line 52, in g
    r.raise_for_status()
  File "D:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\requests\models.py", line 960, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://127.0.0.1:5600/api/0/query/

SK@SK-Desktop MINGW64 /d/Users/Documents/GitHub/aw-client (master)
$ make test
python -c "import aw_client"
pytest -s -vv tests/test_requestqueue.py
process_begin: CreateProcess(NULL, pytest -s -vv tests/test_requestqueue.py, ...) failed.
make (e=2): The system cannot find the file specified.
make: *** [test] Error 2