Comments (9)
- Primary partition key ConnectionId (String)
- Export is done with Data Pipeline. you can do it manually with this pgsql query:
copy features from 'dynamodb://Snoop'
credentials 'aws_access_key_id=key;aws_secret_access_key=secret'
readratio 50; - You need to create an application in github developers site. But that's only if you want to use the website that is not very useful yet :(
from rtcstats-server.
installation went smoothly. After fighting with AWS security groups. zero effort for integration, just dumped the script with changed path into things.
from rtcstats-server.
do you have a definition for data pipeline? I now want the full pain :-)
from rtcstats-server.
renaming tables:
alter table features rename to features_old
also: increase the read capacity or dynamodb to 100-200 and use a read ratio of 95
from rtcstats-server.
@fippo @ggarber Could you please provide more details in README file in order to configure the server. I have inspected the yaml files in config folder but I still do not understand how works the flow. I am able to run the client, but I do not understand how the client send the stats to the server or how to run the server in order to collect all the data from the different clients.
I think it would be great you guys could bring some light on it, I am really interested in using your application, but I need some extra steps to put all the pieces together.
Thanks in advance guys!
from rtcstats-server.
@jmg-syncrtc: unfortunately neither of us has time for documenting this -- and setting up the full server->kinesis->redshift workflow has taken several days the last time we tried.
Maybe @dagingaa can shed some light on this
from rtcstats-server.
Thanks for letting me know, @fippo.
@dagingaa , could you, please, provide further steps in order to configure the server? Maybe, not the final setup document, but any help would be great to unlock me.
Thanks so much
from rtcstats-server.
Err, one day I might have time to open source the terraform config for this, but currently I can't. I agree it's not a lot to go on here, but how I did it was:
- Modify rtcstats to run in elastic beanstalk, I have a specific fork of this to do that, since I use travis to do the deploying
- Create an s3 bucket to dump logs into
- Create a redshift cluster
- Create a firehose and point that to your redshift cluster
- Create the database table using https://github.com/fippo/rtcstats-server/blob/develop/features.sql (it's not completely up to date, so sometimes I scroll through the commit history to find stuff, or look up the source code if I find anything missing that I want)
- Config rtcstats with the firehose stream and s3 bucket
- Now run it and configure the rtcstats-client to connect to it
Reason I'm being so short on these things is that it's surprisingly complex to do, and I don't have the time or energy to sit down and document it currently. At some point some kind soul might contribute patches to this to make it easier and more understandable to get it up and running. I just know this stuff because I spent time figuring out how to deploy it by reading the source and knowing a ton of amazon stuff from before, which certainly made things easier. Sadly (and I honestly regret this), I didn't take the time to document what I did back then.
Confrere might consider donating some time to rtcstats in the future, but it won't be right now.
from rtcstats-server.
Thanks so much for this @dagingaa , maybe it is not so documented as you'd like, but I think you have provided very good tips here in order to make the installation easier.
Thanks again guys
from rtcstats-server.
Related Issues (20)
- number of different host candidates in onicecandidate
- location features HOT 2
- feature: candidate types after ice restart HOT 1
- write peerconnections to different files HOT 4
- work with spec-stats HOT 3
- chrome 51 broke stuff
- receivingvideo10s is broken
- extractTrack should not rely on onaddstream HOT 3
- Ability to start/end session outside opening/closing tab HOT 2
- inconsistent internal use of .timestamp HOT 1
- move the repository HOT 5
- feature: delta(qp) HOT 2
- ipv6 obfuscation HOT 1
- fileFormat 2 breaks time series in webrtc-dump-importer HOT 2
- gcp/bigquery support HOT 5
- use materialized views
- port publicLocation HOT 5
- maxmind postinstall won't work anymore HOT 3
- navigator.userAgent deprecation
- BigQuery ignore unknown values HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rtcstats-server.