nytlabs/hive

A platform for backing crowdsourcing websites, built in golang for elasticsearch

hive's Issues

Error loading data into Hive

I am attempting to load data into hive. I have Elasticsearch running on port 9200, Hive running on 8080. Any attempts at POSTing JSON data to the Hive server give this error - {"error":"unexpected end of JSON input"}. My JSON is valid. I even tried simply loading the example JSON from this repo and received the same error.

I was able to post the data directly to the Elasticsearch port, in index "hive," but I'm not able to utilize any of the Hive API endpoints.

Here's the actual readout from the Hive server:
2015/02/19 10:52:04 Creating index hive
2015/02/19 10:52:04 Done configuring elasticsearch
2015/02/19 10:52:04 Step 2: creating project.
2015/02/19 10:52:04 {"error":"unexpected end of JSON input"}

Here's the JSON I'm trying to POST:
{ "Project":
{ "Id": "idnc", "Name": "IDNC", "Description": "Test loading IDNC image data" },
"Tasks":
[
{ "Name": "categorize", "Description": "categorize images", "CurrentState": "available", "AssignmentCriteria":
{"SubmittedData": { "categorize": {} } }, "CompletionCriteria":
{ "Total": 50, "Matching": 50 } },
{ "Name": "vote", "Description": "vote on image quality (from 1 to 10)", "CurrentState": "waiting", "AssignmentCriteria": { "SubmittedData": { "categorize": { "ad-content": "usable" }, "vote": {} } }, "CompletionCriteria": { "Total": 2, "Matching": 2 } } ], "Assets": [ { "Name": "DIL19720801", "Url": "http://idnc.library.illinois.edu/cgi-bin/imageserver/imageserver.pl?oid=DIL19720801.2.29.2&color=all&ext=jpg&area=2&width=700" }, { "Name": "DIL19661012", "Url": "http://idnc.library.illinois.edu/cgi-bin/imageserver/imageserver.pl?oid=DIL19661012.2.12.2&color=all&ext=jpg&area=7&width=700" }, { "Name": "DIL19640213", "Url": "http://idnc.library.illinois.edu/cgi-bin/imageserver/imageserver.pl?oid=DIL19640213.2.16.1&color=all&ext=jpg&area=11&width=700" }, { "Name": "DIL19691217", "Url": "http://idnc.library.illinois.edu/cgi-bin/imageserver/imageserver.pl?oid=DIL19691217.2.22.2&color=all&ext=jpg&area=1&width=700" } ] }

Any suggestions as to what I'm doing wrong here are welcomed. Thanks!

Fix error in readme instructions

This line: https://github.com/nytlabs/hive/blame/master/README.md#L24

Download the [latest release](https://github.com/nytlabs/hive/releases) and double click to start. `hive` will be running on http://localhost:8080 by default.

There are no tagged releases. It is confusing for user trying to set up. :-(

add a license

Preferably Apache 2.0

Importing Data error

I have elastic search running and started hive..

When i run this command:
curl -XPOST localhost:8080/admin/setup -d@samples/example.json
I get this response:
{"error":"record not found"}

logs
2014/12/14 19:11:47 running hive-server on port 8080 storing data in elasticsearch under index hive
2014/12/14 19:12:47 {"error":"record not found"}

Any ideas ?

Adding new properties in Project

i cannot add new properties in Project Struct.

Example front-end available?

Just wondering if there is an front-end somewhere to provide an example / starting-point to use hive?

Error while building from Source.

Hi Everyone.

I tried to build hive from source but it generates the following error:

$ make
go get .
# github.com/araddon/gou
../../araddon/gou/testutil.go:26:6: error: expected operand
  for range timer.C {
      ^
../../araddon/gou/testutil.go:26:6: error: expected ‘{’
../../araddon/gou/testutil.go:26:6: error: expected ‘;’ or ‘}’ or newline
../../araddon/gou/testutil.go:29:9: error: break statement not within for or switch or select
    break
         ^
../../araddon/gou/testutil.go:31:3: error: expected declaration
   if tryct >= timeoutSecs*10 {
   ^
../../araddon/gou/testutil.go:33:4: error: expected declaration
    break
    ^
../../araddon/gou/testutil.go:34:3: error: expected declaration
   }
   ^
../../araddon/gou/testutil.go:35:3: error: expected declaration
   tryct++
   ^
../../araddon/gou/testutil.go:36:2: error: expected declaration
  }
  ^
../../araddon/gou/testutil.go:37:1: error: expected declaration
 }
 ^
make: *** [build/hive-server] Error 2

Please help me resolve this issue. Thanks in advance!

Error when trying to import data, using the binary file.

Hello,

I managed to install elasticsearch and have it up and running at localhost:9200. But when I try to import data by following the readme:

$ curl -XPOST localhost:8080/admin/setup -d@samples/example.json

I get the following error.

{"error":"2016-05-09 16:59:12.436297591 +0530 IST: Error [map[root_cause:[map[type:illegal_argument_exception reason:Mapper for [Project] conflicts with existing mapping in other types:
[mapper [Project] has different [index] values, mapper [Project] has different [omit_norms] values, cannot change from disable to enabled, mapper [Project] has different [analyzer], mapper [Project] is used by multiple types. Set update_all_types to true to update [omit_norms] across all types., mapper [Project] is used by multiple types. Set update_all_types to true to update [search_analyzer] across all types., mapper [Project] is used by multiple types. Set update_all_types to true to update [search_quote_analyzer] across all types.]]] type:illegal_argument_exception reason:Mapper for [Project] conflicts with existing mapping in other types:
[mapper [Project] has different [index] values, mapper [Project] has different [omit_norms] values, cannot change from disable to enabled, mapper [Project] has different [analyzer], mapper [Project] is used by multiple types. Set update_all_types to true to update [omit_norms] across all types., mapper [Project] is used by multiple types. Set update_all_types to true to update [search_analyzer] across all types., mapper [Project] is used by multiple types. Set update_all_types to true to update [search_quote_analyzer] across all types.]]] Status [400] [400]"}

I specifically mention binary file as I haven't tried it using any other method (See Issue #9 ). Any help is appreciated. Thanks in advance!

No Makefile

The instructions say to run make, but I see no Makefile in the repo

Add explicit instructions to run elastic search to readme.

I would have submitted this as a pull request, but I am not sure if you had a preferred way of doing this or an opinion on where this should go in the Readme.

---

When importing data, I got a connection error and realized it was because I didn't have Elastic search running. Maybe add something to the Setup section?

Details if you decide to add something specific to the readme.....

If you get this error while importing data:

{"error":"Put http://localhost:9200/hive/assignments/_mapping: dial tcp 127.0.0.1:9200: connection refused"}

Make sure that elastic search is running. From the Homebrew Elastic Search install:

To have launchd start elasticsearch at login:
    ln -sfv /usr/local/opt/elasticsearch/*.plist ~/Library/LaunchAgents
Then to load elasticsearch now:
    launchctl load ~/Library/LaunchAgents/homebrew.mxcl.elasticsearch.plist
Or, if you don't want/need launchctl, you can just run:
    elasticsearch --config=/usr/local/opt/elasticsearch/config/elasticsearch.yml

Add logo to README

Specify what to double click to start in Readme

In this line: https://github.com/nytlabs/hive/blame/master/README.md#L24

The instructions say "double click to start". Double click what to start?