Giter Site home page Giter Site logo

configuration's Introduction

Searchisko Build Status Coverage Status

Searchisko is an open source project that allows to quickly build secured role-based REST service to index, search, retrieve and aggregate content from heterogeneous sources. It can attribute content to people and projects regardless of where the content originated.

Searchisko is Java EE 6 application which runs in the JBoss EAP 6 application server to provide REST API, and using Apache Lucene based full-text search engine and relational database in the background to provide powerful content retrieval, full-text search and aggregation functions.

Searchisko High-level View

Why have we created it?

Initially Searchisko was intended to provide a unified search experience across the multiple applications hosted at jboss.org but over time we realised it could also provide a powerful way to understand how people contribute to upstream projects using these applications and others on the internet.

Documentation

Anyone who would like to use Searchisko or implement a REST client for Searchisko can learn more in the following documentation:

Other resources

License

Copyright 2012 Red Hat Inc. and/or its affiliates and other contributors
as indicated by the @authors tag.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

configuration's People

Contributors

adelasofia avatar dantheman720 avatar dhladky avatar lkrzyzanek avatar lukas-vlcek avatar paulrobinson avatar tremes avatar unibrew avatar velias avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

configuration's Issues

Improvements for webpage_missing_data query

We need two features:

  • support for specifying sys_content_type in order to return results only relevant to this type
  • support for specifying from parameter to be able to page results

[query] Remove escaping in resources query template (both doc and json)

Remove escaping in resources.md documentation

Replace

{\"term\":{\"sys_project\":\"{{.}}\"}},

with

{ "term" : { "sys_project" : "{{.}}" }},

Remove escaping in resources.json query

Replace

{\\\"term\\\":{\\\"sys_project\\\":\\\"{{.}}\\\"}},

with

{\"term\":{\"sys_project\":\"{{.}}\"}},

Create version branches

We need to create branches per Searchisko version and document the process of using and updating the branches.

Small sys_content_type and mapping roles change

We currently tend to set provider role for DownloadManager-related sys_content_type and for employee node information in the mapping. This is not the right role to use in those places which is why we'd like to introduce 'trusted' role.

Fix all normalizations that uses copying fields that is array

In some cases the the normalization that has ESLookupPreprocessor that copy field which is not leaf and is array it leads to:

The server encountered an internal error that prevented it from fulfilling this request.</u></p><p><b>JBWEB000070: exception</b> <pre>org.jboss.resteasy.spi.UnhandledException: java.lang.ArrayIndexOutOfBoundsException: 0
        org.jboss.resteasy.core.SynchronousDispatcher.handleApplicationException(SynchronousDispatcher.java:367)
        org.jboss.resteasy.core.SynchronousDispatcher.handleException(SynchronousDispatcher.java:235)
        org.jboss.resteasy.core.SynchronousDispatcher.handleInvokerException(SynchronousDispatcher.java:211)
        org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:576)
        org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:543)
        org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:128)
        org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208)
        org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55)
        org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        org.searchisko.api.filter.CDIServletRequestProducingListener.doFilter(CDIServletRequestProducingListener.java:41)
        org.searchisko.api.filter.CORSWithCredentialsFilter.doFilter(CORSWithCredentialsFilter.java:120)
        org.searchisko.api.filter.JSONPRestrictionFilter.doFilter(JSONPRestrictionFilter.java:54)
        org.searchisko.api.security.util.ActualRolesRequestWrapperFilter.doFilter(ActualRolesRequestWrapperFilter.java:45)
        org.searchisko.api.filter.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:102)
</pre></p><p><b>JBWEB000071: root cause</b> <pre>java.lang.ArrayIndexOutOfBoundsException: 0
        org.jboss.elasticsearch.tools.content.ESLookupValuePreprocessor.lookupValue(ESLookupValuePreprocessor.java:362)
        org.jboss.elasticsearch.tools.content.ESLookupValuePreprocessor.processOneSourceValue(ESLookupValuePreprocessor.java:303)
        org.jboss.elasticsearch.tools.content.ESLookupValuePreprocessor.processOneSourceValue(ESLookupValuePreprocessor.java:190)
        org.jboss.elasticsearch.tools.content.StructuredContentPreprocessorWithSourceBasesBase.preprocessData(StructuredContentPreprocessorWithSourceBasesBase.java:43)
        org.searchisko.api.rest.NormalizationRestService.runPreprocessors(NormalizationRestService.java:200)
        org.searchisko.api.rest.NormalizationRestService.normalizeOne(NormalizationRestService.java:111)
        org.searchisko.api.rest.NormalizationRestService$Proxy$_$$_WeldClientProxy.normalizeOne(NormalizationRestService$Proxy$_$$_WeldClientProxy.java)
        sun.reflect.GeneratedMethodAccessor225.invoke(Unknown Source)
        sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        java.lang.reflect.Method.invoke(Method.java:606)
        org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:168)
        org.jboss.resteasy.core.ResourceMethod.invokeOnTarget(ResourceMethod.java:269)
        org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:227)
        org.jboss.resteasy.core.ResourceMethod.invoke(ResourceMethod.java:216)
        org.jboss.resteasy.core.SynchronousDispatcher.getResponse(SynchronousDispatcher.java:561)
        org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:543)
        org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:128)
        org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:208)
        org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:55)
        org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:50)
        javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
        org.searchisko.api.filter.CDIServletRequestProducingListener.doFilter(CDIServletRequestProducingListener.java:41)
        org.searchisko.api.filter.CORSWithCredentialsFilter.doFilter(CORSWithCredentialsFilter.java:120)
        org.searchisko.api.filter.JSONPRestrictionFilter.doFilter(JSONPRestrictionFilter.java:54)
        org.searchisko.api.security.util.ActualRolesRequestWrapperFilter.doFilter(ActualRolesRequestWrapperFilter.java:45)
        org.searchisko.api.filter.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:102)

[query] Developer materials does not work for quickstart sys_type

Developer materials query does not work correctly for quickstart and quickstart_early_access types. The problem is caused by renaming sys_type from jbossdeveloper_quickstart to quickstart, this change must be correctly reflected in configuration of registered query and in internal query scripting.

[query] Fix missing comma in JSON array

This commit b3bdb55 improved events query but the documentation (the .md file) is missing a comma in the JSON array.

Usually the query template from doc file is used by authors when changing the query, which can introduce a bug in this case.

Query for specific fields

Hey @lukas-vlcek - wondering how I can query by a specific field.

For example, I want to search for videos where the _id field is jbossdeveloper_youtube-YoC0vDIWpC8

I'm not sure this is possible - is it?

CC @paulrobinson - this is for the video detail page

Jive river preprocessors configs need date format improvement

If used with GMT located Jive instances like developer-dev the preprocessing of dates doesn't work because they use ISO format with 'Z' instead of +00:00. The parsing format must be set to yyyy-MM-dd'T'HH:mm:ss.SSSX instead of yyyy-MM-dd'T'HH:mm:ss.SSSZ

[query] Remove escaping in developer_materials.md query template

Invalid escaping in query has been fixed here 068bf75
However, it is good practice to fix it also in documentation as this can be used by authors to get original query template when modifying the query.

We need to turn

{\"term\":{\"sys_project\":\"{{.}}\"}}

into

{ "term" : { "sys_project" : "{{.}}" }}

in developer_materials.md file.

Skip cURL SSL certificate validation

If SSL certificate is invalid then init scripts fail. We can disable SSL certificate validation using curl option.

man curl says:

-k, --insecure

(SSL) This option explicitly allows curl to perform "insecure" SSL connections and transfers. All SSL connections are attempted to be made secure by using the CA certificate bundle installed by default. This makes all connections considered "insecure" fail unless -k, --insecure is used.

More cURL docs can be found here: http://curl.haxx.se/docs/sslcerts.html

Add Hawkular project configuration

The following are some initial data:

{  
   "_source":{  
      "sys_type":"project_info",
      "sys_content_provider":"jbossorg",
      "sys_content_type":"jbossorg_project_info",
      "sys_id":"jbossorg_project_info-hawkular",
      "sys_content_id":"hawkular",
      "sys_title":"Hawkular",
      "sys_url_view":"http://www.hawkular.org",
      "sys_description":"Systems Management and Monitoring Platform",
      "sys_updated":"2015-06-16T08:15Z",
      "chatLink":"irc://irc.freenode.net/#hawkular",
      "nodePath":"/hawkular",
      "docsLink":"http://www.hawkular.org/docs/user/getting-started.html",
      "downloadsLink":"http://www.hawkular.org/downloads.html",
      "twitterLink":"https://twitter.com/hawkular_org",
      "githubLink":"https://github.com/hawkular",
      "homePage":"http://www.hawkular.org",
      "blogLink":"http://www.hawkular.org/blog.html",
      "buildLink":"https://travis-ci.org/hawkular",
      "description":"Systems Management and Monitoring Platform",
      "jiraLink":"https://issues.jboss.org/browse/HAWKULAR",
      "projectName":"Hawkular",
      "mailingListLink":"https://lists.jboss.org/mailman/listinfo/hawkular-dev",
      "license":"ASL"
   }
}

Add all params to registered queries

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.