enonic/app-explorer

app-explorer's Issues

Interfaces page Modal Search

Move new from menu to lower right corner with modal popup

1. Documentation

app-simple-search / starter-search

Implementing a search frontend can become quite complex, in order to avoid writing endless outdated documentation having an example app/starter is a good idea.

Remove all usage of phrases inside app-yase

Require name on Collection

Preferably client side validation

Rename 'Collect?' Checkbox to 'Activate scheduling'

Handle "system" fields

Add system = true property to if a field that is initialized (i.e. Displayname, collector, type, _alltext etc)

This prevents "conflicts" between custom defined and system fields.

Standardize buttons like Edit synonym

Rename YASE admin to YASE

Repo and app name: app-yase (com.enonic.app.yase)

Hardcode query on home page

Logs tab with finished tasks

Add GUI to build filters

It should be possible to specify that a field named "type" should have the value "com.enonic.yase:document"

Sidebar menu overlay on mobile, push otherwise

Submenu hidden until Collections selected

Stopwords page should have same new button as the other pages

Merge 'Edit thesaurus' with 'Edit synonyms'

Remove List button on Collection page

Search history

Installable collectors

I would like collectors like surgeon to be separate apps that can be installed independently.

There needs to be a standard "API" for YASE to work with such collectors.

The collector app should register itself on startup.

• lib-yase should provide a register function.

A collector should contain a collect task which can be used via submitNamedTask.

The collector should use a collection root node to check whether it should stop.

• lib-yase could have a shouldStop function

I'm uncertain how the collector app should provide it's configuration ui to YASE.
Perhaps via an react component bundle provided during registration.

Listing status failes for a while, then goes back to normal

Some times, after starting collector-jobs, the listing of status fails with exception for a while before working again, typically a couple of minutes(?):

SyntaxError: Invalid JSON: <json>:1:0 Expected json literal but found E Error: Finished with 3 errors. ^ com.enonic.xp.web.WebException: SyntaxError: Invalid JSON: <json>:1:0 Expected json literal but found E Error: Finished with 3 errors. ^ at com.enonic.xp.web.impl.exception.ExceptionMapperImpl.map(ExceptionMapperImpl.java:32) at com.enonic.xp.portal.handler.BasePortalHandler.handleError(BasePortalHandler.java:60) at com.enonic.xp.portal.handler.BasePortalHandler.doHandle(BasePortalHandler.java:52) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:66) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.impl.trace.TraceWebFilter.doHandle(TraceWebFilter.java:38) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:66) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.impl.handler.WebDispatcherImpl.dispatch(WebDispatcherImpl.java:50) at com.enonic.xp.web.impl.handler.WebDispatcherServlet.doHandle(WebDispatcherServlet.java:135) at com.enonic.xp.web.impl.handler.WebDispatcherServlet.service(WebDispatcherServlet.java:63) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at com.enonic.xp.web.impl.dispatch.mapping.ServletDefinitionImpl.service(ServletDefinitionImpl.java:39) at com.enonic.xp.web.impl.dispatch.pipeline.ServletPipelineImpl.service(ServletPipelineImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:45) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.portal.impl.idprovider.IdProviderFilter.doHandle(IdProviderFilter.java:45) at com.enonic.xp.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:31) at com.enonic.xp.web.filter.BaseWebFilter.doFilter(BaseWebFilter.java:33) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.auth.BasicAuthFilter.doHandle(BasicAuthFilter.java:33) at com.enonic.xp.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:31) at com.enonic.xp.web.filter.BaseWebFilter.doFilter(BaseWebFilter.java:33) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.context.ContextFilter.lambda$doHandle$0(ContextFilter.java:33) at com.enonic.xp.context.ContextImpl.callWith(ContextImpl.java:101) at com.enonic.xp.web.impl.context.ContextFilter.doHandle(ContextFilter.java:32) at com.enonic.xp.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:31) at com.enonic.xp.web.filter.BaseWebFilter.doFilter(BaseWebFilter.java:33) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:26) at com.enonic.xp.web.filter.BaseWebFilter.doFilter(BaseWebFilter.java:33) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.dos.DosFilterWrapper.doFilter(DosFilterWrapper.java:65) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.dispatch.pipeline.FilterPipelineImpl.filter(FilterPipelineImpl.java:39) at com.enonic.xp.web.impl.dispatch.DispatchServletImpl.service(DispatchServletImpl.java:49) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:860) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:420) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:203) at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:73) at com.enonic.xp.web.vhost.impl.VirtualHostFilter.doHandle(VirtualHostFilter.java:53) at com.enonic.xp.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:31) at com.enonic.xp.web.filter.BaseWebFilter.doFilter(BaseWebFilter.java:33) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.dos.DosFilterWrapper.doFilter(DosFilterWrapper.java:65) at com.enonic.xp.web.impl.dispatch.mapping.FilterDefinitionImpl.doFilter(FilterDefinitionImpl.java:40) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:50) at com.enonic.xp.web.impl.dispatch.pipeline.FilterChainImpl.doFilter(FilterChainImpl.java:36) at com.enonic.xp.web.impl.dispatch.pipeline.FilterPipelineImpl.filter(FilterPipelineImpl.java:39) at com.enonic.xp.web.impl.dispatch.DispatchServletImpl.service(DispatchServletImpl.java:49) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:860) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:530) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.enonic.xp.resource.ResourceProblemException: SyntaxError: Invalid JSON: <json>:1:0 Expected json literal but found E Error: Finished with 3 errors. ^ at com.enonic.xp.resource.ResourceProblemException$Builder.build(ResourceProblemException.java:131) at com.enonic.xp.script.impl.util.ErrorHelper.doHandleException(ErrorHelper.java:54) at com.enonic.xp.script.impl.util.ErrorHelper.handleError(ErrorHelper.java:27) at com.enonic.xp.script.impl.value.FunctionScriptValue.call(FunctionScriptValue.java:41) at com.enonic.xp.script.impl.executor.ScriptExportsImpl.executeMethod(ScriptExportsImpl.java:56) at com.enonic.xp.portal.impl.controller.ControllerScriptImpl.doExecute(ControllerScriptImpl.java:71) at com.enonic.xp.portal.impl.controller.ControllerScriptImpl.lambda$execute$0(ControllerScriptImpl.java:36) at com.enonic.xp.trace.Tracer.traceEx(Tracer.java:72) at com.enonic.xp.trace.Tracer.trace(Tracer.java:51) at com.enonic.xp.trace.Tracer.trace(Tracer.java:98) at com.enonic.xp.portal.impl.controller.ControllerScriptImpl.execute(ControllerScriptImpl.java:36) at com.enonic.xp.portal.impl.handler.service.ServiceHandlerWorker.execute(ServiceHandlerWorker.java:105) at com.enonic.xp.portal.impl.handler.service.ServiceHandler.doHandle(ServiceHandler.java:63) at com.enonic.xp.portal.impl.handler.service.ServiceHandler.doHandle(ServiceHandler.java:22) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:66) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.web.handler.BaseWebHandler.handle(BaseWebHandler.java:75) at com.enonic.xp.web.impl.handler.WebHandlerChainImpl.handle(WebHandlerChainImpl.java:30) at com.enonic.xp.portal.handler.BasePortalHandler.doHandle(BasePortalHandler.java:46) ... 107 common frames omitted Caused by: jdk.nashorn.internal.runtime.ECMAException: SyntaxError: Invalid JSON: <json>:1:0 Expected json literal but found E Error: Finished with 3 errors. ^ at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ECMAErrors.error(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ECMAErrors.syntaxError(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ECMAErrors.syntaxError(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.JSONFunctions.parse(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.objects.NativeJSON.parse(Unknown Source) at jdk.scripting.nashorn.scripts/jdk.nashorn.internal.scripts.Script$Recompilation$2645$1479A$listCollectors.L:1#L:1-6#u#body(com.enonic.app.explorer:/services/listCollectors/listCollectors.js:1) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptFunctionData.invoke(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptFunction.invoke(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptRuntime.apply(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.objects.NativeArray$10.forEach(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.arrays.IteratorAction.apply(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.objects.NativeArray.map(Unknown Source) at jdk.scripting.nashorn.scripts/jdk.nashorn.internal.scripts.Script$Recompilation$2639$1403$listCollectors.L:1#L:1-6#u(com.enonic.app.explorer:/services/listCollectors/listCollectors.js:1) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptFunctionData.invoke(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptFunction.invoke(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.runtime.ScriptRuntime.apply(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.api.scripting.ScriptObjectMirror.call(Unknown Source) at com.enonic.xp.script.impl.value.FunctionScriptValue.call(FunctionScriptValue.java:36) ... 138 common frames omitted Caused by: jdk.nashorn.internal.runtime.ParserException: <json>:1:0 Expected json literal but found E Error: Finished with 3 errors. ^ at jdk.scripting.nashorn/jdk.nashorn.internal.parser.JSONParser.error(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.parser.JSONParser.error(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.parser.JSONParser.expectedError(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.parser.JSONParser.parseLiteral(Unknown Source) at jdk.scripting.nashorn/jdk.nashorn.internal.parser.JSONParser.parse(Unknown Source) ... 153 common frames omitted

License info, market

Left menu visible at all times

role:yase admin is not enough

Currently it seems you need super admin in order to see YASE. This should not be the case. Having role yase admin should be enough.

Merge lib-client, lib-collector and into lib-explorer

Since the big files are moved to app-explorer there is no longer need for multiple libs.

One lib rule them all.

Collections 'Collect now' button becomes 'Stop collecting' when collector active

Include web crawler collector in app-explorer?

Page headings

New Interface

Merge yase-collector-surgeon into app-yase

validate enonic license

Merge collector surgeon into app-yase

better name handling for fields

1. No fields can be created with name starting with _
2. The standard system fields i.e. _allText are crated "outside of fields api" through init script and should use same name in tree structure as it is called, i.e. _allText

This way, key and name will be consistent, and we avoid problems with _xx properties.

Not scheduled in cron column

Explorer home interface selector

Search page per interface

Left align main content

Remove pagination from edit interface form

ref: enonic/lib-explorer#17

Make it possible to preview Interface inside Edit Interface

Export is easier to understand than a.csv

Document development process

@sigdestad has to be able to compile, install and setup at his machine.

Fields merge 'edit values' into edit

Try vertical menu

Follow robots.txt and meta noindex

Status tab with progress bars

Make it possible to have more than one collector per app?

Header on Status and Journal

Do not spam log on status page info not beeing JSON

Remove Edit and Delete from Collections page

app-collector-simple / starter-collector

Implementing a collector is quite complex, in order to avoid writing endless outdated documentation having an example app/starter is a good idea.

Search page is slow?