Comments (4)
Sounds good to me. The 'interesting stuff' was some additional logging that @LLTommy added so we could do some deeper analysis of queries from the logs. We have an ELK stack configured to analyse this output.
from lodestar.
Sounds good to me. The 'interesting stuff' was some additional logging that @LLTommy added
so we could do some deeper analysis of queries from the logs. We have an ELK stack configured
to analyse this output.
Would you prefer a pull request to the 1.4 branch or to master? Which is really most current at this point?
from lodestar.
@simonjupp , I decided I should of course merge to master, but that 1.4-release should also be merged into master. So, I've created a pull request just for that. I'll proceed on the assumption that 1.4 release should be merged first, but if I send a new pull request, it will be against master.
from lodestar.
I've looked at three different ways to get to logs already in JSON, e.g. each line is JSON:
- A logstash layout for Log4j 1.2 - https://github.com/logstash/log4j-jsonevent-layout
- A JSON encoder for logback - https://github.com/logstash/logstash-logback-encoder
- A community JSON layout for log4j 2.11 - https://github.com/lukasniemeier-zalando/log4j2-json-layout
The first two are part of the logstash organization on github, but the last is just some guy. So, I think it is best to stick with log4j 1.2.17, however, moving to a JSON encoding and making use of Mapped Diagnostic Context (MDC) would be a better way to capture the extra information - you guys probably have some complicated logstash configuration turning multiple log messages into one event, or you just look at them and know.
With the first of these, I was able to achieve the following log entry from our SPARQL endpoint:
{
"@timestamp": "2019-03-07T23:32:36.097Z",
"source_host": "NLM01890936OCCS",
"file": "SparqlController.java",
"method": "query",
"level": "INFO",
"line_number": "74",
"thread_name": "http-nio-8080-exec-2",
"@version": 1,
"logger_name": "gov.nih.nlm.lode.api",
"message": "sparql query",
"class": "gov.nih.nlm.lode.servlet.SparqlController",
"mdc": {
"cliaddr": "0:0:0:0:0:0:0:1",
"format": "JSON",
"query": "PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>\r\nPREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#>\r\nPREFIX xsd: <http://www.w3.org/2001/XMLSchema#>\r\nPREFIX owl: <http://www.w3.org/2002/07/owl#>\r\nPREFIX meshv: <http://id.nlm.nih.gov/mesh/vocab#>\r\nPREFIX mesh: <http://id.nlm.nih.gov/mesh/>\r\nPREFIX mesh2019: <http://id.nlm.nih.gov/mesh/2019/>\r\nPREFIX mesh2018: <http://id.nlm.nih.gov/mesh/2018/>\r\nPREFIX mesh2017: <http://id.nlm.nih.gov/mesh/2017/>\r\n\r\nSELECT distinct ?d ?dLabel \r\nFROM <http://id.nlm.nih.gov/mesh>\r\nWHERE {\r\n ?d meshv:allowableQualifier ?q .\r\n ?q rdfs:label 'adverse effects'@en . \r\n ?d rdfs:label ?dLabel . \r\n} \r\nORDER BY ?dLabel \r\n",
"session-id": "C4A0A12448D59EB069F628C00F21A2A5",
"offset": 0,
"session-time": "2019-03-07T18:32:35.018-05:00",
"inference": false,
"ua": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36",
"limit": 50,
"webui": true
}
}
from lodestar.
Related Issues (20)
- link to stable release gives error HOT 1
- Lodestar won't build: Unknown host coconut.ebi.ac.uk HOT 6
- lodestar returns HTTP status 200 for resources that do not exist
- remove/document unreferenced bean
- Update to Spring 4 and Java 1.8 HOT 5
- Link to documentation and stable releases HOT 2
- Security updates for Lodestar HOT 1
- Upgrade to Spring boot
- Update to virt_jena3.jar and Apache Jena 3.10.0 HOT 2
- Documentation is missing and links are stale HOT 2
- Wrong media type used for JSON(-LD) HOT 2
- Bamboo CI/CD integration discussion HOT 2
- Changes for security of our clients from XSS attacks
- Merge Lodestar version HOT 1
- left-align table header to reduce necessity to scroll right over HOT 3
- Simple tweak to CorsFilter for Chrome HOT 1
- jenaVirtuosoExecutorService.endpointURL in default ebi-lode-service.xml is wrong HOT 1
- OWASP plugin needs to be updated, 1.4.3 triggers errors
- log4j vulnerability and Apache Jena 2 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lodestar.