Comments (11)
Thanks @fruch for reporting it.
I am looking into it
from gemini.
Here is original error:
{"L":"INFO","T":"2023-06-11T08:05:16.152Z","N":"work cycle.validation_job","M":"Validation failed. Error: unable to load check data from the oracle store: system failed: gocql: no response received from cassandra within timeout period"}
Error detected: &joberror.JobError{Timestamp:time.Date(2023, time.June, 11, 8, 5, 16, 152043820, time.Local), Message:"Validation failed: unable to load check data from the oracle store: system failed: gocql: no response received from cassandra within timeout period", Query:"SELECT * FROM ks1.table1_mv_0 WHERE col8=d2808980-8b12-11b8-995a-0a420e931031 AND pk0=1 AND pk1=228134926 AND pk2=4333304577001056359 AND pk3=97 AND pk4=-28154 AND pk5=515616374 "}{"L":"INFO","T":"2023-06-11T08:05:16.152Z","N":"work cycle.validation_job","M":"ending validation loop"}
It shows two problems:
from gemini.
Seems like those are stilling happening:
https://argus.scylladb.com/test/c05bf635-e29a-490c-a72f-9d4e42e6c7e7/runs?additionalRuns[]=b6fc4ff5-1120-404e-b8f4-8dd19738bc91
do we have fixes for those ready ?
from gemini.
@fruch can we try this with older oracle version? enterprise 2020.1.x or 2021.1.x (if it's not already the one).
I want to know if it's a regression in Scylla.
from gemini.
@fruch can we try this with older oracle version? enterprise 2020.1.x or 2021.1.x (if it's not already the one). I want to know if it's a regression in Scylla.
those failures has started showing since we move to v1.8.2, I don't thing it's an issue with the oracle itself.
we could try, but I'm guessing it would fail the same.
from gemini.
oracle now is:
2021.1.15
from gemini.
running with 2020.1.14
https://jenkins.scylladb.com/view/staging/job/scylla-staging/job/fruch/job/gemini-3h-test/9/
from gemini.
@fruch , @roydahan , this issue partially fixed on v1.8.3
, chance of getting it greatly reduced there, but in order to make it 100% go away we need to implement proper timeout handling
from gemini.
@fruch, @roydahan, ok it looks like there are two different issues, one - is related to multirow, any error on multirow is related to what I have been saying, including timeouts and missing rows.
Other issue is other missing rows that popup when gemini is terminating the test cycle, it is also gemini issue, that needs to be addressed.
This is exactly what happened here and on issue before.
from gemini.
running with 2020.1.14 https://jenkins.scylladb.com/view/staging/job/scylla-staging/job/fruch/job/gemini-3h-test/9/
this run confirms the failure isn't related to the version of the oracle.
from gemini.
Both issues that led to this error are fixed:
from gemini.
Related Issues (20)
- Validate fails to get response from test cluster HOT 4
- Gemini generated query with wrong number of values
- The `result channel` doesn't get closed after load ends blocking the results file generation HOT 2
- Add support of an embedded complex-type for a collection in a given json schema
- Make error more verbose
- Gemini failed writing to a "map" type column: Mutation statement generation failed","error":"json: unsupported type: map[interface {}]interface {}"} HOT 1
- There is a case when GetHash would not ever return hash that matches certain partitions
- Values are not circulating properly from new to old
- AddIfNotPresent to be run early
- Mutation failed: unable to apply mutations to the test store HOT 1
- after v1.8,7 it hungs without `--schema-seed`
- gemini detected row difference, while error message shows rows are the same HOT 4
- 'varint' and 'decimal' scylla types does`t work properly as a maps key. HOT 2
- MIgrate Go to v1.21 HOT 3
- Log details required for debugging failed tests HOT 4
- Make use of PGO HOT 1
- Could not initialize seastar when starting scylla 5.2.9 HOT 1
- Could not initialize seastar when starting scylla 5.2.9 HOT 12
- Use Query.Observer to log statements
- Float type (float32) is shown and compared as a 64-bit number instead of 32-bit HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gemini.