gearvrf/gearvrf-tests

gearvrf-tests's Issues

jassimpEmbeddedTextures fails

Trying to get a texture from somewhere else

E/GVRAssetLoader: ASSET: Texture: ERROR cannot load texture ..\..\..\..\Work\BenchmarkApp\benchmark\models\TestMeshLoad\bmw\MaxFile\Gar_chb.png 2

jassimpLightmap fails

Correct

Incorrect, boring (S8, Note8, Adreno)

Incorrect, psychedelic (Euro S7, S7 edge)

Incorrect, empty (Korean S7 edge)

golden_masters/S7Edge/TextureTests/testRepeatTexture.png is bad

I get skia errors and also all viewers I tried confirm that.

Lightmap tests: failures on Euro S7, S7 edge

testNormalDiffuseSpecularLightmapUnlit

Correct on Note4, Note8, S8+, Adreno:

Fails on S7 Euro, S7 Euro edge:

Slight corruption on Korean S7 edge:

Similar issues with testNormalDiffuseSpecularLightmap

testTwoPostEffects fail on 4.0

Image is not flipped vertically -- only one post effect applied?

x3dSpotLight4 fails

Some spotlights missing.
Broken:

Good:

canLoadModelWithoutLights fails on 4.0

java.lang.AssertionError: expected false
at org.gearvrf.tester.AssetImportTests$MeshVisitorNoLights.visit(AssetImportTests.java:274)

                mWaiter.assertFalse(vbuf.hasAttribute("a_normal"));

x3dOpacity test fails

In the image below, the overlaying square is 50% transparent and text should show through
X3D source: https://github.com/gearvrf/GearVRf-Tests/blob/master/x3d/general/opacitytest01.x3d

Tests crash on Note4

Crashes in the middle of ./gradlew cAT

08-30 10:36:43.101 485 485 F DEBUG : *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
08-30 10:36:43.101 485 485 F DEBUG : Build fingerprint: 'Verizon/trltevzw/trltevzw:6.0.1/MMB29M/N910VVRS2CQH2:user/release-keys'
08-30 10:36:43.101 485 485 F DEBUG : Revision: '12'
08-30 10:36:43.101 485 485 F DEBUG : ABI: 'arm'
08-30 10:36:43.101 485 485 F DEBUG : pid: 18469, tid: 20592, name: OVR::TimeWarp >>> org.gearvrf.tester <<<
08-30 10:36:43.101 485 485 F DEBUG : signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x0
08-30 10:36:43.241 485 485 F DEBUG : r0 00000000 r1 64e7ed40 r2 00000100 r3 00000000
08-30 10:36:43.241 485 485 F DEBUG : r4 000b7240 r5 04373000 r6 00000103 r7 00000010
08-30 10:36:43.241 485 485 F DEBUG : r8 00000000 r9 000000ff sl 00000000 fp 00000001
08-30 10:36:43.241 485 485 F DEBUG : ip 00000003 sp 09ce8fd0 lr a8a922a5 pc b6c85192 cpsr 200f0030
08-30 10:36:43.281 485 485 F DEBUG :
08-30 10:36:43.281 485 485 F DEBUG : backtrace:
08-30 10:36:43.281 485 485 F DEBUG : #00 pc 00018192 /system/lib/libc.so (__memcpy_base+261)
08-30 10:36:43.281 485 485 F DEBUG : #1 pc 001df2a1 /system/vendor/lib/egl/libGLESv2_adreno.so (A4xContext::UpdateCBuffer(EsxCBufferDescriptor*, A4xConstants)+64)
08-30 10:36:43.281 485 485 F DEBUG : #2 pc 00032ffc
08-30 10:36:48.051 485 485 F DEBUG :
08-30 10:36:48.051 485 485 F DEBUG : Tombstone written to: /data/tombstones/tombstone_02
08-30 10:36:48.051 485 485 E DEBUG : AM write failed: Broken pipe
08-30 10:36:48.051 485 485 E : ro.product_ship = true
08-30 10:36:48.051 485 485 E : ro.debug_level = 0x4f4c
08-30 10:36:48.051 485 485 E : sys.mobilecare.preload = false

S7Euro AssetLightTests: off-by-one

The following tests results exhibit 1 pixel horizontal shift compared to S7Edge masters.

x3dDirectLight x3dGenerateNormalsPoint x3dSpotLight1 x3dSpotLight2 x3dSpotLight3

canDisplayCubes/canDisplaySpheres fail on 4.0

No skybox

PickerTests randomly fail

Release 3.3 candidate C on G935F failed 2 tests: canPickObjectWithRay, canPickWithFrustum

Comparison images, assets on the sdcard

• create a script that pushes all the images and assets to some location on the sdcard
• update the tests to load from the sdcard and not bundle the images and the assets

The apk is too big already; slows down the development cycle. If there are no objections I will go ahead and make the changes some time in the near future.

S6, S7 Euro: canDisplayCubes() fail

Fails because background texture is missing

Tests in GearVRf-Tests crash frequently

Tests fail frequently with this exception:

02-09 16:55:00.979 15050-15050/? A/DEBUG: pid: 14111, tid: 14994, name: GLThread 1883 >>> org.gearvrf.tester <<<
02-09 16:55:00.979 15050-15050/? A/DEBUG: signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x1c
02-09 16:55:00.979 15050-15050/? A/DEBUG: r0 00000018 r1 00000000 r2 56cbbcb4 r3 00000018
02-09 16:55:00.979 15050-15050/? A/DEBUG: r4 d569b088 r5 00000000 r6 0f61fb51 r7 d587e2b8
02-09 16:55:00.979 15050-15050/? A/DEBUG: r8 d587ed90 r9 cca26f00 sl 00000000 fp d587ec6c
02-09 16:55:00.979 15050-15050/? A/DEBUG: ip d569c3d8 sp d587e2b8 lr d5248df3 pc d51ff85a cpsr 000b0030
02-09 16:55:00.981 15050-15050/? A/DEBUG: backtrace:
02-09 16:55:00.981 15050-15050/? A/DEBUG: #00 pc 0059085a /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (_ZNKSt6vectorIPN3gvr11SceneObjectESaIS2_EE4sizeEv+9)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #1 pc 005d9def /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (_ZN3gvr11SceneObject15getChildByIndexEi+30)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #2 pc 005e83d5 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (_ZNK3gvr9CameraRig16getHeadTransformEv+24)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #3 pc 005e88c9 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (_ZN3gvr9CameraRig11setRotationERKN3glm5tquatIfLNS1_9precisionE0EEE+36)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #4 pc 005e8371 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (_ZN3gvr9CameraRig14updateRotationEv+68)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #5 pc 0000bf20 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf-oculus.so (_ZN3gvr11GVRActivity11onDrawFrameEP8_jobject+1144)
02-09 16:55:00.981 15050-15050/? A/DEBUG: #6 pc 0000d624 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf-oculus.so (Java_org_gearvrf_OvrViewManager_drawEyes+40)
02-09 16:55:00.982 15050-15050/? A/DEBUG: #7 pc 006c399f /data/app/org.gearvrf.tester-2/oat/arm/base.odex (offset 0x627000)
02-09 16:55:00.999 15052-15052/? E/Zygote: v2

StateSortTests/testByRenderingOrder fails

testBillboardOwnersScale fails on 4.0

java.lang.AssertionError: expected true
at org.gearvrf.tester.SceneObjectTests.testBillboardOwnersScale(SceneObjectTests.java:328)

    GVRTransform t = quadObj1.getTransform();
    mWaiter.assertTrue(Math.abs(5 - t.getScaleX()) < epsilon);

x3dEmissive asset test fails

AssetImportTest/x3dEmissive fails on golden image compare

x3dGenerateNormals bad golden image

Golden image looks broken

Output from Release 3.3 candidate C looks correct (or, rather, more correct -- there still are some artifacts)

StencilTests/testBasic fails

jassimpCubeNormalDiffuseDirect golden master compare fails

Image shifted horizontally by 1 pixel. Didn't check other differences yet

Also fail, same issue maybe?
jassimpCubeNormalDiffusePoint
jassimpCubeNormalDiffuseSpot
jassimpCubeNormalDiffuseSpotLinearDecay

x3dShininess fails

Broken image:

Diff image (showing that we fail to render material and instead render some edge lines plus garbage)

ShadowTests failures on 4.0

directLightAtTopCastsShadow: no shadow.
spotLightAtTopCastsShadow: wrong shadow on the bottom horizontal plane. Adreno: shadow too big. Mali: shadow too small by about factor of 4

x3dPointLight2 different in Release 4.0

The dog texture is upside down.
asset-tests AssetLightTest x3dPointLight2
Result:

Diff:

Correct image from Release 3.3:

StencilTests fail on 4.0

All black -- nothing

StateSortTests fail on 4.0

'class gvr::Renderer' has no member named 'getRenderDataVector'

/home/d.vasilev/GVRFMerge/GearVRf-Tests/framework-tests/app/src/main/cpp/helpers.cpp: In function '_jlongArray* Java_org_gearvrf_tester_StateSortTests_getRenderDataVector(JNIEnv*, jclass)':
/home/d.vasilev/GVRFMerge/GearVRf-Tests/framework-tests/app/src/main/cpp/helpers.cpp:7:78: error: 'class gvr::Renderer' has no member named 'getRenderDataVector'
   const std::vector<gvr::RenderData *> &renderDataVector = gvr::gRenderer->getRenderDataVector();

Full test run crashes -- memory leaks

Crashes in the middle of full test run (./gradlew cAT)

08-30 10:38:32.021 10881 14074 F libc : Fatal signal 11 (SIGSEGV), code 1, fault addr 0xfffffff4 in tid 14074 (GLThread 929)
08-30 10:38:32.362 14097 14097 F DEBUG : *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
08-30 10:38:32.363 14097 14097 F DEBUG : Build fingerprint: 'Verizon/heroqltevzw/heroqltevzw:7.0/NRD90M/G930VVRU4BQC1:user/release-keys'
08-30 10:38:32.363 14097 14097 F DEBUG : Revision: '11'
08-30 10:38:32.363 14097 14097 F DEBUG : ABI: 'arm'
08-30 10:38:32.363 14097 14097 F DEBUG : pid: 10881, tid: 14074, name: GLThread 929 >>> org.gearvrf.tester <<<
08-30 10:38:32.364 14097 14097 F DEBUG : signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0xfffffff4
08-30 10:38:32.364 14097 14097 F DEBUG : r0 c8003274 r1 00000006 r2 c8003294 r3 00000000
08-30 10:38:32.364 14097 14097 F DEBUG : r4 c8003274 r5 cb070a10 r6 00000000 r7 c8003294
08-30 10:38:32.364 14097 14097 F DEBUG : r8 cc587e00 r9 c6679bfc sl c855e800 fp d1924fc4
08-30 10:38:32.364 14097 14097 F DEBUG : ip f1f04948 sp c6679b30 lr d18c46b7 pc d18aee8e cpsr 600f0030
08-30 10:38:32.371 14097 14097 F DEBUG :
08-30 10:38:32.371 14097 14097 F DEBUG : backtrace:
08-30 10:38:32.371 14097 14097 F DEBUG : #00 pc 00090e8e /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::Light::render(int, int)+69)
08-30 10:38:32.371 14097 14097 F DEBUG : #1 pc 000a66b3 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::CustomShader::render(gvr::RenderState*, gvr::RenderData*, gvr::Material*)+830)
08-30 10:38:32.371 14097 14097 F DEBUG : #2 pc 0008e3d9 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::GLRenderer::renderMaterialShader(gvr::RenderState&, gvr::RenderData*, gvr::Material*)+1424)
08-30 10:38:32.372 14097 14097 F DEBUG : #3 pc 0008cd8d /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::GLRenderer::renderMesh(gvr::RenderState&, gvr::RenderData*)+92)
08-30 10:38:32.372 14097 14097 F DEBUG : #4 pc 0008f23f /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::Renderer::renderRenderData(gvr::RenderState&, gvr::RenderData*)+40)
08-30 10:38:32.372 14097 14097 F DEBUG : #5 pc 0008bfad /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::BatchManager::renderBatches(gvr::RenderState&)+404)
08-30 10:38:32.372 14097 14097 F DEBUG : #6 pc 0008d2e9 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::GLRenderer::renderCamera(gvr::Scene*, gvr::Camera*, int, int, int, int, int, gvr::ShaderManager*, gvr::PostEffectShaderManager*, gvr::RenderTexture*, gvr::RenderTexture*, bool)+520)
08-30 10:38:32.373 14097 14097 F DEBUG : #7 pc 0008cd19 /data/app/org.gearvrf.tester-2/lib/arm/libgvrf.so (gvr::GLRenderer::renderCamera(gvr::Scene*, gvr::Camera*, gvr::ShaderManager*, gvr::PostEffectShaderManager*, gvr::RenderTexture*, gvr::RenderTexture*, bool)+108)
08-30 10:38:32.373 14097 14097 F DEBUG : #8 pc 005ba965 /data/app/org.gearvrf.tester-2/oat/arm/base.odex (offset 0x53e000)

x3dPointLightAttenuation difference

Test passes, but golden image differs. We only have S7Edge Golden image; new results are the same on S7Edge and S7Euro. Diff is below.