skyapmtest/agent-auto-integration-testcases

agent-auto-integration-testcases's Issues

Add ci and license check for safe.

cc @peng-yongsheng @lytscu @ascrutae

how to integreation testcases

Hi all,
I am trying to write an agent's auto-testcases. But something puzzle me for long time.

1. Can I run testcases without deploy-test.sh. That means I run the docker-compose.yml only. If I can, how to get the report.
2. to execute deploy-test.sh, it has to clone the Apache Skywalking's source everytime?
3. How to configure my agent's repo, which I push my testcases.

Thanks

yaml.parser.ParserError

Not sure what I'm doing wrong here. I've tried it on multiple scenarios and I get the same result.

git clone https://github.com/SkyAPMTest/agent-auto-integration-testcases
cd agent-auto-integration-testcases/spring-scenario
mvn package docker:build

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] skywalking-spring-scenrio .......................... SUCCESS [  0.410 s]
[INFO] spring-projectA .................................... SUCCESS [  2.680 s]
[INFO] spring-projectB .................................... SUCCESS [  1.074 s]
[INFO] spring-projectC .................................... SUCCESS [  0.725 s]
[INFO] spring-projectD .................................... SUCCESS [  0.939 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 6.011 s
[INFO] Finished at: 2019-03-10T19:36:25-06:00
[INFO] Final Memory: 51M/1035M
[INFO] ------------------------------------------------------------------------

cd config
docker-compose up

ERROR: yaml.parser.ParserError: while parsing a block collection
  in "./docker-compose.yml", line 20, column 6
expected <block end>, but found '<scalar>'
  in "./docker-compose.yml", line 20, column 25

I've tried formatting the file and it gives the same error with different offsets.

Docker compose version: 1.23.2
OS: Ubuntu 18.04

if the server whitch run testcases is not very strong and use default settings the most testcases will fail

i think the default settings witch run 8 cases paralleled without set --parallel_running_case_number , container will not work well on the limited mermery resource

Make sure master, 6.x and 5.x test cases consistent

Now, I notice master and 6.x branch test cases are all targeting SkyWalking 6.x codebase. Could you merge them to keep one for 6.x, and the other for 5.x? @ascrutae

testcase.yml with testcase.desc

I was confused with testcase.yml with testcase.desc, i 've found that there is no testcase.desc file in any other scenario folder. but when i run "./deploy-test.sh" , the log "
grep: /Users/francis/workspc/agent-auto-integration-testcases/testcases/hessian-scenario-4.0.38/testcase.desc: No such file or directory" tells me that i need a testcase.desc.