sharat
d0f301adb7
etcd-runner:add flags in watcher for hardcoded values
2017-01-04 15:17:53 +05:30
sharat
5cb6dd268b
etcd-runner: make command compliant
2017-01-03 14:43:58 +05:30
Gyu-Ho Lee
db8b15bf8f
etcd-tester: remove unused err var from maxRev
2016-12-27 12:16:43 -08:00
Gyu-Ho Lee
591bb5e7f6
etcd-tester: fix typo, add endpoint in logs
2016-12-22 12:51:27 -08:00
Gyu-Ho Lee
301abddc72
etcd-tester: cancel lease stream; fix OOM panic
...
It was never closing lease keep-alive streams, leaking memory.
Fix OOM panics in etcd-tester (after 1K rounds).
2016-12-13 09:56:30 -08:00
Gyu-Ho Lee
7d16e7d27e
etcd-tester: add 'enable-pprof' option
2016-12-13 05:03:27 -08:00
Gyu-Ho Lee
b8e09bf849
tools: simplify boolean comparison, remove unused
2016-12-12 10:07:14 -08:00
fanmin shi
b9e9c9483b
Merge pull request #6885 from fanminshi/refractor_lease_checker
...
etcd-tester: refactor lease checker
2016-12-01 10:11:15 -08:00
fanmin shi
394ab43587
etcd-tester: refactor lease checker
...
Move few checking logic from lease stresser to lease checker and change connection logic for lease stresser and checker
2016-11-30 17:29:58 -08:00
fanmin shi
ec5f9bce63
Merge pull request #6886 from fanminshi/fix_dial_grpc
...
functional-tester: add withBlock() to grpc dial
2016-11-21 11:33:31 -08:00
fanmin shi
2ccba33dd1
functional-tester: add withBlock() to grpc dial
...
grpc dail withTimeout() only works if withBlock() option is present.
2016-11-21 11:15:12 -08:00
fanmin shi
2ac1c4c9ed
etcd-tester:limit max retry backoff delay
...
grpc uses expoential retry if a connection is lost. grpc will sleep base on exponential delay.
if delay is too large, it slows down tester.
2016-11-21 10:58:55 -08:00
Xiang Li
b1178469be
etcd-tester: do not resolve localhost
2016-11-19 18:38:26 -08:00
Xiang Li
0a8e28524b
Merge pull request #6779 from xiang90/watch_clean
...
etcd-runner: clean up watcher runner
2016-11-10 09:59:08 -08:00
Xiang Li
523a859ad9
etcd-runner: clean up watcher runner
2016-11-10 08:56:19 -08:00
fanmin shi
107d7b663c
etcd-tester: changed compaction timeout calculation
...
functional tester sometime experiences timeout during compaction phase. I changed the timeout calculation base on number of entries created and deleted.
FIX #6805
2016-11-08 17:00:04 -08:00
Gyu-Ho Lee
f82aac2fc6
Merge pull request #6797 from fanminshi/lease_checker_println_fix
...
etcd-tester: fix lease checker logging format.
2016-11-03 10:17:54 -07:00
fanmin shi
6968028020
etcd-tester: fix lease checker logging format.
...
lease checker used a wrong print format for a variable. this change fixes it.
2016-11-03 10:11:00 -07:00
fanmin shi
649fe7f2af
etcd-tester: add retry logic on retriving lease info
...
getting lease and keys info through raw rpcs rarely experience error such as EOF. This is considered as a failure and causes tester to clean up.
however, they are just transient problem with temporary connection issue which should not be considered as a testing failure. so we add retry logic in case of transient failure.
FIX #6754
2016-11-03 10:05:06 -07:00
fanmin shi
8a03c95dd4
etcd-tester: refactor checking short lived lease logic
...
move the logic of waiting lease expired from stresser to checker
2016-11-01 14:06:22 -07:00
fanmin shi
c781f30ed5
functional-tester: remove stablilization limit
...
This change removes the waiting needed to ensure the cluster to be stable.
FIX #6760
2016-11-01 10:01:59 -07:00
Anthony Romano
4969a0e9e7
Merge pull request #6758 from heyitsanthony/move-checker
...
etcd-tester: refactor stresser / checker management
2016-10-31 13:59:54 -07:00
Anthony Romano
308f2a1695
etcd-tester: refactor stresser/checker organization
...
The checkers and stressers should be composable without special cases; this
patch tries to address that while refactoring out some old cruft.
Namely,
* Single stresser/checker for a tester; built from composition
* Composite stresser via comma-separated list of stressers
* Split stressers into separate files
* Removed v2 only flags and special cases
* Rate limiter shared among key stresser and leases stresser
* Composite checker is now concurrent
* Stresser can return a Checker to check its invariants
* Each lease checker only operates on a single lease stresser
2016-10-31 13:59:04 -07:00
Xiang Li
9f0ee53e86
etcd-runner: move string generation to pkg/stringutil
2016-10-31 12:20:02 -07:00
Gyu-Ho Lee
5bd00ab1f6
*: fix minor typos
2016-10-31 09:47:15 -07:00
Xiang Li
7e06a95942
Merge pull request #6759 from xiang90/tester
...
etcd-runner: refactor code structure and flag cleanup
2016-10-31 09:07:18 -07:00
Xiang Li
e5c3978725
etcd-runner: refactor code structure and flag cleanup
2016-10-30 18:45:16 -07:00
Anthony Romano
86c4a74139
etcd-tester: move stresser and checker to tester
...
These really belong in tester code; the stressers and
checkers are higher order operations that are orchestrated
by the tester. They're not really cluster primitives.
2016-10-29 10:57:17 -07:00
fanmin shi
34c906be55
functional-tester: fix log statement
...
simple fix for wrongly printed statement.
2016-10-28 14:27:09 -07:00
fanmin shi
7f5a7d1da5
functional-tester: always clean up if tester encouters an error
...
The current tester doesn't not clean up if any of the failure injection/recovery fails. if tester fails to recover a dead node, tester hangs in the next round because the tester will keep waiting until cluster becomes healthy which is impossible since a node is down. To fix this issue, we will always clean up if any error happens during each round so that cluster will be healthy for next round.
FIX #6743
2016-10-27 15:07:58 -07:00
fanmin shi
8d9e2623e1
functional-tester: add short lived leases checking
...
lease stresser now generates short lived leases that will expire before invariant checking.
this addition verifies that the expired leases are indeed being deleted on the sever side.
2016-10-26 14:46:57 -07:00
fanmin shi
1dc60bb97e
functional-tester: increase lease TTL
...
increasing lease TTL ensure that lease doesn't expire during hashes stabilization period.
I observed that it can take a long time for etcd cluster to become stable.
2016-10-26 10:32:52 -07:00
Xiang Li
12e4dfa9c4
Merge pull request #6715 from fanminshi/lease_hash_fix
...
Lease hash fix
2016-10-25 16:28:11 -07:00
Xiang Li
b398233f4f
Merge pull request #6730 from gyuho/round-prefix
...
etcd-runner: fix typo in round prefix
2016-10-25 16:24:27 -07:00
Gyu-Ho Lee
12488d4a70
etcd-runner: fix typo in round prefix
2016-10-25 15:59:44 -07:00
fanmin shi
bb97adda0d
functional-tester: add retries to hash checking
...
allows hashes to converge through retrying.
2016-10-25 14:27:36 -07:00
sharat
6e7e346c93
etcd-runner: Added client connection timeout flag
2016-10-26 01:58:22 +05:30
sharat
69ae49a1dd
etcd-runner: remove unused code and change name for randClient
2016-10-25 19:16:27 +05:30
Xiang Li
92c987f75d
Merge pull request #6695 from sinsharat/watch_runner_respect_rounds
...
etcd-runner: watcher runner respect rounds
2016-10-21 20:28:29 -07:00
sharat
90146d863c
etcd-runner: watcher runner respect rounds
2016-10-22 05:00:10 +05:30
fanmin shi
d582fdcc1b
functional-tester: add rate limiter to lease stresser
...
too many leases created can cause compaction to timeout. adding a rate limiter limits number of leases and attched keys.
2016-10-21 12:34:49 -07:00
fanmin shi
161eb2c457
Merge pull request #6696 from fanminshi/lease_expire_fix
...
functional-tester: modify lease renew logic
2016-10-20 16:25:04 -07:00
fanmin shi
a25d4ac821
functional-tester: modify lease renew logic
...
only renew a lease if the lease is present.
2016-10-20 15:27:46 -07:00
fanmin shi
94ea82c00d
functional-tester: add logic to ensure etcd node is alive after fault recovery returns
...
failure recovery needs to wait etcd node to become alive before returning
FIX #6654
2016-10-20 10:31:08 -07:00
sharat
50523e22d8
etcd-runner: make run watcher fail safe
2016-10-20 00:23:35 +05:30
fanmin shi
ab2b58a80f
functional-tester: add lease stresser
...
Add lease stresser to test lease code under stress and etcd failures
resolve #6380
2016-10-18 14:20:26 -07:00
fanmin shi
ed75d93625
Merge pull request #6666 from fanminshi/function-tester-refractor
...
functional-tester: move checker logic to cluster
2016-10-18 11:44:37 -07:00
fanmin shi
7d86d1050e
functional-tester: move checker logic to cluster
...
I move the checker logic from tester to cluster so that stressers and checkers can be initialized at the same time.
this is useful because some checker depends on stressers.
2016-10-18 11:17:40 -07:00
Xiang Li
24c284160b
Merge pull request #6635 from sinsharat/etcd_runner_add_watcher_runner
...
etcd-runner:added watch runner
2016-10-17 11:02:06 -07:00
sharat
8297322176
etcd-runner:added watch runner
2016-10-17 23:04:33 +05:30