19368 Commits

Author SHA1 Message Date
Marek Siarkowicz
58d74e2b73 test: Refactor TestLinearizability function
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-15 13:02:42 +01:00
Marek Siarkowicz
a64263cf49 tests: Refactor persisting single member dir
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-15 13:02:42 +01:00
Marek Siarkowicz
d0e5c44f67 tests: Refactor getting test results directory
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-15 13:02:42 +01:00
Marek Siarkowicz
2afaddd5b7 tests: Refactor getting longest history
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-15 13:02:42 +01:00
Marek Siarkowicz
a806d155eb
Merge pull request #15323 from lavacat/main-mono-clock
tests: use monotonic clock for linearizability test history
2023-02-15 11:38:44 +01:00
Marek Siarkowicz
25eb025fc0
Merge pull request #15293 from serathius/linearizability-bookmark
Codify kubernetes using response header revision as bookmark
2023-02-15 11:36:03 +01:00
Benjamin Wang
d0c3112d5a dependency: bump go.opentelemetry.io/otel from 1.11.2 to 1.13.0
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-15 18:33:00 +08:00
Bogdan Kanivets
d2ccb12f36 tests: use monotonic clock for linearizability test history
Problem: time.Now() uses wall clock reading. See https://github.com/golang/go/blob/master/src/time/time.go#L17
"later time-telling operations use the wall clock reading, but later time-measuring operations, specifically comparisons and subtractions, use the monotonic clock reading."
This can cause 'Return' to be before 'Call' and wrong order of operations from different clients.

Solution: use same base time for all clients and only use 'time-measuring' operations to record timestamps for history.
Signed-off-by: Bogdan Kanivets <bkanivets@apple.com>
2023-02-15 01:37:21 -08:00
Marek Siarkowicz
b55dbe88ca tests: Codify kubernetes using response header revision as bookmark
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-15 10:26:34 +01:00
Marek Siarkowicz
202d813c7b
Merge pull request #15259 from serathius/linearizability-multi-op-txn
tests: Implement multi operation Txn
2023-02-15 09:35:16 +01:00
Marek Siarkowicz
04ba936ea6 tests: Implement multi operation Txn
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-14 17:57:52 +01:00
Marek Siarkowicz
ab27d56244
Merge pull request #15316 from dims/do-not-run-arm64-jobs-on-forks
Do not run arm64 jobs on forks
2023-02-14 17:10:45 +01:00
Marek Siarkowicz
c60e5954b3
Merge pull request #15318 from serathius/linearizability-duplicate-revision
Allow multiple operations with same mod revisions, but forbid …
2023-02-14 17:03:47 +01:00
Marek Siarkowicz
b4f9bb45fc tests: Allow multiple operations with same mod revisions, but forbid those operations to be spread between multiple responses
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-14 14:36:51 +01:00
Davanum Srinivas
597bac7b51
Do not run arm64 jobs on forks
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-02-14 08:20:06 -05:00
Marek Siarkowicz
6c439aa9e2
Merge pull request #15283 from serathius/linearizability-blackhole-refactor
tests: Refactor blackholing and add separate BlackholePeerUntilSnapsh…
2023-02-14 11:56:37 +01:00
Benjamin Wang
1d8fe11ad9 dependency: bump golang.org/x/net from 0.5.0 to 0.6.0
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-14 17:40:47 +08:00
Benjamin Wang
cc47f7bc7c dependency: bump gopkg.in/natefinch/lumberjack.v2 from 2.0.0 to 2.2.1
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-14 17:40:47 +08:00
Marek Siarkowicz
e569217a6d tests: Refactor blackholing
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-14 09:38:10 +01:00
James Blair
90f486f477 Adding CHANGELOG entries for zap timestamp resolution fixes.
Signed-off-by: James Blair <mail@jamesblair.net>
2023-02-14 07:28:41 +08:00
dependabot[bot]
50532c9fb5 build(deps): bump github/codeql-action from 2.2.1 to 2.2.4
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.2.1 to 2.2.4.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](3ebbd71c74...17573ee1cc)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-13 20:35:03 +08:00
Benjamin Wang
f005a20aa7 changelog: add items for the duplicated events issue
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-13 19:35:31 +08:00
Marek Siarkowicz
ed30d5415a
Merge pull request #15284 from serathius/funtional-remove
tests: Remove functional testing as they were replaced by linearizabi…
2023-02-13 12:32:04 +01:00
Benjamin Wang
b4dfa9d34f test: correct the logic of comparing revision in linearizablity/watch.go
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-13 19:22:31 +08:00
Marek Siarkowicz
5f68ecc1ef tests: Remove functional testing as they were replaced by linearizability tests
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-11 13:20:44 +01:00
Benjamin Wang
87e271701b test: enhance the test case TestV3WatchProgressOnMemberRestart
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-10 20:09:26 +08:00
Benjamin Wang
36fc3cae65 clientv3: correct the nextRev on receving progress notification response
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-10 09:09:19 +08:00
Marek Siarkowicz
3c64ae4b79
Merge pull request #15239 from jmhbnz/main
Adjust time resolution to microseconds
2023-02-09 13:45:00 +01:00
Marek Siarkowicz
d0575e4f18
Merge pull request #15268 from lavacat/main-before-follower-send-failpoint
tests: trigger raftBeforeFollowerSend failpoint in linearizability test
2023-02-09 09:45:58 +01:00
Myrat92
2eadb0ab74 contributing: invalid command for install tools
Fix command for install build tools

Signed-off-by: Myrat92 <zjsegzhf@gmail.com>
2023-02-09 16:05:37 +08:00
Bogdan Kanivets
4b91ae2800 tests: trigger raftBeforeFollowerSend failpoint in linearizability test
raftBeforeFollowerSend can only be triggered on Follower and won't work on 1 node cluster.
Had to split RandomFailpoint into RandomOneNodeClusterFailpoint and RandomMultiNodeClusterFailpoint

Signed-off-by: Bogdan Kanivets <bkanivets@apple.com>
2023-02-08 23:28:23 -08:00
Marek Siarkowicz
39d98522d6 tests: Enable progress notify in linearizability tests
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-09 07:32:54 +08:00
Marek Siarkowicz
586eaccc4d
Merge pull request #15252 from ahrtr/walSync_failpoint_20230207
etcdserver: add failpoints walBeforeSync and walAfterSync
2023-02-08 09:59:46 +01:00
Benjamin Wang
1fe7b9793a etcdserver: add failpoints walBeforeSync and walAfterSync
Signed-off-by: Benjamin Wang <wachao@vmware.com>
2023-02-08 09:08:09 +08:00
Marek Siarkowicz
9bae010994
Merge pull request #15250 from serathius/linearizability-validate-watch
tests: Validate watch responses in linearizability tests
2023-02-07 14:50:34 +01:00
dependabot[bot]
8f54d38b6c build(deps): bump honnef.co/go/tools from 0.3.3 to 0.4.0 in /tools/mod
Bumps [honnef.co/go/tools](https://github.com/dominikh/go-tools) from 0.3.3 to 0.4.0.
- [Release notes](https://github.com/dominikh/go-tools/releases)
- [Commits](https://github.com/dominikh/go-tools/compare/v0.3.3...v0.4.0)

---
updated-dependencies:
- dependency-name: honnef.co/go/tools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-07 06:29:36 +08:00
Marek Siarkowicz
189d90ab7b tests: Validate watch responses in linearizability tests
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-06 16:58:17 +01:00
Marek Siarkowicz
d8eae85f58
Merge pull request #15249 from etcd-io/serathius-patch-1
Update @serathius email address just in case
2023-02-06 12:19:55 +01:00
Marek Siarkowicz
adf14f80ba Update @serathius email address just in case
Signed-off-by: Marek Siarkowicz <siarkowicz@google.com>
2023-02-06 12:19:08 +01:00
Marek Siarkowicz
dc51cf1646
Merge pull request #15104 from lavacat/main-tests-snapshots
tests linearizability: trigger snapshot related failpoints
2023-02-06 09:47:12 +01:00
Bogdan Kanivets
91b056968d tests linearizability: trigger snapshot related failpoints
Signed-off-by: Bogdan Kanivets <bkanivets@apple.com>
2023-02-05 00:03:39 -08:00
Marek Siarkowicz
65aa0fa305
Merge pull request #15242 from fuweid/linearizability-forcestop-cluster
tests/linearizability: force stop cluster with signal kill
2023-02-03 21:19:04 +01:00
Wei Fu
2183a55b47 tests: forcestop member procs with signal kill
When the linearizability test cases run with three members, it might take
7-8s to stop three members, especially stopping the leader. The leader
will transfer the leadership and it might take more time to stop peer
listener.

In order to reduce the runtime, this commit is using signal kill to force
stop members instead of graceful shutdown.

REF: #15086

Signed-off-by: Wei Fu <fuweid89@gmail.com>
2023-02-03 23:06:40 +08:00
Wei Fu
fa527c5e54 tests: support to stop the multiple members concurrently
Signed-off-by: Wei Fu <fuweid89@gmail.com>
2023-02-03 22:23:06 +08:00
Marek Siarkowicz
712bd8a802
Merge pull request #15233 from kevinzs2048/wip-integration-arm64
Add integration test for Arm64
2023-02-03 12:10:35 +01:00
Kevin Zhao
4d715c0c44 Add integration test for Arm64
Signed-off-by: Kevin Zhao <kevin.zhao@linaro.org>
2023-02-03 18:20:30 +08:00
James Blair
5f27af9bb8
Fix regression in timestamp resolution
Historic capnslog timestamps are in microsecond resolution. We need to match that when we migrate to the zap logger.

Signed-off-by: James Blair <mail@jamesblair.net>
2023-02-03 21:42:01 +13:00
Iavael
dc2b198cc7 docker: remove nsswitch.conf
Co-authored-by: Benjamin Wang <wachao@vmware.com>
Signed-off-by: Iavael <905853+iavael@users.noreply.github.com>
2023-02-03 06:37:03 +08:00
Marek Siarkowicz
9505d72930
Merge pull request #15230 from kevinzs2048/wip-e2e-arm64
Add E2E tests on arm64
2023-02-02 09:05:44 +01:00
Kevin Zhao
009a6c0b94 Add E2E tests on arm64
Now it is daily nightly build at 1 am.

Signed-off-by: Kevin Zhao <kevin.zhao@linaro.org>
2023-02-02 10:38:04 +08:00