Mirroristas/etcd
2
0
Fork 0
mirror of https://github.com/etcd-io/etcd.git synced 2024-09-27 06:25:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
16,921 Commits 15 Branches 491 Tags
86393ecfcd302a76c7bca420c249fa6d484924d3
Commit Graph

16921 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sam Batschelet
86393ecfcd scripts: add missing etcdutl to release pipeline 
Signed-off-by: Sam Batschelet <sbatsche@redhat.com>
 2021-05-18 07:16:28 -04:00
Sam Batschelet
6decbe15db Merge pull request #12774 from hexfusion/add-log-rotate 
server: add support for log rotation
 2021-05-07 12:18:10 -04:00
Sam Batschelet
f178677765 CHANGELOG: server: add support for log rotation #12774 
Signed-off-by: Sam Batschelet <sbatsche@redhat.com>
 2021-05-07 08:39:51 -04:00
Sam Batschelet
82b2d5c67d server: add support for log rotation 
Signed-off-by: Sam Batschelet <sbatsche@redhat.com>
 2021-05-07 08:39:51 -04:00
Piotr Tabor
4f87333230 Merge pull request #12922 from serathius/actions 
Migrate PR testing from travis to GitHub actions
 2021-05-07 09:31:23 +02:00
Marek Siarkowicz
e818f21790 Migrate PR testing from travis to GitHub actions 2021-05-06 17:06:57 +02:00
Gyuho Lee
344c9f3930 Merge pull request #12896 from wilsonwang371/profiling-txn2 
server: make applier use ReadTx() in Txn() instead of ConcurrentReadTx()
 2021-05-06 01:59:14 -07:00
Sam Batschelet
8af8f6af27 Merge pull request #12918 from iflamed/fix-doc-demo-bug 
fix doc demo bug
 2021-05-05 17:01:43 -04:00
刘兵
a8a3eea56d fix doc demo bug 
the service parameter not used.
 2021-05-05 13:57:10 +08:00
odidev
7296a0708c Set ETCD_UNSUPPORTED_ARCH to ARM64 (#12557) 
Signed-off-by: odidev <odidev@puresoftware.com>
 2021-05-04 13:29:47 -07:00
tangcong
b32bc914ff learner support snapshot RPC (#12890) 
* learner support snapshot RPC

* CHANGELOG: update for 12890
 2021-05-04 13:26:33 -07:00
Wilson Wang
98083ea914 server: add experimental flag for using shared buffer in transacton write 2021-05-04 11:59:08 -07:00
Piotr Tabor
a3fc535a5a Merge pull request #12914 from ptabor/20210430-read-membership 
No-storeV2: Read membership information from the backend (Part5)
 2021-05-04 10:15:01 +02:00
Wilson Wang
56154216b7 update variable declaration location 2021-05-03 10:30:15 -07:00
Gyuho Lee
eb128d2d8c Merge pull request #12916 from wpedrak/pass-mlock-during-defrag 
server: reapply `Mlock` flag after defrag
 2021-05-03 09:01:50 -07:00
wpedrak
6623c008ee server: reapply Mlock flag after defrag 2021-05-03 11:01:02 +02:00
Piotr Tabor
c46e96d519 Merge pull request #12910 from ptabor/20210430-zap-polish 
Finish migration zap.NewExample -> zaptest.NewLogger(t) in integration tests
 2021-04-29 23:12:56 +02:00
Piotr Tabor
3acf6e35b2 Finish migration zap.NewExample -> zaptest.NewLogger(t) in integration tests 2021-04-29 22:32:26 +02:00
Piotr Tabor
451f65d661 Merge pull request #12908 from ptabor/20210429-client-retry-logging 
Clientv3 (retry interceptor) logs should use the configured logger
 2021-04-29 19:25:04 +02:00
Piotr Tabor
cedbea6c81 Merge pull request #12904 from wpedrak/limit_mlocked_memory 
server: replace mlockall with `Mlock` in `--experimental-memory-mlock`
 2021-04-29 18:21:24 +02:00
Piotr Tabor
ffea1537d4 ClientV3 tests use integration.NewClient that configures proper logger. 2021-04-29 18:18:34 +02:00
Piotr Tabor
835643e6e2 Merge pull request #12906 from ptabor/20210429-etcdctl-v2-backup-cindex-fix 
20210429 etcdctl v2 backup cindex fix
 2021-04-29 18:01:45 +02:00
Piotr Tabor
e908ef3da9 Merge pull request #12903 from lilic/exit-on-signal-int 
etcdctl/ctlv3: Cleanup keys on signal interrupt.
 2021-04-29 16:22:41 +02:00
Piotr Tabor
205a1a442a Read membership information from the backend. 2021-04-29 13:45:45 +02:00
Piotr Tabor
bc8d3f6639 Clientv3 (retry) logs should use the configured logger. 
clientv3 logs (especially tests) were poluted with unattributed to testing.T log lines:

```
{"level":"warn","ts":"2021-04-29T12:42:11.055+0200","logger":"etcd-client","caller":"v3/retry_interceptor.go:64","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc0000fafc0/#initially=[unix://localhost:m10]","attempt":0,"error":"rpc error: code = ResourceExhausted desc = etcdserver: mvcc: database space exceeded"}
```

The reasons were 2 fold:
  - Interceptors were copying logger before "WithLogger" could modify it.
  - We were not propagating the loggers in a few testing contexts.
 2021-04-29 12:57:09 +02:00
Lili Cosic
586b2383f4 etcdctl/ctlv3: Cleanup keys on signal interrupt of check perf 
If ctc+c is pressed during the run of etcdctl check perf,
this deletes all the previously created keys that perf check created.
 2021-04-29 12:55:36 +02:00
wpedrak
1145c57601 server: replace mlockall with Mlock in --experimental-memory-mlock 
Implementation of `--experimental-memory-mlock` backed by `mlockall` syscall is replaced by `Mlock` flag (backed by mlock syscall) of bboltDB.
 2021-04-29 12:08:52 +02:00
wpedrak
927b3a3152 server: replace mlockall with Mlock in --experimental-memory-mlock 
Implementation of `--experimental-memory-mlock` backed by `mlockall` syscall is replaced by `Mlock` flag (backed by mlock syscall) of bboltDB.
 2021-04-29 12:08:20 +02:00
Piotr Tabor
e90504fe62 Unify shared code (and constants) with cindex package. 2021-04-29 11:51:25 +02:00
Piotr Tabor
f53b70facb Embed: In case KVStoreHash verification fails, close the backend. 
In case of failed verification, the server used to keep opened backend
(so the file was locked on OS level).
 2021-04-29 11:51:25 +02:00
Piotr Tabor
2ad893b110 Integrate verification into e2e tests. 2021-04-29 11:51:24 +02:00
Piotr Tabor
911204cd76 Fix ETCDCTL_API=2 etcdctl backup --with-v3 consistent index consistency 
Prior to this CL, `ETCDCTL_API=2 etcdctl backup --with-v3` was readacting WAL log
(by removal of some entries), but was NOT updating consistent_index in the backend.
Also the WAL editing logic was buggy, as it didn't took in consideration the fact
that when TERM changes, there can be entries with duplicated indexes in
the log. So its NOT sufficient to subtract number of removed entries to
get accurate log indexes.

The PR replaces removing and shifting of WAL entries with replacing them with an no-op entries.
Thanks to this consistent-index references are staying up to date.

The PR also:
  - updates 'verification' logic to check whether consistent_index does not lag befor last snapshot
  - env-gated execution of verification framework in `etcdctl backup`.

Tested with:
```
(./build.sh && cd tests && EXPECT_DEBUG=TRUE 'env' 'go' 'test' '-timeout=300m' 'go.etcd.io/etcd/tests/v3/e2e' -run=TestCtlV2Backup --count=1000 2>&1 | tee TestCtlV2BackupV3.log)
```
 2021-04-29 11:51:24 +02:00
Piotr Tabor
adc365e14f etcdctl2: backup command logging cleanup (zap) 2021-04-28 23:26:17 +02:00
Wilson Wang
8d8d0377a2 server: applier uses ReadTx instead of ConcurrentTx 2021-04-28 11:06:24 -07:00
Piotr Tabor
ed4a87d541 Merge pull request #12901 from ptabor/20210427-verification 
Verification of persisted data
 2021-04-28 08:45:15 +02:00
Piotr Tabor
7107cb9f86 fixup! Create 'datadir' package responsible for paths. 2021-04-28 08:44:06 +02:00
Piotr Tabor
c4b13a5c83 Integrate verification framework 
Verification framework is integrated with:
  - integration tests (by default)
  - `ETCD_VERIFY=all etcdctl snapshot restore` command
  - etcd shutdown when running with `ETCD_VERIFY=all` env.
 2021-04-28 07:56:16 +02:00
Piotr Tabor
47b28b600a Verification package: Verified given data-dir. 
For now verifies whete Backend.cindex is consistent with WAL log,
but should get expanded to cover memberships & revisions.
 2021-04-28 07:56:15 +02:00
Piotr Tabor
6f8f506cf4 Create 'datadir' package responsible for paths. 2021-04-28 07:56:13 +02:00
Piotr Tabor
d2722ff955 Merge pull request #12820 from ptabor/20210326-membership-from-be 
(no)StoreV2 (Part 2): Prepare to read membership information from backend
 2021-04-28 07:53:42 +02:00
Piotr Tabor
067521981e v2 etcdctl backup: producing consistent state of membership 2021-04-27 19:34:34 +02:00
Piotr Tabor
a70386a1a4 Simplify membership interface: Does not pass the 'unused' token. 2021-04-27 17:17:31 +02:00
Piotr Tabor
4725567d5e e2e tests: More logging and expect adopted to 3.4. 2021-04-27 17:17:31 +02:00
Piotr Tabor
7ae3d25f91 Membership: Add additional methods to trim/manage membership data in backend. 2021-04-27 17:17:31 +02:00
Piotr Tabor
aa6597384b etcd-dump-logs: Print full confState as json for debugging purposes. 2021-04-27 17:17:31 +02:00
Piotr Tabor
768da490ed sever: v2store deprecation: Fix etcdctl snapshot restore to restore 
correct 'backend' (bbolt) context in aspect of membership.

Prior to this change the 'restored' backend used to still contain:
  - old memberid (mvcc deletion used, why the membership is in bolt
bucket, but not mvcc part):
    ```
	mvs := mvcc.NewStore(s.lg, be, lessor, ci, mvcc.StoreConfig{CompactionBatchLimit: math.MaxInt32})
	defer mvs.Close()
	txn := mvs.Write(traceutil.TODO())
	btx := be.BatchTx()
	del := func(k, v []byte) error {
		txn.DeleteRange(k, nil)
		return nil
	}

	// delete stored members from old cluster since using new members
	btx.UnsafeForEach([]byte("members"), del)
    ```
  - didn't get new members added.
 2021-04-27 17:17:30 +02:00
Gyuho Lee
06d6f09a8a Merge pull request #12894 from MakDon/patch-1 
etcdserver/mvcc: update tw.trace.Step condition
 2021-04-27 00:19:10 -07:00
Gyuho Lee
c4f7d578d8 Merge pull request #12898 from tangcong/add-disk-io-failure-case 
functional: add disk io failure case
 2021-04-26 14:37:53 -07:00
tangcong
4fb22093a6 functional: add SHORT_TTL_LEASE_EXPIRE checker 2021-04-26 20:00:45 +08:00
tangcong
16e38e49a9 functional: add FAILPOINTS_WITH_DISK_IO_LATENCY case 2021-04-26 12:07:05 +08:00