Gyu-Ho Lee
0b01acf131
storage: watchable_store.go events slice
2015-12-31 23:44:02 -08:00
Gyu-Ho Lee
f568a1ccfc
storage: watcher_test.go events slice
2015-12-31 23:43:59 -08:00
Xiang Li
a74147384d
Merge pull request #4070 from mitake/storage-bench
...
tools: a new tool for benchmarking storage backends
2015-12-31 22:26:46 -08:00
Hitoshi Mitake
454865bd67
tools: a new tool for benchmarking storage backends
...
Current etcd repository has a test for benchmarking a storage backend
in storage/kvstore_bench_test.go. However, it is hard to test various
parameters (e.g. batch interval, a number of keys, etc) with the test.
This commit adds a new benchmarking subcommand "storage" to
tools/benchmark. It will encourage analysis of storage backends with
various parameter and complex workloads.
Exmaple usage:
$ ./benchmark storage put
total: 9.894173792s
average: 9.894173ms
minimum latency: 6.596991ms
maximum latency: 29.455695ms
2016-01-01 15:18:54 +09:00
Gyu-Ho Lee
5aded6cd77
storage: watcher.go events slice
2015-12-31 19:26:20 -08:00
Gyu-Ho Lee
8f03c600b5
etcdserver/api/v3rpc: watch.go with events slice
2015-12-31 19:25:15 -08:00
Gyu-Ho Lee
8da6e76588
etcdserver/etcdserverpb: rpc WatchResponse with events slice
2015-12-31 19:24:46 -08:00
Hitoshi Mitake
0b2d31f3bc
storage: decouple default parameters and storage creation
...
newStore() uses constants for some important parameters
e.g. batchInerval. It is not suitable for other storage users
(e.g. tools/benchmark). This commit decouples the default parameters
from storage creation. etcd should use a newly added function
newDefaultStore() for creating a store with default parameters.
2015-12-31 22:28:59 +09:00
Xiang Li
73230f9603
Merge pull request #4108 from xiang90/proto
...
*: fix proto and regenerate all go files
2015-12-30 20:29:04 -08:00
Xiang Li
1dc0e664f0
*: fix proto and regenerate all go files
2015-12-30 20:11:19 -08:00
Anthony Romano
4444d92032
Merge pull request #4105 from heyitsanthony/benchmark-put-seq-keys
...
tools/benchmark: support puts on sequential keys over a bounded keyspace
2015-12-30 17:04:37 -08:00
Anthony Romano
1689bb3f02
tools/benchmark: support puts on sequential keys over a bounded keyspace
...
This patch makes it possible to use benchmark to generate n keys and
make random updates to only those n keys.
2015-12-30 16:47:24 -08:00
Xiang Li
c8a0cc80dc
Merge pull request #4104 from xiang90/ctl
...
etcdctl: fix syncWithPeerAPI by breaking the loop when there is no error
2015-12-30 11:17:30 -08:00
Xiang Li
34abead33e
etcdctl: fix syncWithPeerAPI by breaking the loop when there is no error
2015-12-30 11:06:42 -08:00
Xiang Li
795b824f4d
Merge pull request #4100 from mitake/ignore-benchmark
...
tools/benchmark: ignore the binary "benchmark"
2015-12-29 23:19:28 -08:00
Hitoshi Mitake
b97f78d356
tools/benchmark: ignore the binary "benchmark"
2015-12-30 16:02:52 +09:00
Gyu-Ho Lee
f19a07289a
Merge pull request #4098 from gyuho/merge_log
...
*: use merge logger for repeating etcdserver error logs
2015-12-29 21:23:30 -07:00
Anthony Romano
8346a7c052
Merge pull request #4094 from heyitsanthony/send-merged-done-nowait
...
etcdserver: respect done channel when sleeping for snapshot backoff
2015-12-29 20:18:08 -08:00
Gyu-Ho Lee
8f943f2f45
etcdserver/etcdhttp: use MergeLogger to log etcdserver errors
...
Related https://github.com/coreos/etcd/issues/3812 .
2015-12-29 20:00:52 -08:00
Gyu-Ho Lee
64032541c3
pkg/logutil: round off start time, add merge_logger_test.go
2015-12-29 20:00:46 -08:00
Anthony Romano
942b5570bd
Merge pull request #4096 from heyitsanthony/serialize-applier-snapmerge
...
etcdserver: serialize snapshot merger with applier
2015-12-29 19:37:11 -08:00
Anthony Romano
4cd86ae1ef
etcdserver: serialize snapshot merger with applier
...
Avoids inconsistent snapshotting by only attempting to
create a snapshot after an apply completes.
Fixes #4061
2015-12-29 18:38:39 -08:00
Gyu-Ho Lee
04ac8969a1
Merge pull request #3986 from mqliang/defer
...
refactor store/store.go
2015-12-29 14:42:11 -07:00
Xiang Li
4b355bd81e
Merge pull request #4093 from xiang90/rm_proto
...
doc: remove proto in rfc, link to proto file in codebase
2015-12-29 13:25:46 -08:00
Anthony Romano
c7c3bda8b9
etcdserver: respect done channel when sleeping for snapshot backoff
2015-12-29 13:23:41 -08:00
Xiang Li
9d9680121c
etcdserver/etcdserverpb: make rpc.proto updated
2015-12-29 12:58:14 -08:00
Xiang Li
39ed73c290
doc: remove proto in rfc, link to proto file in codebase
2015-12-29 12:53:27 -08:00
Xiang Li
d9d7137ea3
Merge pull request #4092 from xiang90/api
...
*: update api proto
2015-12-29 12:46:12 -08:00
Xiang Li
1a0201a31a
*: update api proto
2015-12-29 12:31:53 -08:00
Xiang Li
d62edfb464
Merge pull request #4090 from xiang90/writable
...
etcdserver: always check if the data dir is writable before starting
2015-12-29 11:40:41 -08:00
Xiang Li
150e646b05
etcdserver: always check if the data dir is writable before starting etcd
2015-12-29 11:29:01 -08:00
Xiang Li
f1761798e9
Merge pull request #4089 from xiang90/fix
...
etcdserver: fix creating member dir
2015-12-28 23:37:50 -08:00
Anthony Romano
0f2675d9b6
Merge pull request #4060 from heyitsanthony/fix-etcdctl-err
...
etcdctl: return exitcode 2 if can't connect to any peer urls
2015-12-28 23:28:29 -08:00
Xiang Li
aef55342d1
etcdsever: avoid creating member dir before finishing validate bootstrap
...
This commit fixes the issue of creating member dir before validating
the configuration. When member dir exists, it indicates the local etcd
process is a valid etcd member. So we should only create member dir
after we finish configuration validation, joining validation or
discovery validation.
2015-12-28 23:20:27 -08:00
Xiang Li
eae52a3138
Revert "etcdserver: always remove member directory when bootstrap fails"
...
This reverts commit a7e443d6412ec405948571d1f758ab7f1c078bf9.
2015-12-28 23:16:08 -08:00
Gyu-Ho Lee
cd42c9139e
Merge pull request #4087 from gyuho/delete_discovery_check
...
etcdserver: always remove member directory when bootstrap fails
2015-12-29 00:04:37 -07:00
Anthony Romano
4477ef636e
etcdctl: return exitcode 2 if can't connect to any peers
2015-12-28 23:04:34 -08:00
Gyu-Ho Lee
a7e443d641
etcdserver: always remove member directory when bootstrap fails
...
This removes member directory when bootstrap fails including joining existing
cluster and forming a new cluster. This fixes https://github.com/coreos/etcd/issues/3827 .
2015-12-28 22:56:03 -08:00
Gyu-Ho Lee
c3655cbfd9
Merge pull request #4084 from gyuho/revisioin_document
...
storage: add/fix revision/generation description
2015-12-28 20:45:36 -07:00
Gyu-Ho Lee
5284c1c3bb
storage: add/fix revision/generation description
...
This adds some struct descriptions to revision/generation structs and corrects
some spelling errors.
2015-12-28 19:32:03 -08:00
Xiang Li
f3b3557951
Merge pull request #4085 from gyuho/doc_iana
...
Documentation: clarification on official etcd ports
2015-12-28 18:13:25 -08:00
Gyu-Ho Lee
7c587e0855
Documentation: clarification on official etcd ports
...
This is for https://github.com/coreos/etcd/issues/3480 .
This adds a notice that etcd officially use 2379 and 2380 for
client and server ports.
2015-12-28 16:29:19 -08:00
Gyu-Ho Lee
6c5dc28d0f
Merge pull request #4043 from gyuho/storage_range_all_unsynced
...
storage: range all unsynced at once
2015-12-28 14:45:40 -07:00
Gyu-Ho Lee
0d7fb820c7
Merge pull request #4082 from gyuho/storage_test_cleanup
...
storage: clean up test variable names, minor typos in comments
2015-12-28 13:02:17 -07:00
Gyu-Ho Lee
d64eb94580
storage: clean up test variable names, minor typos in comments
...
This just changes variable name to be more consistent: `N` rather than `Size`.
And fix some minor grammatical errors.
2015-12-28 11:49:57 -08:00
Gyu-Ho Lee
ecc3e15a46
storage: delete RangeHistory
...
This has been replaced by operations inside `syncWatchings`.
2015-12-28 11:37:32 -08:00
Gyu-Ho Lee
78b0b8a4a0
storage: range all unsynced at once
...
This is for https://github.com/coreos/etcd/issues/3848 .
It replaces RangeHistory method for more efficient event
sending.
2015-12-28 11:37:26 -08:00
Anthony Romano
570687a509
Merge pull request #4081 from heyitsanthony/benchmark-multi-ep
...
tools/benchmark: support connecting to several endpoints
2015-12-28 10:31:35 -08:00
Anthony Romano
8e728afa62
tools/benchmark: support connecting to several endpoints
...
--endpoints is comma separated but gRPC blocks forever on comma
separated lists. Instead, round-robin select endpoints when
creating new connections.
2015-12-28 10:22:33 -08:00
Xiang Li
d07a9cd893
Merge pull request #4059 from xiang90/snap_log
...
rafthttp: better snapshot sending logging
2015-12-28 10:05:35 -08:00
