Yicheng Qin
00ce0702b9
rafthttp: increase the size of streaming buffer
...
Streaming buffer is used for:
1. hand over data to io goroutine in non-blocking way
2. hold pressure for temprorary network delay
3. be able to wait on I/O instead of data coming under high throughput
The old 1024 value is too small and is very likely to be full and
break the streaming when suffering temprorary network delay.
2014-11-26 14:46:52 -08:00
Yicheng Qin
dd57c1f189
Merge pull request #1784 from yichengq/234
...
raft: not compact log if the compact index < first index of the log
2014-11-25 11:52:01 -08:00
Yicheng Qin
4b43824be9
raft: not compact log if the compact index < first index of the log
...
It should ignore the compact operation instead of panic because the case that
the log is restored from snapshot before executing compact is reasonable.
2014-11-25 11:51:20 -08:00
Yicheng Qin
1a5333e51d
Merge pull request #1778 from yichengq/232
...
docs: add configuration doc
2014-11-25 11:16:44 -08:00
Yicheng Qin
07ca99f4d6
docs: add configuration doc
2014-11-25 11:09:29 -08:00
Xiang Li
aa2721e31d
Merge pull request #1781 from orls/fix-backup-snapshots
...
Fix backup snapshots
2014-11-25 08:59:16 -08:00
Xiang Li
c46e30412e
Merge pull request #1782 from orls/fix-forcenew-panic
...
etcdserver: Fix panic when restoring from backup (-force-new-cluster)
2014-11-25 08:58:32 -08:00
Owen Smith
dbb6a75e3f
backup: Ensure dest snapshot dir always exists
...
Otherwise the SaveSnap operation fails
2014-11-25 16:57:18 +00:00
Owen Smith
c67b937d62
etcdserver: truncate WAL from correct index when forcing new cluster
...
When loading from a backup with a snapshot and WAL, the length of WAL entries
can be lower than the current index integer value, causing a panic when
slicing off uncommitted entries. This looks for WAL entries higher than
the current index before slicing.
2014-11-25 16:46:56 +00:00
Owen Smith
9974bf0291
backup: Add fatal if dest snapshot failed
...
Errors are currently silently swallowed
2014-11-25 14:08:20 +00:00
Xiang Li
e3cb3d640b
Merge pull request #1780 from xiang90/fix_raft_lead
...
raft: always check leader changes in node run loop
2014-11-24 19:29:53 -08:00
Xiang Li
9455119968
raft: always check leader changes in node run loop
2014-11-24 19:07:10 -08:00
Yicheng Qin
d67eea4a7d
Merge pull request #1779 from yichengq/233
...
rafthttp: limit the buffer for every read correctly
2014-11-24 17:44:25 -08:00
Yicheng Qin
61ce494386
rafthttp: limit the buffer for every read correctly
2014-11-24 17:39:39 -08:00
Yicheng Qin
cfb96de413
Merge pull request #1770 from yichengq/230
...
*: set read/write timeout for raft transport and listener
2014-11-24 14:01:57 -08:00
Yicheng Qin
1e797c1e38
rafthttp: limit the data size read from connection each time
2014-11-24 13:54:45 -08:00
Yicheng Qin
3e55834c38
*: set read/write timeout for raft transport and listener
2014-11-24 13:46:44 -08:00
Yicheng Qin
ad58122e3c
pkg/transport: fix dialer typo
2014-11-24 13:35:46 -08:00
Yicheng Qin
400e573013
rafthttp: log start and stop of streaming
2014-11-24 13:35:46 -08:00
Xiang Li
bb640e326d
Merge pull request #1773 from xiang90/header
...
pkg/transport: add copyright header
2014-11-24 00:40:30 -08:00
Xiang Li
c72221a691
pkg/transport: add copyright header
2014-11-24 00:39:55 -08:00
Xiang Li
c6cbea451a
Merge pull request #1771 from xiang90/listener
...
pkg/transport: add timeout dailer and timeout listener
2014-11-23 23:00:54 -08:00
Xiang Li
35e6df6d0a
integration: longer request timeout for slow travis
2014-11-23 22:53:05 -08:00
Xiang Li
da1ff2d2bb
pkg/transport: add timeout dailer and timeout listener
2014-11-23 21:18:34 -08:00
Xiang Li
68e79868cc
Merge pull request #1768 from xiang90/batcher
...
rafthttp: add batcher
2014-11-23 12:08:00 -08:00
Xiang Li
91bfead9e9
rafthttp: add batcher
...
After we enable streaming, there will be a large amount of msgAppResp due to high
rate msgApp. We should batch msgAppResp in a meanful way.
2014-11-23 12:05:42 -08:00
Xiang Li
66c30f28d6
Merge pull request #1761 from xiang90/fix_raft
...
raft: should not decrease match and next when handling out of order msgAppResp
2014-11-20 18:12:15 -08:00
Xiang Li
edcdffe11e
Merge pull request #1762 from xiang90/fix_import
...
rafthttp: fix import
2014-11-20 18:10:49 -08:00
Xiang Li
264a63be80
rafthttp: fix import
2014-11-20 18:05:45 -08:00
Xiang Li
063c5c77a0
raft: should not decrease match and next when handling out of order msgAppResp
2014-11-20 17:58:23 -08:00
Brian Waldon
c0fb1c8a00
Merge pull request #1755 from bcwaldon/golang.org-deps
...
Switch to golang.org/x/net/context
2014-11-20 16:26:14 -08:00
Barak Michener
5139257b8d
Merge pull request #1743 from barakmich/auto_upgrade
...
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
2014-11-20 17:20:34 -05:00
Barak Michener
ce82a3e7ad
Fix migration to allow snapshots to have the right IDs
2014-11-20 16:49:34 -05:00
Xiang Li
53fbf0f333
Merge pull request #1760 from xiang90/wal
...
wal: add a bench for write entry
2014-11-20 13:16:37 -08:00
Barak Michener
2d5ccf12ef
add snapshotted integration test
2014-11-20 15:38:08 -05:00
Barak Michener
d1e7fee3ca
fix test import loop
2014-11-20 15:38:08 -05:00
Barak Michener
59a0c64e9f
fix import loop, add set to types, and fix comments
2014-11-20 15:38:08 -05:00
Barak Michener
78ea3335bf
etcdserver: autodetect v0.4 WALs and upgrade them to v0.5 automatically
2014-11-20 15:38:08 -05:00
Xiang Li
d0dd205b0e
wal: add a bench for write entry
2014-11-20 12:07:17 -08:00
Yicheng Qin
aca195f3ad
Merge pull request #1746 from yichengq/229
...
rafthttp: streaming server and client
2014-11-20 11:42:00 -08:00
Yicheng Qin
9d53b94546
rafthttp: add streaming server and client
2014-11-20 11:34:50 -08:00
Brian Waldon
da5538b8c7
dep: use vendored imports in codegangsta/cli
2014-11-20 10:19:13 -08:00
Brian Waldon
9a728a127a
dep: bump golang.org/x/net/context
...
Move from code.google.com/p/go.net/context to
golang.org/x/net/context before bumping to latest.
2014-11-20 10:19:12 -08:00
Xiang Li
b50f331558
Merge pull request #1744 from xiang90/next
...
raft: optimistically increase the next if the follower is already matched
2014-11-19 13:21:11 -08:00
Brandon Philips
12aaf046d7
Merge pull request #1752 from philips/include-etcd-migrate-in-releases
...
scripts: build-release add etcd-migrate
2014-11-19 12:13:21 -08:00
Brandon Philips
f08df9e0f3
Merge pull request #1753 from philips/fixup-build-docker
...
scripts: build-docker tag and use ENTRYPOINT
2014-11-19 12:13:08 -08:00
Brandon Philips
00df13138e
scripts: build-docker tag and use ENTRYPOINT
...
Use ENTRYPOINT so people can specify flags to etcd without providing the
binary.
Thanks to @hugod in IRC for pointing this out.
2014-11-19 12:11:27 -08:00
Brandon Philips
d2e36a9535
scripts: build-release add etcd-migrate
...
this tool is only temporary for the alphas but make sure it makes it in.
2014-11-19 12:10:06 -08:00
Brandon Philips
893fb3b890
Merge pull request #1747 from proppy/master
...
create .godir
2014-11-18 16:00:07 -08:00
Johan Euphrosine
03bacc1984
create .godir
2014-11-18 15:01:57 -08:00
