Mirroristas/etcd
2
0
Fork 0
mirror of https://github.com/etcd-io/etcd.git synced 2024-09-27 06:25:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,133 Commits 15 Branches 491 Tags 148 MiB
Commit Graph

57 Commits

Author SHA1 Message Date
Gyu-Ho Lee
b4aa4607cb wal: use bytes.Equal, other minor updates 
- Replace reflect.Equal with bytes.Equal where possible
- Remove some TODOs
- Some minor simplifications
 2016-06-13 01:33:53 -07:00
Gyu-Ho Lee
4570eddc2c wal: PrivateFileMode/DirMode as in pkg/fileutil 
To make it consistent with pkg/fileutil
 2016-06-10 15:20:57 -07:00
Gyu-Ho Lee
4a5befc2de wal: update LICENSE header 2016-05-12 20:50:04 -07:00
Anthony Romano
17391336af wal: atomically initialize wal directory 
Fixes #5270
 2016-05-11 16:50:17 -07:00
Gyu-Ho Lee
641a1a66e1 *: fix govet -shadow in go tip 2016-04-15 07:39:52 -07:00
Anthony Romano
bfe3a3d08e wal: fix tail corruption 
On ReadAll, WAL seeks to the end of the last record in the tail. If the tail did not
end with preallocated space, the decoder would report 0 as the last offset and begin
writing at offset 0 of the tail.

Fixes #4903
 2016-04-01 15:05:52 -07:00
Anthony Romano
24b806d2ee wal: preallocate WAL files with initial size equal to segment size 
Avoids having to update file size metadata during fdatasync on common path.

Fixes #4755
 2016-03-21 11:56:53 -07:00
Anthony Romano
7397e14c0a fileutil, wal: refactor file locking 
File lock interface was more verbose than it needed to be while
simultaneously making it difficult to support systems (e.g., Windows)
that only permit locked writes on a single fd holding the lock.
 2016-03-16 15:02:15 -07:00
Gyu-Ho Lee
a4de207d53 wal: fix shadowed variables 
Fixes for https://github.com/coreos/etcd/issues/3954.
 2015-12-12 09:38:26 -08:00
Dmitry Smirnov
b2f4a5f587 *: fix spelling issues (codespell). 
Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
 2015-09-11 10:22:29 +10:00
Xiang Li
f59da0e453 *:fix point-in-time backup 
Backup process should be able to read all WALs until io.EOF to
generate a point-in-time backup.

Our WAL file is append-only. And the backup process will lock all
files before start reading, which can prevent the gc routine from
removing any files in the middle.
 2015-06-15 11:12:28 -07:00
Yicheng Qin
3dd6e0b88f wal: fix missing import 2015-03-24 22:53:15 -07:00
Xiang Li
6e6669d696 wal: releastTo should work with large release index 2015-03-24 22:34:26 -07:00
Xiang Li
b66eb3d81c wal: fix ReleaseLockTo 
ReleaseLockTo should not release the lock on the WAL
segment that is right before the given index. When
restarting etcd, etcd needs to read from the WAL segment
that has a smaller index than the snapshot index.

The correct behavior is that ReleaseLockTo releases
the locks w is holding so that w only holds one lock
that has an index smaller than the given index.
 2015-03-09 19:52:54 -07:00
Xiang Li
86429264fb wal: support auto-cut in wal 
WAL should control the cut logic itself. We want to do falloc to
per allocate the space for a segmented wal file at the beginning
and cut it when it size reaches the limit.
 2015-02-28 11:18:59 -08:00
Barak Michener
92dca0af0f *: remove shadowing of variables from etcd and add travis test 
We've been bitten by this enough times that I wrote a tool so that
it never happens again.
 2015-02-17 16:31:42 -05:00
Jonathan Boulle
f1ed69e883 *: switch to line comments for copyright 
Build tags are not compatible with block comments.
Also adds copyright header to a few places it was missing.
 2015-01-26 09:53:30 -08:00
Yicheng Qin
9bdc343b7c wal: add ReleaseLockTo test 2015-01-09 14:59:41 -08:00
Yicheng Qin
270e67db84 wal: not export unnecessary public functions 2015-01-09 14:55:10 -08:00
Yicheng Qin
6460e49a33 wal: save empty snapshot when create 
So caller can open at empty snapshot to read all entries.
 2015-01-06 19:48:21 -08:00
Yicheng Qin
84f62f21ee wal: record and check snapshot 2015-01-06 16:27:40 -08:00
Xiang Li
53bf7e4b5e wal: rename openAtIndex -> open; OpenAtIndexUntilUsing -> openNotInUse 2014-12-14 19:33:06 -08:00
Xiang Li
ea94d19147 *: lock the in using files; do not purge locked the wal files 2014-12-14 19:27:22 -08:00
Yicheng Qin
b9bf957c6d wal: sync after writing data to disk in Cut function 2014-12-04 22:56:34 -08:00
Yicheng Qin
af0f34c595 wal: save latest state into new WAL 
So we could always read out state when open at valid index.
 2014-12-04 12:19:21 -08:00
Yicheng Qin
aa61009560 wal: not return ErrIndexNotFound in ReadAll 
This IndexNotFound case is reasonable now because we don't write dummy
entries into wals any more.
 2014-12-02 00:28:54 -08:00
Xiang Li
ff1f5a9d57 wal: sync before returning from create 2014-11-03 14:28:59 -08:00
Jonathan Boulle
7a4d42166b *: add license header to all source files 2014-10-17 15:41:22 -07:00
Yicheng Qin
447caf1afc etcdserver/wal: record info at the head of WAL file 2014-10-10 11:57:09 -07:00
Xiang Li
8bbbaa88b2 *: raft related int64 -> uint64 2014-10-09 14:29:21 +08:00
Yicheng Qin
1d5d2e3726 *: Id -> ID for protobuf types 
We use ID instead of Id in this project based on golang conventions.
 2014-09-26 11:49:30 -07:00
Yicheng Qin
29f6d8a9e6 wal: add ErrFileNotFound and ErrIndexNotFound 2014-09-17 15:58:06 -07:00
Yicheng Qin
7160b5ae26 wal: OpenFromIndex fails if it cannot find previous index 
Example:
We save entry 1, 2, 3 to WAL.
If we try to open 100, it should fail.
 2014-09-17 15:07:07 -07:00
Yicheng Qin
023dc7cba2 etcdserver: add SYNC request 2014-09-16 13:42:03 -07:00
Xiang Li
1d09c25f5f wal: add walName function; cleanup test 2014-09-15 10:17:21 -07:00
Xiang Li
1164c4b83d wal: recover writting seq 2014-09-15 10:14:18 -07:00
Xiang Li
21860bc017 wal: cut(i uint64) -> cut 2014-09-15 10:14:18 -07:00
Yicheng Qin
a9af70c52b raft: write entry 0 into log 2014-09-15 09:55:52 -07:00
Yicheng Qin
2030ca202f wal: change wal filename format 
Make raftIndex section to be expected raftIndex of next entry.

It makes filename more intuitive and straight-forward.

The commit also adds comments for filename format.
 2014-09-12 11:24:28 -07:00
Brandon Philips
884c702512 wal: wal.OpenFromIndex -> wal.OpenAtIndex 
The first entry read from the wal should be the index provided. This
name makes that more clear.
 2014-09-11 12:52:06 -07:00
Brandon Philips
24fd126822 *: stop using 0xBEEF 
Using 0xBEEF is annoying in examples because it makes it makes it look
like the user can use ascii or something. In the Procfile use
0x0,0x1,0x2,etc and use 0xBAD0 in test.
 2014-09-09 16:40:51 -07:00
Xiang Li
6f06923e96 wal: test save empty state 2014-09-09 10:41:15 -07:00
Jonathan Boulle
9997c9488a *: fix a few small issues identified by go vet 2014-09-08 23:52:36 -07:00
Blake Mizerany
46a7a61b7d wal: fix broken tests 2014-09-03 15:56:28 -07:00
Xiang Li
bdb954b2f5 wal: fix wal 2014-09-03 15:10:15 -07:00
Yicheng Qin
442cae6844 wal: support multiple files 2014-09-03 09:20:10 -07:00
Xiang Li
659eb5fd2a wal: make record a protobuf type 2014-09-03 09:20:03 -07:00
Xiang Li
8e06333d45 raft: make State a protobuf type 2014-09-03 09:20:03 -07:00
Xiang Li
d6c3ebb1a0 raft: make Info a protobuf type 2014-09-03 09:20:03 -07:00
Xiang Li
38ec659cd6 raft: make Entry a protobuf type 2014-09-03 09:20:01 -07:00