Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dedup translog operations by reading in reverse #27268

Merged
merged 19 commits into from
Nov 26, 2017
Merged

Dedup translog operations by reading in reverse #27268

merged 19 commits into from
Nov 26, 2017

Commits on Nov 4, 2017

  1. Dedup translog operations by reading in reverse 

    Currently, translog operations are read and processed one by one.  This
may be a problem as stale operations in translogs may suddenly reappear
in recoveries. To make sure that stale operations won't be processed, we
read the translog files in a reverse order (eg. from the most recent
file to the oldest file) and only process an operation if its sequence
number was not seen before.
    @dnhatn
    dnhatn committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    d6e64ea View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2017

  1. add the replication test

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    d006988 View commit details
    Browse the repository at this point in the history

  2. remove tier in name and comment

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    5935009 View commit details
    Browse the repository at this point in the history

  3. improve the SeqNumSet tests

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    ea11a2a View commit details
    Browse the repository at this point in the history

  4. add description for the matcher

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    ebe92b6 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into dedup-translog-merge 

    # Conflicts:
#	core/src/test/java/org/elasticsearch/index/translog/TranslogTests.java
    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    def1d39 View commit details
    Browse the repository at this point in the history

  6. skippedOperations -> overriddenOperations

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    5cc33bb View commit details
    Browse the repository at this point in the history

  7. check against unassigned

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    aa21d87 View commit details
    Browse the repository at this point in the history

  8. correct condition

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    9bdb507 View commit details
    Browse the repository at this point in the history

  9. fix compilation

    @dnhatn
    dnhatn committed Nov 8, 2017
    Configuration menu
    Copy the full SHA
    b3e0b6d View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2017

  1. Merge branch 'master' into dedup-translog

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    3bd5cd5 View commit details
    Browse the repository at this point in the history

  2. simple test

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    7d3482b View commit details
    Browse the repository at this point in the history

  3. SeqNum -> SeqNo

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    a3994f8 View commit details
    Browse the repository at this point in the history

  4. address feedback

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    48b0ff9 View commit details
    Browse the repository at this point in the history

  5. more restrict asserts

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    97aa4d7 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into dedup-translog

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    c960f37 View commit details
    Browse the repository at this point in the history

  7. another address

    @dnhatn
    dnhatn committed Nov 22, 2017
    Configuration menu
    Copy the full SHA
    a3ff8c8 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2017

  1. add todo

    @dnhatn
    dnhatn committed Nov 23, 2017
    Configuration menu
    Copy the full SHA
    f79e3ef View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2017

  1. Merge branch 'master' into dedup-translog

    @dnhatn
    dnhatn committed Nov 26, 2017
    Configuration menu
    Copy the full SHA
    29aa2f2 View commit details
    Browse the repository at this point in the history