Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Troubleshoot a TiFlash Cluster: Add four more problems and their solutions #7277

Conversation

shichun-0415
Copy link
Contributor

@shichun-0415 shichun-0415 commented Oct 14, 2021

First-time contributors' checklist

What is changed, added or deleted? (Required)

Troubleshoot a TiFlash Cluster: Add four more problems and their solutions

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions (in Chinese).

  • master (the latest development version)
  • v5.2 (TiDB 5.2 versions)
  • v5.1 (TiDB 5.1 versions)
  • v5.0 (TiDB 5.0 versions)
  • v4.0 (TiDB 4.0 versions)
  • v3.1 (TiDB 3.1 versions)
  • v3.0 (TiDB 3.0 versions)
  • v2.1 (TiDB 2.1 versions)

What is the related PR or file link(s)?

  • This PR is translated from:
  • Other reference link(s):

Do your changes match any of the following descriptions?

  • Delete files
  • Change aliases
  • Need modification after applied to another branch
  • Might cause conflicts after applied to another branch

@ti-chi-bot
Copy link
Member

ti-chi-bot commented Oct 14, 2021

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • qiancai

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@ti-chi-bot ti-chi-bot requested a review from TomShawn October 14, 2021 09:15
@ti-chi-bot ti-chi-bot added missing-translation-status This PR does not have translation status info. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Oct 14, 2021
@ti-chi-bot
Copy link
Member

@LiSong0214: Thanks for your review. The bot only counts approvals from reviewers and higher roles in list, but you're still welcome to leave your comments.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
@ti-chi-bot
Copy link
Member

@LiSong0214: Thanks for your review. The bot only counts approvals from reviewers and higher roles in list, but you're still welcome to leave your comments.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@shichun-0415 shichun-0415 added translation/doing This PR’s assignee is translating this PR. needs-cherry-pick-release-5.0 and removed missing-translation-status This PR does not have translation status info. labels Oct 14, 2021
@shichun-0415 shichun-0415 requested review from qiancai and solotzg and removed request for TomShawn October 15, 2021 02:28
@shichun-0415 shichun-0415 self-assigned this Oct 15, 2021
@shichun-0415
Copy link
Contributor Author

I've finished the self-check of this PR. PTAL. Thanks.

@TomShawn
Copy link
Contributor

@moyun

@shichun-0415 shichun-0415 added the type/enhancement The issue or PR belongs to an enhancement. label Oct 15, 2021
Copy link
Contributor

@solotzg solotzg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@shichun-0415 shichun-0415 added the area/bigdata Indicates that the Issue or PR belongs to the area of TiFlash, TiSpark, and OLAP. label Oct 15, 2021
Copy link
Collaborator

@qiancai qiancai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@shichun-0415 PTAL. Thanks.

tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
tiflash/troubleshoot-tiflash.md Show resolved Hide resolved
执行 `ALTER table <tbl_name> set tiflash replica <num>` 操作,查看是否有正常返回:

- 如果有正常返回,进入下一步。
- 如果无正常返回,请执行 `SELECT * FROM information_schema.tiflash_replica` 检查是否已经创建 TiFlash replica。如果没有,请重新执行 `ALTER table ${tbl_name} set tiflash replica ${num}` 或者查看是否有其他执行语句(如 `add index` )或 DDL 操作是否异常。
Copy link
Collaborator

@qiancai qiancai Jan 13, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

“查看是否有其他执行语句(如 add index )或 DDL 操作是否异常” 这句有点不通顺,请看看要不要调整下

tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
- 没有更新,检查下一步;
- 有更新,检查是否有 `down peer` (`down peer` 没有清理干净可能会导致同步卡住)
- `pd-ctl region check-down-peer`
- `pd-ctl operator add remove-peer\<region-id> \<tiflash-store-id>`
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里的步骤是这样的吗? 1。 执行 pd-ctl region check-down-peer 命令检查是否有 down peer。2. 如果检查出来有 down peer,执行pd-ctl operator add remove-peer\<region-id> \<tiflash-store-id> 清除 down peer.

tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
tiflash/troubleshoot-tiflash.md Show resolved Hide resolved
tiflash/troubleshoot-tiflash.md Outdated Show resolved Hide resolved
Copy link
Collaborator

@qiancai qiancai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot ti-chi-bot added the status/LGT1 Indicates that a PR has LGTM 1. label Jan 14, 2022
@shichun-0415 shichun-0415 added the require-LGT1 Indicates that the PR requires an LGTM. label Jan 14, 2022
@shichun-0415 shichun-0415 reopened this Jan 14, 2022
@qiancai
Copy link
Collaborator

qiancai commented Jan 14, 2022

/merge

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: abeb6d5

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Jan 14, 2022
@ti-chi-bot ti-chi-bot merged commit b142523 into pingcap:master Jan 14, 2022
@shichun-0415 shichun-0415 deleted the Troubleshoot-a-TiFlash-Cluster-Add-four-more-problems-and-their-solutions branch January 14, 2022 08:05
@shichun-0415 shichun-0415 added translation/done This PR has been translated from English into Chinese and updated to pingcap/docs-cn in a PR. and removed translation/doing This PR’s assignee is translating this PR. labels Mar 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/bigdata Indicates that the Issue or PR belongs to the area of TiFlash, TiSpark, and OLAP. require-LGT1 Indicates that the PR requires an LGTM. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. status/can-merge Indicates a PR has been approved by a committer. status/LGT1 Indicates that a PR has LGTM 1. status/PTAL This PR is ready for reviewing. translation/done This PR has been translated from English into Chinese and updated to pingcap/docs-cn in a PR. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants