Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

relay_server::services::project_upstream #3251

Open
BenJChen opened this issue Aug 7, 2024 · 6 comments
Open

relay_server::services::project_upstream #3251

BenJChen opened this issue Aug 7, 2024 · 6 comments

Comments

@BenJChen
Copy link

BenJChen commented Aug 7, 2024

Self-Hosted Version

24.7.1

CPU Architecture

x86_64

Docker Version

24.0.6

Docker Compose Version

2.20.3

Steps to Reproduce

After a large number of errors entered the sentry service, sentry crashed

Expected Result

The relay service returns to normal, and you can see error and performance statistics.

Actual Result

Image

Yesterday, due to a large number of errors reported by the project, sentry failed. We tried removing all Kafka-related volumes and recreating them, restarting sentry and other methods. The project can run normally, but the data cannot be written. 12 hours have passed and we still cannot see new data in sentry. The data, nginx view request is normal, but a large number of errors appear in the relay, how to solve this

Event ID

No response

@joshuarli
Copy link
Member

Related: getsentry/relay#3828

What do you mean by "sentry crashed"? Is the web container failing?

@BenJChen
Copy link
Author

Related: getsentry/relay#3828

What do you mean by "sentry crashed"? Is the web container failing?

The error and performance data cannot be updated for more than ten hours. The nginx view request is normal and the relay prompts relay_server::services::project_upstream.

@joshuarli
Copy link
Member

Have you tried restarting Relay? Is it just total failure to ingest any more events?

@BenJChen
Copy link
Author

您是否尝试过重新启动 Relay?是否完全无法接收更多事件?

Have you tried restarting Relay? Is it just total failure to ingest any more events?

Restarting relay and even restarting sentry failed to solve the problem. It was not until I tried to clear all redis caches and restart sentry that relay returned to normal.

@iambriccardo
Copy link
Member

Hi, did you experience any overload of Redis when the errors started happening?

@getsantry
Copy link

getsantry bot commented Sep 19, 2024

This issue has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you remove the label Waiting for: Community, I will leave it alone ... forever!


"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀

@getsantry getsantry bot added the Stale label Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Waiting for: Community
Status: No status
Development

No branches or pull requests

4 participants