Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proxy error, connectivity issue or a bug...connection closed #2728

Open
xavidop opened this issue Sep 4, 2024 · 12 comments
Open

Proxy error, connectivity issue or a bug...connection closed #2728

xavidop opened this issue Sep 4, 2024 · 12 comments
Labels
bug Something isn't working

Comments

@xavidop
Copy link

xavidop commented Sep 4, 2024

Bug Description

Get this error about 50 times a day (Proxy error, connectivity issue or a bug...connection closed), so I need to disconnect my env, reconnect, then re-mesh. It feels like 1/3rd of my day is managing my mesh. I think its due to my wifi being weirdly unstable on my laptop, cause if I hotspot using my phone I don’t encounter it. But that’s not sustainable for me long term. Any suggestions would be appreciated. Having a retry mechanism will be very very helpful.

image

Steps to Reproduce

just use mirrord, connect and disconnect from internet

Backtrace

No response

Relevant Logs

No response

Your operating system and version

Mac OS

Local process

we are running yarn commands

Local process version

No response

Additional Info

No response

@xavidop xavidop added the bug Something isn't working label Sep 4, 2024
@aviramha
Copy link
Member

aviramha commented Sep 4, 2024

Is your remote pod restarting when this happens?

@xavidop
Copy link
Author

xavidop commented Sep 4, 2024

@aviramha no restarts in the remote pod

@xavidop
Copy link
Author

xavidop commented Sep 4, 2024

@trs can add more context if needed

@sahityacodes
Copy link

I'm facing the same issue, when I use steal with an HTTP proxy . mirroring works fine

@aviramha
Copy link
Member

I'm facing the same issue, when I use steal with an HTTP proxy . mirroring works fine

Can you please elaborate? Did you check if the remote pod is restarting?

@sahityacodes
Copy link

sahityacodes commented Sep 30, 2024

The remote pod has not restarted. Everytime I use the mode "steal" with a socks5 proxy running to connect to the remote cluster where my actual pod is deployed, I see the following error in my local machine.
Proxy error, connectivity issue or a bug. You may report it to us on https://github.com/metalbear-co/mirrord/issues/new?assignees=&labels=bug&projects=&template=bug_report.yml connection closed /home/appuser/entryPoint.sh: line 40: 17 Killed java -Djava.security.egd=file:/dev/./urandom -jar /home/appuser/app.jar

Correcting myself, its a socks5 proxy.

@aviramha
Copy link
Member

The remote pod has not restarted. Everytime I use the mode "steal" with a socks5 proxy running to connect to the remote cluster where my actual pod is deployed, I see the following error in my local machine. Proxy error, connectivity issue or a bug. You may report it to us on https://github.com/metalbear-co/mirrord/issues/new?assignees=&labels=bug&projects=&template=bug_report.yml connection closed /home/appuser/entryPoint.sh: line 40: 17 Killed java -Djava.security.egd=file:/dev/./urandom -jar /home/appuser/app.jar

Correcting myself, its a socks5 proxy.

Would you like to share screen to debug it? I'm available on our Discord

@sahityacodes
Copy link

Sorry, I'm working on my organization's machine, I dont think I can share my screen. I can provide logs though. Could you please tell let me know what kind of logs would you require to debug this?

@aviramha
Copy link
Member

Please use:

{
  "internal_proxy": {
    "log_level": "mirrord=trace",
    "log_destination": "/tmp/mirrord.log"
  }
}

then attach the log (with redacted sensitive info)

@sahityacodes
Copy link

Please find it here :mirrord-logs.txt

@aviramha
Copy link
Member

aviramha commented Sep 30, 2024

Oh, you found a wonderful bug. Seems we're not handling well cases where remote cluster has ipv6.

2024-09-30T10:02:38.653317Z TRACE handle_agent_message{Close("Background task `Stealer` failed with `IPTables failed with `code: 2, msg: iptables v1.8.9 (legacy): host/network `fc00:1000::fa24' not found\nTry `iptables -h' or 'iptables --help' for more information.\n``")}: mirrord_intproxy: return=Err(AgentFailed("Background task `Stealer` failed with `IPTables failed with `code: 2, msg: iptables v1.8.9 (legacy): host/network `fc00:1000::fa24' not found\nTry `iptables -h' or 'iptables --help' for more information.\n``"))

Please follow up on this issue here #2788

@sahityacodes
Copy link

thanks for the quick help!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants