Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow monitoring connection refused on individual destination #43

Open
tailhook opened this issue Jul 24, 2017 · 1 comment
Open

Allow monitoring connection refused on individual destination #43

tailhook opened this issue Jul 24, 2017 · 1 comment
Milestone

Comments

@tailhook
Copy link
Collaborator

tailhook commented Jul 24, 2017

Currently we're getting this behavior:

2819  connect(13, {sa_family=AF_INET, sin_port=htons(12345), sin_addr=inet_addr("127.0.0.1")}, 16) = -1 EINPROGRESS (Operation now in progress)
2819  epoll_ctl(3, EPOLL_CTL_ADD, 13, {EPOLLIN|EPOLLOUT|EPOLLRDHUP|EPOLLET, {u32=2102, u64=2102}}) = 0
2819  epoll_wait(3, {}, 1024, 0)        = 0
2819  epoll_wait(3, {{EPOLLIN|EPOLLOUT|EPOLLERR|EPOLLHUP|EPOLLRDHUP, {u32=2102, u64=2102}}}, 1024, 176) = 1
2819  write(5, "\1", 1)                 = 1
2819  epoll_wait(3, {{EPOLLIN, {u32=4294967295, u64=18446744073709551615}}}, 1024, 0) = 1
2819  read(4, "\1", 128)                = 1
2819  read(4, 0x7ffc81ffd8d0, 128)      = -1 EAGAIN (Resource temporarily unavailable)
2819  getsockopt(13, SOL_SOCKET, SO_ERROR, [111], [4]) = 0
2819  close(13) 

Which is fine, except we can't see what specifically is wrong without running strace.

I'm not sure what the best fix is, either exposing this thing in !Status or showing it in metrics or logs, or the combination of all of them.

Update: Also we have queue-size-for-503 of the default 100k which is just too big both for our use case and as a default value.

@tailhook tailhook added this to the v0.6.1 milestone Jul 24, 2017
@tailhook
Copy link
Collaborator Author

Okay the first two things to do are:

  1. Expose metric for the size of the backend queue
  2. Cancel dropped (timed out) connections (to keep queue minimal)

@tailhook tailhook modified the milestones: v0.6.3, v0.6.4 Aug 19, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant