Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Small HW cluster for Jaeger/ClickHouse GSoC project #239

Closed
yurishkuro opened this issue May 17, 2023 · 13 comments
Closed

Small HW cluster for Jaeger/ClickHouse GSoC project #239

yurishkuro opened this issue May 17, 2023 · 13 comments
Assignees
Milestone

Comments

@yurishkuro
Copy link

yurishkuro commented May 17, 2023

Please fill out the details below to file a request for access to the CNCF Community Infrastructure Lab. Please note that access is targeted to people working on specific open source projects; this is not designed just to get your feet wet. The most important answer is the URL of the project you'll be working with. If you're looking to learn Kubernetes and related technologies, please try out Katacoda.

First and Last Name

Yuri Shkuro

Email

[email protected]

Project Title (i.e., a summary of what do you want to do, not what is the name of the open source project you're working with)

ClickHouse as a core storage backend for Jaeger

Briefly describe the project (i.e., what is the detail of what you're planning to do with these servers?)

This is a mentorship project part of GSoC. The aim is to develop storage implementation in Jaeger using ClickHouse as the backend. The servers are needed to run performance benchmarks to determine the optimal database schema and the write/query methods.

jaegertracing/jaeger#4196

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located? What is your association with that project?

https://github.com/jaegertracing/jaeger

I am a maintainer of Jaeger, but the work will be done by GSoC mentee @haanhvu.

What kind of machines and how many do you expect to use (see: https://metal.equinix.com/product/servers/)?

Five c3.small.x86 or m3.small.x86 machines.

What operating system and networking are you planning to use?

Linux

Any other relevant details we should know about?

Reservation will be needed through GSoC project completion at the end of Aug 2023.

@idvoretskyi
Copy link
Member

PTAL @caniszczyk

@caniszczyk
Copy link
Contributor

caniszczyk commented May 17, 2023 via email

@yurishkuro
Copy link
Author

@idvoretskyi what's the follow-up here? Does someone need to approve ? Who can action the ticket? Thx.

@caniszczyk
Copy link
Contributor

@RobertKielty can you take care of this

@jeefy
Copy link
Member

jeefy commented Jun 5, 2023

@yurishkuro You should have an invite to a new Equinix project now. :) Feel free to reach out if you need anything else!

@yurishkuro
Copy link
Author

@jeefy thanks, I got it. Are there any guidelines on how to use this service? We don't want to accidentally rack up a huge usage bill.

@yurishkuro
Copy link
Author

@jeefy also, please invite [email protected], I don't seem to have that option.

@jeefy
Copy link
Member

jeefy commented Jun 5, 2023

Use responsibly. :) Don't leave machines around that you don't need. Technically Equinix is all bare metal so even leaving a machine powered off is still considered "consumption".

In terms of using too much, we'll ping you to let you know if consumption is a bit too wild.

cc @vielmetti

@vielmetti
Copy link
Collaborator

@yurishkuro - the project currently has 12 systems provisioned, which is more than the original expectation of 5 systems. Can you please take a look to see if there's any infrastructure that can be cleaned up or consolidated? Or, if project scope has expanded, please describe the additional resources and how they are being used.

(I also note that the project original completion date is end of August 2023, so if this is the final burst of systems needed to complete your work that's fine - just don't want to have machines running idle.)

cc @jeefy @idvoretskyi @caniszczyk

@yurishkuro
Copy link
Author

will check. We're wrapping up the work.

@haanhvu
Copy link

haanhvu commented Aug 24, 2023

@vielmetti @yurishkuro I'll delete all the hosts by the end of this week.

Or, if project scope has expanded, please describe the additional resources and how they are being used.

We have been having more performance benchmarks to run than we originally expected. The benchmarks are going to be finished this week.

Update: Sorry it's already end of the week but we haven't closed all the servers yet... We closed 5/12 of them. We'll try to close the remaining in last week of August.

@vielmetti
Copy link
Collaborator

Sounds great @haanhvu ! Looking forward to seeing your report and results.

@vielmetti vielmetti added this to the Jaeger milestone Dec 15, 2023
@idvoretskyi
Copy link
Member

@yurishkuro anything else should be done here (or we can close the ticket)?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants