Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka SSL - UI uploading Certs and keys #19063

Open
harshach opened this issue Dec 14, 2024 · 1 comment · May be fixed by #19433
Open

Kafka SSL - UI uploading Certs and keys #19063

harshach opened this issue Dec 14, 2024 · 1 comment · May be fixed by #19433
Assignees
Labels
bug Something isn't working Ingestion

Comments

@harshach
Copy link
Collaborator

[2024-11-19 07:47:26] INFO {metadata.OMetaAPI:server_mixin:74} - OpenMetadata client running with Server version [1.5.9] and Client version [1.5.9.0]
%4|1732002446.513|CONFWARN|rdkafka#producer-1| [thrd:app]: Configuration property `sasl.mechanism` set to `SCRAM-SHA-256` but `security.protocol` is not configured for SASL: recommend setting `security.protocol` to SASL_SSL or SASL_PLAINTEXT
[2024-11-19 07:47:26] INFO {metadata.Metadata:test_connections:203} - Running GetTopics...
[2024-11-19 07:47:36] ERROR {metadata.Metadata:test_connections:214} - GetTopics-Failed to fetch topics due to: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}. Please validate credentials and check if you are using correct security protocol
[2024-11-19 07:47:36] INFO {metadata.Metadata:test_connections:228} - Test connection results:
[2024-11-19 07:47:36] INFO {metadata.Metadata:test_connections:229} - lastUpdatedAt=None status=<StatusType.Running: 'Running'> steps=[TestConnectionStepResult(name='GetTopics', mandatory=True, passed=False, message='Failed to fetch topics, please validate the credentials', errorLog='Failed to fetch topics due to: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}. Please validate credentials and check if you are using correct security protocol')]
Traceback (most recent call last):
File "/ingestion/collate/main.py", line 127, in <module>
main()
File "/ingestion/collate/main.py", line 119, in main
workflow = workflow_class.create(workflow_config)
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/ingestion.py", line 110, in create
return cls(config)
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/ingestion.py", line 86, in __init__
super().__init__(
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/base.py", line 110, in __init__
self.post_init()
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/ingestion.py", line 105, in post_init
self.set_steps()
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/metadata.py", line 31, in set_steps
self.source = self._get_source()
File "/usr/local/lib/python3.10/site-packages/metadata/workflow/metadata.py", line 54, in _get_source

---
**Affected module**
Does it impact the UI, backend or Ingestion Framework?

**Describe the bug**
A clear and concise description of what the bug is.

**To Reproduce**

Screenshots or steps to reproduce

**Expected behavior**
A clear and concise description of what you expected to happen.

**Version:**
 - OS: [e.g. iOS]
 - Python version:
 - OpenMetadata version: [e.g. 0.8]
 - OpenMetadata Ingestion package version: [e.g. `openmetadata-ingestion[docker]==XYZ`]

**Additional context**
Add any other context about the problem here.
@ayush-shah
Copy link
Member

Network issue - whitelisting it works, if it gets reproduced again, we can open it.

@github-project-automation github-project-automation bot moved this from Integration to Done in Release 1.6.2 Jan 3, 2025
@ayush-shah ayush-shah added bug Something isn't working Ingestion and removed validation labels Jan 13, 2025
@ayush-shah ayush-shah reopened this Jan 13, 2025
@ayush-shah ayush-shah changed the title Kafka SSL Validation UI + CLI Kafka SSL - UI uploading Certs and keys Jan 13, 2025
@ulixius9 ulixius9 moved this to Integration in Release 1.6.3 Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Ingestion
Projects
Status: Integration
Status: Done
Development

Successfully merging a pull request may close this issue.

3 participants