Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCI split data in different tables #11499

Draft
wants to merge 19 commits into
base: master
Choose a base branch
from
Draft

OCI split data in different tables #11499

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
c9cbf2d
Update main.py
v-sabiraj Nov 27, 2024
5585c28
Update OCILogsConn.zip
v-sabiraj Nov 27, 2024
addec7a
Update main.py
v-sabiraj Nov 28, 2024
6cea78b
Update OCILogs.yaml
v-sabiraj Nov 28, 2024
d4fbc05
Update OCILogsConn.zip
v-sabiraj Nov 28, 2024
654126c
Updated logtype to create new default table
v-sabiraj Dec 3, 2024
520da25
Update OCILogs.yaml
v-sabiraj Dec 3, 2024
31abef3
Update main.py
v-sabiraj Dec 5, 2024
4c15dfe
Update OCILogsConn.zip
v-sabiraj Dec 5, 2024
659ce90
Added logging and changed the eventtype logic
v-sabiraj Dec 6, 2024
0bbbb65
Update OCILogsConn.zip
v-sabiraj Dec 6, 2024
8e4c04d
grouping events based on types
v-sabiraj Dec 9, 2024
72e8c7d
Update sentinel_connector.py
v-sabiraj Dec 9, 2024
e05d51e
Update OCILogsConn.zip
v-sabiraj Dec 9, 2024
8bf7be9
Updated log type value
v-sabiraj Dec 13, 2024
6e49446
Update main.py
v-sabiraj Dec 23, 2024
3acb919
Update OCILogsConn.zip
v-sabiraj Dec 23, 2024
a0c0007
updated the event type with in operator
v-sabiraj Jan 2, 2025
0a7a429
Updated table name to V3
v-sabiraj Jan 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion Solutions/Oracle Cloud Infrastructure/Data Connectors/AzureFunctionOCILogs/main.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,11 +61,19 @@
# event_type = event.get("type", "default")
if event["type"] == "com.oraclecloud.loadbalancer.access" or event["type"] == "com.oraclecloud.loadbalancer.error" or event["type"]=="com.oraclecloud.OraLB-API.ListLoadBalancers":
return "OCI_LoadBalancerLogs"
# elif event_type == "com.oraclecloud.loadbalancer.error":
# return "OCI_LoadBalancerLogs"
if event["type"] == "com.oraclecloud.Audit.ListEvents":
return "OCI_AuditLogs"
if event["type"] == "com.oraclecloud.vcn.flowlogs.DataEvent" or event["type"] == "com.oraclecloud.vcn.flowlogs.QualityEvent.NoData" or event["type"] == "com.oraclecloud.virtualNetwork.GetVcn" or event["type"] == "com.oraclecloud.virtualNetwork.ListVcns" or event["type"] == "com.oraclecloud.vcn.flowlogs.QualityEvent.SkipData" or event["type"] == "com.oraclecloud.virtualNetwork.GetVcnDnsResolverAssociation":
if event["type"] == "com.oraclecloud.computeApi.ListVolumeAttachments" or event["type"] == "com.oraclecloud.computeApi.ListVnicAttachments" or event["type"] == "com.oraclecloud.computeApi.ListBootVolumeAttachments" or event["type"] == "com.oraclecloud.computeApi.GetInstance":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As i said before we should do a contains in order to classifiy each log type instead of parssing each type,

reason:
in the future there is an option that it may be a new event data type for example :
com.oraclecloud.vcn.newqtype

because we are using == instead of in this log will be sent to the defualt talbe and not to the relevant one

return "OCI_ComputeApiLogs"
if event["type"] == "com.oraclecloud.sch.serviceconnector.runlog":
return "OCI_ServiceConnector_Logs"
if "com.oraclecloud.DatabaseService" in event["type"]:
return "OCI_DatabaseService_Logs"
if "com.oraclecloud.KeyManagementService" in event["type"]:
return "OCI_KeyManagementService_Logs"
if event["type"] == "com.oraclecloud.vcn.flowlogs.DataEvent" or event["type"] == "com.oraclecloud.vcn.flowlogs.QualityEvent.NoData" or event["type"] == "com.oraclecloud.virtualNetwork.GetVcn" or event["type"] == "com.oraclecloud.virtualNetwork.ListVcns" or event["type"] == "com.oraclecloud.virtualNetwork.GetVnic" or event ["type"] == "com.oraclecloud.virtualNetwork.GetSubnet" or event["type"] == "com.oraclecloud.vcn.flowlogs.QualityEvent.SkipData" or event["type"] == "com.oraclecloud.virtualNetwork.GetVcnDnsResolverAssociation":
return "OCI_VirtualNetworkLogs"
else:
return "OCI_LogsV2" # Default log type
Expand Down
Binary file modified Solutions/Oracle Cloud Infrastructure/Data Connectors/OCILogsConn.zip
View file
Open in desktop
Binary file not shown.
Loading