Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Endace Integration enhancements #12784

Open
wants to merge 3,856 commits into
base: endace
Choose a base branch
from
Open

Conversation

rcesar99999
Copy link

Type of change

  • Enhancement

Proposed commit message

This PR is replacing PR #12000 that was cancelled due to corrupstion in the original repository.
A new repository was created to work with Endace Integration.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

niraj-elastic and others added 30 commits May 9, 2024 12:06
* Update the input type from HTTPJSON to CEL.

    * Update the input type to CEL for better debugging
    * Added fingerprint in the plugin data stream
    * Update the build version 3.0.0 and change the type to enhancement
    * Added asset.hit_count to all datastreams system test config
    * Handled the export_status timeout condition in assets and vulnerability datastreams
    * Implemented the cancel export_uid API to terminate the export job ID if the timeout condition is met, in asset and vulnerability data stream.
    * Added a check to ensure that if the previous export is not finished, a new export shouldn't be initiated, in asset and vulnerability data stream.

---------

Co-authored-by: Dan Kortschak <[email protected]>
* Rename apache2.error.integration to apache.error.module

* Add Changelog for the PR

* Update manifest to version 1.17.2
All non-200 HTTP status codes are treated as error conditions. The
ThreatConnect API docs[1] indicate that 200 and 201 are success codes
used by their API, but this integration does not make use of object
creation, so 201 is not handled here.

[1]https://docs.threatconnect.com/en/latest/rest_api/v3/http_status_codes.html
Added support for the new WAF score fields included in the HTTP requests event dataset by Cloudflare.
Add `ignore_failure: true` to the community_id processor to prevent
failures from skipping the execution of the remaining processors.

Fixes #9835
…n packages (#9832)

* updated field types in multiple packages to resolve ignore_malformed related issues

* updated changelogs

* updated data types and addressed PR comments

* updated readmes
Set `response.split.ignore_empty_value: true` for splitting responses
from AWS Security Hub, to avoid indexing the empty wrapper document
when the Insights or Findings list is empty.

The [`response.split` documentation][1] says:

> If the split target is empty the parent document will be kept.
> If documents with empty splits should be dropped, the
> `ignore_empty_value` option should be set to `true`.
 
[1]: https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-input-httpjson.html#response-split
…her nsg (#9652)

* Initial release of the azure network watcher nsg
…cher vnet (elastic#9680)

* Initial release of the azure network watcher vnet
* Revert "[Universal profiling symbolizer] use secrets variables (#9807)"

This reverts commit 9ea6816.

* restore 8.14.0 changelog

* bump to 8.14.1 + changelog
* Revert "[Universal profiling collector] use secrets variables (#9806)"

This reverts commit 0ce1c1b.

* restore 8.14.0 changelog

* bump to 8.14.1 + changelog
Migrate package to spec v3 so it is ready for serverless, this includes:
* Add secrets support.
* Remove duplicated and ambiguous field definitions.
* Fix normalization as arrays of event.category and event.type fields.
* Handle event.original in pipelines.
* Add condition to Logstash cel streams

While `condition` is an option for the Logstash cel-based metrics, the condition
parameter was not specified in the stream definitions.

Fixes: #9800
* add the cloud formation credentials url

* add cloud credentials change for changelog

* use 8.15.0 version and change description
Responsibility was split between teams.
* add support of organization log datastream

* update changelog with pr link

* resolve review comments

* resolve review comments

* update readme.md

* minor interval change

* update readme.md
* [Enhancement] Update winlog.event_data.AttributeValue

* Update manifest.yml

* Update README.md
- Improve ECS categorizations for messages
jamesagarside and others added 25 commits July 4, 2024 11:22
… (#10489)

* Able to create P2V when just one IP is present - Fixed start&end time

* ngest_pipeline/endace-netflow.yml changed to handle single IP events

* updating expected.json after command elastic-package test pipeline --generate
Co-authored-by: Taylor Swanson <[email protected]>
* Able to create P2V when just one IP is present - Fixed start&end time

* ngest_pipeline/endace-netflow.yml changed to handle single IP events

* updating expected.json after command elastic-package test pipeline --generate

* change lookback to view window

* updating expected test flows

* update Endace README.md

* changing view_window to 20

* changed expected.json files to reflect the new view_window of 10 minutes

* change default udp host to 0.0.0.0

* Fixed grammar and terminology

* updating docs/README.md

* updating docs/README.md, remove empty line at the end of the file

* removing the ? after && for a condition already evaluated

* changed variable to endace_view_window

* json-expected after test pipeline generate

* Adding tags in all processors

* fixing final errors

* caught a mistake last minute

* One last fix in the ? after &&

---------

Co-authored-by: barry.shaw <[email protected]>
@rcesar99999 rcesar99999 requested review from a team as code owners February 14, 2025 01:00
Copy link

❌ Author of the following commits did not sign a Contributor Agreement:
, 72b6f7c, a0a58ea, , deb84fb, , , , , , , , , , , , , , , , , , , , 82ad2b4, , , , ,

Please, read and sign the above mentioned agreement if you want to contribute to this project

@rcesar99999
Copy link
Author

See attached the CLA signed by Endace

Corporate_Contributor_License Endace Elastic Oct 2024.pdf

@jamesagarside jamesagarside self-assigned this Feb 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.