Skip to content

CSPL-4513 Events for Index & Ingestion separation#1706

Open
kasiakoziol wants to merge 192 commits intofeature/slog-as-default-loggerfrom
feature/cspl-4513-events-for-index-ingest-sep
Open

CSPL-4513 Events for Index & Ingestion separation#1706
kasiakoziol wants to merge 192 commits intofeature/slog-as-default-loggerfrom
feature/cspl-4513-events-for-index-ingest-sep

Conversation

@kasiakoziol
Copy link
Collaborator

@kasiakoziol kasiakoziol commented Feb 18, 2026

Description

It adds events and enhances logs for IngestorCluster and enhances events for IndexerCluster.

Key Changes

  • Refactoring existing event messages for IngestorCluster and IndexerCluster
  • Introducing new events for IngestorCluster: ScaledUp, ScaledDown, QueueConfigUpdated and
    IngestorsRestarted
  • Introducing new events for IndexerCluster: QueueConfigUpdated and
    IngestorsRestarted
  • Introducing slog
  • Automated tests for the above

Testing and Verification

Automated and manual tests

Related Issues

Jira: https://splunk.atlassian.net/browse/CSPL-4513

PR Checklist

  • Code changes adhere to the project's coding standards.
  • Relevant unit and integration tests are included.
  • Documentation has been updated accordingly.
  • All tests pass locally.
  • The PR description follows the project's guidelines.

kasiakoziol and others added 30 commits July 24, 2025 13:49
* test

* test

* test

* test

* Use endpoint to update conf file

* CSPL-3895 Matching changes from Ingestor to Indexer

---------

Co-authored-by: Kasia Koziol <kkoziol@splunk.com>
Co-authored-by: igor.grzankowski <@splunk.com>
…torCluster (#1606)

* CSPL-4002 Update role for ingestor to ingestor from standalone

* CSPL-4212 Address changes from unit tests from develop branch

* Addressing comments

* Run tests against Splunk 10.2

* Fix

* Address changes from develop

* CSPL-4002 Revert 10.2 changes
…tion (#1550)

* CSPL-3551 Init IngestorCluster CR implementation

* CSPL-3551 Enhancing Ingestor inputs

* fix

* fix

* CSPL-3551 Adding tests

* CSPL-3551 Mound defaults and update them with no Splunk restart

* CSPL-3551 Fixing code after tests

* CSPL-3895-indexercluster (#1562)

* test

* test

* test

* test

* Use endpoint to update conf file

* CSPL-3895 Matching changes from Ingestor to Indexer

---------

Co-authored-by: Kasia Koziol <kkoziol@splunk.com>
Co-authored-by: igor.grzankowski <@splunk.com>

* CSPL-3551 Applying fixes do Indexer integration

* CSPL-3551 Fixes

* CSPL-3551 Fixes

* CSPL-3560 Initial docs for I&I separation

* CSPL-3551 Update documentation to reflect on Grafana

* CSPL-3556 Unit tests

* CSPL-3972 Addressing TODOs

* CSPL-3972 Addressing TODOs

* CSPL-3551 Moving default from types to controller code

* CSPL-3551 Applying previous changes to IndexerCluster

* CSPL-3551 Moving validations to separate function and adding validation for empty values

* CSPL-3551 Making sure all inputs are put into status

* CSPL-3551 Update of conf files when queue name or type change

* CSPL-3551 Unit tests

* CSPL-4003 Helm charts support for bus and pipeline configs

* CSPL-4003 Docs update

* CSPL-4003 Addressing comments

* CSPL-3558 Integ tests init

* CSPL-3558 Adding extra validation for integraion test

* CSPL-3558 Refactoring

* CSPL-3558 Adding scenario for update and delete

* CSPL-3558 Adding helm test

* CSPL-3558 Update of k8s version

* CSPL-3558 Fix metrics-server installation issues after k8s version upgrade

* CSPL-3558 Adding additional tests

* CSPL-3558 Fixing helm tests

* CSPL-3558 Fix tests after merge

* CSPL-3558 Fix helm tests

* CSPL-4022 Remove pipeline config from inputs

* CSPL-4022 Remove bus inputs

* CSPL-4022 Introduce BusConfiguration CR

* CSPL-4022 Update docs and tests

* CSPL-4022 Update ns reference for BusConfiguration

* CSPL-4022 Fixing tests and adding bus config to ingestor controller

* CSPL-4022 Fix update behaviour

* CSPL-4022 Docs update

* CSPL-4022 Fix failing tests

* CSPL-4022 Fix tests

* CSPL-4022 Addressing PR comments

* CSPL-4022 Address comments

* CSPL-4022 Fix helm tests

* CSPL-4358 Splitting BusConfiguration into Bus and LargeMessageStore

* CSPL-4358 Update docs

* CSPL-4358 Addressing comments

* CSPL-4358 Adding more validations

* CSPL-4360 Secret reference added for Bus CR

* CSPL-4360 Fix failing tests

* CSPL-4360 Add Splunk restart

* CSPL-4360 Fix failing tests

* CSPL-4360 Fix failing tests

* CSPL-4360 Fix errors with failing validation on status

* CSPL-4358 Rename Bus to Queue

* CSPL-4358 Rename LargeMessageStore to ObjectStorage

* CSPL-4358 Making region authRegion and optional, simplifying endpoint

* CSPL-4360 Fixing tests after merge

* CSPL-4360 Fix validation that fails for status

* CSPL-4360 Fix failing to get k8s secret

* CSPL-4360 Fix failing integ and helm tests

* CSPL-4360 Fixing failing tests due to incorrect secret ref

* CSPL-4360 Addressing comments

* CSPL-4360 Addressing secret value change and removing redundant controllers

* CSPL-4360 Update of docs, helm tests and validations

* CSPL-4360 Add secret watch and fix controller tests

* CSPL-4360 Update docs

* CSPL-4360 Restart Splunk when SA changed

* Addressing comments

* Addressing changes from recent PRs

* Formatting fix

* Addressing PR comments

* Address comments

* Addressing comments

* Fix pipeline issues

* Reverting

* Refactoring according to comments

* Fmt fix

* CSPL-4002 Update Ansible role to ingestor (from standalone) for IngestorCluster (#1606)

* CSPL-4002 Update role for ingestor to ingestor from standalone

* CSPL-4212 Address changes from unit tests from develop branch

* Addressing comments

* Run tests against Splunk 10.2

* Fix

* Address changes from develop

* CSPL-4002 Revert 10.2 changes

---------

Co-authored-by: Igor Grzankowski <igorg@splunk.com>
Base automatically changed from CSPL-3551-ingestion-cr to develop February 20, 2026 15:29
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we pass new parameter here for logger ?

return result, err
}

eventPublisher.Normal(ctx, "QueueConfigUpdated",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

queue configured message is updated before restart

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because it is updated in the .conf file before the restart. Restart just makes it work.

@kasiakoziol kasiakoziol force-pushed the feature/cspl-4513-events-for-index-ingest-sep branch from d540e31 to 14d99b5 Compare February 23, 2026 15:00
kasiakoziol and others added 10 commits February 24, 2026 11:55
* Add sqs_smartubus_cp to providers

* Addressing comments
Fix pre-release bundle target after Helm CRD removal
* Fixes the app.conf within the app_tel_for_sok app which has -e [install] on its first line instead of just [install]

* skipping code coverage for PRs from forks (as the secrets for COVERALLS_TOKEN is not available in these workflow runs for GitHub security reasons)

* adding similar fix due to secret for FOSSA_API_TOKEN not being available

---------

Co-authored-by: Gabriel J Mendoza <gabrielm@splunk.com>
@kasiakoziol kasiakoziol changed the base branch from develop to feature/slog-as-default-logger February 26, 2026 07:07
@github-actions
Copy link
Contributor

github-actions bot commented Feb 26, 2026

CLA Assistant Lite bot:
Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


5 out of 6 committers have signed the CLA.
@kasiakoziol
@Igor-splunk
@gabrielm-splunk
@kubabuczak
@minjieqiu
@Nguyen Duc Trung
NGUYEN Duc Trung seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You can retrigger this bot by commenting recheck in this Pull Request

1 similar comment
@github-actions
Copy link
Contributor

CLA Assistant Lite bot:
Thank you for your submission, we really appreciate it. Like many open-source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution. You can sign the CLA by just posting a Pull Request Comment same as the below format.


I have read the CLA Document and I hereby sign the CLA


5 out of 6 committers have signed the CLA.
@kasiakoziol
@Igor-splunk
@gabrielm-splunk
@kubabuczak
@minjieqiu
@Nguyen Duc Trung
NGUYEN Duc Trung seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You can retrigger this bot by commenting recheck in this Pull Request

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants