Commit Graph

1911 Commits

Author SHA1 Message Date
Mika Ayenson 434b3ffcc0 [FR] Independently package kql / kibana and bump to py3.12 (#3514)
(cherry picked from commit d26981f712)
2024-03-15 01:26:12 +00:00
Mika Ayenson 2af0c64945 [FR] Add support for dataviews in the rule schema (#3510)
(cherry picked from commit 8724077a0e)
2024-03-14 22:48:44 +00:00
Susan 0a729b77a4 Beaconing - Add whitelist to rules, with some more processes (#3497)
* Add whitelist to rules, with some more processes

* Update rules exceptionlist

* Update exceptions

---------

Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit a4ecfe3ccf)
2024-03-14 19:56:12 +00:00
Jonhnathan a08cbc7390 [Rule Tuning] Guided Onboarding Rule (#3502)
* [Rule Tuning] Guided Onboarding Rule

* Update guided_onboarding_sample_rule.toml

* Revert "Update guided_onboarding_sample_rule.toml"

This reverts commit 18721277df7416534440a4708fa3b060f2775a27.

* Update guided_onboarding_sample_rule.toml

* Update guided_onboarding_sample_rule.toml

---------

Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit c610e19114)
2024-03-14 14:04:49 +00:00
Ruben Groenewoud 4fec1a766e [New Rules] mprotect() RWX Binary Execution (#3507)
* [New Rules] mprotect() RWX Binary Execution

* Added rule names

* Update execution_netcon_from_rwx_mem_region_binary.toml

* Update execution_unknown_rwx_mem_region_binary_executed.toml

* Update execution_unknown_rwx_mem_region_binary_executed.toml

* Update execution_netcon_from_rwx_mem_region_binary.toml

* Update execution_netcon_from_rwx_mem_region_binary.toml

(cherry picked from commit 4179180fcb)
2024-03-13 21:18:29 +00:00
Jonhnathan 22ed934946 [Rule Tuning] Improve Compatibility in WIndows Detection Rules - Part 1 (#3501)
* Initial commit

* Date bump

(cherry picked from commit f5254f3b5e)
2024-03-13 13:33:15 +00:00
Ruben Groenewoud 11168606d5 [Tuning] event.action and event.type change (#3495)
Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit 9f8638a004)
2024-03-13 09:16:45 +00:00
Jonhnathan 9101dfc064 [Security Content] Small tweaks on the setup guides (#3308)
* [Security Content] Small tweaks on the setup guides

* Additional Fixes

* Avoid touching deprecated rules

(cherry picked from commit 458e67918a)
2024-03-11 12:15:22 +00:00
Jonhnathan aebe64a42b [Rule Tuning] DR Performance-Poor Rules (#3399)
* [Rule Tuning] DR Performance

* .

* Update rules/cross-platform/lateral_movement_remote_file_creation_in_sensitive_directory.toml

Co-authored-by: Ruben Groenewoud <78494512+Aegrah@users.noreply.github.com>

* Update rules/windows/persistence_registry_uncommon.toml

Co-authored-by: Ruben Groenewoud <78494512+Aegrah@users.noreply.github.com>

* Update lateral_movement_remote_file_creation_in_sensitive_directory.toml

* Update lateral_movement_remote_file_creation_in_sensitive_directory.toml

* Update persistence_startup_folder_scripts.toml

---------

Co-authored-by: Ruben Groenewoud <78494512+Aegrah@users.noreply.github.com>

(cherry picked from commit edf4da8526)
2024-03-11 11:56:05 +00:00
Leandro Maciel 6241e8c7b4 fix: correct the provider for the create, delete and modify routes in EC2 VPCs (#3500)
(cherry picked from commit 709cfddcbe)
2024-03-08 19:07:31 +00:00
Ruben Groenewoud b180502a19 [Tuning] Linux Cross-Platform Tuning - Part 1 (#3468)
* [Tuning] Linux Cross-Platform Tuning - Part 1

* Update defense_evasion_deletion_of_bash_command_line_history.toml

* Update defense_evasion_deletion_of_bash_command_line_history.toml

* Update defense_evasion_deletion_of_bash_command_line_history.toml

* Update defense_evasion_deletion_of_bash_command_line_history.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit a438052ff3)
2024-03-07 17:26:26 +00:00
Ruben Groenewoud 28220d0ccd [Tuning] Linux DR Tuning - Part 12 (#3464)
* [Tuning] Linux DR Tuning - Part 12

* Update persistence_shared_object_creation.toml

* Update privilege_escalation_dac_permissions.toml

* Update privilege_escalation_enlightenment_window_manager.toml

* Update privilege_escalation_enlightenment_window_manager.toml

* Min stack rule-bending test

* formatting fix

* Revert "Merge branch 'linux-dr-tuning-12' of https://github.com/elastic/detection-rules into linux-dr-tuning-12"

This reverts commit 0170cddd905b4b983f8413eebbc11c9c7b3719ce, reversing
changes made to 29d4a747603faf0ac7c2d502786533b0cd93a5d5.

* Revert "Min stack rule-bending test"

This reverts commit 29d4a747603faf0ac7c2d502786533b0cd93a5d5.

* Update privilege_escalation_enlightenment_window_manager.toml

* Update privilege_escalation_chown_chmod_unauthorized_file_read.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 9c4ba4559d)
2024-03-07 17:15:18 +00:00
Ruben Groenewoud a6c223de70 [Tuning] Linux BBR Tuning - Part 1 (#3469)
* [Tuning] Linux BBR Tuning - Part 1

* [Tuning] Linux BBR Tuning - Part 1

* Update defense_evasion_processes_with_trailing_spaces.toml

* Update defense_evasion_processes_with_trailing_spaces.toml

* One more tuning

* Update collection_linux_suspicious_clipboard_activity.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 3fd0358b73)
2024-03-07 16:24:36 +00:00
Ruben Groenewoud 124e8c836c [Tuning] Linux DR Tuning - Part 14 (#3467)
* [Tuning] Linux DR Tuning - Part 14

* Update privilege_escalation_sudo_cve_2019_14287.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit ed4a7fc15b)
2024-03-07 15:51:17 +00:00
Ruben Groenewoud dfaed78e75 [Tuning] Linux DR Tuning - Part 13 (#3465)
* [Tuning] Linux DR Tuning - Part 13

* updated date bump

* Update privilege_escalation_load_and_unload_of_kernel_via_kexec.toml

* Update privilege_escalation_netcon_via_sudo_binary.toml

* Update privilege_escalation_load_and_unload_of_kernel_via_kexec.toml

* Update rules/linux/privilege_escalation_shadow_file_read.toml

Co-authored-by: Jonhnathan <26856693+w0rk3r@users.noreply.github.com>

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>
Co-authored-by: Jonhnathan <26856693+w0rk3r@users.noreply.github.com>

(cherry picked from commit 60fda8d756)
2024-03-07 15:33:51 +00:00
Ruben Groenewoud f9a652ff78 [Tuning] Linux BBR Tuning - Part 2 (#3470)
* [Tuning] Linux BBR Tuning - Part 2

* Update discovery_of_accounts_or_groups_via_builtin_tools.toml

* Update discovery_process_discovery_via_builtin_tools.toml

* Update discovery_hosts_file_access.toml

* Update discovery_system_network_connections.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 7a0967924c)
2024-03-07 11:40:41 +00:00
Ruben Groenewoud 09fe63d18f [Tuning] Linux DR Tuning - Part 11 (#3463)
* [Tuning] Linux DR Tuning - Part 11

* Update persistence_message_of_the_day_creation.toml

* Update persistence_message_of_the_day_execution.toml

* Update rules/linux/persistence_message_of_the_day_execution.toml

* Update persistence_linux_user_added_to_privileged_group.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit ef66c57030)
2024-03-07 11:26:39 +00:00
Ruben Groenewoud 68cfb3dfde [Tuning] Linux DR Tuning - Part 10 (#3462)
* [Tuning] Linux DR Tuning - Part 10

* updated_date bump

* Update persistence_kworker_file_creation.toml

* Update persistence_linux_backdoor_user_creation.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit a76a3755d9)
2024-03-07 10:50:21 +00:00
Ruben Groenewoud 6141bc3dd7 [Tuning] Linux DR Tuning - Part 9 (#3461)
* [Tuning] Linux DR Tuning - Part 9

* Update persistence_credential_access_modify_ssh_binaries.toml

* Update lateral_movement_ssh_it_worm_download.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit fd84573212)
2024-03-07 10:39:28 +00:00
Ruben Groenewoud f209923155 [Tuning] Linux DR Tuning - Part 8 (#3460)
* [Tuning] Linux DR Tuning - Part 8

* Update impact_esxi_process_kill.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 08f946b394)
2024-03-07 10:06:27 +00:00
Ruben Groenewoud e44b8a7768 [Tuning] Linux DR Tuning - Part 7 (#3458)
* [Tuning] Linux DR Tuning - Part 7

* Update execution_potential_hack_tool_executed.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit c537fb9c22)
2024-03-07 09:52:07 +00:00
Ruben Groenewoud 472ca216d3 [Tuning] Linux DR Tuning - Part 6 (#3457)
* [Tuning] Linux DR Tuning - Part 6

* Update discovery_ping_sweep_detected.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit f37a3bfd48)
2024-03-07 09:14:25 +00:00
Ruben Groenewoud d28bd2abef [Tuning] Linux DR Tuning - Part 5 (#3456)
* [Tuning] Linux DR Tuning - Part 6

* Update discovery_dynamic_linker_via_od.toml

* Update discovery_esxi_software_via_find.toml

* Update discovery_esxi_software_via_grep.toml

* Update discovery_linux_hping_activity.toml

* Update discovery_linux_nping_activity.toml

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit ae3f4737ab)
2024-03-07 08:59:38 +00:00
github-actions[bot] 59812dac4e Lock versions for releases: 8.3,8.4,8.5,8.6,8.7,8.8,8.9,8.10,8.11,8.12,8.13 (#3491)
(cherry picked from commit bf3932f384)
2024-03-06 17:45:52 +00:00
shashank-elastic 7043173371 Prepare For Next Elastic Stack Minor Release (#3490)
Removed changes from:
- detection_rules/etc/packages.yml

(selectively cherry picked from commit a4094df732)
2024-03-06 16:03:19 +00:00
Ruben Groenewoud 2f18b54ac8 [Tuning] Auditbeat event.action Compatibility (#3471)
Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 83abf8d42c)
2024-03-06 14:34:12 +00:00
Ruben Groenewoud e6db511ac7 [BBR Promotion] Linux BBR --> DR Promotion (#3472)
* [BBR Promotion] Linux BBR --> DR Promotion

* [BBR Promotion] Linux BBR --> DR Promotion

---------

Co-authored-by: Colson Wilhoit <48036388+DefSecSentinel@users.noreply.github.com>

(cherry picked from commit 5a80423003)
2024-03-06 13:55:08 +00:00
Terrance DeJesus f8a7fe9cec [Bug] Fix URL links in autogenerated security docs (#3474)
* added content() class method for guide and setup

* removed non-existent variable

* removed unnecessary newlines

* adjusted levels for titles

* reverting changes

* added method to convert markdown links to asciidoc

* adjusted regex to include trailing periods

* fixing linting errors

* adjusted regex pattern

* added content() class method for guide and setup

* stripped # out of investigation guide, setup or note

* adjusted formatting outcome

* changed function call

* fixed linting errors

* fixing auto-formatting for rule asciidoc

* fixing URL link removal

* fixing URL link removal

* removed strip() from string for setup

* fixed linting errors

* fixed linting errors

* adjusting code formatting for convert_markdown_to_asciidoc

(cherry picked from commit 8e0ca421ca)
2024-02-23 21:55:30 +00:00
Mika Ayenson 2312455d7a [FR] Skip eql optimizations on parsing query for unique fields (#3443)
(cherry picked from commit 542053719b)
2024-02-21 02:31:01 +00:00
github-actions[bot] c772b2a842 Lock versions for releases: 8.3,8.4,8.5,8.6,8.7,8.8,8.9,8.10,8.11,8.12 (#3459)
(cherry picked from commit 7815d23110)
2024-02-20 17:32:25 +00:00
sbousseaden fb835e396d [Tuning] Tuning Windows - 3 Rules (#3388)
* Update privilege_escalation_newcreds_logon_rare_process.toml

* Update privilege_escalation_make_token_local.toml

* Update privilege_escalation_make_token_local.toml

* Update privilege_escalation_create_process_with_token_unpriv.toml

---------

Co-authored-by: Jonhnathan <26856693+w0rk3r@users.noreply.github.com>
Co-authored-by: Samirbous <64742097+Samirbous@users.noreply.github.com>
Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit 853e18950f)
2024-02-20 16:01:52 +00:00
Ruben Groenewoud 7adff8ebd2 [Tuning] Linux DR Tuning - Part 4 (#3455)
* [Tuning] Linux DR Tuning - Part 4

* Update defense_evasion_file_mod_writable_dir.toml

* Update defense_evasion_hidden_file_dir_tmp.toml

(cherry picked from commit 089e6671aa)
2024-02-20 14:44:07 +00:00
Ruben Groenewoud 24eea0e1e5 [Tuning] Event.dataset removal & Tag Addition (#3451)
* [Tuning] Removed event.dataset and added tag

* [Tuning] Removed event.dataset and added tag

* fixed typo

---------

Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit 3484cac7eb)
2024-02-20 14:23:44 +00:00
Ruben Groenewoud 5af7ec1a4b [Tuning] Linux DR Tuning - Part 3 (#3454)
(cherry picked from commit 5e6e4a359b)
2024-02-20 13:56:14 +00:00
Ruben Groenewoud d09d0b0609 [Tuning] Linux DR Tuning - Part 1 (#3452)
* [Tuning] Linux DR Tuning - Part 1

* Update command_and_control_linux_tunneling_and_port_forwarding.toml

* Update command_and_control_cat_network_activity.toml

(cherry picked from commit 1dc7fd6a42)
2024-02-20 13:44:07 +00:00
Ruben Groenewoud 5b8b6c4450 [Tuning] Linux DR Tuning - Part 2 (#3453)
* [Tuning] Linux DR Tuning - Part 2

* Update defense_evasion_binary_copied_to_suspicious_directory.toml

* Update defense_evasion_base16_or_base32_encoding_or_decoding_activity.toml

(cherry picked from commit 0e48747aa6)
2024-02-20 13:22:50 +00:00
Ruben Groenewoud 984f2a6fbf [FR] NON_DATASET_PACKAGE list & Data Source tag for Auditd_manager (#3430)
* [FR] Add Auditd_Manager to NON_DATASET_PACKAGE

* Changed alphabetical order

---------

Co-authored-by: Mika Ayenson <Mikaayenson@users.noreply.github.com>
Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit a637bcec38)
2024-02-19 08:42:19 +00:00
Samirbous 144754c8a5 [New] Suspicious Execution from INET Cache (#3445)
* Create initial_access_execution_from_inetcache.toml

* Update initial_access_execution_from_inetcache.toml

(cherry picked from commit 4809de6584)
2024-02-15 19:19:30 +00:00
Jonhnathan 9c265abb41 [Rule Tuning] Windows BBR Tuning - 3 (#3382)
* [Rule Tuning] Windows BBR Tuning - 3

* Update defense_evasion_service_disabled_registry.toml

---------

Co-authored-by: Samirbous <64742097+Samirbous@users.noreply.github.com>

(cherry picked from commit 5334601b6f)
2024-02-14 18:06:02 +00:00
Jonhnathan 7758575430 [Rule Tuning] Windows BBR Tuning - 4 (#3384)
* [Rule Tuning] Windows BBR Tuning - 4

* Update discovery_system_time_discovery.toml

(cherry picked from commit 1a8271db2f)
2024-02-14 17:26:31 +00:00
Jonhnathan ba92fb7fde [Rule Tuning] Windows BBR Tuning - 6 (#3386)
Co-authored-by: Samirbous <64742097+Samirbous@users.noreply.github.com>

(cherry picked from commit f233909e7d)
2024-02-14 15:54:44 +00:00
Jonhnathan a864d77e0a [Rule Tuning] Windows BBR Tuning - 5 (#3385)
Co-authored-by: Samirbous <64742097+Samirbous@users.noreply.github.com>

(cherry picked from commit 97e49795ab)
2024-02-14 13:28:21 +00:00
Jonhnathan 0c0a5bdaad [Rule Tuning] Windows BBR Tuning - 2 (#3381)
* [Rule Tuning] Windows BBR Tuning - 2

* Update defense_evasion_masquerading_windows_system32_exe.toml

---------

Co-authored-by: Ruben Groenewoud <78494512+Aegrah@users.noreply.github.com>

(cherry picked from commit ae00f30574)
2024-02-14 13:03:47 +00:00
Mika Ayenson 1f418fa9e5 [FR] Add New Kibana Schema Issue Template (#3441)
(cherry picked from commit df6dd09db4)
2024-02-13 22:41:12 +00:00
Mika Ayenson bde05d63c6 [FR] Add support for Threshold Alert Suppression (#3433)
(cherry picked from commit c3ca01ebcc)
2024-02-12 16:01:10 +00:00
Terrance DeJesus 00fe4c8283 [Bug] Adjust build-release CLI and fix links when generating security docs (#3434)
* removed historical argument; added setup string; fixed links

* fixing flake errors

* added types for command arguments

* adjusted get_release_diff to append strings for release tags

* set fetch-depth to 0 for integrations checkout in workflow

* changed the name of the workflow

* removed TODOs

* adjusted release docs workflow to remove prefix for release tags

* adjusted URL replacement only if pointed to docs site

* added elastic website to regex pattern

* add docstrings; adjusted regex; add note for stopgap

* added a note about the regex pattern for elastic URLs

(cherry picked from commit 06b97ec79b)
2024-02-12 15:13:42 +00:00
Justin Ibarra 934edfd618 Add the Zen of Security Rules to philosophy (#3437)
(cherry picked from commit 298d1bce0d)
2024-02-09 19:52:03 +00:00
Jonhnathan 4ac56fbd40 [Rule Tuning] Suspicious Antimalware Scan Interface DLL (#3432)
Co-authored-by: Ruben Groenewoud <78494512+Aegrah@users.noreply.github.com>

(cherry picked from commit 21b559c97f)
2024-02-08 09:32:22 +00:00
github-actions[bot] 10d36f6872 Lock versions for releases: 8.3,8.4,8.5,8.6,8.7,8.8,8.9,8.10,8.11,8.12 (#3431)
* Locked versions for releases: 8.3,8.4,8.5,8.6,8.7,8.8,8.9,8.10,8.11,8.12

* Update detection_rules/etc/version.lock.json

* updated downloadable updates file to reconcile changes

* Removed spacing from downloadable updates file

---------

Co-authored-by: terrancedejesus <terrancedejesus@users.noreply.github.com>
Co-authored-by: Terrance DeJesus <99630311+terrancedejesus@users.noreply.github.com>

(cherry picked from commit 827dfa7327)
2024-02-06 19:54:15 +00:00
Terrance DeJesus 7201490af1 [Bug] Update Prebuilt Detection Rules Release Process (#3403)
* release fleet workflow updates; build package integration reference changes

* updated commit hash extraction to output to env

* adjusted bump-pkg-versions to only include release if necessary

* fixed flake errors

* add historical argument for build-release set to yes by default

* Update detection_rules/devtools.py

* fixed fleet workflow; updated registry data references

* updated job names

* removed extract commit hash job and consolidated into fleet pr job

* added echo statement for current branch before checkout

* removed id from extract commit hash

(cherry picked from commit 7df7ab5101)
2024-02-06 14:04:40 +00:00