azure-container-networking/npm/metrics
Hunter Gregory ebddca18bd
perf: [NPM] [LINUX] add NetPols in background (#1969)
* wip: apply dirty NetPols every 500ms in Linux

* only build npm linux image

* fix: check for empty cache

* feat: toggle for netpol interval. default 500 ms

* ci: remove stages "build binaries" and "run windows tests"

* wip: max batched netpols (toggle-specified)

* ci: remove manifest build/push for win npm

* wip: handle ipset deletion properly and max batch for delete too

* fix: correct remove policy

* fix: only remove policy if it was in kernel

* finalize toggles, allowing ability to turn off iptablesInBackground

* ci: conf + cyc use PR's configmaps

* fix: lints

* fix dp toggle: iptablesInBackground

* fix lock typo and config logging

* fix background thread. add comments. only add tmp ref when enabled

* copy pod selector list

* fix: removepolicy needs namespace too

* rename opInfo to event

* fix: fix references and prevent concurrent map read/write

* tmp: debug logging

* fix: missing set references by swap keys and values

* Revert "tmp: debug logging"

This reverts commit 70ed34c714ea4a6d009a1fe90a7168be4bedd5bf.

* fix: add podSelectorList to fake NetPol

* log: do not print error when failing to delete non-existent nft rule

* log: verbose iptables bootup

* log: use fmt.Errorf for clean logging

* log: never return error for iptables in background and fix some lints

* fix: activate/deactivate azure chain rules

* fix: correctly decrement netpols in kernel

* ci: run UTs again

* ci: update profiles. default to placefirst=false

* address comment: rename batch to pendingPolicy

* refactor: make dirty cache  OS-specific

* test: UTs

* test: put UT cfg back to placefirst to not break things

* ci: update cyclonus workflows

* fmt: address comment & lint

* fmt: rename numInKernel to policiesInKernel

* log: switch to fmt.Errorf

* fmt: whitespace

* feat: resiliency to errors while reconciling dirty netpols

* log: temporarily print everything for ipset restore

* fix: remove nomatch from ipset -D for cidr blocks

* test: UTs for non-happy path

* test: fix hns fake

* fix: don't change windows. let it delete ipsets when removing policies

* fix windows lint

* fix: ignore chain doesn't exist errors for iptables -D

* feat: latency and failure metrics

* test: update exit code for UT

* metrics: new metrics should go in node-metrics path

* style: simplify nesting

* style: move identical windows & linux code to shared file

* ci: remove v1 conformance and cyclonus

* feat: add NetPols in background from the DP (revert background code in pMgr)

* style: remove "background" from iptables metrics

* revert changes in ipsetmanager, const.go, and dp.Remove/UpdatePolicy

* style: whitespace

* perf: use len() instead of creating slice from map

* remove verbosity for iptables bootup

* build: add return statement

* style: whitespace

* build: fix variable shadowing

* build: fix more import shadowing

* build: windows pointer issue and UT issue

* test: fix UT for iptables error code 2

* ci: enable linux scale test

* ci: revert to master pipeline.yaml

* revert changes to chain-management. do changes in PR #2012

* log: change wording

* test: UTs for netpol in background

* log: wording

* feat: apply ipsets for each netpol individually

* config: rearrange ConfigMap & update capz yaml

* fix: windows bootup phase logic for addpolicy

* feat: restrict netpol in background to linux + nftables

* test: skip nftables check for UT

* style: netpols[0] instead of loop

* log: address log comments

* style: lint for long line

---------

Co-authored-by: Vamsi Kalapala <vakr@microsoft.com>
2023-07-19 09:13:52 -07:00
..
promutil
acl_rules.go feat: [WIN-NPM] metrics for latencies and failures (#1959) 2023-06-05 12:43:39 -07:00
acl_rules_linux.go perf: [NPM] [LINUX] add NetPols in background (#1969) 2023-07-19 09:13:52 -07:00
acl_rules_linux_test.go perf: [NPM] [LINUX] add NetPols in background (#1969) 2023-07-19 09:13:52 -07:00
acl_rules_test.go feat: [NPM] num ACL rules for v2 & update existing metrics (#1223) 2022-02-09 20:38:46 -08:00
acls_windows.go fix: [WIN-NPM] fix units of new latency metrics (#2018) 2023-06-16 23:22:27 +00:00
acls_windows_test.go feat: [WIN-NPM] metrics for latencies and failures (#1959) 2023-06-05 12:43:39 -07:00
ai-utils.go fix: [NPM-LINUX] resiliency for several non-retriable errors (#1566) 2022-11-23 10:38:21 -08:00
endpoints_windows.go fix: [WIN-NPM] fix units of new latency metrics (#2018) 2023-06-16 23:22:27 +00:00
endpoints_windows_test.go feat: [WIN-NPM] metrics for latencies and failures (#1959) 2023-06-05 12:43:39 -07:00
ipsets.go feat: [NPM] metric for total Pod IPs (#1999) 2023-06-09 09:59:27 -07:00
ipsets_test.go feat: [NPM] metric for total Pod IPs (#1999) 2023-06-09 09:59:27 -07:00
namespaces.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
namespaces_test.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
pods.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
pods_test.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
policies.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
policies_test.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
prometheus-metrics.go perf: [NPM] [LINUX] add NetPols in background (#1969) 2023-07-19 09:13:52 -07:00
prometheus-server-alternative-scrape-config.yaml
prometheus-server-scrape-config.yaml
prometheus-values.go perf: [NPM] [LINUX] add NetPols in background (#1969) 2023-07-19 09:13:52 -07:00
prometheus_metrics_test.go feat: [NPM] perf metrics for pod/ns/policy CRUD (#1220) 2022-02-09 15:27:35 -08:00
prometheus_test.go feat: [WIN-NPM] metrics for latencies and failures (#1959) 2023-06-05 12:43:39 -07:00
setpolicies_windows.go fix: [WIN-NPM] fix units of new latency metrics (#2018) 2023-06-16 23:22:27 +00:00
setpolicies_windows_test.go feat: [WIN-NPM] metrics for latencies and failures (#1959) 2023-06-05 12:43:39 -07:00
timer.go fix: [WIN-NPM] fix units of new latency metrics (#2018) 2023-06-16 23:22:27 +00:00
timer_test.go fix: [WIN-NPM] fix units of new latency metrics (#2018) 2023-06-16 23:22:27 +00:00