Commit Graph

1176 Commits (589b589b53e56af38de25db9b56967bdf1f2c069)

Author SHA1 Message Date
Mitchell Hashimoto 0d6dcbd2f1 agent: disallow API registration with managed proxy if not enabled
7 years ago
Mitchell Hashimoto f7fc026e18 agent/config: AllowManagedAPIRegistration
7 years ago
Mitchell Hashimoto ed98d65c2b agent/proxy: AllowRoot to disable executing managed proxies when root
7 years ago
Mitchell Hashimoto 5ae32837f7 agent/proxy: set the proper arguments so we only run the helper process
7 years ago
Mitchell Hashimoto 4897ca6545 agent/config: add AllowManagedRoot
7 years ago
Kyle Havlovitz 82a4b3c13f connect: fix two CA tests that were broken in a previous PR (#60)
7 years ago
Paul Banks 41a29a469e Fix roots race with CA setup hammering bug and defensive nil check hit during obscure upgrade scenario
7 years ago
Kyle Havlovitz aafa3ca64a agent: format all CA config fields
7 years ago
Kyle Havlovitz edbeeeb23c agent: update accepted CA config fields and defaults
7 years ago
Mitchell Hashimoto 316bdbe010 agent/proxy: fix build on Windows
7 years ago
Paul Banks 0824d1df5f Misc comment cleanups
7 years ago
Paul Banks e57aa52ca6 Warn about killing proxies in dev mode
7 years ago
Mitchell Hashimoto 028aa78e83 agent/consul: set precedence value on struct itself
7 years ago
Mitchell Hashimoto 927b45bf91 agent/config: move ports to `ports` structure, update docs
7 years ago
Paul Banks d1c67d90bc Fixs a few issues that stopped this working in real life but not caught by tests:
7 years ago
Paul Banks 85d6502ab3 Don't kill proxies on agent shutdown; backport manager close fix
7 years ago
Paul Banks b2ff583392 Test for adopted process Stop race and fix
7 years ago
Mitchell Hashimoto 62d4aaa33e agent: accept connect param for execute
7 years ago
Mitchell Hashimoto daf46c9cfa agent/consul: support a Connect option on prepared query request
7 years ago
Mitchell Hashimoto 440b1b2d97 agent/consul: prepared query supports "Connect" field
7 years ago
Mitchell Hashimoto 8bcadddda7 agent: intention create returns 500 for bad body
7 years ago
Mitchell Hashimoto 1830c6b308 agent: switch ConnectNative to an embedded struct
7 years ago
Paul Banks df2cb30b01 Make tests pass and clean proxy persistence. No detached child changes yet.
7 years ago
Paul Banks cdc7cfaa36 Abandon daemonize for simpler solution (preserving history):
7 years ago
Paul Banks a2fe604191 WIP
7 years ago
Paul Banks 8cf4b3a6eb Sanity check that we are never trying to self-exec a test binary. Add daemonize bypass for TestAgent so that we don't have to jump through ridiculous self-execution hooks for every package that might possibly invoke a managed proxy
7 years ago
Mitchell Hashimoto 827b671d4a agent/proxy: Manager.Close also has to stop all proxy watchers
7 years ago
Paul Banks ef9c40643e Fix import tooling fail
7 years ago
Paul Banks ba0fb58a72 Make daemoinze an option on test binary without hacks. Misc fixes for racey or broken tests. Still failing on several though.
7 years ago
Paul Banks 2b377dc624 Run daemon processes as a detached child.
7 years ago
Paul Banks e21723a891 Persist proxy state through agent restart
7 years ago
Mitchell Hashimoto eb3fcb39b3 agent/consul/state: support querying by Connect native
7 years ago
Mitchell Hashimoto 6b745964c4 agent/cache: update comment from PR review to clarify
7 years ago
Mitchell Hashimoto 424272361d agent: agent service registration supports Connect native services
7 years ago
Mitchell Hashimoto d6a823ad0d agent/consul: support catalog registration with Connect native
7 years ago
Mitchell Hashimoto d609ad216b agent/cache: update comments
7 years ago
Mitchell Hashimoto 839d3c323d agent/cache: correct test name
7 years ago
Mitchell Hashimoto 45e49f31de agent/cache: change behavior to return error rather than retry
7 years ago
Mitchell Hashimoto 311d503fb0 agent/cache: perform backoffs on error retries on blocking queries
7 years ago
Matt Keeler 3afa4f9c7e
Merge pull request #4234 from hashicorp/feature/default-new-ui
7 years ago
Matt Keeler af910bda39
Merge pull request #4216 from hashicorp/rpc-limiting
7 years ago
Matt Keeler 0d4e8676d1
Merge pull request #4215 from hashicorp/feature/config-node-meta-dns-txt
7 years ago
Matt Keeler 7f7c703118 Update the runtime tests
7 years ago
Matt Keeler 8216816e3f Make filtering out TXT RRs only apply when they would end up in Additional section
7 years ago
Matt Keeler 197e2f69d5 Switch over to defaulting to the new UI
7 years ago
Kyle Havlovitz ab4a9a94f4
Re-use uint8ToString
7 years ago
Kyle Havlovitz 5683d628c4
Support giving the duration as a string in CA config
7 years ago
Mitchell Hashimoto eb2a6952ba
address comment feedback
7 years ago
Mitchell Hashimoto cd39f09693
agent: leaf endpoint accepts name, not service ID
7 years ago
Mitchell Hashimoto 1906fe1c0d
agent: address feedback
7 years ago
Mitchell Hashimoto 0accfc1628
agent: rename test to check
7 years ago
Mitchell Hashimoto d1c21a8629
agent: implement HTTP endpoint
7 years ago
Mitchell Hashimoto 2a29679e9d
agent/consul: forward request if necessary
7 years ago
Mitchell Hashimoto 54ac5adb08
agent: comments to point to differing logic
7 years ago
Mitchell Hashimoto d68462fca6
agent/consul: implement Intention.Test endpoint
7 years ago
Paul Banks a80559e439
Make invalid clusterID be fatal
7 years ago
Paul Banks 140f3f5a44
Fix logical conflicts with CA refactor
7 years ago
Paul Banks c58d47ba59
Fix broken api test for service Meta (logical conflict rom OSS). Add test that would make this much easier to catch in future.
7 years ago
Paul Banks f4b8e8c96d
Add default CA config back - I didn't add it and causes nil panics
7 years ago
Paul Banks 1228a5839a
Ooops remove the CA stuff from actual server defaults and make it test server only
7 years ago
Paul Banks 4aeab3897c
Fixed many tests after rebase. Some still failing and seem unrelated to any connect changes.
7 years ago
Paul Banks bc07ff4983
Comment cleanup
7 years ago
Paul Banks 1722734313
Verify trust domain on /authorize calls
7 years ago
Paul Banks b4803eca59
Generate CSR using real trust-domain
7 years ago
Paul Banks 622a475eb1
Add CSR signing verification of service ACL, trust domain and datacenter.
7 years ago
Paul Banks c1f2025d96
Return TrustDomain from CARoots RPC
7 years ago
Kyle Havlovitz e00088e8ee
Rename some of the CA structs/files
7 years ago
Kyle Havlovitz 6e9f1f8acb
Add more metadata to structs.CARoot
7 years ago
Kyle Havlovitz 627aa80d5a
Use provider state table for a global serial index
7 years ago
Kyle Havlovitz 988510f53c
Add test for ca config http endpoint
7 years ago
Kyle Havlovitz de72834b8c
Move connect CA provider to separate package
7 years ago
Mitchell Hashimoto 4f3b5647e5
agent/cache: change uint8 to uint
7 years ago
Mitchell Hashimoto fc5508f8a3
agent/cache: string through attempt rather than storing on the entry
7 years ago
Mitchell Hashimoto cfcd733609
agent/cache: implement refresh backoff
7 years ago
Mitchell Hashimoto bc605a1576
agent/consul: change provider wait from goto to a loop
7 years ago
Mitchell Hashimoto c8b65217c3
agent/consul: check nil on getCAProvider result
7 years ago
Mitchell Hashimoto 9b3495dddb
agent/consul: retry reading provider a few times
7 years ago
Mitchell Hashimoto e54e69d11f
agent: verify local proxy tokens for CA leaf + tests
7 years ago
Mitchell Hashimoto a099c27b07
agent: verify proxy token for ProxyConfig endpoint + tests
7 years ago
Mitchell Hashimoto 6e386ba6be
agent/proxy: pass proxy ID as an env var
7 years ago
Mitchell Hashimoto 37dde6d64a
agent/config: add managed proxy upstreams config to skip
7 years ago
Mitchell Hashimoto 965a902474
agent/structs: validate service definitions, port required for proxy
7 years ago
Mitchell Hashimoto 9a62bce03b
agent/config: default connect enabled in dev mode
7 years ago
Paul Banks d13be6b952
Make CSR work with jank domain
7 years ago
Mitchell Hashimoto de3f49a880
agent/proxy: delete pid file on Stop
7 years ago
Mitchell Hashimoto aaca1fbcf5
agent: increase timer for blocking cache endpoints
7 years ago
Mitchell Hashimoto b4ba31c61b
agent/proxy: address PR feedback
7 years ago
Mitchell Hashimoto f5e7993249
agent: clarify why we Kill still
7 years ago
Mitchell Hashimoto 2809203408
agent: restore proxy snapshot but still Kill proxies
7 years ago
Mitchell Hashimoto 718aabe35f
agent/proxy: check if process is alive in addition to Wait
7 years ago
Mitchell Hashimoto f5ccc65295
agent: only set the proxy manager data dir if its set
7 years ago
Mitchell Hashimoto 1a32435a4d
agent/proxy: improve comments on snapshotting
7 years ago
Mitchell Hashimoto e0bbe66427
agent/proxy: implement periodic snapshotting in the manager
7 years ago
Mitchell Hashimoto 13ff115436
agent/proxy: check if process is alive
7 years ago
Mitchell Hashimoto 0e8c0b7b48
agent/proxy: implement snapshotting for daemons
7 years ago
Mitchell Hashimoto b7580f4fad
agent/proxy: manager configures the daemon pid path to write pids
7 years ago
Mitchell Hashimoto 1e7f253b53
agent/proxy: write pid file whenever the daemon process changes
7 years ago
Mitchell Hashimoto 09dcb0be98
agent/proxy: change LogDir to DataDir to reuse for other things
7 years ago
Mitchell Hashimoto 5e6bd8291c
agent/proxy: make the logs test a bit more robust by waiting for file
7 years ago
Mitchell Hashimoto d00ff7cb58
agent/proxy: don't create the directory in newProxy
7 years ago
Mitchell Hashimoto 6cdacd1fd9
agent/proxy: send logs to the correct location for daemon proxies
7 years ago
Mitchell Hashimoto ba00fa3548
agent: add additional tests for defaulting in AddProxy
7 years ago
Mitchell Hashimoto 171bf8d599
agent: clean up defaulting of proxy configuration
7 years ago
Mitchell Hashimoto 3d3eee2f6e
agent: resolve some conflicts and fix tests
7 years ago
Mitchell Hashimoto d9bd4ffebd
agent/local: clarify the non-risk of a full buffer
7 years ago
Mitchell Hashimoto 437689e83c
agent/local: remove outdated comment
7 years ago
Mitchell Hashimoto 6ae95d754c
agent: use os.Executable
7 years ago
Mitchell Hashimoto 39974df52a
agent/proxy: local state event coalescing
7 years ago
Mitchell Hashimoto b0f377b519
agent/proxy: implement force kill of unresponsive proxy process
7 years ago
Mitchell Hashimoto 6539280f2a
agent: fix crash that could happen if proxy was nil on load
7 years ago
Mitchell Hashimoto 420edc4c1e
agent/proxy: pull exit status extraction to constrained file
7 years ago
Mitchell Hashimoto 1a2b28602c
agent: start proxy manager
7 years ago
Mitchell Hashimoto 7879e1d2ef
agent/proxy: detect config change to stop/start proxies
7 years ago
Mitchell Hashimoto 2d60684a8b
agent/proxy: test removing proxies and stopping them
7 years ago
Mitchell Hashimoto fcd2ab2338
agent/proxy: manager and basic tests, not great coverage yet coming soon
7 years ago
Mitchell Hashimoto 2bd39a84a6
agent/local: add Notify mechanism for proxy changes
7 years ago
Mitchell Hashimoto 476ea7b04a
agent: start/stop proxies
7 years ago
Mitchell Hashimoto fbfc6fce66
agent/proxy: clean up usage, can't be restarted
7 years ago
Mitchell Hashimoto aaa2431350
agent: change connect command paths to be slices, not strings
7 years ago
Mitchell Hashimoto 7355a614fe
agent/local: store proxy on local state, wip, not working yet
7 years ago
Mitchell Hashimoto ffd284de36
agent/proxy: exponential backoff on restarts
7 years ago
Mitchell Hashimoto aa08a4cb46
agent/proxy: Daemon works, tests cover it too
7 years ago
Mitchell Hashimoto e14fa850d8
wip
7 years ago
Paul Banks e0e12e165b
TLS watching integrated into Service with some basic tests.
7 years ago
Paul Banks 90c574ebaa
Wire up agent leaf endpoint to cache framework to support blocking.
7 years ago
Kyle Havlovitz a4d18f0eaa
Fill out connect CA rpc endpoint tests
7 years ago
Kyle Havlovitz b081c34255
Fix config tests
7 years ago
Kyle Havlovitz cce7f1cca1
Add tests for the built in CA's state store table
7 years ago
Kyle Havlovitz 15fbc2fd97
Add more tests for built-in provider
7 years ago
Kyle Havlovitz edcfdb37af
Fix some inconsistencies around the CA provider code
7 years ago
Paul Banks 1b197d934a
Don't allow connect watches in agent/cli yet
7 years ago
Paul Banks e8c510332c
Support legacy watch.HandlerFunc type for backward compat reduces impact of change
7 years ago
Paul Banks cd88b2a351
Basic `watch` support for connect proxy config and certificate endpoints.
7 years ago
Kyle Havlovitz daa8dd1779
Add CA config to connect section of agent config
7 years ago
Kyle Havlovitz 32d1eae28b
Move ConsulCAProviderConfig into structs package
7 years ago
Kyle Havlovitz 315b8bf594
Simplify the CAProvider.Sign method
7 years ago
Kyle Havlovitz c6e1b72ccb
Simplify the CA provider interface by moving some logic out
7 years ago
Kyle Havlovitz a325388939
Clarify some comments and names around CA bootstrapping
7 years ago
Mitchell Hashimoto 8c1d5a2cdc
agent: resolve flaky test by checking cache hits increase, rather than
7 years ago
Mitchell Hashimoto 051f004683
agent: use helper/retry instead of timing related tests
7 years ago
Mitchell Hashimoto bd3b8e042a
agent/cache: address PR feedback, lots of typos
7 years ago
Mitchell Hashimoto 02b20a0353
agent/cache: address feedback, clarify comments
7 years ago
Mitchell Hashimoto af1d70b026
agent/cache: don't every block on NotifyCh
7 years ago
Mitchell Hashimoto 724b829104
agent/cache: unit tests for ExpiryHeap, found a bug!
7 years ago
Mitchell Hashimoto 194b256861
agent/cache: send the total entries count on eviction to go-metrics
7 years ago
Mitchell Hashimoto e0d964188c
agent/cache: make edge case with prev/next idx == 0 handled better
7 years ago
Mitchell Hashimoto 3b550d2b72
agent/cache: rework how expiry data is stored to be more efficient
7 years ago
Mitchell Hashimoto 595193a781
agent/cache: initial TTL work
7 years ago
Mitchell Hashimoto 1df99514ca
agent/cache: send the RefreshTimeout into the backend fetch
7 years ago
Mitchell Hashimoto db4c47df27
agent/cache: on error, return from Get immediately, don't block forever
7 years ago
Mitchell Hashimoto cc2c98f961
agent/cache: lots of comment/doc updates
7 years ago
Mitchell Hashimoto 6c01e402e0
agent: augment /v1/connect/authorize to cache intentions
7 years ago
Mitchell Hashimoto 0f3f3d13ca
agent/cache-types: support intention match queries
7 years ago
Mitchell Hashimoto e1c1b8812a
agent/cache: return the error as part of Get
7 years ago
Mitchell Hashimoto 00e7ab3cd5
agent/cache: integrate go-metrics so the cache is debuggable
7 years ago
Mitchell Hashimoto 9f3dbf7b2a
agent/structs: DCSpecificRequest sets all the proper fields for
7 years ago
Mitchell Hashimoto be873d2558
agent/cache-types/ca-leaf: proper result for timeout, race on setting CA
7 years ago
Mitchell Hashimoto fcb15e15ae
agent/cache: support timeouts for cache reads and empty fetch results
7 years ago
Mitchell Hashimoto e81942df7a
agent/cache-types: rename to separate root and leaf cache types
7 years ago
Mitchell Hashimoto 8e7c517db1
agent/cache-types: got basic CA leaf caching work, major problems still
7 years ago
Mitchell Hashimoto 917a9e63d5
agent: check cache hit count to verify CA root caching, background update
7 years ago
Mitchell Hashimoto 6902d721d6
agent: initialize the cache and cache the CA roots
7 years ago
Mitchell Hashimoto c329b4cb34
agent/cache: partition by DC/ACL token
7 years ago
Mitchell Hashimoto e3c1162881
agent/cache: Reorganize some files, RequestInfo struct, prepare for partitioning
7 years ago
Mitchell Hashimoto b0db5657c4
agent/cache: ConnectCA roots caching type
7 years ago
Mitchell Hashimoto 975be337a9
agent/cache: blank cache key means to always fetch
7 years ago
Mitchell Hashimoto 1cfb0f1922
agent/cache: initial kind-of working cache
7 years ago
Kyle Havlovitz 33418afd3c
Add cross-signing mechanism to root rotation
7 years ago
Kyle Havlovitz d83fbfc766
Add the root rotation mechanism to the CA config endpoint
7 years ago
Kyle Havlovitz f9d92d795e
Have the built in CA store its state in raft
7 years ago
Kyle Havlovitz 30c1973e8b
Fix the testing endpoint's root set op
7 years ago
Kyle Havlovitz 75f62e3117
Update the CA config endpoint to enable GETs
7 years ago
Kyle Havlovitz ab737ef0f8
Hook the CA RPC endpoint into the provider interface
7 years ago
Kyle Havlovitz 1f6501895f
Add CA bootstrapping on establishing leadership
7 years ago
Kyle Havlovitz 682f105c7c
Add the bootstrap config for the CA
7 years ago
Kyle Havlovitz 9fc33d2a62
Add the CA provider interface and built-in provider
7 years ago
Kyle Havlovitz 1787f88618
Add CA config set to fsm operations
7 years ago
Kyle Havlovitz 6b3416e480
Add the Connect CA config to the state store
7 years ago
Paul Banks 36dbd878c9
Adds `api` client code and tests for new Proxy Config endpoint, registering with proxy and seeing proxy config in /agent/services list.
7 years ago
Paul Banks 730da74369
Fix various test failures and vet warnings.
7 years ago
Paul Banks 1e72ad66f5
Refactor localBlockingQuery to use memdb.WatchSet. Much simpler and correct as a bonus!
7 years ago
Paul Banks 8d09381b96
Super ugly hack to get TeamCity build to work for this PR without adding a vendor that is being added elsewhere and will conflict...
7 years ago
Paul Banks d73f079d0f
Add X-Consul-ContentHash header; implement removing all proxies; add load/unload test.
7 years ago
Paul Banks 2a69663448
Agent Connect Proxy config endpoint with hash-based blocking
7 years ago
Paul Banks 3e3f0e1f31
HTTP agent registration allows proxy to be defined.
7 years ago
Paul Banks e6071051cf
Added connect proxy config and local agent state setup on boot.
7 years ago
Paul Banks 88541bba17
Add tests all the way up through the endpoints to ensure duplicate src/destination is supported and so ultimately deny/allow nesting works.
7 years ago
Paul Banks ed9f07c361
Allow duplicate source or destination, but enforce uniqueness across all four.
7 years ago
Paul Banks 10db79c8ae
Rework connect/proxy and command/connect/proxy. End to end demo working again
7 years ago
Paul Banks 26e65f6bfd
connect.Service based implementation after review feedback.
7 years ago
Mitchell Hashimoto 95da20ffd7
agent: rename authorize param ClientID to ClientCertURI
7 years ago
Mitchell Hashimoto 6e57233913
agent: add TODO for verification
7 years ago
Mitchell Hashimoto 5a47a53c70
acl: IntentionDefault => IntentionDefaultAllow
7 years ago
Mitchell Hashimoto ac72a0c5fd
agent: ACL checks for authorize, default behavior
7 years ago
Mitchell Hashimoto 6dc2db94ea
agent/structs: String format for Intention, used for logging
7 years ago
Mitchell Hashimoto fb7bccc690
agent: bolster commenting for clearer understandability
7 years ago
Mitchell Hashimoto 9a987d6452
agent: default deny on connect authorize endpoint
7 years ago
Mitchell Hashimoto 86a8ce45b9
agent: /v1/agent/connect/authorize is functional, with tests
7 years ago
Mitchell Hashimoto 3ef0b93159
agent/connect: Authorize for CertURI
7 years ago
Mitchell Hashimoto 70d1d5bf06
agent: get rid of method checks since they're done in the http layer
7 years ago