Meta tags:
description= Publish log events to AWS Cloudwatch Logs;
keywords= aws,cloudwatch,component,sink,logs;
Headings (most frequently used words):
encoding, request, auth, tls, cef, csv, syslog, adaptive_concurrency, buffer, proxy, batch, concurrency, enabled, imds, protobuf, retention, health, checks, aws, logs, acknowledgements, healthcheck, region, tags, rate, limits, adaptive, max_events, timeout_secs, avro, gelf, json, headers, extensions, severity, deprecated, cloudwatch, configuration, environment, variables, input, types, telemetry, permissions, how, it, works, vector, site, footer, example, configurations, compression, create_missing_group, create_missing_stream, endpoint, group_name, inputs, kms_key, stream_name, aws_access_key_id, aws_config_file, aws_default_region, aws_profile, aws_role_session_name, aws_secret_access_key, aws_session_token, aws_shared_credentials_file, metrics, authentication, buffers, and, batches, retry, policy, state, transport, layer, security, about, components, setup, community, download, access_key_id, assume_role, credentials_file, external_id, load_timeout_secs, profile, secret_access_key, session_name, session_token, max_bytes, max_size, type, when_full, codec, except_fields, metric_tag_values, only_fields, timestamp_format, http, https, no_proxy, rate_limit_duration_secs, rate_limit_num, retry_attempts, retry_initial_backoff_secs, retry_jitter_mode, retry_max_duration_secs, days, alpn_protocols, ca_file, crt_file, key_file, key_pass, server_name, verify_certificate, verify_hostname, buffer_byte_size, buffer_discarded_events_total, buffer_events, buffer_received_event_bytes_total, buffer_received_events_total, buffer_sent_event_bytes_total, buffer_sent_events_total, buffer_size_bytes, buffer_size_events, component_discarded_events_total, component_errors_total, component_received_event_bytes_total, component_received_events_count, component_received_events_total, component_sent_bytes_total, component_sent_event_bytes_total, component_sent_events_total, utilization, obtaining, an, access, key, assuming, roles, require, disable, arc, static, connect_timeout_seconds, max_attempts, read_timeout_seconds, schema, device_event_class_id, device_product, device_vendor, device_version, name, version, capacity, delimiter, double_quote, escape, fields, quote, quote_style, max_chunk_size, pretty, desc_file, message_type, use_json_names, app_name, facility, msg_id, proc_id, rfc, decrease_ratio, ewma_alpha, initial_concurrency, max_concurrency_limit, rtt_deviation_scale,
Text of the page (most frequently used words):
the (498), optional (159), #vector (127), this (86), for (76), string (75), component (73), literal (58), aws (55), and (54), default (54), encoding (53), that (52), are (49), when (48), event (44), request (39), type (37), data (36), use (35), from (35), examples (35), name (33), can (32), which (32), required (31), file (30), host (29), with (28), not (28), events (28), concurrency (27), you (26), options (26), logs (26), number (25), path (25), buffer (24), value (24), log (24), instance (23), used (23), credentials (23), object (23), enum (23), configuration (22), values (22), hostname (22), set (21), field (21), metrics (20), auth (20), uint (20), csv (20), cef (20), running (19), process (19), http (18), pid (18), system (18), component_type (18), kind (18), component_kind (18), component_id (18), originated (18), codec (18), must (18), bytes (17), tls (16), key (16), option (15), json (15), format (15), timestamp (15), syslog (15), sinks (14), will (14), sink (14), true (14), than (14), certificate (14), group (14), service (13), relevant (13), protobuf (13), message (13), gelf (13), requests (12), adaptive (12), limit (12), enabled (12), counter (12), description (12), compression (12), batch (11), region (11), transform (11), common (11), bool (11), maximum (11), proxy (11), source (11), fields (11), cloudwatch (10), output (10), uri (10), valid (10), example (10), more (10), encodes (10), acknowledgements (10), health (9), role (9), access (9), any (9), only (9), profile (9), seconds (9), endpoint (9), mode (9), metric (9), stream (9), less (9), quotes (9), datadog (8), all (8), uses (8), behavior (8), also (8), your (8), has (8), supported (8), server (8), time (8), unique (8), avro (8), device (8), imds (8), end (8), via (7), these (7), like (7), checks (7), false (7), services (7), using (7), how (7), unix (7), internal (7), they (7), tags (7), writing (7), stream_name (7), before (7), full (7), none (7), rtt (7), inputs (7), group_name (7), components (6), new (6), defaults (6), environment (6), retry (6), size (6), instead (6), create_missing_stream (6), either (6), level (6), types (6), session (6), enables (6), pem (6), retention (6), names (6), equal (6), adaptive_concurrency (6), reference (6), 127 (6), represent (6), serializer (6), necessary (6), empty (6), prometheus (6), model (6), aws_cloudwatch_logs (6), my_sink_id (6), gcp (6), github (5), specified (5), input (5), such (5), does (5), healthcheck (5), check (5), error (5), specific (5), iam (5), authentication (5), amazoncloudwatchlogs (5), create_missing_group (5), gauge (5), sent (5), absolute (5), currently (5), remote (5), com (5), provided (5), list (5), template (5), identifier (5), target (5), retries (5), allowed (5), text (5), float (5), matches (5), encoded (5), otlp (5), version (5), length (5), product (5), vendor (5), memory (5), disk (5), chat (4), openssl (4), each (4), failed (4), other (4), backoff (4), policy (4), rate_limit_num (4), rate_limit_duration_secs (4), limits (4), static (4), performance (4), systems (4), automatically (4), based (4), config (4), require (4), buffers (4), configured (4), batches (4), concepts (4), them (4), assume (4), roles (4), within (4), keys (4), may (4), token (4), expired (4), container (4), order (4), operation (4), every (4), were (4), protocol (4), origins (4), note (4), been (4), deprecated (4), specifies (4), cli (4), unless (4), verification (4), client (4), but (4), create (4), additional (4), tag (4), per (4), one (4), same (4), whether (4), timeout (4), jitter (4), current (4), after (4), header (4), support (4), average (4), measurements (4), range (4), cause (4), east (4), proxying (4), traffic (4), 5000 (4), rfc (4), severity (4), single (4), 8192 (4), quote (4), record (4), native (4), remap (4), specification (4), identifies (4), docs (4), architecture (4), rss (3), releases (3), download (3), going (3), sources (3), updates (3), protocols (3), due (3), location (3), variable (3), its (3), state (3), 500 (3), rate (3), fixed (3), integer (3), feature (3), have (3), downstream (3), blog (3), disable (3), max_events (3), timeout_secs (3), flushed (3), global (3), setting (3), assume_role (3), possible (3), user (3), secret_access_key (3), access_key_id (3), metadata (3), refresh (3), home (3), linux (3), windows (3), variables (3), following (3), amazon (3), never (3), total (3), some (3), configurations (3), sanitized (3), pod (3), pod_name (3), pathname (3), peer_path (3), peer_addr (3), connection (3), container_name (3), useful (3), dropped (3), non (3), communicating (3), custom (3), connections (3), extension (3), key_file (3), der (3), pkcs (3), additionally (3), inline (3), pairs (3), supports (3), syntax (3), multiple (3), creating (3), below (3), could (3), amount (3), wait (3), strategy (3), delay (3), first (3), window (3), headers (3), given (3), past (3), deviation (3), increases (3), scale (3), greater (3), lead (3), hosts (3), should (3), arn (3), see (3), point (3), rfc5424 (3), encoder (3), already (3), exposed (3), strings (3), controls (3), graylog (3), puts (3), around (3), means (3), delimiter (3), character (3), ascii_char (3), configures (3), escape (3), capacity (3), logfmt (3), while (3), opentelemetry (3), experimental (3), apache (3), points (3), extensions (3), combination (3), schema (3), lost (3), buffering (3), websocket (3), splunk (3), hec (3), azure (3), kinesis (3), administration (2), deployment (2), installation (2), setup (2), transforms (2), about (2), appsignal (2), content (2), adjust (2), security (2), stateless (2), across (2), status (2), responses (2), control (2), retry_attempts (2), both (2), highly (2), recommend (2), enabling (2), algorithms (2), arc (2), etc (2), yaml (2), healthy (2), upon (2), failure (2), accept (2), performed (2), fails (2), logged (2), proceed (2), meets (2), exceeds (2), max_bytes (2), age (2), conditions (2), above (2), treats (2), delivery (2), guarantees (2), cases (2), account (2), profiles (2), found (2), works (2), ec2 (2), requires (2), eks (2), response (2), aws_profile (2), directory (2), ecs (2), including (2), web (2), aws_secret_access_key (2), aws_access_key_id (2), ratio (2), would (2), indicate (2), idle (2), waiting (2), emitted (2), send (2), destination (2), raw (2), accepted (2), tagged (2), cumulatively (2), separate (2), batching (2), issues (2), histogram (2), topology (2), stage (2), errors (2), intentionally (2), filter (2), buffer_size_events (2), buffer_size_bytes (2), received (2), favor (2), telemetry (2), store (2), wjalrxutnfemi (2), k7mdeng (2), bpxrficyexamplekey (2), secret (2), akiaiosfodnn7example (2), understand (2), risks (2), verifying (2), outgoing (2), connect (2), present (2), presented (2), certificates (2), issuer (2), upstream (2), host_certificate (2), identify (2), crt (2), 509 (2), alpn (2), defined (2), sets (2), parameter (2), dynamic (2), writer (2), include (2), days (2), recommends (2), pile (2), being (2), into (2), reduce (2), select (2), 223372036854776e (2), make (2), plain (2), outbound (2), ignore (2), larger (2), algorithm (2), takes (2), initial (2), smaller (2), high (2), down (2), parameters (2), typically (2), meta (2), stable (2), addresses (2), foo (2), bar (2), 3128 (2), https (2), proxied (2), through (2), external (2), array (2), starts (2), compatible (2), rfc3164 (2), formatting (2), facility (2), proto (2), package (2), desc (2), read (2), descriptor (2), last (2), null (2), ignored (2), pretty (2), keep (2), recommended (2), even (2), strictly (2), always (2), well (2), disabled (2), otherwise (2), escaped (2), raw_message (2), native_json (2), careful (2), modifying (2), removing (2), doing (2), parsing (2), emitting (2), sdk (2), loki (2), spec (2), reason (2), part (2), two (2), products (2), traces (2), dynamically (2), exist (2), zlib (2), snappy (2), gzip (2), block (2), acceptance (2), consumption (2), free (2), space (2), performant (2), durable (2), restarted (2), forcefully (2), crashes (2), buffered (2), synchronized (2), least (2), information (2), aqodyxdz (2), connected (2), handled (2), open (2), api (2), pipeline (2), statsd (2), socket (2), sematext (2), redis (2), pulsar (2), write (2), nats (2), mqtt (2), formerly (2), kafka (2), influxdb (2), humio (2), greptimedb (2), pubsub (2), stackdriver (2), cloud (2), storage (2), monitoring (2), sqs (2), firehose (2), amqp (2), route (2), kubernetes (2), docker (2), agent (2), observability (2), pipelines (2), guides (2), sidebar, 2026, inc, rights, reserved, community, prod, cookies, privacy, team, contact, site, footer, next, previous, thank, joining, our, newsletter, sign, receive, emails, latest, page, maturity, enable, openssl_conf, usr, local, ssl, cnf, transport, layer, meaning, consistent, 408, 429, 501, retried, attempts, retry_backoff_secs, apply, addition, limiting, overall, throughput, manually, specifying, improves, reliability, communicates, made, further, away, optimizes, underlying, mechanism, feedback, loop, inspired, tcp, congestion, checkout, announcement, post, exit, immediately, pass, flag, ensure, accessible, ready, initialization, start, controlled, met, shown, diagram, notice, differently, treating, isolates, ensuring, disruptions, contained, honored, helpful, variety, cross, assuming, general, whenever, where, generate, provides, created, detailed, guide, obtaining, imdsv2, need, increase, hop, named, entries, microsoft, userprofile, tasks, identity, putlogevents, describelogstreams, describeloggroups, createlogstream, createloggroup, policies, platform, permissions, load, completely, simply, updated, utilization, component_sent_events_total, component_sent_event_bytes_total, excluding, query, component_sent_bytes_total, component_received_events_total, mostly, low, debugging, small, passed, component_received_events_count, component_received_event_bytes_total, occurred, error_type, encountered, component_errors_total, discarded, intentional, component_discarded_events_total, buffer_sent_events_total, buffer_sent_event_bytes_total, buffer_received_events_total, buffer_received_event_bytes_total, buffer_events, blocking, buffer_discarded_events_total, buffer_byte_size, link, table, lists, aware, available, differ, aws_shared_credentials_file, aqoexampleh4aoah0gncapy, truncated, zrkuwjogqs8izzaiv2bxia2r4olgk, aws_session_token, associate, appears, cloudtrail, commands, aws_role_session_name, stored, aws_default_region, aws_config_file, entry, subject, alternative, verify_hostname, validity, issued, trusted, operates, hierarchical, manner, checking, leaf, until, reaches, root, initiate, validates, verify_certificate, www, indication, sni, server_name, password1, key_pass_env_var, effect, passphrase, unlock, encrypted, key_pass, private, archive, crt_file, certificate_authority, ca_file, declare, during, negotiation, peer, prioritized, alpn_protocols, represented, pair, applied, there, instances, guaranteed, retain, lower, orphaned, result, duplicate, take, aborted, between, retry_max_duration_secs, incorporating, greatly, likelihood, accidental, denial, dos, against, own, many, clients, recovering, random, anywhere, calculated, retry_jitter_mode, fibonacci, sequence, future, backoffs, attempting, retry_initial_backoff_secs, templating, add, outstanding, managed, positive, denotes, calculating, secondary, computed, indicates, those, comparing, expected, factor, appropriate, reasonable, deviations, considered, anomalous, rtt_deviation_scale, 200, bound, put, place, safeguard, max_concurrency_limit, seeing, long, ramp, restart, find, looking, adaptive_concurrency_limit, initial_concurrency, exponentially, weighted, moving, ewma, compare, slowly, unusually, variability, weighting, compared, older, ewma_alpha, rounded, applying, back, rapidly, latency, fraction, decreasing, decrease_ratio, changes, incorrect, unstable, caution, settings, splat, 192, 168, blocks, cidr, subdomains, wildcard, domains, domain, match, pattern, patterns, avoid, no_proxy, similar, convention, different, proxies, configure, making, resource, encrypting, kms, kms_key, prefix, info, wildcards, ids, microseconds, unix_us, nanoseconds, unix_ns, milliseconds, unix_ms, floating, unix_float, 3339, rfc3339, timestamp_format, informational, modern, legacy, proc, proc_id, msg, msg_id, semantic, missing, app, app_name, working, converted, interfacing, naming, conventions, looks, their, job_description, jobdescription, camelcase, snake_case, use_json_names, serializing, message_type, protobuf_descriptor_set, here, protoc, desc_file, included, only_fields, show, assigned, arrays, bare, displayed, assignments, metric_tag_values, jsonserializer, chunked, datagram, byte, chunking, datagrams, exceed, decoding, framing, chunked_gelf, max_chunk_size, excluded, except_fields, numeric, parse, aren, non_numeric, writes, produces, invalid, contain, terminator, indistinguishable, quoting, style, quote_style, regex, appear, needs, double_quotes, variants, special, escaping, doubling, doubled, double, escapes, double_quote, 8kb, resembles, export, 3164, 5424, suitable, sending, endpoints, application, forward, implementation, might, continue, relax, enforcement, codecs, maintained, much, relaxed, strict, actual, receiver, adheres, exception, characters, encode, formatted, lowest_importance, highest_importance, reflects, importance, human, readable, 512, equals, collection, paths, problem, sends, messages, device_version, device_vendor, device_product, reported, 1023, device_event_class_id, selected, determines, ignores, directly, creates, zstandard, zstd, highest, priority, preferable, temporarily, lose, rather, slowdown, drops, drop_newest, applies, backpressure, signalling, slow, edge, handling, when_full, 500ms, then, 256, megabytes, 268435488, allocated, hold, max_size, individual, section, 10000, 048576e, uncompressed, batched, serialized, compressed, processed, temporary, session_token, indexer, principal, autogenerated, provider, 1736428351340, assumed, rolesessionname, session_name, west, itself, sts, develop, chain, successfully, loading, load_timeout_secs, read_timeout_seconds, fetching, tokens, max_attempts, connect_timeout_seconds, authenticating, randomexampleidstring, conjunction, external_id, credentials_file, 123456789098, my_role, interacting, disabling, precedence, over, waits, acknowledged, acknowledging, acknowledgement, toml, advanced, minimal, view, egress, yes, once, publish, versioning, glossary, secrets, unit, tests, webhdfs, exporter, postgres, papertrail, relic, mezmo, logdna, honeycomb, chronicle, unstructured, elasticsearch, doris, databricks, zerobus, databend, console, clickhouse, blackhole, monitor, ingestion, blob, axiom, sns, streams, trace, throttle, cardinality, sample, lua, incremental, exclusive, dedupe, aggregate, vrl, stdin, scrape, pushgateway, postgresql, okta, nginx, mongodb, logstash, journald, heroku, logplex, fluent, exec, eventstoredb, dnstap, demo, expressions, functions, language, pgo, optimization, validating, management, runtime, sizing, planning, rollout, availability, hardening, architecting, unified, aggregator, architectures, production, topologies, installer, archives, manual, ubuntu, rhel, raspbian, nixos, macos, debian, centos, arch, operating, platforms, yum, rpm, pacman, nix, msi, homebrew, helm, dpkg, apt, managers, quickstart, introduction, navbar, dropdown, menu, search, toggle, dark, documentation,
Text of the page (random words):
n pem format examples path to certificate_authority crt tls crt_file optional string literal absolute path to a certificate file used to identify this server the certificate must be in der pem x 509 or pkcs 12 format additionally the certificate can be provided as an inline string in pem format if this is set and is not a pkcs 12 archive key_file must also be set examples path to host_certificate crt tls key_file optional string literal absolute path to a private key file used to identify this server the key must be in der or pem pkcs 8 format additionally the key can be provided as an inline string in pem format examples path to host_certificate key tls key_pass optional string literal passphrase used to unlock the encrypted key file this has no effect unless key_file is set examples key_pass_env_var password1 tls server_name optional string literal server name to use when using server name indication sni only relevant for outgoing connections examples www example com tls verify_certificate optional bool enables certificate verification for components that create a server this requires that the client connections have a valid client certificate for components that initiate requests this validates that the upstream has a valid certificate if enabled certificates must not be expired and must be issued by a trusted issuer this verification operates in a hierarchical manner checking that the leaf certificate the certificate presented by the client server is not only valid but that the issuer of that certificate is also valid and so on until the verification process reaches a root certificate do not set this to false unless you understand the risks of not verifying the validity of certificates tls verify_hostname optional bool enables hostname verification if enabled the hostname used to connect to the remote host must be present in the tls certificate presented by the remote host either as the common name or as an entry in the subject alternative name extension only relevant for outgoing connections do not set this to false unless you understand the risks of not verifying the remote hostname environment variables aws_access_key_id common optional string literal the aws access key id used for aws authentication when communicating with aws services examples akiaiosfodnn7example aws_config_file common optional string literal specifies the location of the file that the aws cli uses to store configuration profiles default aws config aws_default_region common optional string literal the default aws region examples path to credentials json aws_profile common optional string literal specifies the name of the cli profile with the credentials and options to use this can be the name of a profile stored in a credentials or config file default default examples my custom profile aws_role_session_name common optional string literal specifies a name to associate with the role session this value appears in cloudtrail logs for commands performed by the user of this profile examples vector session aws_secret_access_key common optional string literal the aws secret access key used for aws authentication when communicating with aws services examples wjalrxutnfemi k7mdeng bpxrficyexamplekey aws_session_token common optional string literal the aws session token used for aws authentication when communicating with aws services examples aqoexampleh4aoah0gncapy truncated zrkuwjogqs8izzaiv2bxia2r4olgk aws_shared_credentials_file common optional string literal specifies the location of the file that the aws cli uses to store access keys default aws credentials input types the following table lists all telemetry data types supported by the component across possible configurations be aware that the available data types may differ based on the specified codec configuration logs log events are supported telemetry metrics link buffer_byte_size gauge the number of bytes currently in the buffer deprecated this metric has been deprecated in favor of buffer_size_bytes component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_discarded_events_total counter the number of events dropped by this non blocking buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_events gauge the number of events currently in the buffer deprecated this metric has been deprecated in favor of buffer_size_events component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_received_event_bytes_total counter the number of bytes received by this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_received_events_total counter the number of events received by this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_sent_event_bytes_total counter the number of bytes sent by this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_sent_events_total counter the number of events sent by this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_size_bytes gauge the number of bytes currently in the buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance buffer_size_events gauge the number of events currently in the buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance component_discarded_events_total counter the number of events dropped by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on intentional true if the events were discarded intentionally like a filter transform or false if due to an error pid optional the process id of the vector instance component_errors_total counter the total number of errors encountered by this component component_id the vector component id component_kind the vector component kind component_type the vector component type error_type the type of the error host optional the hostname of the system vector is running on pid optional the process id of the vector instance stage the stage within the component at which the error occurred component_received_event_bytes_total counter the number of event bytes accepted by this component either from tagged origins like file and uri or cumulatively from other origins component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_received_events_count histogram a histogram of the number of events passed in each internal batch in vector s internal topology note that this is separate than sink level batching it is mostly useful for low level debugging performance issues in vector due to small internal batches component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_received_events_total counter the number of events accepted by this component either from tagged origins like file and uri or cumulatively from other origins component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_sent_bytes_total counter the number of raw bytes sent by this component to destination sinks component_id the vector component id component_kind the vector component kind component_type the vector component type endpoint optional the endpoint to which the bytes were sent for http this will be the host and path only excluding the query string file optional the absolute path of the destination file host optional the hostname of the system vector is running on pid optional the process id of the vector instance protocol the protocol used to send the bytes region optional the aws region name to which the bytes were sent in some configurations this may be a literal hostname component_sent_event_bytes_total counter the total number of event bytes emitted by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance component_sent_events_total counter the total number of events emitted by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance utilization gauge a ratio from 0 to 1 of the load on a component a value of 0 would indicate a completely idle component that is simply waiting for input a value of 1 would indicate a that is never idle this value is updated every 5 seconds component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on pid optional the process id of the vector instance permissions platform amazon web services relevant policies policy required for required when amazoncloudwatchlogs createloggroup operation create_missing_group is set to true amazoncloudwatchlogs createlogstream operation create_missing_stream is set to true amazoncloudwatchlogs describeloggroups healthcheck amazoncloudwatchlogs describelogstreams operation amazoncloudwatchlogs putlogevents operation how it works aws authentication vector checks for aws credentials in the following order the auth access_key_id and auth secret_access_key options the aws_access_key_id and aws_secret_access_key environment variables in web identity token credentials from the environment or container including eks these credentials will automatically refresh when expired ecs credentials iam roles for tasks these credentials will automatically refresh when expired as entries in the credentials file in the aws directory in your home directory aws credentials on linux os x and unix userprofile aws credentials on microsoft windows using a named profile specified in the credentials file via the aws_profile environment variable the iam instance profile only works if running on an ec2 instance with an instance profile role requires imdsv2 to be enabled for eks you may need to increase the metadata token response hop limit to 2 these credentials will automatically refresh when expired if no credentials are found vector s health check fails and an error is logged obtaining an access key in general we recommend using instance profiles roles whenever possible in cases where this is not possible you can generate an aws access key for any user within your aws account aws provides a detailed guide on how to do this such created aws access keys can be used via auth access_key_id and auth secret_access_key options assuming roles vector can assume an aws iam role via the auth assume_role option this is an optional setting that is helpful for a variety of use cases such as cross account access buffers and batches this component buffers batches data as shown in the diagram above you ll notice that vector treats these concepts differently instead of treating them as global concepts vector treats them as sink specific concepts this isolates sinks ensuring services disruptions are contained and delivery guarantees are honored batches are flushed when 1 of 2 conditions are met the batch age meets or exceeds the configured timeout_secs the batch size meets or exceeds the configured max_bytes or max_events buffers are controlled via the buffer options health checks health checks ensure that the downstream service is accessible and ready to accept data this check is performed upon sink initialization if the health check fails an error will be logged and vector will proceed to start req...
|
