Meta tags:
description=Collect logs from AWS S3;
keywords=aws,s3,storage,component,source,logs;

Headings (most frequently used words):

decoding, sqs, framing, tls_options, auth, multiline, proxy, chunked_gelf, length_delimited, lossy, imds, protobuf, max_length, no_proxy, deprecated, avro, gelf, vrl, character_delimited, deferred, aws, acknowledgements, region, https_proxy, http_proxy, metrics, source, enabled, influxdb, json, native_json, syslog, max_frame_length, newline_delimited, octet_counting, connect_timeout_seconds, queue_url, read_timeout_seconds, alpn_protocols, ca_file, crt_file, key_file, key_pass, server_name, verify_certificate, verify_hostname, s3, requirements, configuration, environment, variables, outputs, output, types, telemetry, permissions, how, it, works, vector, site, footer, example, configurations, compression, endpoint, force_path_style, aws_access_key_id, aws_config_file, aws_default_region, aws_profile, aws_role_session_name, aws_secret_access_key, aws_session_token, aws_shared_credentials_file, component_id, traces, logs, authentication, context, handling, events, from, the, aws_s3, state, transport, layer, security, tls, about, components, setup, community, download, access_key_id, assume_role, credentials_file, external_id, load_timeout_secs, profile, secret_access_key, session_name, session_token, codec, signal_types, method, condition_pattern, mode, start_pattern, timeout_ms, http, https, client_concurrency, delete_failed_message, delete_message, max_number_of_messages, operation_timeout_seconds, poll_secs, visibility_timeout_secs, warning, object, component_discarded_events_total, component_errors_total, component_received_bytes_total, component_received_event_bytes_total, component_received_events_count, component_received_events_total, component_sent_event_bytes_total, component_sent_events_total, source_buffer_max_byte_size, source_buffer_max_event_size, source_buffer_max_size_bytes, source_buffer_max_size_events, source_buffer_utilization, source_buffer_utilization_level, source_buffer_utilization_mean, source_lag_time_seconds, sqs_message_delete_succeeded_total, sqs_message_processing_succeeded_total, sqs_message_receive_succeeded_total, sqs_message_received_messages_total, sqs_s3_event_record_ignored_total, obtaining, an, access, key, assuming, roles, max_attempts, schema, strip_schema_id_prefix, validation, desc_file, message_type, use_json_names, timezone, delimiter, decompression, pending_messages_limit, timeout_secs, length_field_is_big_endian, length_field_length, length_field_offset, max_age_secs, fields,

Text of the page (most frequently used words):
the (608), optional (184), #vector (126), this (109), component (94), for (75), string (74), aws (60), examples (58), literal (58), from (51), when (45), and (42), that (42), are (42), file (41), not (41), sqs (40), default (39), type (38), data (38), which (35), decoding (35), message (34), object (33), can (32), with (31), required (31), source (30), output (30), set (30), logs (29), hostname (28), name (28), certificate (28), used (27), host (26), bytes (26), configuration (25), options (25), example (25), events (25), instance (25), number (25), metrics (25), process (24), system (24), originated (24), credentials (23), messages (23), requests (23), framing (23), use (22), running (22), relevant (22), component_id (22), uint (22), true (21), pid (21), component_type (21), kind (21), component_kind (21), http (21), path (21), length (21), auth (20), must (20), proxy (19), gelf (19), specific (18), buffer (18), tls_options (18), format (18), key (17), maximum (17), common (17), bool (17), line (16), com (16), matches (16), you (15), one (15), server (15), byte (15), decoder (15), codec (15), mode (14), raw (14), json (14), all (13), event (13), time (13), level (13), has (13), log (13), will (12), counter (12), uri (12), pem (12), enum (12), protobuf (12), region (11), pattern (11), valid (11), sequences (11), decodes (11), sources (10), option (10), role (10), such (10), enabled (10), seconds (10), traces (10), 127 (10), timeout (10), whether (10), invalid (10), utf (10), tls (9), false (9), aws_s3 (9), access (9), how (9), only (9), profile (9), east (9), more (9), types (9), value (9), queue (9), method (9), character (9), vrl (9), avro (9), acknowledgements (9), components (8), unless (8), multiline (8), order (8), total (8), outputs (8), send (8), another (8), https (8), remote (8), verification (8), influxdb (8), compression (8), imds (8), new (7), remap (7), cases (7), where (7), error (7), limit (7), automatically (7), services (7), over (7), metric (7), deprecated (7), useful (7), bucket (7), priority (7), hosts (7), names (7), allowed (7), url (7), through (7), client (7), provided (7), absolute (7), service (7), endpoint (7), memory (7), delimited (7), frames (7), length_delimited (7), chunked_gelf (7), field (7), auto (7), instead (7), syslog (7), datadog (6), transforms (6), uses (6), defaults (6), environment (6), its (6), setting (6), using (6), any (6), may (6), operation (6), gauge (6), connection (6), than (6), lowercase (6), variant (6), uppercase (6), overridden (6), addresses (6), proxying (6), foo (6), bar (6), 3128 (6), global (6), session (6), connections (6), also (6), key_file (6), der (6), pkcs (6), additionally (6), inline (6), additional (6), they (6), configured (6), should (6), being (6), does (6), description (6), end (6), my_source_id (6), gcp (6), github (5), protocols (5), via (5), specified (5), local (5), each (5), input (5), parse (5), iam (5), expired (5), container (5), authentication (5), received (5), timestamp (5), emitted (5), either (5), origins (5), internal (5), 192 (5), 168 (5), no_proxy (5), match (5), include (5), list (5), specifies (5), enables (5), supported (5), processing (5), lines (5), newline_delimited (5), character_delimited (5), decompression (5), style (5), replaced (5), fffd (5), replacement (5), determines (5), replace (5), failing (5), lossy (5), otlp (5), strict (5), schema (5), prometheus (5), model (5), chat (4), kinesis (4), openssl (4), behavior (4), per (4), assume (4), roles (4), user (4), within (4), requires (4), metadata (4), token (4), these (4), following (4), histogram (4), utilization (4), hold (4), sanitized (4), pod (4), pod_name (4), pathname (4), peer_path (4), peer_addr (4), container_name (4), like (4), other (4), note (4), errors (4), fields (4), see (4), trace (4), stream (4), avoid (4), cli (4), understand (4), risks (4), verifying (4), outgoing (4), presented (4), certificates (4), issuer (4), host_certificate (4), identify (4), crt (4), 509 (4), alpn (4), there (4), amount (4), read (4), first (4), polling (4), poll_secs (4), traffic (4), consecutive (4), matching (4), included (4), group (4), indicating (4), octet_counting (4), max_length (4), malformed (4), unbounded (4), lead (4), usage (4), prefixed (4), chunks (4), gzip (4), force_path_style (4), 5000 (4), signal (4), native_json (4), native (4), validation (4), spec (4), specification (4), reference (4), kafka (4), scheme (4), docs (4), architecture (4), rss (3), releases (3), download (3), going (3), setup (3), sinks (3), firehose (3), updates (3), receive (3), content (3), due (3), location (3), state (3), transform (3), keys (3), account (3), assume_role (3), your (3), secret_access_key (3), access_key_id (3), need (3), response (3), refresh (3), home (3), linux (3), windows (3), web (3), variables (3), amazon (3), reason (3), record (3), was (3), successfully (3), processed (3), between (3), been (3), favor (3), accepted (3), sink (3), 2020 (3), information (3), splat (3), range (3), blocks (3), cidr (3), subdomains (3), wildcard (3), domains (3), domain (3), patterns (3), communicating (3), connect (3), extension (3), but (3), create (3), have (3), initiate (3), effect (3), during (3), defined (3), controls (3), delete (3), available (3), limits (3), queue_url (3), fully (3), large (3), once (3), max_age_secs (3), deferred (3), based (3), socket (3), rate (3), support (3), reached (3), buffered (3), ends (3), marker (3), some (3), conjunction (3), aggregation (3), determine (3), continue (3), delimiter (3), frame (3), graylog (3), none (3), program (3), relaxed (3), opentelemetry (3), protocol (3), experimental (3), apache (3), unique (3), websocket (3), splunk (3), hec (3), azure (3), administration (2), deployment (2), installation (2), next (2), variable (2), security (2), stateless (2), drop_on_error (2), inputs (2), chain (2), helpful (2), context (2), profiles (2), possible (2), works (2), ec2 (2), eks (2), aws_profile (2), directory (2), ecs (2), tasks (2), including (2), aws_secret_access_key (2), aws_access_key_id (2), checks (2), delete_message (2), policy (2), policies (2), platform (2), times (2), mean (2), current (2), source_buffer_max_size_events (2), source_buffer_max_size_bytes (2), tagged (2), cumulatively (2), debugging (2), performance (2), issues (2), small (2), passed (2), batch (2), stage (2), filter (2), dropped (2), last (2), 111111111111 (2), came (2), different (2), namespacing (2), localhost (2), come (2), here (2), globally (2), https_proxy (2), http_proxy (2), store (2), wjalrxutnfemi (2), k7mdeng (2), bpxrficyexamplekey (2), secret (2), custom (2), config (2), akiaiosfodnn7example (2), present (2), entry (2), subject (2), alternative (2), verify_hostname (2), validity (2), issued (2), trusted (2), operates (2), hierarchical (2), manner (2), checking (2), leaf (2), until (2), reaches (2), root (2), validates (2), upstream (2), verify_certificate (2), www (2), indication (2), sni (2), server_name (2), password1 (2), key_pass_env_var (2), passphrase (2), unlock (2), encrypted (2), key_pass (2), private (2), archive (2), crt_file (2), certificate_authority (2), ca_file (2), declare (2), negotiation (2), peer (2), prioritized (2), sets (2), alpn_protocols (2), long (2), takes (2), longer (2), visibility_timeout_secs (2), request (2), take (2), care (2), configuring (2), settings (2), allow (2), enough (2), interval (2), read_timeout_seconds (2), amazonaws (2), 123456789012 (2), myqueue (2), poll (2), notifications (2), changed (2), wait (2), while (2), files (2), ingestion (2), retryable (2), forward (2), older (2), their (2), connect_timeout_seconds (2), high (2), into (2), objects (2), fetching (2), target (2), multiple (2), proxied (2), external (2), incomplete (2), info (2), regular (2), expression (2), start (2), halt_with (2), halt_before (2), continue_through (2), continue_past (2), begins (2), part (2), condition_pattern (2), octet (2), counting (2), risk (2), controlled (2), consider (2), reasonably (2), safety (2), net (2), prevents (2), enforced (2), resource (2), potentially (2), exhaustion (2), extreme (2), trailing (2), newline (2), compatible (2), encoding (2), varint_length_delimited (2), according (2), big (2), endian (2), chunked (2), 388608e (2), max_frame_length (2), header (2), pending (2), payload (2), zlib (2), handles (2), encoded (2), timezone (2), zone (2), result (2), language (2), deserializer (2), attempt (2), systems (2), proto (2), package (2), descriptor (2), strictly (2), configures (2), rfc (2), decoded (2), sdk (2), loki (2), documentation (2), zstd (2), determined (2), aqodyxdz (2), arn (2), acknowledgement (2), handled (2), enabling (2), open (2), aggregator (2), api (2), pipeline (2), statsd (2), sematext (2), redis (2), pulsar (2), write (2), nats (2), mqtt (2), formerly (2), humio (2), greptimedb (2), pubsub (2), stackdriver (2), cloud (2), storage (2), monitoring (2), cloudwatch (2), amqp (2), route (2), kubernetes (2), docker (2), agent (2), concurrency (2), observability (2), pipelines (2), blog (2), guides (2), sidebar, 2026, inc, rights, reserved, community, prod, cookies, privacy, team, contact, about, site, footer, previous, thank, joining, our, newsletter, sign, emails, latest, page, maturity, enable, adjust, openssl_conf, usr, ssl, cnf, transport, layer, meaning, consistent, across, request_url_parts, parse_url, request_url, parse_aws_alb_log, elasticloadbalancing_fields_parsed, load, balancer, parse_aws_vpc_flow_log, flow_logs, commonly, want, vpc, flow, sent, behaves, very, similarly, handling, augments, variety, cross, assuming, general, recommend, whenever, generate, provides, created, detailed, guide, obtaining, found, health, check, fails, logged, imdsv2, increase, hop, named, entries, unix, microsoft, userprofile, identity, deletemessage, receivemessage, getobject, permissions, ignoring, ignore_type, ignored, objectcreated, sqs_s3_event_record_ignored_total, sqs_message_received_messages_total, receiving, sqs_message_receive_succeeded_total, sqs_message_processing_succeeded_total, successful, deletions, sqs_message_delete_succeeded_total, difference, recorded, ingested, expressed, fractional, source_lag_time_seconds, smoothed, exponentially, weighted, moving, average, ewma, source_buffer_utilization_mean, source_buffer_utilization_level, source_buffer_utilization, source_buffer_max_event_size, source_buffer_max_byte_size, component_sent_events_total, component_sent_event_bytes_total, component_received_events_total, separate, batching, mostly, low, batches, topology, component_received_events_count, component_received_event_bytes_total, component_received_bytes_total, occurred, error_type, encountered, component_errors_total, were, discarded, intentionally, intentional, component_discarded_events_total, link, telemetry, 452332, t17, modified, missing, source_type, c5605d9f1baf680d_20201026t1950z_b1ea4a7a, _fl, _vpcflowlogs_us, vpcflowlogs, awslogs, 20308, 401, get, disintermediate, 0400, oct, 246, 150, 126, shown, below, details, warning, downstream, aws_shared_credentials_file, aqoexampleh4aoah0gncapy, truncated, zrkuwjogqs8izzaiv2bxia2r4olgk, aws_session_token, associate, appears, cloudtrail, commands, performed, aws_role_session_name, stored, aws_default_region, aws_config_file, 300, happen, issue, consuming, deleting, left, unavailable, after, made, again, consumer, visibility, initiated, generally, instructed, always, consumed, regardless, serviced, represents, full, lifecycle, call, operation_timeout_seconds, smaller, help, prevent, causing, exceed, visibility_timeout, values, max_number_of_messages, initial, rejected, deleted, non, delete_failed_message, 3600, forwarded, later, deferring, age, typically, sometimes, beneficial, raise, pushed, fetched, resources, utilized, without, second, consumption, affects, retrieval, cpus, concurrent, client_concurrency, similar, convention, proxies, configure, making, 600000, 1000, guaranteed, flushed, even, milliseconds, timeout_ms, start_pattern, termination, semicolon, contains, java, stack, indicator, leading, whitespace, indicates, proceeding, matched, continuethrough, continuation, backslash, same, plus, disabled, varint, unsigned, bit, integer, chosen, underlying, boundaries, split, segments, before, length_field_offset, representing, length_field_length, little, length_field_is_big_endian, drops, timed, out, float, timeout_secs, starts, dropping, ensuring, bounded, grow, pending_messages_limit, excluded, calculation, concatenation, chunk, payloads, composed, applies, whole, individual, single, decompress, detect, magic, delimits, ascii_char, separated, form, way, marks, addressing, est5edt, america, new_york, apply, conversions, contain, explicit, indicate, database, execute, final, contents, compilation, abort, trying, duplicate, removed, preserving, tries, signals, allows, optimize, know, expected, attempting, parsing, signal_types, working, needs, converted, interfacing, naming, conventions, job_description, jobdescription, camelcase, snake_case, use_json_names, serializing, message_type, buf, images, work, protoc, desc, desc_file, closely, follows, treat, violations, allowing, accept, don, follow, skips, passes, them, old, includes, structured, 5424, 3164, three, detects, buffers, implementation, means, relax, enforcement, codecs, maintained, much, actual, receiver, adheres, exception, characters, datum, strip, prefix, described, confluent, strip_schema_id_prefix, timemillis, fixed, duration, decimal, date, definition, variants, apache_avro, encoder, decoders, uncompressed, cannot, well, suffix, decompressing, retrieved, temporary, session_token, indexer, principal, autogenerated, provider, 1736428351340, identifier, assumed, rolesessionname, session_name, west, itself, sts, develop, select, loading, load_timeout_secs, retries, tokens, max_attempts, authenticating, randomexampleidstring, external_id, credentials_file, 123456789098, my_role, strategy, interacting, disabling, toml, yaml, advanced, minimal, configurations, desired, buckets, requirements, view, egress, yes, delivery, least, status, stable, collect, versioning, meta, glossary, secrets, template, syntax, unit, tests, webhdfs, exporter, postgres, papertrail, relic, mezmo, logdna, keep, honeycomb, chronicle, unstructured, elasticsearch, doris, databricks, zerobus, databend, console, clickhouse, blackhole, monitor, blob, axiom, sns, streams, appsignal, window, throttle, tag, cardinality, sample, reduce, lua, incremental, exclusive, delay, dedupe, aggregate, stdin, static, scrape, pushgateway, postgresql, okta, nginx, mongodb, logstash, journald, heroku, logplex, fluent, exec, eventstoredb, dnstap, demo, expressions, functions, pgo, optimization, validating, management, guarantees, adaptive, buffering, runtime, sizing, capacity, planning, rollout, availability, hardening, architecting, unified, architectures, production, topologies, installer, archives, manual, ubuntu, rhel, raspbian, nixos, macos, debian, centos, arch, operating, platforms, yum, rpm, pacman, nix, msi, homebrew, helm, dpkg, apt, managers, quickstart, concepts, introduction, navbar, dropdown, menu, search, toggle, dark,

Text of the page (random words):
that is maintained by graylog and is much more relaxed than the gelf spec going forward vector will use the go sdk as the reference implementation which means the codec may continue to relax the enforcement of the specification influxdb decodes the raw bytes as an influxdb line protocol message json decodes the raw bytes as json native decodes the raw bytes as native protocol buffers format this decoder can output all types of events logs metrics and traces this codec is experimental native_json decodes the raw bytes as native json format this decoder can output all types of events logs metrics and traces this codec is experimental otlp decodes the raw bytes as otlp opentelemetry protocol protobuf format this decoder handles the three otlp signal types logs metrics and traces it automatically detects which type of otlp message is being decoded protobuf decodes the raw bytes as protobuf syslog decodes the raw bytes as a syslog message decodes either as the rfc 3164 style format old style or the rfc 5424 style format new style includes structured data vrl decodes the raw bytes as a string and passes them as input to a vrl program default bytes decoding gelf optional object gelf specific decoding options relevant when codec gelf decoding gelf lossy optional bool determines whether to replace invalid utf 8 sequences instead of failing when true invalid utf 8 sequences are replaced with the u fffd replacement character default true decoding gelf validation optional string literal enum configures the decoding validation mode enum options option description relaxed uses more relaxed validation that skips strict gelf specification checks this mode does not treat specification violations as errors allowing the decoder to accept messages from sources that don t strictly follow the gelf spec strict uses strict validation that closely follows the gelf spec default strict decoding influxdb optional object influxdb specific decoding options relevant when codec influxdb decoding influxdb lossy optional bool determines whether to replace invalid utf 8 sequences instead of failing when true invalid utf 8 sequences are replaced with the u fffd replacement character default true decoding json optional object json specific decoding options relevant when codec json decoding json lossy optional bool determines whether to replace invalid utf 8 sequences instead of failing when true invalid utf 8 sequences are replaced with the u fffd replacement character default true decoding native_json optional object vector s native json specific decoding options relevant when codec native_json decoding native_json lossy optional bool determines whether to replace invalid utf 8 sequences instead of failing when true invalid utf 8 sequences are replaced with the u fffd replacement character default true decoding protobuf optional object protobuf specific decoding options relevant when codec protobuf decoding protobuf desc_file optional string literal the path to the protobuf descriptor set file this file is the output of protoc i include path o desc output path proto for more information see how buf images work decoding protobuf message_type optional string literal the name of the message type to use for serializing examples package message decoding protobuf use_json_names optional bool use json field names camelcase instead of protobuf field names snake_case when enabled the deserializer will output fields using their json names as defined in the proto file for example jobdescription instead of job_description this is useful when working with data that needs to be converted to json or when interfacing with systems that use json naming conventions default false decoding signal_types optional string signal types to attempt parsing in priority order the deserializer tries to parse signals in the specified order this allows you to optimize performance when you know the expected signal types for example if you only receive traces set this to traces to avoid attempting to parse as logs or metrics first if not specified defaults to trying all types in this order logs metrics traces duplicate signal types are automatically removed while preserving order relevant when codec otlp default logs metrics traces decoding syslog optional object syslog specific decoding options relevant when codec syslog decoding syslog lossy optional bool determines whether to replace invalid utf 8 sequences instead of failing when true invalid utf 8 sequences are replaced with the u fffd replacement character default true decoding vrl required object vrl specific decoding options relevant when codec vrl decoding vrl source required string literal the vector remap language vrl program to execute for each event the final contents of the target are used as the decoding result compilation errors or use of abort in the program result in a decoding error decoding vrl timezone optional string literal the name of the timezone to apply to timestamp conversions that do not contain an explicit time zone the time zone name may be any name in the tz database or local to indicate system local time if not set local is used examples local america new_york est5edt endpoint optional string literal custom endpoint for use with aws compatible services examples http 127 0 0 0 5000 path to service force_path_style optional bool specifies which addressing style to use this controls whether the bucket name is in the hostname or part of the url default true framing optional object framing configuration framing handles how events are separated when encoded in a raw byte form where each event is a frame that must be prefixed or delimited in a way that marks where an event begins and ends within the byte stream framing character_delimited required object options for the character delimited decoder relevant when method character_delimited framing character_delimited delimiter required ascii_char the character that delimits byte sequences framing character_delimited max_length optional uint the maximum length of the byte buffer this length does not include the trailing delimiter by default no maximum length is enforced if events are malformed this can lead to additional resource usage as events continue to be buffered in memory and can potentially lead to memory exhaustion in extreme cases if there is a risk of processing malformed data such as logs with user controlled input consider setting the maximum length to a reasonably large value as a safety net this prevents processing from being unbounded framing chunked_gelf optional object options for the chunked gelf decoder relevant when method chunked_gelf framing chunked_gelf decompression optional string literal enum decompression configuration for gelf messages enum options option description auto automatically detect the decompression method based on the magic bytes of the message gzip use gzip decompression none do not decompress the message zlib use zlib decompression default auto framing chunked_gelf max_length optional uint the maximum length of a single gelf message in bytes messages longer than this length are dropped if this option is not set the decoder does not limit the length of messages and the per message memory is unbounded note a message can be composed of multiple chunks and this limit applies to the whole message not to individual chunks this limit takes into account only the message payload gelf header bytes are excluded from the calculation the message payload is the concatenation of all chunk payloads framing chunked_gelf pending_messages_limit optional uint the maximum number of pending incomplete messages if this limit is reached the decoder starts dropping chunks of new messages ensuring the memory usage of the decoder s state is bounded if this option is not set the decoder does not limit the number of pending messages and the memory usage of its messages buffer can grow unbounded this matches graylog server s behavior framing chunked_gelf timeout_secs optional float the timeout in seconds for a message to be fully received if the timeout is reached the decoder drops all received chunks for the timed out message default 5 framing length_delimited required object options for the length delimited decoder relevant when method length_delimited framing length_delimited length_field_is_big_endian optional bool length field byte order little or big endian default true framing length_delimited length_field_length optional uint number of bytes representing the field length default 4 framing length_delimited length_field_offset optional uint number of bytes in the header before the length field framing length_delimited max_frame_length optional uint maximum frame length default 8 388608e 06 framing max_frame_length optional uint maximum frame length relevant when method varint_length_delimited default 8 388608e 06 framing method optional string literal enum the framing method enum options option description bytes byte frames are passed through as is according to the underlying i o boundaries for example split between messages or stream segments character_delimited byte frames which are delimited by a chosen character chunked_gelf byte frames which are chunked gelf messages length_delimited byte frames which are prefixed by an unsigned big endian 32 bit integer indicating the length newline_delimited byte frames which are delimited by a newline character octet_counting byte frames according to the octet counting format varint_length_delimited byte frames which are prefixed by a varint indicating the length this is compatible with protobuf s length delimited encoding default newline_delimited framing newline_delimited optional object options for the newline delimited decoder relevant when method newline_delimited framing newline_delimited max_length optional uint the maximum length of the byte buffer this length does not include the trailing delimiter by default no maximum length is enforced if events are malformed this can lead to additional resource usage as events continue to be buffered in memory and can potentially lead to memory exhaustion in extreme cases if there is a risk of processing malformed data such as logs with user controlled input consider setting the maximum length to a reasonably large value as a safety net this prevents processing from being unbounded framing octet_counting optional object options for the octet counting decoder relevant when method octet_counting framing octet_counting max_length optional uint the maximum length of the byte buffer multiline optional object multiline aggregation configuration if not specified multiline aggregation is disabled multiline condition_pattern required string literal regular expression pattern that is used to determine whether or not more lines should be read this setting must be configured in conjunction with mode examples s info error multiline mode required string literal enum aggregation mode this setting must be configured in conjunction with condition_pattern enum options option description continue_past all consecutive lines matching this pattern plus one additional line are included in the group this is useful in cases where a log message ends with a continuation marker such as a backslash indicating that the following line is part of the same message continue_through all consecutive lines matching this pattern are included in the group the first line the line that matched the start pattern does not need to match the continuethrough pattern this is useful in cases such as a java stack trace where some indicator in the line such as a leading whitespace indicates that it is an extension of the proceeding line halt_before all consecutive lines not matching this pattern are included in the group this is useful where a log line contains a marker indicating that it begins a new message halt_with all consecutive lines up to and including the first line matching this pattern are included in the group this is useful where a log line ends with a termination marker such as a semicolon examples continue_past continue_through halt_before halt_with multiline start_pattern required string literal regular expression pattern that is used to match the start of a new message examples s info error multiline timeout_ms required uint the maximum amount of time to wait for the next additional line in milliseconds once this timeout is reached the buffered message is guaranteed to be flushed even if incomplete examples 1000 600000 proxy optional object proxy configuration configure to proxy traffic through an http s proxy when making external requests similar to common proxy configuration convention you can set different proxies to use based on the type of traffic being proxied you can also set specific hosts that should not be proxied proxy enabled optional bool enables proxying support default true proxy http optional string literal proxy endpoint to use when proxying http traffic must be a valid uri string examples http foo bar 3128 proxy https optional string literal proxy endpoint to use when proxying https traffic must be a valid uri string examples http foo bar 3128 proxy no_proxy optional string a list of hosts to avoid proxying multiple patterns are allowed pattern example match domain names example com matches requests to example com wildcard domains example com matches requests to example com and its subdomains ip addresses 127 0 0 1 matches requests to 127 0 0 1 cidr blocks 192 168 0 0 16 matches requests to any ip addresses in this range splat matches all hosts region optional string literal the aws region of the target service examples us east 1 sqs optional object configuration options for sqs sqs client_concurrency optional uint number of concurrent tasks to create for polling the queue for messages defaults to the number of available cpus on the system should not typically need to be changed but it can sometimes be beneficial to raise this value when there is a high rate of messages being pushed into the queue and the objects being fetched are small in these cases system resources may not be fully utilized without fetching more messages per second as the sqs message consumption rate affects the s3 object retrieval rate examples 5 sqs connect_timeout_seconds optional uint the connection timeout for aws requests limits the amount of time allowed to initiate a socket connection examples 20 sqs deferred optional object configuration for deferring events to another queue based on their age sqs deferred max_age_secs required uint event must have been emitted within the last max_age_secs seconds to be processed if the event is older it is forwarded to the queue_url for later processing examples 3600 sqs deferred queue_url required string literal the url of the queue to forward events to when they are older than max_age_secs examples https sqs us east 2 amazonaws com 123456789012 myqueue sqs delete_failed_message optional bool whether to delete non retryable messages if a message is rej...