Meta tags:
description=Receive logs from an MQTT broker;
keywords=mqtt,component,source;

Headings (most frequently used words):

decoding, framing, tls, chunked_gelf, length_delimited, lossy, protobuf, max_length, avro, gelf, vrl, character_delimited, metrics, influxdb, json, native_json, syslog, max_frame_length, newline_delimited, octet_counting, deprecated, mqtt, configuration, outputs, output, types, telemetry, how, it, works, vector, site, footer, example, configurations, client_id, host, keep_alive, max_packet_size, password, port, topic, topic_key, user, component_id, traces, logs, context, lapin, state, about, components, setup, community, download, codec, signal_types, method, alpn_protocols, ca_file, crt_file, enabled, key_file, key_pass, server_name, verify_certificate, verify_hostname, warning, record, component_discarded_events_total, component_errors_total, component_received_bytes_total, component_received_event_bytes_total, component_received_events_count, component_received_events_total, component_sent_bytes_total, component_sent_event_bytes_total, component_sent_events_total, connection_shutdown_total, open_connections, source_buffer_max_byte_size, source_buffer_max_event_size, source_buffer_max_size_bytes, source_buffer_max_size_events, source_buffer_utilization, source_buffer_utilization_level, source_buffer_utilization_mean, source_lag_time_seconds, schema, strip_schema_id_prefix, validation, desc_file, message_type, use_json_names, source, timezone, delimiter, decompression, pending_messages_limit, timeout_secs, length_field_is_big_endian, length_field_length, length_field_offset, fields,

Text of the page (most frequently used words):
the (427), optional (132), vector (109), #component (77), this (63), from (41), data (37), which (37), decoding (35), bytes (31), mqtt (30), host (30), string (30), for (29), type (29), when (29), output (29), logs (27), metrics (26), default (26), are (26), that (24), originated (24), message (24), and (23), hostname (23), literal (23), framing (23), events (22), file (22), source (21), name (21), length (21), process (20), system (20), not (20), instance (19), pid (19), running (19), number (19), gelf (19), component_id (18), buffer (18), options (18), component_type (17), kind (17), component_kind (17), specific (17), relevant (17), with (16), maximum (16), can (16), raw (16), topic (16), object (16), used (15), tls (15), certificate (15), decoder (15), codec (15), examples (14), byte (14), aws (13), true (13), required (13), json (13), messages (12), example (12), format (12), uint (12), protobuf (12), path (11), mode (11), use (11), set (11), bool (11), server (11), sequences (11), decodes (11), sources (10), uri (10), log (10), traces (10), invalid (10), utf (10), event (9), counter (9), types (9), method (9), character (9), vrl (9), avro (9), configuration (8), outputs (8), send (8), must (8), com (8), enum (8), influxdb (8), gauge (7), metric (7), more (7), field (7), memory (7), delimited (7), frames (7), length_delimited (7), chunked_gelf (7), instead (7), syslog (7), datadog (6), all (6), components (6), you (6), each (6), time (6), has (6), connections (6), connection (6), only (6), enabled (6), pem (6), whether (6), order (6), option (6), limit (6), my_source_id (6), gcp (6), github (5), input (5), such (5), level (5), may (5), protocol (5), absolute (5), http (5), origins (5), internal (5), remote (5), client (5), key (5), port (5), does (5), character_delimited (5), decompression (5), replaced (5), fffd (5), replacement (5), determines (5), replace (5), failing (5), lossy (5), otlp (5), strict (5), schema (5), prometheus (5), model (5), chat (4), sinks (4), new (4), uses (4), amqp (4), how (4), timestamp (4), histogram (4), utilization (4), hold (4), been (4), deprecated (4), total (4), emitted (4), will (4), sanitized (4), pod (4), pod_name (4), pathname (4), peer_path (4), peer_addr (4), container (4), container_name (4), either (4), note (4), than (4), error (4), errors (4), false (4), fields (4), stream (4), value (4), topic_key (4), verification (4), valid (4), also (4), max_packet_size (4), keep_alive (4), octet_counting (4), max_length (4), processing (4), malformed (4), unbounded (4), lead (4), usage (4), newline_delimited (4), prefixed (4), description (4), chunks (4), local (4), signal (4), names (4), native_json (4), native (4), validation (4), spec (4), specification (4), style (4), reference (4), kafka (4), docs (4), architecture (4), rss (3), releases (3), download (3), going (3), transforms (3), nats (3), updates (3), receive (3), state (3), using (3), current (3), open (3), were (3), sent (3), some (3), accepted (3), like (3), other (3), received (3), see (3), trace (3), user (3), unless (3), outgoing (3), key_file (3), der (3), pkcs (3), additionally (3), provided (3), inline (3), additional (3), supported (3), 1883 (3), 10240 (3), being (3), continue (3), include (3), delimiter (3), frame (3), graylog (3), automatically (3), program (3), remap (3), relaxed (3), opentelemetry (3), experimental (3), apache (3), websocket (3), splunk (3), hec (3), azure (3), kinesis (3), administration (2), deployment (2), installation (2), setup (2), mongodb (2), stateless (2), its (2), behavior (2), sink (2), lapin (2), context (2), between (2), was (2), seconds (2), mean (2), source_buffer_max_size_events (2), source_buffer_max_size_bytes (2), favor (2), region (2), configurations (2), destination (2), endpoint (2), tagged (2), cumulatively (2), useful (2), performance (2), issues (2), due (2), passed (2), stage (2), within (2), filter (2), dropped (2), 2020 (2), line (2), individual (2), record (2), namespacing (2), understand (2), risks (2), verifying (2), connect (2), presented (2), enables (2), certificates (2), issuer (2), host_certificate (2), identify (2), incoming (2), information (2), crt_file (2), crt (2), 509 (2), alpn (2), protocols (2), they (2), defined (2), password (2), keep (2), address (2), broker (2), octet (2), counting (2), there (2), risk (2), controlled (2), consider (2), setting (2), reasonably (2), large (2), safety (2), net (2), prevents (2), enforced (2), resource (2), buffered (2), potentially (2), exhaustion (2), extreme (2), cases (2), trailing (2), newline (2), indicating (2), varint_length_delimited (2), according (2), big (2), endian (2), chunked (2), 388608e (2), max_frame_length (2), header (2), timeout (2), reached (2), pending (2), payload (2), auto (2), zlib (2), gzip (2), handles (2), encoded (2), where (2), timezone (2), zone (2), result (2), language (2), specified (2), deserializer (2), parse (2), systems (2), proto (2), package (2), descriptor (2), strictly (2), configures (2), rfc (2), decoded (2), sdk (2), loki (2), following (2), documentation (2), acknowledgements (2), aggregator (2), home (2), api (2), pipeline (2), statsd (2), socket (2), sematext (2), redis (2), pulsar (2), write (2), formerly (2), humio (2), greptimedb (2), pubsub (2), stackdriver (2), cloud (2), storage (2), monitoring (2), sqs (2), firehose (2), cloudwatch (2), route (2), windows (2), kubernetes (2), docker (2), agent (2), end (2), concurrency (2), linux (2), observability (2), pipelines (2), support (2), blog (2), guides (2), sidebar, 2026, inc, rights, reserved, community, prod, cookies, privacy, team, contact, about, site, footer, next, previous, thank, joining, our, newsletter, sign, emails, latest, content, page, meaning, consistent, across, under, hood, reliable, pure, rust, library, facilitates, communication, servers, rabbitmq, augments, helpful, keys, works, difference, recorded, ingested, expressed, fractional, source_lag_time_seconds, smoothed, over, exponentially, weighted, moving, average, ewma, source_buffer_utilization_mean, source_buffer_utilization_level, source_buffer_utilization, source_buffer_max_event_size, source_buffer_max_byte_size, open_connections, times, shut, down, connection_shutdown_total, component_sent_events_total, component_sent_event_bytes_total, excluding, query, component_sent_bytes_total, component_received_events_total, separate, batching, mostly, low, debugging, small, batches, batch, topology, component_received_events_count, component_received_event_bytes_total, component_received_bytes_total, occurred, error_type, encountered, component_errors_total, discarded, intentionally, transform, intentional, component_discarded_events_total, link, telemetry, came, 452332, t17, 20308, 401, get, disintermediate, 0400, oct, 246, 150, 126, shown, below, different, details, warning, downstream, username, published, overrides, add, topics, read, present, common, entry, subject, alternative, extension, verify_hostname, validity, expired, issued, trusted, operates, hierarchical, manner, checking, leaf, but, until, reaches, root, create, requires, have, initiate, requests, validates, upstream, verify_certificate, www, indication, sni, server_name, password1, key_pass_env_var, effect, passphrase, unlock, encrypted, key_pass, private, identity, require, archive, certificate_authority, ca_file, declare, during, negotiation, peer, prioritized, sets, list, alpn_protocols, tcp, packet, size, alive, interval, 127, domain, varint, compatible, encoding, unsigned, bit, integer, chosen, through, underlying, boundaries, split, segments, before, length_field_offset, representing, length_field_length, little, length_field_is_big_endian, fully, drops, timed, out, float, timeout_secs, incomplete, starts, dropping, ensuring, bounded, grow, matches, pending_messages_limit, takes, into, account, excluded, calculation, concatenation, chunk, payloads, composed, multiple, applies, whole, single, longer, per, decompress, none, detect, based, magic, delimits, ascii_char, separated, form, way, marks, begins, ends, est5edt, america, new_york, apply, conversions, contain, explicit, any, indicate, database, execute, final, contents, target, compilation, abort, defaults, trying, duplicate, removed, while, preserving, tries, signals, allows, optimize, know, expected, avoid, attempting, first, attempt, parsing, priority, signal_types, working, needs, converted, interfacing, naming, conventions, their, job_description, jobdescription, camelcase, snake_case, use_json_names, serializing, message_type, buf, images, work, protoc, desc, desc_file, closely, follows, treat, violations, allowing, accept, don, follow, skips, checks, passes, them, old, includes, structured, 5424, 3164, three, detects, buffers, forward, implementation, means, relax, enforcement, codecs, maintained, much, actual, receiver, adheres, exception, characters, allowed, reason, datum, strip, prefix, described, confluent, strip_schema_id_prefix, timemillis, fixed, duration, decimal, date, definition, variants, apache_avro, encoder, decoders, determine, client_id, 1_883, 10_240, toml, yaml, advanced, minimal, view, egress, delivery, best, effort, role, status, beta, versioning, security, meta, glossary, environment, variables, cli, secrets, template, syntax, unit, tests, global, webhdfs, exporter, postgres, papertrail, relic, mezmo, logdna, honeycomb, chronicle, unstructured, elasticsearch, doris, databricks, zerobus, databend, console, clickhouse, blackhole, monitor, ingestion, blob, axiom, sns, streams, appsignal, window, throttle, tag, cardinality, sample, reduce, lua, incremental, exclusive, delay, dedupe, ec2, metadata, aggregate, stdin, static, scrape, pushgateway, postgresql, okta, nginx, logstash, journald, heroku, logplex, fluent, exec, eventstoredb, dnstap, demo, ecs, expressions, functions, pgo, optimization, validating, management, guarantees, adaptive, buffering, runtime, sizing, capacity, planning, rollout, high, availability, hardening, architecting, unified, architectures, production, topologies, roles, installer, archives, manual, ubuntu, rhel, raspbian, nixos, macos, debian, centos, arch, amazon, operating, platforms, yum, rpm, pacman, nix, msi, homebrew, helm, dpkg, apt, managers, quickstart, concepts, introduction, navbar, dropdown, menu, search, toggle, dark,

Text of the page (random words):
ing format varint_length_delimited byte frames which are prefixed by a varint indicating the length this is compatible with protobuf s length delimited encoding default bytes framing newline_delimited optional object options for the newline delimited decoder relevant when method newline_delimited framing newline_delimited max_length optional uint the maximum length of the byte buffer this length does not include the trailing delimiter by default no maximum length is enforced if events are malformed this can lead to additional resource usage as events continue to be buffered in memory and can potentially lead to memory exhaustion in extreme cases if there is a risk of processing malformed data such as logs with user controlled input consider setting the maximum length to a reasonably large value as a safety net this prevents processing from being unbounded framing octet_counting optional object options for the octet counting decoder relevant when method octet_counting framing octet_counting max_length optional uint the maximum length of the byte buffer host required string literal mqtt server address the broker s domain name or ip address examples mqtt example com 127 0 0 1 keep_alive optional uint connection keep alive interval default 60 max_packet_size optional uint maximum packet size default 10240 password optional string literal mqtt password port optional uint tcp port of the mqtt server to connect to default 1883 tls optional object tls configuration tls alpn_protocols optional string sets the list of supported alpn protocols declare the supported alpn protocols which are used during negotiation with a peer they are prioritized in the order that they are defined tls ca_file optional string literal absolute path to an additional ca certificate file the certificate must be in the der or pem x 509 format additionally the certificate can be provided as an inline string in pem format examples path to certificate_authority crt tls crt_file optional string literal absolute path to a certificate file used to identify this server the certificate must be in der pem x 509 or pkcs 12 format additionally the certificate can be provided as an inline string in pem format if this is set and is not a pkcs 12 archive key_file must also be set examples path to host_certificate crt tls enabled optional bool whether to require tls for incoming or outgoing connections when enabled and used for incoming connections an identity certificate is also required see tls crt_file for more information tls key_file optional string literal absolute path to a private key file used to identify this server the key must be in der or pem pkcs 8 format additionally the key can be provided as an inline string in pem format examples path to host_certificate key tls key_pass optional string literal passphrase used to unlock the encrypted key file this has no effect unless key_file is set examples key_pass_env_var password1 tls server_name optional string literal server name to use when using server name indication sni only relevant for outgoing connections examples www example com tls verify_certificate optional bool enables certificate verification for components that create a server this requires that the client connections have a valid client certificate for components that initiate requests this validates that the upstream has a valid certificate if enabled certificates must not be expired and must be issued by a trusted issuer this verification operates in a hierarchical manner checking that the leaf certificate the certificate presented by the client server is not only valid but that the issuer of that certificate is also valid and so on until the verification process reaches a root certificate do not set this to false unless you understand the risks of not verifying the validity of certificates tls verify_hostname optional bool enables hostname verification if enabled the hostname used to connect to the remote host must be present in the tls certificate presented by the remote host either as the common name or as an entry in the subject alternative name extension only relevant for outgoing connections do not set this to false unless you understand the risks of not verifying the remote hostname topic optional string literal mqtt topic or topics from which messages are to be read default vector topic_key optional string literal overrides the name of the log field used to add the topic to each event the value is the topic from which the mqtt message was published to by default topic is used examples topic default topic user optional string literal mqtt username outputs component_id default output stream of the component use this component s id as an input to downstream transforms and sinks output types metrics metric events that may be emitted by this source traces trace events that may be emitted by this source logs warning the fields shown below will be different if log namespacing is enabled see log namespacing for more details record an individual mqtt message fields message required string literal the raw line from the mqtt message examples 53 126 150 246 01 oct 2020 11 25 58 0400 get disintermediate http 2 0 401 20308 timestamp required timestamp the current time when the message has been received examples 2020 10 10 t17 07 36 452332 z topic required string literal the mqtt topic that the message came from examples topic logs telemetry metrics link component_discarded_events_total counter the number of events dropped by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on intentional true if the events were discarded intentionally like a filter transform or false if due to an error pid optional the process id of the vector instance component_errors_total counter the total number of errors encountered by this component component_id the vector component id component_kind the vector component kind component_type the vector component type error_type the type of the error host optional the hostname of the system vector is running on pid optional the process id of the vector instance stage the stage within the component at which the error occurred component_received_bytes_total counter the number of raw bytes accepted by this component from source origins component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_received_event_bytes_total counter the number of event bytes accepted by this component either from tagged origins like file and uri or cumulatively from other origins component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_received_events_count histogram a histogram of the number of events passed in each internal batch in vector s internal topology note that this is separate than sink level batching it is mostly useful for low level debugging performance issues in vector due to small internal batches component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_received_events_total counter the number of events accepted by this component either from tagged origins like file and uri or cumulatively from other origins component_id the vector component id component_kind the vector component kind component_type the vector component type container_name optional the name of the container from which the data originated file optional the file from which the data originated host optional the hostname of the system vector is running on mode optional the connection mode used by the component peer_addr optional the ip from which the data originated peer_path optional the pathname from which the data originated pid optional the process id of the vector instance pod_name optional the name of the pod from which the data originated uri optional the sanitized uri from which the data originated component_sent_bytes_total counter the number of raw bytes sent by this component to destination sinks component_id the vector component id component_kind the vector component kind component_type the vector component type endpoint optional the endpoint to which the bytes were sent for http this will be the host and path only excluding the query string file optional the absolute path of the destination file host optional the hostname of the system vector is running on pid optional the process id of the vector instance protocol the protocol used to send the bytes region optional the aws region name to which the bytes were sent in some configurations this may be a literal hostname component_sent_event_bytes_total counter the total number of event bytes emitted by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance component_sent_events_total counter the total number of events emitted by this component component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance connection_shutdown_total counter the total number of times the connection has been shut down host optional the hostname of the system vector is running on pid optional the process id of the vector instance open_connections gauge the number of current open connections to vector host optional the hostname of the system vector is running on pid optional the process id of the vector instance source_buffer_max_byte_size gauge the maximum number of bytes the source buffer can hold the outputs of the source send data to this buffer deprecated this metric has been deprecated in favor of source_buffer_max_size_bytes component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_max_event_size gauge the maximum number of events the source buffer can hold the outputs of the source send data to this buffer deprecated this metric has been deprecated in favor of source_buffer_max_size_events component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_max_size_bytes gauge the maximum number of bytes the source buffer can hold the outputs of the source send data to this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_max_size_events gauge the maximum number of events the source buffer can hold the outputs of the source send data to this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_utilization histogram the utilization level of the source buffer the outputs of the source send data to this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_utilization_level gauge the current utilization level of the source buffer the outputs of the source send data to this buffer component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_buffer_utilization_mean gauge the mean utilization level of the source buffer the outputs of the source send data to this buffer the mean utilization is smoothed over time using an exponentially weighted moving average ewma component_id the vector component id component_kind the vector component kind component_type the vector component type host optional the hostname of the system vector is running on output optional the specific output of the component pid optional the process id of the vector instance source_lag_time_seconds histogram the difference between the timestamp recorded in each event and the time when it was ingested expressed as fractional seconds component_id the vector component id component_kind ...