Meta tags:
description=Redpanda Documentation: Guides, API references, and resources for event streaming.;

Headings (most frequently used words):

credentials, tcp, keep_alive, endpoint, you, this, page, let, us, aws_sqs, metadata, fields, from_ec2_role, id, profile, role, role_external_id, secret, token, delete_message, max_number_of_messages, max_outstanding_messages, message_timeout, region, reset_visibility, connect_timeout, count, idle, interval, tcp_user_timeout, url, wait_time_seconds, simple, online, edits, contribution, guide, components, highlight, hit, preview, attribute, title, what, do, think, of, know, more, contact, about, your, feedback, example, on,

Text of the page (most frequently used words):
rpk (150), the (75), cloud (65), item (58), #preview (54), redpanda (50), api (46), cluster (40), html (34), type (33), state (31), return (30), data (30), configure (30), for (29), registry (29), connect (26), with (24), context (24), and (24), default (24), security (23), const (22), create (22), product (21), list (20), use (20), credentials (20), components (19), aws (18), profile (18), schema (18), query (16), doc (15), set (15), hit (15), attribute (15), string (15), delete (15), iceberg (15), connector (15), reference (14), index (14), time (14), algolia (13), url (13), you (13), manage (13), role (13), sql (13), topics (13), topic (12), this (11), https (11), www (11), com (11), optional (11), title (11), catalog (11), storage (11), byoc (11), gcp (11), streaming (10), plane (10), objectid (10), from (10), tcp (10), message (10), azure (10), server (9), map (9), window (9), private (9), group (9), connection (9), describe (9), shadow (9), show (8), let (8), get (8), componenttitle (8), platform (8), parameters (8), true (8), add (8), open (8), breadcrumbs (8), snippet (8), intro (8), description (8), your (8), control (8), secret (8), aws_sqs (8), mcp (8), user (8), console (8), results (7), overview (7), can (7), about (7), text (7), breadcrumb (7), highlight (7), keep_alive (7), keep (7), configuration (7), transform (7), alter (7), config (7), sink (7), path (6), new (6), link (6), version (6), see (6), facet (6), values (6), docs (6), selected (6), when (6), false (6), titles (6), length (6), search (6), algoliabtn (6), event (6), queryid (6), positions (6), status (6), messages (6), log (6), maximum (6), before (6), zero (6), 15s (6), alive (6), more (6), level (6), access (6), generate (6), catalogs (6), drop (6), privatelink (6), source (6), mongodb (6), bloblang (6), endpoint (5), method (5), origin (5), all (5), that (5), managed (5), exact (5), match (5), sources (5), plugin (5), hits (5), nestedhits (5), docindices (5), function (5), ask (5), stoppropagation (5), clickedobjectidsaftersearch (5), eventname (5), __autocomplete_indexname (5), __autocomplete_queryid (5), objectids (5), activeitemid (5), href (5), edit (5), enable (5), connections (5), iam (5), inputs (5), build (5), compatibility (5), mode (5), quotas (5), auth (5), monitor (5), kafka (5), management (5), not (4), required (4), currentquery (4), view (4), self (4), home (4), filters (4), _tags (4), content (4), autocomplete (4), label (4), null (4), none (4), clickanalytics (4), matchingheading (4), tolowercase (4), click (4), target (4), aws_s3 (4), feedback (4), int (4), wait (4), consume (4), idle (4), probes (4), count (4), object (4), bool (4), using (4), token (4), information (4), secrets (4), amazon (4), services (4), fields (4), metadata (4), update (4), acl (4), install (4), txn (4), producers (4), mount (4), transforms (4), properties (4), http (4), dedicated (4), regions (4), serverless (4), join (4), billing (4), service (4), peering (4), centralized (4), egress (4), quickstart (4), broker (4), switch (4), nats_kv (4), byovpc (4), hasendpoint (3), endpointline (3), curlexample (3), agentic (3), fallback (3), getitems (3), header (3), right (3), render (3), our (3), used (3), libraries (3), getalgoliafacets (3), queries (3), params (3), term (3), phrase (3), disables (3), getalgoliaresults (3), items (3), foreach (3), _highlightresult (3), matchedindex (3), matchedtopleveltitle (3), has (3), stale (3), renderproduct (3), seen (3), supported_preview_types (3), includes (3), other (3), document (3), btn (3), addeventlistener (3), enter (3), slice (3), know (3), select (3), page (3), azure_blob_storage (3), contribution (3), whether (3), sqs (3), linux (3), only (3), tcp_user_timeout (3), defaults (3), interval (3), complete (3), connect_timeout (3), these (3), settings (3), specific (3), network (3), timeout (3), each (3), region (3), handle (3), 1000 (3), number (3), max_outstanding_messages (3), specify (3), field (3), web (3), input (3), deploy (3), failover (3), subject (3), globals (3), tiers (3), timestamp (3), distinct (3), table (3), commits (3), policies (3), gbac (3), rbac (3), authorization (3), gateway (3), shadowing (3), migrate (3), snowflake (3), introduction (3), debezium (3), mirrormaker2 (3), jdbc (3), connectors (3), memory (3), into (3), redis (3), gcp_cloud_storage (3), sql_raw (3), resource (3), azure_cosmosdb (3), pipelines (3), example (2), enrichment (2), try (2), catch (2), integrate (2), current (2), askaibutton (2), viewalllink (2), strict (2), typo (2), exacttoggle (2), tags (2), tagsbyfacet (2), tag (2), sourceid (2), checkbox (2), param (2), searchclient (2), indexname (2), test_redpanda (2), facetquery (2), maxfacethits (2), transformresponse (2), facethits (2), union (2), templates (2), attributes (2), which (2), matching (2), __algoliatoggleexactmatch (2), exactmatch (2), exactparams (2), hitsperpage (2), attributestosnippet (2), snippetellipsistext (2), tagfilters (2), order (2), while (2), are (2), nondocitems (2), filter (2), unixtimestamp (2), infinity (2), nondocindex (2), full (2), clear (2), array (2), navigate (2), atag (2), setcontext (2), ctx (2), instance (2), custom (2), dropdown (2), without (2), references (2), across (2), autocompleteinstance (2), button (2), action (2), var (2), queryselector (2), detachedsearchbutton (2), key (2), should (2), _blank (2), rel (2), noopener (2), noreferrer (2), openchatwithquery (2), policy (2), thanks (2), thumb_down (2), thumb_up (2), was (2), helpful (2), work (2), read (2), guide (2), issue (2), github (2), simple (2), directly (2), wait_time_seconds (2), acknowledgment (2), enabled (2), must (2), than (2), duration (2), between (2), probe (2), negative (2), disable (2), issues (2), have (2), requirements (2), tune (2), networks (2), performance (2), reliability (2), visibility (2), consumed (2), queue (2), reset_visibility (2), 30s (2), process (2), receipt (2), message_timeout (2), max_number_of_messages (2), allows (2), delete_message (2), being (2), role_external_id (2), assume (2), from_ec2_role (2), interpolation (2), component (2), out (2), copy (2), metrics (2), produce (2), print (2), uninstall (2), offset (2), mountable (2), logdirs (2), proxy (2), apis (2), transactions (2), system (2), tables (2), bitwise (2), shift (2), left (2), operators (2), sum (2), min (2), max (2), bool_or (2), bool_and (2), avg (2), to_char (2), json (2), functions (2), zone (2), numeric (2), support (2), pay (2), methods (2), based (2), authentication (2), hub (2), errors (2), troubleshoot (2), client (2), throughput (2), audit (2), maintenance (2), cli (2), postgresql (2), google (2), handling (2), authenticate (2), started (2), jira (2), migrator (2), streams (2), ingest (2), real (2), open_telemetry_collector (2), decompress (2), avro (2), noop (2), aws_dynamodb (2), sync_response (2), sql_select (2), sql_insert (2), retry (2), qdrant (2), processors (2), gcp_bigquery_select (2), cache (2), timeplus (2), sftp (2), schema_registry (2), redpanda_migrator (2), redpanda_common (2), redis_streams (2), redis_pubsub (2), redis_list (2), otlp_http (2), otlp_grpc (2), nats_jetstream (2), nats (2), mqtt (2), kafka_franz (2), inproc (2), http_client (2), gcp_pubsub (2), azure_table_storage (2), azure_queue_storage (2), aws_kinesis (2), amqp_0_9 (2), what (2), documentation (2), labs (2), txt (2), tiny, reduce, clicks, pure, touppercase, curl, assistant, compose, respects, productparams, shows, products, 20data, 20plane, toggle, forces, layout, side, footer, tips, root, define, actual, core, concepts, getsources, groupby, tagsplugin, fetch, populate, menu, raw, facets, known, happens, require, every, spelling, word, note, deliberately, wrap, quotes, searchable, unordered, proximity, quoted, returns, nothing, give, reliable, __algoliaexactmatch, typotolerance, removewordsifnoresults, optionalwords, maptoalgoliafilters, mixed, stay, place, non, sorted, compute, deep, best, sort, findindex, matchlevel, noresults, don, helper, deduped, badges, isarray, else, previewable, within, panel, otherwise, tab, getitemurl, onactive, expose, globally, drive, its, capturing, renders, intentionally, namespaced, notes, below, __algoliaautocompleteinstance, wire, sidebar, modal, clicking, hidden, detached, queryselectorall, keydown, preventdefault, domcontentloaded, initalgolia, answers, may, imprecise, always, verify, any, believe, close, esc, image, analytics, requires, start, children, checked, typeof, setisopen, cookie, preferences, trust, terms, privacy, 2026, inc, rights, reserved, make, group_add, share, mail, community, extensive, updates, prefer, locally, something, want, change, changes, such, fixing, online, edits, back, top, seconds, times, activate, queued, polling, transmitted, killing, kernel, ignored, platforms, greater, value, per, rfc, 5482, sending, first, unanswered, dropping, amount, dial, will, most, users, modify, experiencing, stability, timeouts, systems, balance, quick, failure, detection, avoiding, positives, unstable, detect, recover, long, lived, increase, allow, establishment, high, latency, socket, optimize, low, controls, useful, receives, acknowledgement, rather, releasing, immediately, reprocessing, allowed, received, refreshes, becomes, visible, again, attempts, refresh, after, half, elapsed, pending, flight, same, polls, acknowledged, deletion, different, mechanism, short, contains, sensitive, usually, shouldn, added, adding, external, provide, assuming, arn, host, ec2, machine, configured, associated, manual, found, sqs_approximate_receive_count, sqs_receipt_handle, sqs_message_id, adds, following, uses, shared, file, connecting, also, explicitly, transfer, accounts, find, advanced, common, available, output, code, plain, copied, markdown, options, checking, glossary, logs, init, trim, prefix, partitions, unassign, assign, check, reset, rename, prompt, help, seek, shell, completion, grafana, dashboard, app, unmount, cancel, import, info, stdio, logout, login, commands, javascript, rust, golang, sdks, virtual, pg_user, pg_type, pg_statio_user_tables, pg_shadow, pg_settings, pg_roles, pg_proc, pg_namespace, pg_language, pg_index, pg_description, pg_depend, pg_database, pg_constraint, pg_class, pg_authid, pg_attribute, pg_attrdef, row_number, rank, percent_rank, ntile, nth_value, lead, last_value, lag, first_value, dense_rank, cume_dist, unix_seconds, unix_millis, unix_micros, to_timestamp, timestamp_trunc, timestamp_seconds, timestamp_millis, timestamp_micros, format_timestamp, extract, date_trunc, current_timestamp, upper, substring, strpos, starts_with, replace, position, lower, ends_with, concat, regexp_replace, regexp_match, posix, regular, expressions, regex, shobj_description, pg_typeof, pg_total_relation_size, pg_table_size, pg_table_is_visible, pg_size_pretty, pg_relation_is_publishable, pg_get_userbyid, pg_get_statisticsobjdef_columns, pg_get_indexdef, pg_get_expr, pg_get_constraintdef, pg_encoding_to_char, pg_backend_pid, obj_description, nullif, has_schema_privilege, generate_series, current_schema, current_database, col_description, coalesce, sqrt, sinh, sin, sign, round, random, power, least, greatest, floor, exp, cosh, ceil, cbrt, abs, math, json_extract_path_text, json_extract_path, json_array_length, json_array_extract, boolean, for_min, for_max, variance, var_samp, var_pop, stddev_samp, stddev_pop, stddev, regr_syy, regr_sxy, regr_sxx, regr_slope, regr_r2, regr_intercept, regr_count, regr_avgy, regr_avgx, covar_samp, covar_pop, corr, statistics, percentile_disc, percentile_cont, ordered, aggregate, row, aliases, geometry, geography, date, bytea, types, where, over, limit, having, outer, intersect, except, operations, clauses, nodes, execs, revoke, grant, statements, schemas, comment, keywords, partner, integrations, notifications, activity, payment, safety, availability, encryption, lists, acls, global, transit, choose, cidr, ranges, design, ports, networking, terraform, provider, deprecation, codes, runbook, disaster, recovery, programmable, push, deserialization, validation, contexts, lakehouse, databricks, unity, glue, rest, sample, logging, upgrades, profiles, addresses, organization, mysql, heartbeat, checkpoint, gcs, bigquery, sizing, single, converters, serialization, test, paginate, follower, fetching, consumer, offsets, leader, pinning, idempotent, develop, degraded, nested, editor, dapper, npgsql, php, pdo, java, psycopg2, oltp, olap, retrieval, augmented, generation, rag, joining, filtering, sampling, workflows, dynamodb, cdc, patterns, cookbooks, unified, synchronous, responses, sensor, telemetry, aurora, roles, arithmetic, walkthrough, guides, logger, prometheus, gcp_cloudtrace, tracers, to_the_end, tar, skip_bom, re_match, lines, json_documents, json_array, csv, chunker, scanners, system_window, buffers, local, rate, limits, ttlru, ristretto, multilevel, memcached, lru, caches, xml, workflow, unarchive, try_catch, text_chunker, string_split, split, sleep, slack_thread, select_parts, schema_registry_encode, schema_registry_decode, redis_script, rate_limit, protobuf, parse_log, parquet_encode, parquet_decode, parallel, openai_translation, openai_transcription, openai_speech, openai_image_generation, openai_embeddings, openai_chat_completion, ollama_moderation, ollama_embeddings, ollama_chat, nats_request_reply, mutation, metric, mapping, json_schema, jmespath, insert_part, group_by_value, group_by, google_drive_search, google_drive_list_labels, google_drive_download, gcp_vertex_ai_embeddings, gcp_vertex_ai_chat, for_each, dedupe, compress, cohere_rerank, cohere_embeddings, cohere_chat, cached, branch, bounds_check, benchmark, aws_lambda, aws_dynamodb_partiql, aws_bedrock_embeddings, aws_bedrock_chat, archive, a2a_message, splunk_hec, snowflake_streaming, snowflake_put, slack_reaction, slack_post, salesforce_sink, reject_errored, reject, redis_hash, questdb, pinecone, opensearch, gcp_bigquery_write_api, gcp_bigquery, elasticsearch_v8, drop_on, cyborgdb, azure_data_lake_gen2, aws_sns, aws_kinesis_firehose, arc, outputs, splunk, spicedb_watch, slack_users, slack, sequence, salesforce_graphql, salesforce_cdc, salesforce, redis_scan, read_until, postgres_cdc, oracledb_cdc, mysql_cdc, mongodb_cdc, microsoft_sql_server_cdc, http_server, gcp_spanner_cdc, git, batched, aws_dynamodb_cdc, aws_cloudwatch_logs, unit, testing, pipeline, resources, paths, contextual, variables, error, windowed, processing, batching, remote, replicas, byovnet, architecture, how, works, hundreds, deployments, run, own, infrastructure, fully, foundation, everything, agents, please, robot, submitting, submit, contact, think, beep, boop, bot, here, familiar, syntax, learn, llms,

Text of the page (random words):
cloud platform ingest real time sensor telemetry with the http gateway synchronous responses migrate to the unified redpanda migrator cookbooks dynamodb cdc patterns enrichment workflows filtering and sampling ingest data into snowflake joining streams redpanda migrator retrieval augmented generation rag work with jira issues redpanda sql get started quickstart enable redpanda sql redpanda sql overview oltp vs olap redpanda sql vs postgresql connect to redpanda sql authenticate psycopg2 java jdbc php pdo c dapper npgsql query data sql editor redpanda catalogs query streaming topics query iceberg enabled topics query topics with nested fields manage redpanda sql manage access troubleshoot degraded state handling query out of memory errors develop kafka compatibility topics overview manage topics manage cloud topics configure producers for cloud topics produce data configure producers idempotent producers configure leader pinning consume data consumer offsets follower fetching paginate messages in redpanda console use redpanda with the http proxy api cloud management mcp server redpanda cloud management mcp server redpanda cloud management mcp server quickstart configure the redpanda cloud management mcp server data transforms overview build configure deploy test monitor manage transactions kafka connect converters and serialization monitor connectors disable kafka connect single message transforms sizing connectors aws s3 sink connector google bigquery sink connector gcs sink connector iceberg sink connector jdbc sink connector jdbc source connector mirrormaker2 source connector mirrormaker2 checkpoint connector mirrormaker2 heartbeat connector mongodb sink connector mongodb source connector mysql debezium source connector postgresql debezium source connector sql server debezium source connector snowflake sink connector manage manage your organization redpanda cli introduction to rpk install or update rpk specify broker addresses for rpk rpk profiles cluster maintenance cluster state upgrades and maintenance configure cluster properties audit logging sample audit log messages about client throughput quotas manage throughput configure client connections mountable topics iceberg about iceberg topics migrate to iceberg topics specify iceberg schema use iceberg catalogs integrate with rest catalogs aws glue databricks unity catalog gcp lakehouse snowflake and open catalog query iceberg topics migrate iceberg catalogs tune performance for iceberg topics troubleshoot iceberg topics schema registry redpanda schema registry use schema registry use the schema registry api schema registry authorization schema registry contexts schema id validation deserialization programmable push filters edit topic configuration disaster recovery shadowing overview configure shadowing monitor shadowing failover failover runbook cloud api cloud api quickstart cloud api overview cloud api authentication use the control plane api byoc dedicated serverless use the data plane apis cloud api errors and status codes cloud api deprecation policy redpanda terraform provider monitor redpanda cloud networking network design and ports choose cidr ranges serverless aws configure privatelink in the cloud console configure privatelink with the cloud api byoc aws add a peering connection configure privatelink in the cloud console configure privatelink with the cloud api add a transit gateway configure centralized egress create an aws hub for centralized egress azure configure azure private link in the cloud console configure azure private link with the cloud api gcp add a peering connection configure private service connect in the cloud console configure private service connect with the cloud api enable global access configure centralized egress create a gcp hub for centralized egress dedicated aws add a peering connection configure privatelink in the cloud console configure aws privatelink with the cloud api azure configure private link in the cloud console configure azure private link with the cloud api gcp add a peering connection configure private service connect in the cloud console configure private service connect with the cloud api security authentication authorization cloud authorization role based access control rbac configure rbac in the control plane configure rbac in the data plane group based access control gbac configure gbac in the control plane configure gbac in the data plane access control lists acls aws iam policies gcp iam policies azure iam policies encryption availability secrets safety and reliability billing billing and support manage payment methods view billing activity manage billing notifications aws use commits use pay as you go azure use commits gcp use commits use pay as you go partner integrations reference redpanda sql reference keywords comment support sql schemas statements alter iceberg catalog alter redpanda catalog alter storage alter table alter user copy to create iceberg catalog create redpanda catalog create storage create table create user describe drop iceberg catalog drop redpanda catalog drop storage drop table drop user grant revoke select set and show show catalogs show execs show nodes show queries show tables clauses set operations except intersect union from from join left join outer join right join group by having limit offset order by over and window where with data types array bool bytea date geography geometry interval json numeric numeric data type aliases row text time time operators timestamp with time zone timestamp without time zone functions aggregate ordered set mode percentile_cont percentile_disc statistics corr covar_pop covar_samp regr_avgx regr_avgy regr_count regr_intercept regr_r2 regr_slope regr_sxx regr_sxy regr_syy stddev stddev_pop stddev_samp var_pop var_samp variance avg bool_and bool_or count distinct for_max for_min max min sum boolean if is distinct from is not distinct from json json_array_extract json_array_length json_extract_path json_extract_path_text math abs cbrt ceil cosh exp floor greatest least ln log power random round sign sin sinh sqrt to_char number other coalesce col_description current_database current_schema generate_series has_schema_privilege nullif obj_description pg_backend_pid pg_encoding_to_char pg_get_constraintdef pg_get_expr pg_get_indexdef pg_get_statisticsobjdef_columns pg_get_userbyid pg_relation_is_publishable pg_size_pretty pg_table_is_visible pg_table_size pg_total_relation_size pg_typeof shobj_description string regex posix regular expressions regexp_match regexp_replace concat ends_with length lower position replace starts_with strpos substring upper timestamp current_timestamp date_trunc extract format_timestamp timestamp_micros timestamp_millis timestamp_seconds timestamp_trunc to_char to_timestamp unix_micros unix_millis unix_seconds window avg bool_and bool_or count cume_dist dense_rank first_value lag last_value lead max min nth_value ntile percent_rank rank row_number sum operators bitwise shift left bitwise shift right system catalogs pg_attrdef pg_attribute pg_authid pg_class pg_constraint pg_database pg_depend pg_description pg_index pg_language pg_namespace pg_proc pg_roles pg_settings pg_shadow pg_statio_user_tables pg_type pg_user information schema system virtual tables transactions cloud tiers and regions serverless regions byoc tiers and regions dedicated tiers and regions api reference control plane api data plane apis http proxy api schema registry api properties cluster configuration properties object storage properties data transforms sdks golang rust javascript data transforms api schema registry api rpk commands rpk rpk x rpk cloud rpk cloud auth rpk cloud auth delete rpk cloud auth list rpk cloud auth token rpk cloud auth use rpk cloud byoc rpk cloud byoc install rpk cloud byoc uninstall rpk cloud cluster rpk cloud cluster select rpk cloud login rpk cloud logout rpk cloud mcp rpk cloud mcp install rpk cloud mcp stdio rpk cluster rpk cluster config rpk cluster config get rpk cluster config list rpk cluster config set rpk cluster config status rpk cluster connections rpk cluster connections list rpk cluster logdirs rpk cluster logdirs describe rpk cluster info rpk cluster quotas rpk cluster quotas alter rpk cluster quotas describe rpk cluster quotas import rpk cluster storage rpk cluster storage cancel mount rpk cluster storage list mount rpk cluster storage list mountable rpk cluster storage mount rpk cluster storage status mount rpk cluster storage unmount rpk cluster txn rpk cluster txn describe rpk cluster txn describe producers rpk cluster txn list rpk generate rpk generate app rpk generate grafana dashboard rpk generate shell completion rpk group rpk group delete rpk group offset delete rpk group describe rpk group list rpk group seek rpk help rpk plugin rpk plugin list rpk plugin uninstall rpk plugin install rpk profile rpk profile clear rpk profile create rpk profile current rpk profile delete rpk profile edit rpk profile edit globals rpk profile list rpk profile print rpk profile print globals rpk profile prompt rpk profile rename to rpk profile set rpk profile set globals rpk profile use rpk registry rpk registry compatibility level rpk registry compatibility level get rpk registry compatibility level set rpk registry context rpk registry context list rpk registry context delete rpk registry mode rpk registry mode get rpk registry mode reset rpk registry mode set rpk registry schema rpk registry schema check compatibility rpk registry schema create rpk registry schema delete rpk registry schema get rpk registry schema list rpk registry schema references rpk registry subject rpk registry subject delete rpk registry subject list rpk security rpk security acl rpk security acl create rpk security acl delete rpk security acl list rpk security role rpk security role assign rpk security role create rpk security role delete rpk security role describe rpk security role list rpk security role unassign rpk security secret rpk security secret create rpk security secret delete rpk security secret list rpk security secret update rpk security user rpk security user create rpk security user delete rpk security user update rpk security user list rpk shadow rpk shadow config generate rpk shadow create rpk shadow delete rpk shadow describe rpk shadow failover rpk shadow list rpk shadow status rpk shadow update rpk topic rpk topic add partitions rpk topic alter config rpk topic consume rpk topic create rpk topic delete rpk topic describe rpk topic list rpk topic produce rpk topic trim prefix rpk transform rpk transform build rpk transform delete rpk transform deploy rpk transform init rpk transform list rpk transform logs rpk version metrics reference glossary status checking was this helpful thumb_up thumb_down thanks for your feedback home data platform cloud redpanda connect components catalog inputs aws_sqs cloud page options copy as markdown copied view as plain text ask ai about this topic add mcp server to vs code aws_sqs type input input output available in cloud self managed consume messages from an aws sqs url common advanced inputs label aws_sqs url no default required max_outstanding_messages 1000 inputs label aws_sqs url no default required delete_message true reset_visibility true max_number_of_messages 10 max_outstanding_messages 1000 wait_time_seconds 0 message_timeout 30s region no default optional endpoint no default optional tcp connect_timeout 0s keep_alive idle 15s interval 15s count 9 tcp_user_timeout 0s credentials profile no default optional id no default optional secret no default optional token no default optional from_ec2_role no default optional role no default optional role_external_id no default optional credentials by default redpanda connect uses a shared credentials file when connecting to aws services you can also set credentials explicitly at the component level which allows you to transfer data across accounts to find out more see amazon web services metadata this input adds the following metadata fields to each message sqs_message_id sqs_receipt_handle sqs_approximate_receive_count all message attributes you can access these metadata fields using function interpolation fields credentials optional manual configuration of aws credentials to use more information can be found in amazon web services type object credentials from_ec2_role use the credentials of a host ec2 machine configured to assume an iam role associated with the instance type bool credentials id the id of credentials to use type string credentials profile a profile from aws credentials to use type string credentials role a role arn to assume type string credentials role_external_id an external id to provide when assuming a role type string credentials secret the secret for the credentials being used this field contains sensitive information that usually shouldn t be added to a configuration directly for more information see manage secrets before adding it to your configuration type string credentials token the token for the credentials being used required when using short term credentials type string delete_message whether to delete the consumed message when it s acknowledged set to false to handle the deletion using a different mechanism type bool default true endpoint allows you to specify a custom endpoint for the aws api type string max_number_of_messages the maximum number of messages that redpanda connect can return each time it polls the sqs url enter values from 1 to 10 only type int default 10 max_outstanding_messages the maximum number of pending messages that redpanda connect can have in flight at the same time type int default 1000 message_timeout the maximum time allowed to process a received message before redpanda connect refreshes the receipt handle and the message becomes visible in the queue again redpanda connect attempts to refresh the receipt handle after half of the timeout has elapsed type string default 30s region the aws region to target type string reset_visibility whether to set the visibility timeout of the consumed message to zero if redpanda connect receives a negative acknowledgement set to false to use the queue s visibility timeout for each message rather than releasing the message immediately for reprocessing type bool default true tcp configure tcp socket level settings to optimize network performance and reliability these low level controls are useful for high latency networks increase connect_timeout to allow more time for connection establishment long lived connections configure keep_alive settings to detect and recover from stale connections unstable networks tune keep alive probes to balance between quick failure detection and avoiding false positives linux systems with specific requirements use tcp_user_timeout linux 2 6 37 to control data acknowledgment timeouts most users should keep the default values only modify these settings if you re experiencing connection stability issues or have spec...