Meta tags:
description=Accelerators documentation;
author=Kx Systems, Inc., a division of FD Technologies plc.;

Headings (most frequently used words):

ingest, historic, onetick, us, comp, data, prerequisites, pipeline, options, example, next, steps,

Text of the page (most frequently used words):
the (40), #pipeline (24), equities (21), ice (21), onetick (20), otdataloader (19), data (18), bloomberg (15), analytics (14), and (12), consolidated (11), order (11), notes (10), release (9), ingest (9), env (9), ot_data_loader_s3_uri (9), set (9), overview (9), accelerators (9), for (8), quickstart (7), bucket (7), directory (7), this (7), historic (7), aws_access_key_id (6), aws_secret_access_key (6), access (6), custom (6), not (5), variables (5), fsi (5), aws_session_token (5), using (5), configure (5), environment (5), how (5), date (5), which (5), prerequisites (5), files (5), configuration (5), bpipe (5), with (4), all (4), kdb (4), next (4), start_date (4), date_limit (4), aws (4), format (4), options (4), from (4), yes (4), contains (4), status (4), comp (4), apis (4), use (4), generation (4), screener (4), get (4), started (4), volume (3), prep (3), realtime (3), accelerator (3), guide (3), steps (3), ot_data_loader_region (3), command (3), note (3), can (3), prefix (3), example (3), allows (3), sym (3), when (3), hdb (3), ingests (3), ingestion (3), page (3), library (3), fixed (3), income (3), book (3), releases (3), functions (3), examples (3), api (3), glossary (3), execution (3), 2026 (2), systems (2), inc (2), see (2), you (2), follow (2), deploy (2), aws_region (2), bucket_name (2), dates (2), parallel (2), will (2), should (2), required (2), running (2), key (2), managed (2), file (2), triggered (2), ready (2), that (2), following (2), pre (2), insights (2), enterprise (2), equity (2), customize (2), getbars (2), getstats (2), daily (2), content (2), feed (2), install (2), setup (2), query (2), window (2), adjustment (2), factor (2), analytic (2), settings (2), prevailing (2), values (2), developer (2), test (2), add (2), results (2), table (2), other (2), than (2), market (2), bar (2), home (2), made, material, mkdocs, insiders, rights, reserved, are, registered, trademarks, subsidiary, software, limited, previous, back, top, review, latest, updates, real, time, documentation, have, yet, deployed, omit, any, flags, need, insert_region, insert_start_date_for_sp_ingestion_from_s3, insert_aws_access_key_id, insert_aws_secret_access_key, insert_aws_session_token, kxi, app, uscomp, quickly, eval, export, credentials, first, used, below, starts, limits, many, ingested, attempt, yyyy, begin, ingesting, partitions, starting, earliest, availaible, optional, may, long, session, token, secret, full, uri, described, section, path, containing, purpose, variable, several, control, behavior, these, runtime, cli, details, inject, enumerations, copies, alongside, partitioned, monitors, checks, new, every, minutes, naming, convention, where, represents, year, month, yyyy_mm_dd, finished_yyyy_mm_dd, txt, text, signal, day, directories, 1314676, has, structure, confirm, your, before, describes, into, pipe, utility, extending, cancellations, corrections, errors, generateorderanalytics, getorderanalyticsummary, getticks, deployment, entitlements, filter, user, map, emrs, manual, about, combined, initializing, search, skip,

Text of the page (random words):
onetick us consolidated equities historic pipeline accelerators skip to content accelerators onetick us consolidated equities historic pipeline initializing search home get started accelerators how to apis examples releases accelerators home get started get started get started with accelerators prerequisites ice combined accelerator fsi accelerators overview fsi library overview accelerators accelerators about ice order book ice order book ice ob overview ice ob quickstart configure ice ob ice ingestion ice fixed income screener ice fixed income screener ice fi screener overview ice fi quickstart configure ice fi screener ice fi data ingestion ice fi historic data set up daily bar generation set up manual bar generation ice equities analytics ice equities analytics ice equities overview ice equities quickstart ingest market data order ingest pipeline results generation use a table other than order add custom analytics test custom analytics custom analytics developer guide configure using prevailing values order execution analytics configuration settings equities order analytic functions glossary query window adjustment factor bloomberg equities analytics bloomberg equities analytics bloomberg equities overview bloomberg equities quickstart ingest bloomberg market data order ingest pipeline use a table other than order results generation add custom analytics test custom analytics custom analytics developer guide configure using prevailing values order execution analytics configuration settings equities order analytic functions glossary query window adjustment factor bloomberg bpipe bloomberg bpipe bloomberg bpipe overview bloomberg bpipe quickstart bloomberg bpipe feed install and setup bloomberg emrs feed install and setup bloomberg to insights enterprise user map bloomberg entitlements filter onetick us consolidated equities onetick us consolidated equities onetick us consolidated equities quickstart onetick us consolidated equities realtime pipeline onetick us consolidated equities historic pipeline onetick us consolidated equities historic pipeline on this page prerequisites pipeline options example next steps onetick us consolidated equities data volume prep how to how to deployment and content configuration configuration in the fsi library use the accelerators set up daily pipeline execution apis apis api overview getticks getstats getbars getorderanalyticsummary generateorderanalytics customize getstats customize data for use with getbars api configuration api errors glossary examples examples cancellations and corrections extending accelerator apis utility functions releases releases overview ice order book release notes ice fixed income release notes ice equity analytics release notes bloomberg equity analytics release notes bloomberg b pipe release notes onetick volume prep release notes onetick us comp release notes fsi library release notes on this page prerequisites pipeline options example next steps ingest historic onetick us comp data this page describes how the otdataloader pipeline ingests historic onetick us comp data from an aws s3 bucket into kdb insights enterprise prerequisites the otdataloader pipeline ingests onetick data from an aws s3 bucket managed by kx and onetick confirm that your environment can access this bucket before running the pipeline the bucket has the following structure aws s3 ls s3 bucket prefix pre hdb pre status 2026 06 11 17 23 03 1314676 sym the bucket contains the following directories and files status directory contains text files that signal when a day of data is ready for ingestion by the otdataloader pipeline files follow the naming convention finished_yyyy_mm_dd txt where yyyy_mm_dd represents the year month and date of the data ready to ingest the otdataloader pipeline monitors this directory and checks for new data every 20 minutes hdb directory contains onetick us comp data in kdb date partitioned format the otdataloader ingests this data when triggered by files in the status directory sym file contains all sym enumerations for the data in the hdb directory the otdataloader copies this file alongside the date directory when triggered by files in the status directory pipeline options several environment variables control the behavior of the otdataloader pipeline set these at runtime using the cli for details see inject environment variables environment variable required purpose notes ot_data_loader_s3_uri yes path to bucket containing onetick data which is managed by kx and onetick format s3 bucket_name prefix should be the full uri as described in the prerequisites section ot_data_loader_region yes aws_region of ot_data_loader_s3_uri aws_access_key_id yes access key id which allows the otdataloader to access ot_data_loader_s3_uri aws_secret_access_key yes secret access key which allows the otdataloader to access ot_data_loader_s3_uri aws_session_token no session token which allows the otdataloader to access ot_data_loader_s3_uri optional may not be required if using long running aws_access_key_id and aws_secret_access_key start_date no the date from which the pipeline should begin ingesting partitions from ot_data_loader_s3_uri note will ingest starting at earliest availaible date if not set format yyyy mm dd date_limit no limits how many dates can be ingested in parallel note will attempt to ingest all dates in parallel if not set example the below command starts the otdataloader pipeline with all options set first set environment variables to be used by pipeline ot_data_loader_s3_uri s3 bucket_name prefix ot_data_loader_region insert_region start_date insert_start_date_for_sp_ingestion_from_s3 date_limit 2 aws_access_key_id insert_aws_access_key_id aws_secret_access_key insert_aws_secret_access_key aws_session_token insert_aws_session_token note variables aws_access_key_id aws_secret_access_key and aws_session_token can be quickly set using the command eval aws configure export credentials format env command to deploy the sp pipeline kxi pm deploy fsi app ot uscomp pipeline otdataloader env otdataloader ot_data_loader_s3_uri ot_data_loader_s3_uri env otdataloader ot_data_loader_region aws_region env otdataloader aws_access_key_id aws_access_key_id env otdataloader aws_secret_access_key aws_secret_access_key env otdataloader aws_session_token aws_session_token env otdataloader start_date start_date env otdataloader date_limit date_limit omit any env flags for variables you do not need next steps if you have not yet deployed the accelerator follow the quickstart guide to ingest real time data see the realtime pipeline documentation review the release notes for the latest updates back to top previous onetick us consolidated equities realtime pipeline next onetick us consolidated equities data volume prep 2026 kx systems inc all rights reserved kx kdb x and kdb are registered trademarks of kx systems inc a subsidiary of kx software limited made with material for mkdocs insiders