# Ingest

> Managed pipelines from any API (REST, GraphQL, SOAP, gRPC, WebSocket, files and SQL) into your
> warehouse or lake. WebSocket sources are bounded batch windows, not real-time delivery.

## Guides

- [The tables Ingest creates](https://connect.ingestdata.ai/docs/guides/tables): What lands in your warehouse (data tables, child tables, quarantine, the three _ingest_ control tables) and the semantics of each.

## API kinds

- [File](https://connect.ingestdata.ai/docs/api-kinds/file): Buckets and local paths via fsspec: `csv`, `jsonl`, `json`, `parquet`, `xlsx`.
- [GraphQL](https://connect.ingestdata.ai/docs/api-kinds/graphql): One document per resource, POSTed as `{query, operationName, variables}`.
- [gRPC](https://connect.ingestdata.ai/docs/api-kinds/grpc): A channel per resource, TLS by default, with auth carried in metadata.
- [REST](https://connect.ingestdata.ai/docs/api-kinds/rest): Ingest's original engine. Only `{method,url,headers,params,data,json,timeout,allow_redirects,ssl,proxy}` are forwarded to the transport.
- [SOAP](https://connect.ingestdata.ai/docs/api-kinds/soap): Envelope templates rendered with XML-escaped parameters, parsed with `lxml`.
- [SQL](https://connect.ingestdata.ai/docs/api-kinds/sql): Databases read through DB-API or ADBC with chunked fetch.
- [WebSocket](https://connect.ingestdata.ai/docs/api-kinds/websocket): A bounded batch window over a stream, not real-time delivery.

## Destinations

- [Amazon Athena](https://connect.ingestdata.ai/docs/destinations/athena): Iceberg tables in S3 and the AWS Glue Data Catalog, ready to query with Athena. Supports append, replace, and merge.
- [BigQuery](https://connect.ingestdata.ai/docs/destinations/bigquery): Load jobs straight from the worker. Native `MERGE`. No bucket to provision.
- [ClickHouse](https://connect.ingestdata.ai/docs/destinations/clickhouse): Native insert. Merge uses `ReplacingMergeTree` keyed by `dedup_sort`.
- [Databricks](https://connect.ingestdata.ai/docs/destinations/databricks): Loads through a Unity Catalog volume into Delta tables. Native MERGE for upserts.
- [DuckDB](https://connect.ingestdata.ai/docs/destinations/duckdb): Not a hosted destination. For DuckDB, use MotherDuck, or keep Iceberg tables in your own S3 bucket and query them with DuckDB.
- [Azure Blob Storage](https://connect.ingestdata.ai/docs/destinations/filesystem_azure): Parquet files in your Azure container, authorised by a connection string.
- [Google Cloud Storage](https://connect.ingestdata.ai/docs/destinations/filesystem_gcs): Parquet files in your own GCS bucket. Ingest holds no credential: your runs authenticate with the AWS identity your workspace already has.
- [Apache Iceberg](https://connect.ingestdata.ai/docs/destinations/filesystem_iceberg): Iceberg tables in your REST catalog. Catalog and storage authentication must be supported by the setup form.
- [Amazon S3](https://connect.ingestdata.ai/docs/destinations/filesystem_s3): Parquet files in your S3 bucket, written under a role you own and can revoke.
- [Generic SQL](https://connect.ingestdata.ai/docs/destinations/generic_sql): MySQL with batched inserts and transactional merge emulation. Review the current TLS setup limitation before connecting.
- [MotherDuck](https://connect.ingestdata.ai/docs/destinations/motherduck): DuckDB, hosted. Same adapter, same semantics.
- [SQL Server](https://connect.ingestdata.ai/docs/destinations/mssql): Not yet available as an Ingest destination.
- [Postgres](https://connect.ingestdata.ai/docs/destinations/postgres): The conformance oracle. `ON CONFLICT` merge, transactional.
- [Redshift](https://connect.ingestdata.ai/docs/destinations/redshift): COPY from your S3 staging prefix into Redshift, with native MERGE for upserts.
- [Snowflake](https://connect.ingestdata.ai/docs/destinations/snowflake): Tables in your Snowflake database, authenticated with your Ingest workspace identity. No stored Snowflake key or password.

## Connectors

- [abilene_311](https://connect.ingestdata.ai/docs/connectors/abilene_311): rest · public_data · beta
- [albanyny_311](https://connect.ingestdata.ai/docs/connectors/albanyny_311): rest · public_data · beta
- [annarbor_311](https://connect.ingestdata.ai/docs/connectors/annarbor_311): rest · public_data · beta
- [annearundelcounty_311](https://connect.ingestdata.ai/docs/connectors/annearundelcounty_311): rest · public_data · beta
- [anthropic](https://connect.ingestdata.ai/docs/connectors/anthropic): rest · analytics · beta
- [asana](https://connect.ingestdata.ai/docs/connectors/asana): rest · productivity · beta
- [auburnwa_311](https://connect.ingestdata.ai/docs/connectors/auburnwa_311): rest · public_data · beta
- [aurorail_311](https://connect.ingestdata.ai/docs/connectors/aurorail_311): rest · public_data · beta
- [austintexas_311](https://connect.ingestdata.ai/docs/connectors/austintexas_311): rest · public_data · beta
- [baltimore_311](https://connect.ingestdata.ai/docs/connectors/baltimore_311): rest · public_data · beta
- [batonrouge_311](https://connect.ingestdata.ai/docs/connectors/batonrouge_311): rest · public_data · beta
- [beaumont_311](https://connect.ingestdata.ai/docs/connectors/beaumont_311): rest · public_data · beta
- [bellevue_311](https://connect.ingestdata.ai/docs/connectors/bellevue_311): rest · public_data · beta
- [bellingham_311](https://connect.ingestdata.ai/docs/connectors/bellingham_311): rest · public_data · beta
- [berkeley_311](https://connect.ingestdata.ai/docs/connectors/berkeley_311): rest · public_data · beta
- [bethlehempa_311](https://connect.ingestdata.ai/docs/connectors/bethlehempa_311): rest · public_data · beta
- [bloomingtonin_311](https://connect.ingestdata.ai/docs/connectors/bloomingtonin_311): rest · public_data · beta
- [bocaraton_311](https://connect.ingestdata.ai/docs/connectors/bocaraton_311): rest · public_data · beta
- [boston_311](https://connect.ingestdata.ai/docs/connectors/boston_311): rest · civic · beta
- [bridgeport_311](https://connect.ingestdata.ai/docs/connectors/bridgeport_311): rest · public_data · beta
- [brockton_311](https://connect.ingestdata.ai/docs/connectors/brockton_311): rest · public_data · beta
- [brookline_311](https://connect.ingestdata.ai/docs/connectors/brookline_311): rest · public_data · beta
- [buffalony_311](https://connect.ingestdata.ai/docs/connectors/buffalony_311): rest · public_data · beta
- [burlingtonvt_311](https://connect.ingestdata.ai/docs/connectors/burlingtonvt_311): rest · public_data · beta
- [cambridge_311](https://connect.ingestdata.ai/docs/connectors/cambridge_311): rest · public_data · beta
- [cambridgema](https://connect.ingestdata.ai/docs/connectors/cambridgema): rest · public_data · beta
- [charlestoncountysc_311](https://connect.ingestdata.ai/docs/connectors/charlestoncountysc_311): rest · public_data · beta
- [charlottenc_311](https://connect.ingestdata.ai/docs/connectors/charlottenc_311): rest · public_data · beta
- [chulavista_311](https://connect.ingestdata.ai/docs/connectors/chulavista_311): rest · public_data · beta
- [cincinnati_311](https://connect.ingestdata.ai/docs/connectors/cincinnati_311): rest · public_data · beta
- [cityofchicago_311](https://connect.ingestdata.ai/docs/connectors/cityofchicago_311): rest · public_data · stable
- [cityofnewyork_311](https://connect.ingestdata.ai/docs/connectors/cityofnewyork_311): rest · public_data · stable
- [claytoncountyga_311](https://connect.ingestdata.ai/docs/connectors/claytoncountyga_311): rest · public_data · beta
- [cleveland_311](https://connect.ingestdata.ai/docs/connectors/cleveland_311): rest · public_data · beta
- [cobbcountyga_311](https://connect.ingestdata.ai/docs/connectors/cobbcountyga_311): rest · public_data · beta
- [columbus_311](https://connect.ingestdata.ai/docs/connectors/columbus_311): rest · public_data · beta
- [corona_311](https://connect.ingestdata.ai/docs/connectors/corona_311): rest · public_data · beta
- [dallas_311](https://connect.ingestdata.ai/docs/connectors/dallas_311): rest · public_data · beta
- [davenport_311](https://connect.ingestdata.ai/docs/connectors/davenport_311): rest · public_data · beta
- [denver_311](https://connect.ingestdata.ai/docs/connectors/denver_311): rest · public_data · beta
- [detroit_311](https://connect.ingestdata.ai/docs/connectors/detroit_311): rest · public_data · beta
- [elgin_311](https://connect.ingestdata.ai/docs/connectors/elgin_311): rest · public_data · beta
- [encinitas_311](https://connect.ingestdata.ai/docs/connectors/encinitas_311): rest · public_data · beta
- [everettwa_311](https://connect.ingestdata.ai/docs/connectors/everettwa_311): rest · public_data · beta
- [federalway_311](https://connect.ingestdata.ai/docs/connectors/federalway_311): rest · public_data · beta
- [fortlauderdale_311](https://connect.ingestdata.ai/docs/connectors/fortlauderdale_311): rest · public_data · beta
- [gilbert_311](https://connect.ingestdata.ai/docs/connectors/gilbert_311): rest · public_data · beta
- [google_ad_manager](https://connect.ingestdata.ai/docs/connectors/google_ad_manager): rest · advertising · beta
- [google_analytics](https://connect.ingestdata.ai/docs/connectors/google_analytics): rest · analytics · beta
- [greenwichct_311](https://connect.ingestdata.ai/docs/connectors/greenwichct_311): rest · public_data · beta
- [hartford_311](https://connect.ingestdata.ai/docs/connectors/hartford_311): rest · public_data · beta
- [honolulu_311](https://connect.ingestdata.ai/docs/connectors/honolulu_311): rest · public_data · beta
- [houston_311](https://connect.ingestdata.ai/docs/connectors/houston_311): rest · public_data · beta
- [howardcountymd_311](https://connect.ingestdata.ai/docs/connectors/howardcountymd_311): rest · public_data · beta
- [huntingtonwv_311](https://connect.ingestdata.ai/docs/connectors/huntingtonwv_311): rest · public_data · beta
- [huntsville_311](https://connect.ingestdata.ai/docs/connectors/huntsville_311): rest · public_data · beta
- [indy_311](https://connect.ingestdata.ai/docs/connectors/indy_311): rest · public_data · beta
- [jerseycity_311](https://connect.ingestdata.ai/docs/connectors/jerseycity_311): rest · public_data · beta
- [jira](https://connect.ingestdata.ai/docs/connectors/jira): rest · productivity · beta
- [kcmo_311](https://connect.ingestdata.ai/docs/connectors/kcmo_311): rest · public_data · beta
- [kentwa_311](https://connect.ingestdata.ai/docs/connectors/kentwa_311): rest · public_data · beta
- [knoxcountytn_311](https://connect.ingestdata.ai/docs/connectors/knoxcountytn_311): rest · public_data · beta
- [lacity_311](https://connect.ingestdata.ai/docs/connectors/lacity_311): rest · public_data · beta
- [lexingtonky_311](https://connect.ingestdata.ai/docs/connectors/lexingtonky_311): rest · public_data · beta
- [lincolnne_311](https://connect.ingestdata.ai/docs/connectors/lincolnne_311): rest · public_data · beta
- [linkedin_ads](https://connect.ingestdata.ai/docs/connectors/linkedin_ads): rest · advertising · beta
- [livonia_311](https://connect.ingestdata.ai/docs/connectors/livonia_311): rest · public_data · beta
- [louisville_311](https://connect.ingestdata.ai/docs/connectors/louisville_311): rest · public_data · beta
- [lubbock_311](https://connect.ingestdata.ai/docs/connectors/lubbock_311): rest · public_data · beta
- [maconbibb_311](https://connect.ingestdata.ai/docs/connectors/maconbibb_311): rest · public_data · beta
- [manchesternh_311](https://connect.ingestdata.ai/docs/connectors/manchesternh_311): rest · public_data · beta
- [mauicounty_311](https://connect.ingestdata.ai/docs/connectors/mauicounty_311): rest · public_data · beta
- [medfordma_311](https://connect.ingestdata.ai/docs/connectors/medfordma_311): rest · public_data · beta
- [memphis_311](https://connect.ingestdata.ai/docs/connectors/memphis_311): rest · public_data · beta
- [miami_311](https://connect.ingestdata.ai/docs/connectors/miami_311): rest · public_data · beta
- [miamidade_311](https://connect.ingestdata.ai/docs/connectors/miamidade_311): rest · public_data · beta
- [minneapolis_311](https://connect.ingestdata.ai/docs/connectors/minneapolis_311): rest · public_data · beta
- [montgomerycountymd_311](https://connect.ingestdata.ai/docs/connectors/montgomerycountymd_311): rest · public_data · beta
- [multnomahcounty_311](https://connect.ingestdata.ai/docs/connectors/multnomahcounty_311): rest · public_data · beta
- [naperville_311](https://connect.ingestdata.ai/docs/connectors/naperville_311): rest · public_data · beta
- [nashua_311](https://connect.ingestdata.ai/docs/connectors/nashua_311): rest · public_data · beta
- [nashville_311](https://connect.ingestdata.ai/docs/connectors/nashville_311): rest · public_data · beta
- [newarknj_311](https://connect.ingestdata.ai/docs/connectors/newarknj_311): rest · public_data · beta
- [noaa](https://connect.ingestdata.ai/docs/connectors/noaa): rest · weather · beta
- [nola_311](https://connect.ingestdata.ai/docs/connectors/nola_311): rest · public_data · beta
- [norfolk_311](https://connect.ingestdata.ai/docs/connectors/norfolk_311): rest · public_data · beta
- [oakland_311](https://connect.ingestdata.ai/docs/connectors/oakland_311): rest · public_data · beta
- [omaha_311](https://connect.ingestdata.ai/docs/connectors/omaha_311): rest · public_data · beta
- [openbrewerydb](https://connect.ingestdata.ai/docs/connectors/openbrewerydb): rest · food_and_drink · stable
- [paterson_311](https://connect.ingestdata.ai/docs/connectors/paterson_311): rest · public_data · beta
- [peoria_311](https://connect.ingestdata.ai/docs/connectors/peoria_311): rest · public_data · beta
- [phila_311](https://connect.ingestdata.ai/docs/connectors/phila_311): rest · public_data · beta
- [pinellascounty_311](https://connect.ingestdata.ai/docs/connectors/pinellascounty_311): rest · public_data · beta
- [pittsburgh_311](https://connect.ingestdata.ai/docs/connectors/pittsburgh_311): rest · public_data · beta
- [pokeapi](https://connect.ingestdata.ai/docs/connectors/pokeapi): rest · entertainment · beta
- [portlandme_311](https://connect.ingestdata.ai/docs/connectors/portlandme_311): rest · public_data · beta
- [postgres](https://connect.ingestdata.ai/docs/connectors/postgres): sql · databases · beta
- [princegeorgescountymd_311](https://connect.ingestdata.ai/docs/connectors/princegeorgescountymd_311): rest · public_data · beta
- [provo_311](https://connect.ingestdata.ai/docs/connectors/provo_311): rest · public_data · beta
- [raleigh_311](https://connect.ingestdata.ai/docs/connectors/raleigh_311): rest · public_data · beta
- [ramp](https://connect.ingestdata.ai/docs/connectors/ramp): rest · erp · beta
- [renton_311](https://connect.ingestdata.ai/docs/connectors/renton_311): rest · public_data · beta
- [rickandmortyapi](https://connect.ingestdata.ai/docs/connectors/rickandmortyapi): rest · entertainment · stable
- [sacramento_311](https://connect.ingestdata.ai/docs/connectors/sacramento_311): rest · public_data · beta
- [salesforce](https://connect.ingestdata.ai/docs/connectors/salesforce): rest · saas · beta
- [sanantonio_311](https://connect.ingestdata.ai/docs/connectors/sanantonio_311): rest · public_data · beta
- [sanfrancisco_311](https://connect.ingestdata.ai/docs/connectors/sanfrancisco_311): rest · public_data · beta
- [sangabriel_311](https://connect.ingestdata.ai/docs/connectors/sangabriel_311): rest · public_data · beta
- [sanjoseca_311](https://connect.ingestdata.ai/docs/connectors/sanjoseca_311): rest · public_data · beta
- [sanmateocounty_311](https://connect.ingestdata.ai/docs/connectors/sanmateocounty_311): rest · public_data · beta
- [sanrafael_311](https://connect.ingestdata.ai/docs/connectors/sanrafael_311): rest · public_data · beta
- [santafe_311](https://connect.ingestdata.ai/docs/connectors/santafe_311): rest · public_data · beta
- [scottsdale_311](https://connect.ingestdata.ai/docs/connectors/scottsdale_311): rest · public_data · beta
- [seattle_311](https://connect.ingestdata.ai/docs/connectors/seattle_311): rest · public_data · beta
- [shopify](https://connect.ingestdata.ai/docs/connectors/shopify): graphql · ecommerce · beta
- [somervillema_311](https://connect.ingestdata.ai/docs/connectors/somervillema_311): rest · public_data · stable
- [springfieldmo_311](https://connect.ingestdata.ai/docs/connectors/springfieldmo_311): rest · public_data · beta
- [stpetersburg_311](https://connect.ingestdata.ai/docs/connectors/stpetersburg_311): rest · public_data · beta
- [tacoma_311](https://connect.ingestdata.ai/docs/connectors/tacoma_311): rest · public_data · beta
- [toledo_311](https://connect.ingestdata.ai/docs/connectors/toledo_311): rest · public_data · beta
- [topeka_311](https://connect.ingestdata.ai/docs/connectors/topeka_311): rest · public_data · beta
- [vallejo_311](https://connect.ingestdata.ai/docs/connectors/vallejo_311): rest · public_data · beta
- [washingtondc_311](https://connect.ingestdata.ai/docs/connectors/washingtondc_311): rest · public_data · beta
- [waynecountymi_311](https://connect.ingestdata.ai/docs/connectors/waynecountymi_311): rest · public_data · beta
- [westdesmoines_311](https://connect.ingestdata.ai/docs/connectors/westdesmoines_311): rest · public_data · beta
- [wichita_311](https://connect.ingestdata.ai/docs/connectors/wichita_311): rest · public_data · beta
- [worcester_311](https://connect.ingestdata.ai/docs/connectors/worcester_311): rest · public_data · beta
- [youngstown_311](https://connect.ingestdata.ai/docs/connectors/youngstown_311): rest · public_data · beta