Source Registry¶

Complete reference for all data source types supported by Dango.

Overview¶

Dango supports 33 data sources across 10 categories, using 5 authentication types. Sources are added via dango source add (wizard-enabled) or manual YAML configuration in .dango/sources.yml.

• 25 wizard-enabled sources can be configured interactively
• 8 wizard-disabled sources require manual YAML configuration or the dlt_native bypass
• Sources without a dedicated Pydantic config model use generic_config: dict in YAML

Source Summary¶

Source	Type Key	Category	Auth	Wizard	Incremental
File Import (CSV, JSON, Parquet)	local_files	Local & Custom	None
REST API (Generic)	rest_api	Local & Custom	API Key
dlt Native Source (Advanced)	dlt_native	Local & Custom	None
CSV Files	csv	Local & Custom	None
Files & Cloud Storage	filesystem	Local & Custom	None
Google Sheets	google_sheets	Marketing & Analytics	OAuth
Facebook Ads	facebook_ads	Marketing & Analytics	OAuth
Google Analytics (GA4)	google_analytics	Marketing & Analytics	OAuth
Google Ads	google_ads	Marketing & Analytics	OAuth
Mux	mux	Marketing & Analytics	API Key
Airtable	airtable	Marketing & Analytics	API Key
Matomo Analytics	matomo	Marketing & Analytics	API Key
HubSpot	hubspot	Business & CRM	API Key
Salesforce	salesforce	Business & CRM	Service Account
Zendesk	zendesk	Business & CRM	Basic
Pipedrive	pipedrive	Business & CRM	API Key
Freshdesk	freshdesk	Business & CRM	API Key
Workable	workable	Business & CRM	API Key
Jira	jira	Business & CRM	Basic
Asana	asana	Business & CRM	API Key
Stripe	stripe	E-commerce & Payment	API Key
Shopify	shopify	E-commerce & Payment	OAuth
Notion	notion	Files & Storage	API Key
Email Inbox (IMAP)	inbox	Files & Storage	Basic
MongoDB	mongodb	Databases	Basic
PostgreSQL	postgres	Databases	Basic
GitHub	github	Development	API Key
Slack	slack	Communication	API Key
Apache Kafka	kafka	Streaming	None
Amazon Kinesis	kinesis	Streaming	Service Account
Chess.com	chess	Other	None
Strapi	strapi	Other	API Key
Personio	personio	Other	API Key

Sources by Category¶

Local & Custom¶

File Import (local_files) ¶

Load CSV, JSON, JSONL, or Parquet files from a directory. All matching files are combined into a single raw table. On re-sync, new/modified files are loaded, deleted files are removed.

sources:
  - name: sales_data
    type: local_files
    local_files:
      directory: data/uploads/sales
      file_pattern: "*.csv"

REST API (rest_api) ¶

Connect to any REST API with configurable authentication (bearer, API key, basic, OAuth2 client credentials, custom header).

sources:
  - name: custom_api
    type: rest_api
    rest_api:
      base_url: https://api.example.com/v1
      auth_type: bearer
      auth_token_env: API_TOKEN
      endpoints:
        - path: /users
        - path: /orders
          params:
            limit: 100

dlt Native Source (dlt_native) ¶

Use any dlt verified source or custom source not in Dango's registry. For advanced users.

sources:
  - name: hubspot_crm
    type: dlt_native
    dlt_native:
      source_module: hubspot
      source_function: hubspot
      function_kwargs:
        api_key: "env:HUBSPOT_API_KEY"

CSV Files (csv)¶

Files & Cloud Storage (filesystem)¶

Marketing & Analytics¶

Google Sheets (google_sheets) ¶

Load data from Google Sheets (one or more tabs). Requires OAuth setup via dango oauth setup google.

sources:
  - name: budgets
    type: google_sheets
    google_sheets:
      spreadsheet_url_or_id: https://docs.google.com/spreadsheets/d/1abc...
      range_names:
        - Monthly Budget
        - Quarterly Forecast
      deduplication: latest_only

Facebook Ads (facebook_ads) ¶

Load ad campaigns, ads, creatives, leads, and daily performance metrics.

sources:
  - name: facebook_marketing
    type: facebook_ads
    facebook_ads:
      account_id: 123456789
      access_token_env: FB_ACCESS_TOKEN
      initial_load_past_days: 30

Default resources: campaigns, ads, ad_sets, facebook_insights

Available resources: campaigns, ads, ad_sets, ad_creatives, leads, facebook_insights

Google Analytics (google_analytics) ¶

Load website analytics data from Google Analytics 4. Supports custom report queries.

sources:
  - name: website_analytics
    type: google_analytics
    google_analytics:
      property_id: "123456789"
      credentials_env: GOOGLE_CREDENTIALS
      start_date: "2024-01-01"

Google Ads (google_ads) ¶

Load daily performance metrics from Google Ads via GAQL queries. Includes 5 default queries (campaign stats, ad group stats, keyword stats, ad stats, search term stats).

Mux (mux) ¶

Load video analytics data from Mux.

Airtable (airtable) ¶

Load tables from Airtable bases.

Matomo Analytics (matomo)¶

Business & CRM¶

HubSpot (hubspot) ¶

Load contacts, companies, deals, and tickets from HubSpot CRM.

sources:
  - name: hubspot_crm
    type: hubspot
    hubspot:
      api_key_env: HUBSPOT_API_KEY
      resources:
        - contacts
        - companies
        - deals

Available resources: contacts, companies, deals, tickets, products, quotes, owners, properties, pipelines_deal, pipelines_ticket

Salesforce (salesforce) ¶

Load data from Salesforce CRM using service account authentication.

Default resources: account, contact, lead, opportunity, campaign

Available resources: account, contact, lead, opportunity, campaign, task, event, sf_user, user_role, product_2

Zendesk (zendesk) ¶

Load support tickets, users, and chat data from Zendesk Support.

Default resources: tickets, ticket_fields

Available resources: tickets, ticket_fields, ticket_events, ticket_metric_events

Pipedrive (pipedrive) ¶

Load deals, contacts, and activities from Pipedrive CRM.

Freshdesk (freshdesk) ¶

Load support tickets, agents, and companies from Freshdesk.

Workable (workable) ¶

Load candidates, jobs, and events from Workable ATS.

Jira (jira)¶

Asana (asana)¶

E-commerce & Payment¶

Stripe (stripe) ¶

Load payment data from Stripe (charges, customers, subscriptions, etc.).

sources:
  - name: stripe_payments
    type: stripe
    stripe:
      stripe_secret_key_env: STRIPE_API_KEY
      endpoints:
        - charges
        - customers
        - invoices
      start_date: "2024-01-01"

Shopify (shopify)¶

Files & Storage¶

Notion (notion) ¶

Load pages and databases from Notion.

Email Inbox (inbox) ¶

Read messages and attachments from email inbox via IMAP.

Databases¶

MongoDB (mongodb) ¶

Load collections from MongoDB databases with incremental support.

PostgreSQL (postgres) ¶

Load tables from PostgreSQL databases with schema filtering.

Streaming¶

Apache Kafka (kafka) ¶

Extract messages from Kafka topics.

Amazon Kinesis (kinesis) ¶

Read messages from Kinesis streams.

Development¶

GitHub (github) ¶

Load repository data, issues, pull requests, and commits from GitHub.

sources:
  - name: my_repo
    type: github
    github:
      access_token_env: GITHUB_ACCESS_TOKEN
      owner: my-org
      name: my-repo

Communication¶

Slack (slack) ¶

Load messages, channels, and user data from Slack.

sources:
  - name: slack_data
    type: slack
    slack:
      access_token_env: SLACK_ACCESS_TOKEN
      selected_channels:
        - C01234ABCDE

Other¶

Chess.com (chess) ¶

Load player profiles and games from Chess.com API. No authentication required.

Strapi (strapi)¶

Personio (personio)¶

generic_config¶

Sources without a dedicated Pydantic configuration model use the generic_config field. This applies to 21+ sources including Zendesk, Pipedrive, Freshdesk, Workable, Airtable, Mux, Notion, Inbox, MongoDB, PostgreSQL, Kafka, Kinesis, and others.

The generic_config field accepts any key-value pairs that the underlying dlt source function expects:

sources:
  - name: my_zendesk
    type: zendesk
    generic_config:
      subdomain: mycompany
      email: [email protected]

Refer to the dlt documentation for source-specific parameters.

Capabilities Matrix¶

Authentication Types¶

Common Source Fields¶

These fields are available on every source regardless of type:

Related Pages¶

• Source Catalog — User-friendly guide to choosing sources
• Adding Sources — Step-by-step source configuration
• Configuration Reference — Full sources.yml schema