Skip to content

Latest commit

 

History

History

pipeline

Requirements

Name Version
terraform >= 1.0.0
azurerm >= 3.58.0

Providers

No providers.

Modules

Name Source Version
bad_1_eh_topic snowplow-devops/event-hub/azurerm 0.1.1
collector_eh snowplow-devops/collector-event-hub-vmss/azurerm 0.3.0
collector_lb snowplow-devops/lb/azurerm 0.2.0
eh_namespace snowplow-devops/event-hub-namespace/azurerm 0.1.1
enrich_eh snowplow-devops/enrich-event-hub-vmss/azurerm 0.3.0
enriched_eh_topic snowplow-devops/event-hub/azurerm 0.1.1
lake_loader snowplow-devops/lake-loader-vmss/azurerm 0.3.0
lake_storage_container snowplow-devops/storage-container/azurerm 0.1.1
raw_eh_topic snowplow-devops/event-hub/azurerm 0.1.1
sf_loader snowplow-devops/snowflake-loader-vmss/azurerm 0.3.0
sf_message_queue_eh_topic snowplow-devops/event-hub/azurerm 0.1.1
sf_transformer_storage_container snowplow-devops/storage-container/azurerm 0.1.1
sf_transformer_wrj snowplow-devops/transformer-event-hub-vmss/azurerm 0.3.0
storage_account snowplow-devops/storage-account/azurerm 0.1.2

Resources

No resources.

Inputs

Name Description Type Default Required
iglu_server_dns_name The DNS name of your Iglu Server string n/a yes
iglu_super_api_key A UUIDv4 string to use as the master API key for Iglu Server management string n/a yes
prefix Will be prefixed to all resource names. Use to easily identify the resources created string n/a yes
resource_group_name The name of the resource group to deploy resources within string n/a yes
ssh_ip_allowlist The list of CIDR ranges to allow SSH traffic from list(any) n/a yes
ssh_public_key The SSH public key to use for the deployment string n/a yes
storage_account_name The name of the Storage Account the data will be loaded into string n/a yes
subnet_id_lb The ID of the subnet to deploy the load balancer into (e.g. collector-agw1) string n/a yes
subnet_id_servers The ID of the subnet to deploy the servers into (e.g. pipeline1) string n/a yes
accept_limited_use_license Acceptance of the SLULA terms (https://docs.snowplow.io/limited-use-license-1.0/) bool false no
confluent_cloud_api_key Confluent Cloud API Key string "" no
confluent_cloud_api_secret Confluent Cloud API Secret string "" no
confluent_cloud_bad_1_topic_name Confluent Cloud 'bad-1' topic name string "bad-1" no
confluent_cloud_bootstrap_server Confluent Cloud cluster bootstrap server string "" no
confluent_cloud_enriched_topic_name Confluent Cloud 'enriched' topic name string "enriched" no
confluent_cloud_raw_topic_name Confluent Cloud 'raw' topic name string "raw" no
confluent_cloud_snowflake_loader_topic_name Confluent Cloud 'snowflake-loader' topic name string "snowflake-loader" no
lake_enabled Whether to load all data into a Storage Container to build a data-lake based on Delta format bool false no
snowflake_account Snowflake account to use string "" no
snowflake_database Snowflake database name string "" no
snowflake_enabled Whether to enable loading into a Snowflake Database bool false no
snowflake_loader_password The password to use for the loader user string "" no
snowflake_loader_user The Snowflake user used by Snowflake Loader string "" no
snowflake_region Region of Snowflake account string "" no
snowflake_schema Snowflake schema name string "" no
snowflake_transformer_window_period_min Frequency to emit transforming finished message - 5,10,15,20,30,60 etc minutes number 5 no
snowflake_warehouse Snowflake warehouse name string "" no
ssl_information SSL certificate information to optionally bind to the load balancer
object({
enabled = bool
data = string
password = string
})
{
"data": "",
"enabled": false,
"password": ""
}
no
storage_account_deploy Whether this module should create a new storage account with the specified name - if the account already exists set this to false bool true no
stream_type The stream type to use as the Kafka Cluster between components (options: azure_event_hubs, confluent_cloud) string "azure_event_hubs" no
tags The tags to append to the resources in this module map(string) {} no
telemetry_enabled Whether or not to send telemetry information back to Snowplow Analytics Ltd bool true no
user_provided_id An optional unique identifier to identify the telemetry events emitted by this stack string "" no

Outputs

Name Description
collector_lb_fqdn The load balancers fully-qualified-domain-name for the Collector
collector_lb_ip_address The load balancers IP address for the Collector