cloudera-deploy icon indicating copy to clipboard operation
cloudera-deploy copied to clipboard

Add CDW playbook for DW datacatalog and virutal warehouse creation

Open raju-saravanan opened this issue 4 years ago • 0 comments

Listed below are the full sets of configurations that can be used in the DW playbook.

dw:
  overlay_network: {'yes' to enable overlay network}
  private_load_balancer: {'yes' to enable private load balancer}
  private_worker_nodes: {'yes' to enable private worker nodes}
  tags: {list of tags that will be applied to all the VWs created}
    <key1>: <"value1">
    <key2>: <"value2">
  definitions:
    - name: { if provided, this will be the name of the database catalog, else new one will be generated}
      use_default_dbc: {'yes' to use the default database catalog for below VWs}
      load_demo_data: {'yes' to load demo data}
      virtual_warehouses:
        - name: { if provided, this will be used, else a new name will be generated}
          vw_type: { this can be either 'hive' or 'impala' }
          template: { size of the vw, this can be 'xsmall', 'small', 'medium' etc]
          autoscaling: {VW autoscaling parameters}
             min_cluster: {min number of instances}
            max_cluster: {max number of instances}
          tags: {list of tags that will be applied to this VW}
            <key1>: <"value1">
            <key2>: <"value2">
          configs:
            common_configs: {common configs that will be applied to all applications, see 'dw_vw' module documentation}
            application_configs: {application specif configurations, see 'dw_vw' module documentation}
            enable_sso: {'yes' to enable sso}
            ldap_groups: {list of ldap groups to be enabled for auth}

Changes in this PR are done in conjunction with the following PRs:

  • Exe : https://github.com/cloudera-labs/cloudera.exe/pull/27
  • Cloud : https://github.com/cloudera-labs/cloudera.cloud/pull/19
  • CDPY: https://github.com/cloudera-labs/cdpy/pull/23

raju-saravanan avatar Jul 15 '21 09:07 raju-saravanan