![]() You can also configure these options using the SQL Warehouse API. You can configure the following advanced options by expanding the Advanced options area when you create a new SQL warehouse or edit an existing SQL warehouse. See What are the available warehouse types? for the list. If serverless is enabled in your account, it will be the default. During a recycle period, you may temporarily see a cluster count that exceeds the maximum as Databricks transitions new workloads to the new cluster and waits to recycle the old cluster until all open workloads have completed. In order to maintain optimal performance, Databricks periodically recycles clusters. ![]() Azure Databricks recommends a cluster for every 10 concurrent queries. You can increase the maximum clusters if you want to handle more concurrent users for a given query. The default is a minimum and a maximum of one cluster. Scaling sets the minimum and maximum number of clusters that will be used for a query. Note that you can create a serverless SQL warehouse using the SQL warehouses API, in which case you can set the Auto Stop value as low as 1 minute. The minimum is 5 minutes when you use the UI. Serverless SQL warehouses: The default is 10 minutes, which is recommended for typical use.Pro and classic SQL warehouses: The default is 45 minutes, which is recommended for typical use.Idle SQL warehouses continue to accumulate DBU and cloud instance charges until they are stopped. To reduce query latency, increase the size.Īuto Stop determines whether the warehouse stops if it’s idle for the specified number of minutes. Warehouse settingsĬreating a SQL warehouse in the UI allows you to update the following settings:Ĭluster Size represents the size of the driver node and number of worker nodes associated with the cluster. Your SQL warehouse is now created and started. You can then configure warehouse permissions if you’d like.(Optional) Configure advanced options.Accept the default warehouse settings or edit them.To create a SQL warehouse using the web UI: The default warehouse settings create an efficient and high-performing SQL warehouse, but you can edit some of the settings to fit your workload needs. You can create warehouses using the SQL Warehouses page in the web UI, using the SQL Warehouse API, or Terraform. Contact your Azure account representative for more information.īefore you can create a serverless SQL warehouse in a region that supports the feature, there may be required steps. Your Azure account may have limitations on how much vCPU quota you can request. See Required Azure vCPU quota for classic and pro SQL warehouses. The default vCPU quota is usually adequate to create a serverless SQL warehouse but might not be enough to scale the SQL warehouse or to create additional warehouses. To manage a SQL warehouse you must be a workspace admin or have the Can Manage permission on the SQL warehouse.įor classic or pro SQL warehouses, your Azure account must have adequate vCPU quota. To create a SQL warehouse you must be a workspace admin or a user with unrestricted cluster creation permissions. SQL warehouses have the following requirements: You can edit or delete this SQL warehouse. ![]() To help you get started quickly, Azure Databricks creates a small SQL warehouse called Starter Warehouse automatically. By default, warehouses are sorted by state (running warehouses first), then in alphabetical order. To navigate to the SQL warehouse dashboard, click SQL Warehouses in the sidebar. ![]() Compute resources are infrastructure resources that provide processing capabilities in the cloud. What is a SQL warehouse?Ī SQL warehouse is a compute resource that lets you run SQL commands on data objects within Databricks SQL. You can also create SQL warehouses using the SQL warehouse API, or Terraform. You will also learn how to convert existing classic warehouses into serverless warehouses. This includes how to create, edit, and monitor existing SQL warehouses. This article explains how to configure and manage SQL warehouses using the Databricks SQL UI. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |