Skip to main content
· 3 min read

June 2024

Materialized Views​

We're introducing Materialized Views in Propel’s Serverless ClickHouse as a powerful tool for data transformation. Developers can leverage Materialized Views to reshape, filter, or enrich data with SQL. Materialized Views are persistent query results that update dynamically as the original data changes.

The key benefit? Data is transformed in real time. No scheduling. No full-refreshes.

Materialized Views in ClickHouse

Learn more about Materialized Views

Rockset Migration Service​

OpenAI has announced the acquisition of Rockset, and as a result, the Rockset service will cease to operate. For those unfamiliar with Rockset, it was a cloud-hosted real-time analytics database that enabled millisecond-latency queries for aggregations and joins, similar to Propel.

We are pleased to announce the immediate availability of the Rockset Migration Service. This service is designed to offer a seamless transition for companies from Rockset.

To get started with the migration process, please schedule a kick-off call with our team here.

Propel's Rockset Migration Service

Customizable Table Engine and Sorting Key for all Data Pools​

We are thrilled to announce that Propel now supports customizable table engines and sorting keys for all Data Pools. What does this mean? Better query performance, more cost-efficient reads, and support for real-time updates and delete on any Data Pool type.

Table engines in Propel’s Serverless ClickHouse determine how tables store, process, read, and update their data.

The sorting key is a set of one or more columns that Propel uses to organize the rows within a table. It determines the order of the rows in the table and significantly impacts the query performance. If the rows are sorted well, Propel can efficiently skip over unneeded rows and thus optimize query performance.

This enhancement provides users with more flexibility and control over their data, allowing them to optimize their data pools for their specific use cases.

Customizable Table Engine and Sorting Key for all Data Pools

Learn more about the table engine and sorting key

Fixes​

Console​

  • The “Operations” tab for all Data Pool types.
  • All Data Pool types can now have a customizable Propeller in the “Preview Data” section.

Improvements​

Terraform​

  • The resource for Kafka Data Pools is now available.
  • The resource for ClickHouse Data Pools is now available.
  • The resource for Materialized View is now available.
  • The Data Pool resource now supports table settings.
  • The Unique ID field is now deprecated in the Data Pool resource.
  • The Tenant ID field is now deprecated in the Data Pool resource.
  • The timestamp field is now Optional in the Data Pool terraform.

API​

  • The API ADMIN scope is sufficient for Applications to get and list other Applications, but it does not allow them to fetch other Application secrets. This simplifies Terraforming of Data Pool Access Policies, which previously failed when the Terraform Application had only ADMIN scope.
  • The ClickHouse Data Source API is now public.
  • You can now modify the timestamp field in the Data Pool API.
  • The uniqueId and tenantId fields are now deprecated in the Webhook Connection Settings object