Building extremely snappy customer-facing data products (that load w/ sub-second latency) with Propel first requires getting data into Propel. Or at least, it used to.
This month the team shipped Clickhouse pass-through functionality (more info in “What’s New” below), which allows you to build customer-facing data products directly on top of your existing Clickhouse or Clickhouse Cloud cluster (no data movement required).
It’s now available in beta; just sign up, connect your ClickHouse, and start building in minutes.
—
Also, last month, I had the chance to share the Propel story at the Data Council Conference.
I shared our journey building customer-facing real-time analytics at Twilio, how we turned that into a platform with Propel, and how you can leverage Propel to ship world-class analytics products in days, not months.
Check out the talk replay below, which I’m told features the first-ever live demo (!!) in Data Council history:
What’s New
April was an incredible month for Propel! Here are the highlights of what’s now available to help you build customer-facing analytics👇
- Propel Airbyte destination: send data from 350+ sources to Propel
- ClickHouse Data Pool beta: run Propel on top of your existing Clickhouse cluster
- 10x faster ingestion for the Webhook Data Pool: data now available for querying in single-digit seconds
- New SQL Playground: test SQL queries directly from the Propel console
- New GraphQL Playground: generate access tokens or test queries directly from the Propel console
✈️ Airbyte destination
The Airbyte destination lets you synchronize data from over 350+ sources to Propel's Serverless ClickHouse infrastructure. It provides an easy way to power your customer-facing analytics and data applications with data from any SaaS application, database, or platform supported by Airbyte.
Learn more about the Airbyte destination.
⚡️10x faster ingestion for the Webhook Data Pool
The Webhook Data Pool now ingests events 10x faster. We have optimized ingestion so that data is available within single-digit seconds.
Learn more about the Webhook Data Pool.
🛝 SQL Playground
With Propel’s new SQL Playground, you can execute SQL queries directly from the Console. This provides an easy way to explore your data when building applications.
Key Features:
- Code examples – easily integrate queries into your code. Get code examples for querying data using SQL via the API, cURL, and JavaScript.
- The "Query as" selector simulates querying as your app. Different apps have unique data query permissions set through Access Policies. The Playground allows you to test queries as a specific app.
- "Propeller" selector – experiment with query speeds. Test different query speeds to optimize performance and cost for your data application.
Log in to the Console and click "Playground", then select "API: SQL".
ClickHouse Data Pool beta
The ClickHouse Data Pool lets you read through to your self-hosted ClickHouse or ClickHouse Cloud rather than syncing data to Propel. This allows you to utilize the data in your analytic dashboards, reports, and workflows directly from your ClickHouse instance through the Propel APIs and UI components.
Learn more about the ClickHouse Data Pool.
GraphQL Playground
The GraphQL Playground enables you to run GraphQL queries directly from the Console, offering a simple way to interact with your data when building applications.
Key Features:
- GraphQL schema autocompletion
- Code examples
- Access token generator
Log in to the Console and click "Playground", then select "API: GraphQL".
✨ Coming soon: Materialized Views ✨
You can transform your data in real-time using SQL with the new Materialized Views. Data transformation is crucial for data aggregation and enrichment, setting the stage for dependable analytics and data applications.
Propel provides an extensive set of SQL functions, facilitating complex operations with ease. Furthermore, Propel ensures the integrity of your data throughout the transformation process, upholding the precision of your analytics.
If you are interested in trying out Materialized Views 👉🏻 Reply to this email.
Latest Posts and Episodes
From Propel
- How to stream PostgreSQL CDC to Kafka and use Propel to get an instant API (Blog post)
- MongoDB change data capture: An in-depth guide (Blog post)
- Lindsey Bell - Product Operations Take 2 (Podcast)
- Product teardown: Mux Data (LinkedIn)
From the community
- BI’s third form - Benn Stancil discusses how the analytics market is shifting towards building domain-specific tools for different business departments rather than generic BI tools.
- Lambda, Kappa, Delta Architectures for Data - short read on data architectures and their tradeoffs.
- What are React Server Components? - a significant advancement in React's rendering.
How to get started with Propel for free?
Easy peasy. Sign up and start building 👩🏽💻 🏗️ 🚀!
Thank you for reading!
Nico Acosta
Co-founder & CEO
If you find these product updates useful, please forward them to a colleague who can subscribe here. Alternatively, you can subscribe to our podcast, Data Chaos, on Spotify or Apple Podcasts.
