Published inAltinity·Pinned1 Trillion Rows in ClickHouse, Part 1: Altinity.Cloud SetupA couple of months ago Data+AI Summit 2022 accepted one of my talk proposals. It describes how to give end users direct access to 1 trillion row datasets. There was just one problem: I didn’t have a dataset that large and needed to create one fast to vet samples for…Clickhouse9 min readClickhouse9 min read
Nov 7Locking Down ClickHouse Networking: A Deep Dive into Securing Your Server’s Network (Part 2)This is the second and last part of the article series where we are looking at locking down ClickHouse networking. We’ll continue looking at securing the ClickHouse server by locking down its networking by picking up where we’ve left off in [Part 1]. Specifically, in the first part, we identified…Network Security15 min readNetwork Security15 min read
Nov 5Locking Down ClickHouse Networking: A Deep Dive into Securing Your Server’s Network (Part 1)In this two-part article series, we will be looking at securing the ClickHouse server by locking down its networking. Specifically, in this first part, we’ll identify what ports are opened by default as well as look at all the ports that can be opened by ClickHouse. We’ll also explore how…Network Security9 min readNetwork Security9 min read
Published inAltinity·Jul 12, 2022Momentum Dash is Building a More Centered Work Environment with PostHog and AltinityThe Opportunity Momentum Dash is a productivity tool that empowers over two million weekly active users to improve their focus, organization, and motivation at work and home. This popular browser extension has over two million people around the world using the app to achieve their goals faster and more consistently. The Problem Momentum Dash…Data Visualization3 min readData Visualization3 min read
Published inAltinity·Jul 6, 2022Battle of the Views — ClickHouse Window View vs Live ViewClickHouse added experimental Window Views starting from 21.12. Window Views aggregate data over a period of time, then automatically post at the end of the period. They add another exciting tool for stream processing and analytics to ClickHouse’s toolbox while expanding its collection of view tables. …Clickhouse11 min readClickhouse11 min read
Published inAltinity·Jun 17, 2022Fast MySQL to ClickHouse Replication: Announcing the Altinity Sink Connector for ClickHouseTransactional Databases like MySQL and PostgreSQL routinely process hundreds of thousands of transactions per second on busy web properties. For analyzing those transactions in real-time an analytic database like ClickHouse is a perfect fit as it provides a lot of benefits like columnar storage, efficient data compression and parallel query…Tutorial9 min readTutorial9 min read
Published inAltinity·Jun 2, 2022Too Wide or Not Too Wide — That is the ClickHouse QuestionClickHouse users often ask, “How many columns are too many? Can I have a table with 100 columns? 1000 columns? 5000 columns?” In truth there is no exact answer. We used to answer “don’t guess, but test.” So we decided to create an extreme example with 10 thousand (!) columns…Benchmark12 min readBenchmark12 min read
Published inAltinity·Jun 1, 2022Migrating Data from Snowflake to ClickHouse using S3 and ParquetSnowflake is now the most popular SQL data warehouse according to the influential DB Engines site. That said, ClickHouse is catching up rapidly and is now the leading open source competitor. ClickHouse offers consistent low latency response, freedom to run anywhere, and outstanding cost efficiency. …Clickhouse10 min readClickhouse10 min read
Published inAltinity·Mar 14, 2022Fixing the Dreaded ClickHouse Crash Loop on KubernetesAs countless ClickHouse users have learned, Kubernetes is a great platform for data. It’s portable to almost every IT environment. Managed Kubernetes services like Amazon EKS simplify operation. And the Altinity Kubernetes Operator for ClickHouse lets you start complex ClickHouse clusters from a single resource file. But there’s still the…Clickhouse9 min readClickhouse9 min read
Published inAltinity·Mar 14, 2022Loading 100B Rows in Minutes in Altinity.CloudA few weeks ago the SingleStore team published interesting research in their blog. They demonstrated how to load 100 billion rows in a database in 10 minutes. …Clickhouse10 min readClickhouse10 min read