Published inAltinity·Pinned1 Trillion Rows in ClickHouse, Part 1: Altinity.Cloud SetupA couple of months ago Data+AI Summit 2022 accepted one of my talk proposals. It describes how to give end users direct access to 1 trillion row datasets. There was just one problem: I didn’t have a dataset that large and needed to create one fast to vet samples for…Clickhouse9 min readClickhouse9 min read
Published inAltinity·Jul 12, 2022Momentum Dash is Building a More Centered Work Environment with PostHog and AltinityThe Opportunity Momentum Dash is a productivity tool that empowers over two million weekly active users to improve their focus, organization, and motivation at work and home. This popular browser extension has over two million people around the world using the app to achieve their goals faster and more consistently. The Problem Momentum Dash…Data Visualization3 min readData Visualization3 min read
Published inAltinity·Jul 6, 2022Battle of the Views — ClickHouse Window View vs Live ViewClickHouse added experimental Window Views starting from 21.12. Window Views aggregate data over a period of time, then automatically post at the end of the period. They add another exciting tool for stream processing and analytics to ClickHouse’s toolbox while expanding its collection of view tables. …Clickhouse11 min readClickhouse11 min read
Published inAltinity·Jun 17, 2022Fast MySQL to ClickHouse Replication: Announcing the Altinity Sink Connector for ClickHouseTransactional Databases like MySQL and PostgreSQL routinely process hundreds of thousands of transactions per second on busy web properties. For analyzing those transactions in real-time an analytic database like ClickHouse is a perfect fit as it provides a lot of benefits like columnar storage, efficient data compression and parallel query…Tutorial9 min readTutorial9 min read
Published inAltinity·Jun 2, 2022Too Wide or Not Too Wide — That is the ClickHouse QuestionClickHouse users often ask, “How many columns are too many? Can I have a table with 100 columns? 1000 columns? 5000 columns?” In truth there is no exact answer. We used to answer “don’t guess, but test.” So we decided to create an extreme example with 10 thousand (!) columns…Benchmark12 min readBenchmark12 min read
Published inAltinity·Jun 1, 2022Migrating Data from Snowflake to ClickHouse using S3 and ParquetSnowflake is now the most popular SQL data warehouse according to the influential DB Engines site. That said, ClickHouse is catching up rapidly and is now the leading open source competitor. ClickHouse offers consistent low latency response, freedom to run anywhere, and outstanding cost efficiency. …Clickhouse10 min readClickhouse10 min read
Published inAltinity·Mar 14, 2022Fixing the Dreaded ClickHouse Crash Loop on KubernetesAs countless ClickHouse users have learned, Kubernetes is a great platform for data. It’s portable to almost every IT environment. Managed Kubernetes services like Amazon EKS simplify operation. And the Altinity Kubernetes Operator for ClickHouse lets you start complex ClickHouse clusters from a single resource file. But there’s still the…Clickhouse9 min readClickhouse9 min read
Published inAltinity·Mar 14, 2022Loading 100B Rows in Minutes in Altinity.CloudA few weeks ago the SingleStore team published interesting research in their blog. They demonstrated how to load 100 billion rows in a database in 10 minutes. …Clickhouse10 min readClickhouse10 min read
Published inAltinity·Mar 3, 2022ClickHouse Black Magic: Skipping IndicesWritten with Lead Support Engineer Mikhail Filimonov. And in such indices, although small pricks To their subsequent volumes, there is seen The baby figure of the giant mass Of things to come at large. -William Shakespeare ClickHouse indices are different from traditional relational database management systems (RDMS) in that: Primary…Clickhouse9 min readClickhouse9 min read
Published inAltinity·Jan 21, 2022Altinity Introduces macOS Homebrew Tap for ClickHouseIf you are a technical person and use a Mac, it is virtually a given that the first thing you do on a fresh machine is install the Homebrew package manager. Nearly everything that is available through Homebrew can be installed manually by building from sources or just unpacking the…Clickhouse8 min readClickhouse8 min read