ClickHouse列式储存数据库

ClickHouse是俄罗斯第一大搜索引擎Yandex开发的列式储存数据库.令人惊喜的是,这个列式储存数据库的性能大幅超越了很多商业MPP数据库软件,比如Vertica,InfiniDB.

相比传统的数据库软件,ClickHouse要快100-1000X:

100Million 数据集:

• ClickHouse比Vertica约快5倍,比Hive快279倍,比My SQL快801倍

1Billion 数据集:

• ClickHouse比Vertica约快5倍,MySQL和Hive已经无法完成任务了

该项目当前还有一些不足:

• pre-build包只有Ubuntu平台的可用,并且该项目当前没有任何架构文档

• 只有Github上面的C++源代码

主要功能

• True column-oriented

• Vectorized query execution

• Data compression

• Parallel and distributed query execution

• Real-time data ingestion

• On-disk locality of reference

• Real-time query processing

• Cross-datacenter replication

• High availability

• SQL support

• Local and distributed joins

• Pluggable external dimension tables

• Arrays and nested data types

•  Approximate query processing

• Probabilistic data structures

• Full support of IPv6

• Features for web analytics

• State-of-the-art algorithms

• Detailed documentation

• Clean documented code

应用场景

• Web and App analytics

• Advertising networks and RTB

• Telecommunications

• E-commerce

• Information security

• Monitoring and telemetry

• Business intelligence

• Online games

• Internet of Things