Apache Storm™ is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing.
具备经济、快速、可靠、易扩充、数据共享、设备共享、通讯方便、灵活等分布式所具备的特性
计算在多线程、进程 和 服务器之间并行进行
能管理工作进程 和 节点的故障
消息处理，能得到一次完成处理的保证
降低了并行批处理复杂性
利用 ZeroMQ 保证了消息的快速处理
加速应用开发
Apache Storm 和 Apache Kafka 相关知识，可以分别参考《Apache Storm 简介》和《Apache Kafka 分布式消息队列框架》
具体安装步骤，详见我的另一篇博客《Apache Eagle》
1 | $ bin/zookeeper-server-start.sh config/zookeeper.properties |
1 | $ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic my-replicated-topic |
1 | $ bin/kafka-topics.sh --list --zookeeper localhost:2181 |
Apache IoTDB™ (Database for Internet of Things) is an IoT native database with high performance for data management and analysis, deployable on the edge and the cloud.
Apache Drill™ is a distributed MPP query layer that supports SQL and alternative query languages against NoSQL and Hadoop data storage systems. It was inspired in part by Google’s Dremel.
