Bigdata Hadoop

Installing Apache Druid on the Local Machine

Bhavesh

Apache Druid is a real-time analytics database designed for fast slice-and-dice analytics (“OLAP” queries) on large data sets. Most often, Druid powers use cases where real-time ingestion, fast query performance, and high uptime are important.

Druid is commonly used as the database backend for GUIs of analytical applications, or for highly-concurrent APIs that need fast aggregations. Druid works best with event-oriented data.

Common application areas for Druid include:

  • Clickstream analytics including web and mobile analytics
  • Network telemetry analytics including network performance monitoring
  • Server metrics storage
  • Supply chain analytics including manufacturing metrics
  • Application performance metrics
  • Digital marketing/advertising analytics
  • Business intelligence/OLAP

Prerequisites

You can follow these steps on a relatively modest machine, such as a workstation or virtual server with 6 GiB of RAM.

The software requirements for the installation machine are:

  • Linux, Mac OS X, or other Unix-like OS. (Windows is not supported)
  • Java 8u92+, 11, or 17
  • Python 3 (preferred) or Python 2

Install Druid

Download the 28.0.0 release from Apache Druid.

In your terminal, extract the file and change directories to the distribution directory:

tar -xzf apache-druid-28.0.0-bin.tar.gz
cd apache-druid-28.0.0

Start up Druid services

Start up Druid services using the automatic single-machine configuration. This configuration includes default settings that are appropriate

./bin/start-nano-quickstart

[Tue Nov 29 16:31:06 2023] Starting Apache Druid.
[Tue Nov 29 16:31:06 2032] Open http://localhost:8888/ in your browser to access the web console.
[Tue Nov 29 16:31:06 2023] Or, if you have enabled TLS, use https on port 9088.
[Tue Nov 29 16:31:06 2023] Starting services with log directory [/apache-druid-28.0.0/log].
[Tue Nov 29 16:31:06 2023] Running command[zk]: bin/run-zk conf
[Tue Nov 29 16:31:06 2023] Running command[broker]: bin/run-druid broker /apache-druid-28.0.0/conf/druid/single-server/quickstart '-Xms1187m -Xmx1187m -XX:MaxDirectMemorySize=791m'
[Tue Nov 29 16:31:06 2023] Running command[router]: bin/run-druid router /apache-druid-28.0.0/conf/druid/single-server/quickstart '-Xms128m -Xmx128m'
[Tue Nov 29 16:31:06 2023] Running command[coordinator-overlord]: bin/run-druid coordinator-overlord /apache-druid-28.0.0/conf/druid/single-server/quickstart '-Xms1290m -Xmx1290m'
[Tue Nov 29 16:31:06 2023] Running command[historical]: bin/run-druid historical /apache-druid-28.0.0/conf/druid/single-server/quickstart '-Xms1376m -Xmx1376m -XX:MaxDirectMemorySize=2064m'
[Tue Nov 29 16:31:06 2023] Running command[middleManager]: bin/run-druid middleManager /apache-druid-28.0.0/conf/druid/single-server/quickstart '-Xms64m -Xmx64m' '-Ddruid.worker.capacity=2 -Ddruid.indexer.runner.javaOptsArray=["-server","-Duser.timezone=UTC","-Dfile.encoding=UTF-8","-X

Open the web console

After starting the Druid services, open the web console at http://localhost:8888.

By Bhavesh