Elasticsearch for Hadoop

太强了

 

 

Seamlessly Move Data between Elasticsearch and Hadoop

With a native integration and a rich query API, ES-Hadoop lets you index data directly into Elasticsearch from Hadoop, query Elasticsearch from Hadoop, and use HDFS as a long-term archive for Elasticsearch.

 

Queries Take (Sub)Seconds — Not Minutes, Hours, or Days

While Hadoop lets you batch, join, and analyze to your heart’s content, its queries aren’t the quickest. ES-Hadoop changes that by providing a bridge for index your Hadoop data into Elasticsearch, letting you take full advantage of its querying speed and get value from it faster than ever before.

 

Have Your Real-Time Search with Analytics, Too

Elasticsearch is a powerful search and analytics engine, fully-loaded with a variety of aggregations. ES-Hadoop is an easy way for you to index your Hadoop data into Elasticsearch and analyze (even visualize!) while you search.

 

Enhanced Security Keeps Your Big Data in the Right Hands

Manage who has access to your data and prevent snooping over the wire to preserve data confidentiality. ES-Hadoop's enhanced security includes basic HTTP authentication, support for SSL/TLS for connections between Elasticsearch and Hadoop clusters, and also works with Kerberos-enabled Hadoop and Shield-enabled Elasticsearch clusters.

 

Works with Any Flavor of Hadoop Distribution

We are official partners with Cloudera, Mapr, Hortonworks, Databricks, and Concurrent, so whether you're using vanilla Hadoop or other distributions, we've got you covered. We are certified on Cloudera Enterprise 5 and Certified Technology Partners with Hortonworks.

 

Get Maximum Flexibility Regardless of Computing Framework

The Hadoop ecosystem is rich with computing frameworks — ES-Hadoop lets you use Elasticsearch with many of them. We provide a dedicated Input and Output format for vanilla MapReduce, taps for reading and writing data in Cascading, storage handlers for Pig, table extensions for Hive, Spark Resilient Distributed Dataset (RDD) for Java and Scala, and support for Storm’s bolt and spout abstractions so you can access Elasticsearch just as if the data were in HDFS.

 

Visualize Your Hadoop Data using Kibana

Elasticsearch works with Kibana to help you visually explore your big data in real time. With beautifully designed graphs, charts, and maps, Kibana transforms your data into real-time, customizable dashboards that let you see the value in your data.