What Is New in Elasticsearch 6.3
Elasticsearch 6.3 delivers significant enhancements to SQL integration, cross-cluster replication, and indexing performance. This release also introduces new features for data frame management and improves overall stability.
| Category | Key Updates |
|---|---|
| New Features | SQL Access, Cross-Cluster Replication (Beta), Data Frames (Beta), Index Lifecycle Management (Beta) |
| Enhancements | Faster Indexing, Improved Recovery, Better Compression |
| Bug Fixes | Resolved issues in aggregation, mapping, and node discovery |
How does Elasticsearch 6.3 improve SQL integration?
This release introduces a dedicated SQL interface, allowing you to query Elasticsearch directly with SQL syntax. It includes a new CLI client and a JDBC driver for easier integration with existing tools.
You can now execute standard SQL commands and get tabular results back, which simplifies analytics for teams familiar with relational databases. The underlying engine translates SQL into efficient Elasticsearch queries.
What is Cross-Cluster Replication in 6.3?
Cross-cluster replication enters beta, enabling indices to be replicated across different clusters. This feature supports active-passive setups for disaster recovery and geo-distribution of data.
You can configure follower indices to pull changes from a leader index on a remote cluster. In practice, this simplifies keeping secondary clusters in sync without complex manual setups.
How are Data Frames used for transformations?
Data Frames (beta) provide a way to transform and summarize your existing Elasticsearch indices. You can pivot your data to create new aggregated indices for specific analytical use cases.
This feature is built for users who need to model their data differently without reindexing manually. It creates new purpose-built indices that are optimized for certain queries.
What indexing performance improvements were made?
Indexing throughput saw significant gains through optimizations in the internal engine. The changes reduce CPU overhead during document ingestion, especially for bulk operations.
They've also improved the efficiency of the stored fields compression, which helps with both indexing speed and storage footprint. You'll notice this most when handling large volumes of writes.
What management features were added?
Index Lifecycle Management (beta) allows you to automate index management policies through defined phases. You can configure actions like rollover, shrink, and delete based on age or size criteria.
This matters because it reduces the operational overhead of managing time-series data patterns. The system can now handle routine maintenance tasks automatically according to your policies.
FAQ
Is the SQL feature production-ready in 6.3?
Yes, the SQL interface is a fully supported feature, not a beta. It includes both a command-line interface and JDBC driver for production use.
Can I use cross-cluster replication between different Elasticsearch versions?
The beta cross-cluster replication in 6.3 requires compatible version matching between clusters. The follower cluster must be the same version as the leader cluster.
How do Data Frames differ from regular aggregations?
Data Frames create new persisted indices containing transformed data, while regular aggregations are computed on-the-fly during query time. Frames are better for repeated queries on summarized data.
What compression improvements were made for stored fields?
Elasticsearch 6.3 implements DEFLATE compression for stored fields instead of LZ4. This change reduces storage usage but may slightly increase CPU usage during compression.
Does Index Lifecycle Management work with existing indices?
Yes, you can apply lifecycle policies to both new and existing indices. The system will manage the indices according to the defined phases and actions in the policy.