link管理

链接快照平台

输入网页链接，自动生成快照
标签化管理网页链接

" Fossies " - the Fresh Open Source Software Archive

Member "elasticsearch-7.17.22/docs/reference/release-notes.asciidoc" (5 Jun 2024, 3960 Bytes) of package / linux / www / elasticsearch-7.17.22.tar.gz :

As a special service "Fossies" has tried to format the requested source page into HTML format (assuming AsciiDoc format). Alternatively you can here view or download the uninterpreted source code file. A member file download can also be achieved by clicking within a package contents listing on the according byte size field. See also the last Fossies "Diffs" side-by-side code changes report for "release-notes.asciidoc":

8.9.1_vs_8.9.2 .

Release notes

The deprecated index.mapper.dynamic setting can break your cluster. It can only be set using the Update index settings API . Symptoms include nodes failing to start or shards failing to allocate. Do not use this setting in versions prior to 7.17.22. The bug is fixed in 7.17.22. (issue: {es-issue}109160[#109160])

Breaking changes

Bug fixes

Packaging

Due to a bug in the bundled JDK 22 nodes might crash abruptly under high memory pressure. We recommend downgrading to JDK 21.0.2 asap to mitigate the issue.

Bug fixes

Ingest Node

Force execution of SearchService.Reaper {es-pull}106544[#106544] (issue: {es-issue}106543[#106543])

Update to latest Lucene bugfix version 8.11.3 {es-pull}106365[#106365]

Adding a custom exception for problems with the graph of pipelines to be applied to a document {es-pull}105196[#105196]

Improving the performance of the ingest simulate verbose API {es-pull}105265[#105265]

Limiting the number of nested pipelines that can be executed {es-pull}105428[#105428]

Bug fixes

Ingest Node

Better handling of async processor failures {es-pull}104289[#104289] (issue: {es-issue}101921[#101921])

Ingest correctly handle upsert operations and drop processors together {es-pull}104585[#104585] (issue: {es-issue}36746[#36746])

Bug fixes

Distributed

Fix cancellation order in CancellableRateLimitedFluxIterator {es-pull}104259[#104259] (issue: {es-issue}103054[#103054])

Fix snapshot version in createSnapshotLegacy {es-pull}104354[#104354] (issue: {es-issue}86889[#86889])

High Memory Pressure due to a GC change in JDK 21

This version of Elasticsearch is bundled with JDK 21. In JDK 21 Preventive GC has been removed . This may lead to increased memory pressure and an increased number of CircuitBreakerExceptions when retrieving large documents under some particular load. (issue: {es-issue}99592[#99592])

If you needed to explicitly enable Preventive GC for your workload in a previous Elasticsearch version , we recommend you avoid to upgrade to this version, as the settings to enable Preventive GC have been removed from JDK 21.

Security updates

The 7.17.16 patch release contains a fix for a potential security vulnerability. Please see our security advisory for more details .

Bug fixes

Infra/Circuit Breakers

High Memory Pressure due to a GC change in JDK 21

Bug fixes

ILM+SLM

Ensure that all failures in TcpTransport#openConnection are treated consistently (all exceptions are now passed to the listener). {es-pull}101907[#101907] (issue: {es-issue}100510[#100510])

Protect NodeConnectionsService from stale connections {es-pull}92558[#92558] (issue: {es-issue}92029[#92029])

High Memory Pressure due to a GC change in JDK 21

Bug fixes

Infra/Core

High Memory Pressure due to a GC JVM setting change

This version of Elasticsearch is bundled with JDK 20. In JDK 20 Preventive GC is disabled by default . This may lead to increased memory pressure and an increased number of CircuitBreakerExceptions when retrieving large documents under some load patterns. (issue: {es-issue}99592[#99592])

If this change affects your use of Elasticsearch, consider re-enabling the previous behaviour by adding the JVM arguments -XX:+UnlockDiagnosticVMOptions -XX:+G1UsePreventiveGC (reference: JDK 20 release notes ). It is important to note that this workaround is temporary and works only with JDK 20, which is bundled with Elasticsearch up to version 7.17.13 inclusive. Successive versions are bundling JDK 21+, where this setting has been removed . Specifying those JVM arguments will prevent the JVM (and therefore Elasticsearch Nodes) from starting.

Security updates

{es} generally filters out sensitive information and credentials before logging to the audit log. It was found that this filtering was not applied when requests to {es} use certain deprecated _xpack/security URIs for APIs. The impact of this flaw is that sensitive information, such as passwords and tokens, might be printed in cleartext in {es} audit logs. Note that audit logging is disabled by default and needs to be explicitly enabled. Even when audit logging is enabled, request bodies that could contain sensitive information are not printed to the audit log unless explicitly configured.

The issue is resolved in {es} 7.17.13.

For more information, see our related security announcement .

High Memory Pressure due to a GC JVM setting change

Bug fixes

Aggregations

Capture max processors in static init {es-pull}97119[#97119] (issue: {es-issue}97088[#97088])

Preserve context in ResultDeduplicator {es-pull}84038[#84038] (issue: {es-issue}84036[#84036])

High Memory Pressure due to a GC JVM setting change

Bug fixes

Distributed

High Memory Pressure due to a GC JVM setting change

Bug fixes

Allocation

Allow ILM to transition to implicit cached steps {es-pull}91779[#91779] (issue: {es-issue}91749[#91749])

Avoiding BulkProcessor deadlock in ILMHistoryStore {es-pull}91238[#91238] (issues: {es-issue}68468[#68468], {es-issue}50440[#50440])

Retry clean and create snapshot if it already exists #83694 {es-pull}84829[#84829] (issue: {es-issue}83694[#83694])

Add checks for exception loops through suppressed exceptions only {es-pull}93944[#93944] (issue: {es-issue}93943[#93943])

Check no unassigned shards even if the node already left {es-pull}94722[#94722]

Fix _cluster/stats .nodes.fs deduplication {es-pull}94798[#94798] (issue: {es-issue}24472[#24472])

Fix FsInfo device deduplication {es-pull}94744[#94744]

Parsing a request when the last element in an array is filtered out (for instance using _source_includes ) fails. This is due to a bug in Jackson parser . Fixed in {es} 8.6.1 ({es-pull}92480[#91456])

Bug fixes

Authentication

Bug fixes

Add trace.id to request trace logs {es-pull}91772[#91772] (issue: {es-issue}88174[#88174])

DoPrivileged in ElasticsearchEncaughtExceptionHandler and check modify thread {es-pull}91704[#91704] (issue: {es-issue}91650[#91650])

Check for unassigned shards on node shutdown {es-pull}91297[#91297] (issue: {es-issue}88635[#88635])

Extend systemd startup timeout to 900s {es-pull}91338[#91338]

Bug fixes

Allocation

Extend the date rounding logic to be conditional {es-pull}89693[#89693] (issues: {es-issue}89096[#89096], {es-issue}58986[#58986])

Fix date rounding for date math parsing {es-pull}90458[#90458] (issue: {es-issue}90187[#90187])

Allow xpack.notification.email.account.domain_allowlist to be set dynamically {es-pull}90426[#90426] (issue: {es-issue}89913[#89913])

Handling timeout exceptions on watcher startup {es-pull}90421[#90421] (issue: {es-issue}44981[#44981])

Bug fixes

Cluster Coordination

Fix potential circuit breaker leak on InternalGeoGrid {es-pull}88273[#88273] (issue: {es-issue}88261[#88261])

Geo_line aggregation returns a geojson point when the resulting line has only one point {es-pull}89199[#89199] (issue: {es-issue}85748[#85748])

Port fixed version of Lucene Tessellator into ES 7.17 {es-pull}88213[#88213] (issue: {es-issue}88014[#88014])

Sort ranges in geo_distance aggregation {es-pull}89154[#89154] (issue: {es-issue}89147[#89147])

Bug fixes

Aggregations

Fix audit logging to consistently include port number in origin.address {es-pull}86732[#86732]

Support removing ignore filters for audit logging {es-pull}87675[#87675] (issue: {es-issue}68588[#68588])

Prevent invalid datastream metadata when CCR follows a datastream with closed indices on the follower {es-pull}87076[#87076] (issue: {es-issue}87048[#87048])

Remove some blocking in CcrRepository {es-pull}87235[#87235]

FastVectorHighlighter should use ValueFetchers to load source data {es-pull}85815[#85815] (issues: {es-issue}75011[#75011], {es-issue}84690[#84690], {es-issue}82458[#82458], {es-issue}80895[#80895])

FastVectorHighlighter should use ValueFetchers to load source data {es-pull}87445[#87445] (issues: {es-issue}75011[#75011], {es-issue}84690[#84690], {es-issue}82458[#82458], {es-issue}80895[#80895])

Clean up DeflateCompressor after exception {es-pull}87163[#87163] (issue: {es-issue}87160[#87160])

Prevent migration of indices that match templates {es-pull}87933[#87933] (issues: {es-issue}86801[#86801], {es-issue}87827[#87827])

Fix a source of "Discarding sample = nan, weights = …" log errors for time series anomaly detection {ml-pull}2286[#2286]

Fix ML task auditor exception early in cluster lifecycle {es-pull}87023[#87023] (issue: {es-issue}87002[#87002])

Do not leak recover from snapshot file permits when recover from snapshot is disabled {es-pull}87633[#87633] (issue: {es-issue}86705[#86705])

Fail shard if STARTED after master failover {es-pull}87451[#87451] (issue: {es-issue}87367[#87367])

Handle empty point values in DiskUsage API {es-pull}87826[#87826] (issue: {es-issue}87761[#87761])

Make sure to rewrite explain query on coordinator {es-pull}87013[#87013] (issue: {es-issue}64281[#64281])

Fork after calling getRepositoryData from StoreRecovery {es-pull}87254[#87254] (issue: {es-issue}87237[#87237])

Fork after calling getRepositoryData from StoreRecovery {es-pull}87264[#87264] (issue: {es-issue}87237[#87237])

Throw exception on illegal RepositoryData updates {es-pull}87654[#87654]

Make ML native processes work with glibc 2.35 (required for Ubuntu 22.04) {ml-pull}2272[#2272]

Improve normalization of anomaly detection results for short bucket lengths. This corrects bias which could cause our scoring to be too low for these jobs {ml-pull}2285[#2285] (issue: {ml-issue}2276[#2276])

Bug fixes

Cluster Coordination

Fix max_model_memory_limit reported by _ml/info when autoscaling is enabled {es-pull}86660[#86660]

Improve reliability of job stats in larger clusters {es-pull}86305[#86305]

Make autoscaling and task assignment use same memory staleness definition {es-pull}86632[#86632] (issue: {es-issue}86616[#86616])

Fix edge case which could cause the model bounds to inflate after detecting seasonality {ml-pull}2261[#2261]

Fix cause of "Must provide points at which to evaluate function" log error training classification and regression models {ml-pull}2268[#2268]

Better failure for source-only snapshots of partially/fully mounted indices {es-pull}86207[#86207]

Check if searchable snapshots cache pre-allocation is successful in Windows {es-pull}86192[#86192] (issue: {es-issue}85725[#85725])

Delay searchable snapshot allocation during shutdown {es-pull}86153[#86153] (issue: {es-issue}85052[#85052])

Bug fixes

Authorization

Allow retrieving boolean fields from _source in data frame analytics jobs {es-pull}85672[#85672]

Avoid multiple queued quantiles documents in renormalizer {es-pull}85555[#85555] (issue: {es-issue}85539[#85539])

Bug fixes

Client

Fork to WRITE thread when failing shard {es-pull}84606[#84606] (issue: {es-issue}84602[#84602])

Increase store ref before snapshotting index commit {es-pull}84776[#84776]

Allow removing unreferenced composable data stream templates {es-pull}84376[#84376] (issues: {es-issue}84171[#84171], {es-issue}84188[#84188])

Remove existing indices/datastreams/aliases before simulating index template {es-pull}84675[#84675] (issue: {es-issue}84256[#84256])

Backport mark GeoIpDownloaderTask as completed after cancellation #84028 {es-pull}85014[#85014] (issues: {es-issue}84028[#84028], {es-issue}84652[#84652])

CompoundProcessor should also catch exceptions when executing a processor {es-pull}84838[#84838] (issue: {es-issue}84781[#84781])

Allow autoscaling to work when vertical scaling is possible {es-pull}84242[#84242] (issue: {es-issue}84198[#84198])

Do not fetch source when finding index of last state docs {es-pull}85334[#85334]

Fix Kibana date format and similar overrides in text structure endpoint {es-pull}84967[#84967]

Fixes for multi-line start patterns in text structure endpoint {es-pull}85066[#85066]

Record node shutdown start time for each node {es-pull}84355[#84355]

Return all Datafeeds with GET Anomaly Detector {es-pull}84759[#84759]

Limit concurrent shard requests in disk usage API {es-pull}84900[#84900] (issue: {es-issue}84779[#84779])

Rewrite match and match_phrase queries to term queries on keyword fields {es-pull}85165[#85165] (issue: {es-issue}82515[#82515])

TransportBroadcastAction should always set response for each shard {es-pull}84926[#84926]

Fix DirectBlobContainerIndexInput cloning method {es-pull}84341[#84341] (issue: {es-issue}84238[#84238])

Fix atomic writes in HDFS {es-pull}85210[#85210]

Fix leaking listeners bug on frozen tier {es-pull}85239[#85239]

Deprecations

Infra/Core

Always re-run Feature migrations which have encountered errors {es-pull}83918[#83918] (issue: {es-issue}83917[#83917])

Copy trace.id in threadcontext stash {es-pull}83218[#83218] (issue: {es-issue}81381[#81381])

Correctly migrate system indices that are still using named types {es-pull}83817[#83817] (issue: {es-issue}83779[#83779])

Update system index metadata if _meta is null {es-pull}83896[#83896] (issue: {es-issue}83890[#83890])

Address cause of "[CStatisticalTests.cc@102] Test statistic is nan" log errors {ml-pull}2196[#2196]

Address possible causes of "x = NaN, distribution = N5boost4math23students_t_distribution" log errors {ml-pull}2197[#2197]

Fix bug restoring data gatherer state for time of day and week anomaly detection functions {ml-pull}2213[#2213]

Avoid eagerly loading StoredFieldsReader in fetch phase {es-pull}83693[#83693] (issue: {es-issue}82777[#82777])

Do not deserialise the document when not needed in the fields fetch phase {es-pull}84184[#84184]

Returns valid PIT when no index matched {es-pull}83424[#83424]

{es} fails to parse system index migration data from the cluster state (issue: {es-issue}84115[#84115])

Feature migration refuses to run if all features requiring upgrade have encountered errors (issue: {es-issue}83917[#83917])

Migrating system indices fails for tasks with mapper_parsing_exception (issue: {es-issue}83779[#83779])

These issues will impact any subsequent upgrade to 8.x, and are fixed in 7.17.1. We strongly recommend that all users upgrade to a later patch release of 7.17 before upgrading to 8.x.

Deprecations

Mapping

Allow read template with cluster monitor privilege {es-pull}82046[#82046] (issue: {es-issue}78832[#78832])

Make authorization performance log message configurable and disabled by default {es-pull}82648[#82648] (issue: {es-issue}75439[#75439])

Add {kib} system permissions for Endpoint action indices {es-pull}81953[#81953]

Add an index→step cache to the PolicyStepsRegistry {es-pull}82316[#82316] (issue: {es-issue}77466[#77466])

Migrate legacy/v2/component templates away from custom attributes routing {es-pull}82472[#82472] (issue: {es-issue}82170[#82170])

Migrate to data tiers API dry run on any ILM status {es-pull}82226[#82226] (issue: {es-issue}82169[#82169])

Allow scaling executors to reject tasks after shutdown {es-pull}81856[#81856] (issues: {es-issue}77017[#77017], {es-issue}77178[#77178])

Prevent direct upgrade of indices from 6.8 to 8.0 {es-pull}82689[#82689] (issue: {es-issue}81326[#81326])

Fix bucket keys format for range aggregations on float field {es-pull}81801[#81801] (issue: {es-issue}81749[#81749])

Fix cardinality aggregation in asynchronous search {es-pull}82108[#82108]

Fix missing fields in range aggregation response for date fields {es-pull}82732[#82732] (issue: {es-issue}82688[#82688])

Handle degenerated rectangles in vector tiles {es-pull}82404[#82404] (issue: {es-issue}81891[#81891])

GeoPolygonDecomposer might fail due to numerical errors when calculating intersection with the dateline {es-pull}82953[#82953] (issue: {es-issue}82840[#82840])

Migrate the coldest node attribute for data tier routing {es-pull}81940[#81940] (issue: {es-issue}81633[#81633])

Retry ILM step to safely refresh the cached phase {es-pull}82613[#82613] (issue: {es-issue}81921[#81921])

Fix ILM allocate action to allow only total_shards_per_node {es-pull}81944[#81944] (issue: {es-issue}81943[#81943])

Add doPrivileged section in deprecation logger {es-pull}81819[#81819] (issue: {es-issue}81708[#81708])

Always emit product origin to deprecation log if present {es-pull}83115[#83115]

Filter enrich policy index deletes to just the policy’s associated indices {es-pull}82568[#82568]

Fix enrich cache corruption bug {es-pull}82441[#82441] (issue: {es-issue}82340[#82340])

Fix annotations index maintenance after reindexing {es-pull}82304[#82304] (issue: {es-issue}82250[#82250])

Improve cleanup for model snapshot upgrades {es-pull}81831[#81831] (issue: {es-issue}81578[#81578])

Make delete intervening results more selective {es-pull}82437[#82437]

Skip time to next interval with data for datafeeds with aggs {es-pull}82488[#82488] (issue: {es-issue}82406[#82406])

Update running process when global calendar changes {es-pull}83044[#83044]

Avoid transient poor time series modeling after detecting new seasonal components. This can affect cases where there are fast and slow repeats in the data, for example 30 minutes and 1 day, and the job uses a short bucket length. {ml-pull}2167[#2167] (issue: {ml-issue}2166[#2166])

Change deprecation.skip_deprecated_settings to work with dynamic settings {es-pull}81836[#81836]

Check both node and cluster settings in NodeDeprecationChecks {es-pull}82487[#82487] (issue: {es-issue}82484[#82484])

Ignore dynamic settings specified by deprecation.skip_deprecated_settings in node deprecation checks {es-pull}82883[#82883] (issue: {es-issue}82889[#82889])

Always fail snapshot deletion listeners on master failover {es-pull}82361[#82361] (issue: {es-issue}81596[#81596])

Fix potential repository corruption during master failover {es-pull}82912[#82912] (issue: {es-issue}82911[#82911])

Remove requirement for key setting on Azure client settings {es-pull}82030[#82030]

Support GKE workload identity for searchable snapshots {es-pull}82974[#82974] (issue: {es-issue}82702[#82702])

Fix LangIdent model when multiple unicode scripts are present {es-pull}81876[#81876] (issue: {es-issue}80675[#80675])

Model snapshot upgrade needs a stats endpoint {es-pull}81641[#81641] (issue: {es-issue}81519[#81519])

A high severity vulnerability ( CVE-2021-44228 ) for Apache Log4j 2 versions 2.0 to 2.14 was disclosed publicly on the project’s GitHub on December 9, 2021.

For information about affected {es} versions and mitigation steps, see our related security announcement .

Painless: Any Painless script where a method call resolves a lambda argument to a UnaryOperator or a BinaryOperator type results in an IllegalArgumentException . This exception results in a compilation error when static types are used, or a runtime error for dynamic types. Use standard procedural statements as a workaround, such as if/else , while , and for statements.

The following example is a UnaryOperator type that will result in a failure:

List l = ['abc', '123']; l.replaceAll(f -> f.replace('abc', 'doremi');

The following example is a possible workaround:

List l = ['abc', '123'];
for (int i = 0; i < l.size(); ++i) {
    l.set(i, l.get(i).replace('abc', 'doremi'));
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Infra/Logging
Disable JNDI lookups via the log4j2.formatMsgNoLookups system property {es-pull}81622[#81622]
Patch log4j jar to remove the JndiLookup class from the classpath {es-pull}81629[#81629]
Fail fast remote cluster requests when skip_unavailable is true {es-pull}80589[#80589] (issue: {es-issue}74773[#74773])
Fix channel open trace logging {es-pull}81308[#81308]
Fix metrics reporting when sorting on aggregated values {es-pull}81510[#81510] (issue: {es-issue}81502[#81502])
Fix rearranging columns in PIVOT queries {es-pull}81032[#81032] (issue: {es-issue}80952[#80952])
Only resolve aliases if asked for local cluster {es-pull}81158[#81158] (issue: {es-issue}81157[#81157])
Fix wire compatibility version for transform cluster state {es-pull}81300[#81300] (issue: {es-issue}81292[#81292])
Handle PIT index not found error {es-pull}81368[#81368] (issues: {es-issue}81252[#81252], {es-issue}81256[#81256])
Add deprecation info and warnings for an empty _tier_preference {es-pull}79305[#79305] (issue: {es-issue}76147[#76147])
Adding deprecation logging and deprecation info API for ILM freeze ation {es-pull}77969[#77969] (issues: {es-issue}42404[#42404], {es-issue}70192[#70192])
Add frozen index deprecation check {es-pull}78915[#78915] (issue: {es-issue}70192[#70192])
Deprecate ignore_throttled parameter {es-pull}77479[#77479] (issue: {es-issue}70192[#70192])
Warn when searching a frozen index {es-pull}78184[#78184] (issue: {es-issue}70192[#70192])
Change default deprecation logger level to CRITICAL {es-pull}77030[#77030] (issue: {es-issue}76754[#76754])
Deprecation logs indexing is enabled by default {es-pull}78991[#78991] (issues: {es-issue}76292[#76292], {es-issue}78850[#78850])
Exposing the ability to log deprecated settings at non-critical level {es-pull}79107[#79107] (issues: {es-issue}77482[#77482], {es-issue}78781[#78781])
REST API to reset deprecation indexing cache {es-pull}78392[#78392] (issue: {es-issue}78134[#78134])
Add category field to deprecation logs {es-pull}77550[#77550] (issue: {es-issue}67443[#67443])
Painless: Any Painless script where a method call resolves a lambda argument
to a UnaryOperator or a BinaryOperator type results in an
IllegalArgumentException. This exception results in a compilation error when
static types are used, or a runtime error for dynamic types. Use standard
procedural statements as a workaround, such as if/else, while, and for
statements.
The following example is a UnaryOperator type that will result in a failure:
List l = ['abc', '123']; l.replaceAll(f -> f.replace('abc', 'doremi');
The following example is a possible workaround:
List l = ['abc', '123'];
for (int i = 0; i < l.size(); ++i) {
    l.set(i, l.get(i).replace('abc', 'doremi'));
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
New features
Data streams
Adds support for the rate aggregation under a composite aggregation {es-pull}76992[#76992] (issue: {es-issue}76988[#76988])
Interrupt aggregation reduce phase if the search task is cancelled {es-pull}71714[#71714] (issue: {es-issue}71021[#71021])
Add deprecation check for adjacency matrix setting {es-pull}77802[#77802] (issue: {es-issue}46327[#46327])
Replace RoutingTable#shardsWithState(…) with RoutingNodes#unassigned(…) {es-pull}78931[#78931] (issue: {es-issue}77466[#77466])
Reuse local node in async shard fetch responses {es-pull}77991[#77991] (issue: {es-issue}77266[#77266])
Add privileges to kibana_system for upgrading endpoint hidden indices {es-pull}80140[#80140]
Allow fleet-server service account to set up Fleet {es-pull}78192[#78192] (issue: {es-issue}78078[#78078])
Grant additional privileges for endpoint transform indices to kibana_system {es-pull}79619[#79619]
Grant privileges required by package upgrade to kibana_system {es-pull}78049[#78049] (issue: {es-issue}77294[#77294])
Optimize FLS/DLS setup in IndicePermission authz {es-pull}77832[#77832]
Skip loading authorized indices if requests do not need them {es-pull}78321[#78321]
Superuser fastpath for indexAccessControl {es-pull}78498[#78498]
Update transform destination index privilege for kibana_system {es-pull}79076[#79076]
Use fixed size memory allocation in IndicesPermission {es-pull}77748[#77748]
Add proper permissions to fleet server for Endpoint response index {es-pull}80231[#80231]
Migrate custom role providers to licensed feature {es-pull}79127[#79127]
Add timing stats to publication process {es-pull}76771[#76771] (issue: {es-issue}76625[#76625])
Get hot threads on lagging nodes {es-pull}78879[#78879]
Improve error message in 8.x to 7.x downgrade {es-pull}78644[#78644] (issue: {es-issue}78638[#78638])
Improve logging in LeaderChecker {es-pull}78883[#78883]
Mention "warn threshold" in master service slowlog {es-pull}76815[#76815] (issue: {es-issue}76625[#76625])
Recycle pages used by outgoing publications {es-pull}77407[#77407] (issue: {es-issue}77317[#77317])
Reuse previous indices lookup when possible {es-pull}79004[#79004] (issues: {es-issue}77888[#77888], {es-issue}78980[#78980])
Validate PING and STATE connections at join time {es-pull}77741[#77741]
Add Fleet search API to wait on refreshes {es-pull}73134[#73134] (issue: {es-issue}71449[#71449])
Add support for superseding in CancellableSingleObjectCache {es-pull}80199[#80199]
Add support for metrics aggregations to mvt end point {es-pull}78614[#78614] (issue: {es-issue}77072[#77072])
Include _index property for each hit in _mvt response {es-pull}77995[#77995] (issue: {es-issue}77205[#77205])
Add track_total_hits support in mvt API {es-pull}78074[#78074] (issue: {es-issue}77222[#77222])
Improve LifecycleExecutionState parsing {es-pull}77855[#77855] (issue: {es-issue}77466[#77466])
Reduce the number of times that LifecycleExecutionState is parsed when running a policy {es-pull}77863[#77863] (issue: {es-issue}77466[#77466])
Add built-in ILM policies for common user use cases {es-pull}76791[#76791]
Allow for setting the total shards per node in the Allocate ILM action {es-pull}76134[#76134]
Add upgrade preparation and completion callbacks to SystemIndexPlugin {es-pull}78542[#78542]
Cache index.hidden setting {es-pull}78612[#78612] (issue: {es-issue}77974[#77974])
Enable wait/blocked time accounting {es-pull}77935[#77935] (issue: {es-issue}72376[#72376])
Handle empty /proc/self/cgroup file {es-pull}78659[#78659] (issue: {es-issue}77833[#77833])
Implement framework for migrating system indices {es-pull}78951[#78951]
Require System Index Descriptors to allow a specific suffix {es-pull}78355[#78355]
Support mem type in nodes hot_threads API {es-pull}72850[#72850] (issue: {es-issue}70345[#70345])
Use enum field for HotThreads report type {es-pull}77462[#77462]
Add ability to augment classes with fields from other classes in Painless {es-pull}76628[#76628]
Add dynamic (duck) type resolution to Painless static types {es-pull}78575[#78575]
Adds a lookup method to Painless for finding methods of all sub classes {es-pull}77044[#77044]
UnsignedLong field type converter {es-pull}77271[#77271]
Compile/cache eviction history metric placeholders {es-pull}78257[#78257] (issue: {es-issue}62899[#62899])
Add show command to the keystore CLI {es-pull}76693[#76693] (issue: {es-issue}57261[#57261])
Filtering setting deprecation info API messages based on a setting {es-pull}78725[#78725]
Make enrich policy execution cancelable {es-pull}77188[#77188] (issue: {es-issue}48988[#48988])
Optimistic concurrency control for updating ingest pipelines {es-pull}78551[#78551] (issue: {es-issue}77031[#77031])
Sync grok processor patterns with Logstash {es-pull}76752[#76752]
Updating ingest pipeline without changes is no-op {es-pull}78196[#78196] (issue: {es-issue}77382[#77382])
Add new normalize_above parameter to p_value significant terms heuristic {es-pull}78833[#78833]
Add new default char filter first_line_with_letters for machine learning categorization {es-pull}77457[#77457]
Add new defer_definition_decompression parameter to put trained model API {es-pull}77189[#77189] (issue: {es-issue}77132[#77132])
Enable ML on macOS on ARM {es-pull}78203[#78203]
Track feature usage for data frame analytics, inference, and anomaly jobs {es-pull}76789[#76789]
Speed up training of regression and classification models {ml-pull}2024[#2024]
Improve concurrency for training regression and classification models {ml-pull}2031[#2031]
Improve aspects of implementation of skip_model_update rule {ml-pull}2053[#2053]
Make sure instrumentation captures the best hyperparameters found for training classification and regression models {ml-pull}2057{#2057}
Better error message for long keys in flattened fields {es-pull}80433[#80433] (issue: {es-issue}78248[#78248])
Add time_series_metric parameter {es-pull}76766[#76766] (issue: {es-issue}74014[#74014])
Add dimension mapping parameter {es-pull}74450[#74450] (issue: {es-issue}74014[#74014])
Use Cloudflare’s zlib in Docker images {es-pull}81245[#81245] (issue: {es-issue}81208[#81208])
Use almalinux as the Docker base image {es-pull}80524[#80524] (issue: {es-issue}76681[#76681])
Add support for peer recoveries using snapshots after primary failovers {es-pull}77420[#77420] (issue: {es-issue}73496[#73496])
Respect generational files in recoveryDiff {es-pull}77695[#77695] (issues: {es-issue}55142[#55142], {es-issue}55239[#55239])
Limit concurrent snapshot file restores in recovery per node {es-pull}79316[#79316] (issue: {es-issue}79044[#79044])
Add _ignored and _routing metatada fields to fields API {es-pull}78981[#78981] (issues: {es-issue}75836[#75836], {es-issue}78828[#78828])
Add _index and _version metatada fields to fields API {es-pull}79042[#79042] (issues: {es-issue}75836[#75836], {es-issue}78828[#78828])
Add ability to retrieve _id via fields option {es-pull}78828[#78828] (issue: {es-issue}75836[#75836])




    

Add node-level field capabilities API requests {es-pull}79212[#79212] (issues: {es-issue}74648[#74648], {es-issue}77047[#77047], {es-issue}78647[#78647])
Add segment sorter for data streams {es-pull}75195[#75195]
Add sort optimization with after from Lucene {es-pull}64292[#64292]
Don’t always rewrite the Lucene query in search phases {es-pull}79358[#79358]
Expand segment sorter for all timeseries indices {es-pull}78639[#78639] (issue: {es-issue}75195[#75195])
Node level can match action {es-pull}78765[#78765]
Search - return ignored field values from fields API {es-pull}78697[#78697] (issue: {es-issue}74121[#74121])
Support request cache on frozen tier {es-pull}77694[#77694] (issue: {es-issue}75309[#75309])
Use search_coordination threadpool for field capabilities API requests {es-pull}79378[#79378] (issue: {es-issue}79212[#79212])
Create a sha-256 hash of the shard request cache key {es-pull}74877[#74877] (issue: {es-issue}74061[#74061])
Add sort by shard count and failed shard count to get snapshots API {es-pull}77011[#77011]
Add descriptions to various tasks {es-pull}76700[#76700]
Add maintenance service to clean up unused docs in snapshot blob cache {es-pull}77686[#77686]
Add periodic maintenance task to clean up unused blob store cache docs {es-pull}78438[#78438] (issue: {es-issue}77686[#77686])
Filter Unneeded SnapshotInfo Instances Early in TransportGetSnapshotsAction {es-pull}78032[#78032] (issue: {es-issue}74350[#74350])
Implement exclude patterns for snapshot and repository names in get snapshots API {es-pull}77308[#77308]
Implement sort by repository name in get snapshots API {es-pull}77049[#77049]
Implement from_sort_value parameter in get snapshots API {es-pull}77618[#77618]
Add _meta field to TransformConfig {es-pull}79003[#79003] (issue: {es-issue}77506[#77506])
Add method to collect deprecations from a transform configuration {es-pull}77565[#77565]
Add transform upgrade endpoint {es-pull}77566[#77566]
Reduce indexes to query based on checkpoints {es-pull}75839[#75839]
Implement the ability to preview the existing transform {es-pull}76697[#76697] (issue: {es-issue}76427[#76427])
Add extra round trip to aggregation tests {es-pull}79638[#79638] (issue: {es-issue}73680[#73680])
Fix rate aggregation with custom _doc_count {es-pull}79346[#79346] (issue: {es-issue}77734[#77734])
Fix several potential circuit breaker leaks in aggregators {es-pull}79676[#79676]
Scale doubles to floats when necessary to match the field {es-pull}78344[#78344] (issue: {es-issue}77033[#77033])
Support for aggregation names with dots in first element path of a pipeline aggregation {es-pull}77481[#77481]
Avoid early release of local forking requests {es-pull}77641[#77641] (issues: {es-issue}77407[#77407], {es-issue}77634[#77634])
Check for global blocks after IndexNotFoundException in TransportMasterNodeAction {es-pull}78128[#78128] (issue: {es-issue}70572[#70572])
Improve control of outgoing connection lifecycles {es-pull}77295[#77295] (issue: {es-issue}67873[#67873])
Only remove active peer on connection failure {es-pull}79557[#79557] (issues: {es-issue}77295[#77295], {es-issue}79550[#79550])
Reduce merging in PersistedClusterStateService {es-pull}79793[#79793] (issue: {es-issue}77466[#77466])
Fix composite aggregation tests failing after #76740 {es-pull}77691[#77691] (issues: {es-issue}76740[#76740], {es-issue}77650[#77650])
Revert 74559 (Avoid global ordinals in composite) {es-pull}78846[#78846] (issues: {es-issue}74559[#74559], {es-issue}78836[#78836])
Add replicated field to get data stream API response {es-pull}80988[#80988] (issue: {es-issue}118899[#118899])
Correct check for write index and increment generation on all data stream backing index operations {es-pull}79916[#79916]
Fix data stream bug causing it to rollover to a non-existent Index {es-pull}79759[#79759]
Fix IndexNotFoundException error when handling remove alias action {es-pull}80312[#80312]
Fix data stream alias validation {es-pull}81040[#81040] (issue: {es-issue}80972[#80972])
Fix bug filtering collinear points on vertical lines {es-pull}81155[#81155] (issues: {es-issue}59501[#59501], {es-issue}81076[#81076])
Spherical mercator transformation should handle properly out of bounds latitudes {es-pull}81145[#81145] (issue: {es-issue}81128[#81128])
Vector tiles: Add key bucket value to the aggregation layer {es-pull}79634[#79634] (issue: {es-issue}79585[#79585])
Prevent duplicate ILM cluster state updates from being created {es-pull}78390[#78390] (issues: {es-issue}77466[#77466], {es-issue}78246[#78246])
Run ILM and SLM stopping cluster state updates at IMMEDIATE priority {es-pull}80207[#80207] (issue: {es-issue}80099[#80099])
Validate that snapshot repository exists for ILM policies during GenerateSnapshotNameStep {es-pull}77657[#77657] (issue: {es-issue}72957[#72957])
Avoid spurious deprecation warnings when calling Deprecation Info API {es-pull}78151[#78151] (issue: {es-issue}78098[#78098])
Fix overflow/underflow in CompositeBytesReference {es-pull}78893[#78893]
Fix race condition in Feature Migration Status API {es-pull}80572[#80572] (issue: {es-issue}79680[#79680])
Prevent stack overflow in rounding {es-pull}80450[#80450]
Set LIBFFI_TMPDIR at startup {es-pull}80651[#80651] (issues: {es-issue}18272[#18272], {es-issue}73309[#73309], {es-issue}74545[#74545], {es-issue}77014[#77014], {es-issue}77053[#77053], {es-issue}77285[#77285], {es-issue}80617[#80617])
Strip index blocks from settings for reindex targets {es-pull}80887[#80887] (issue: {es-issue}80654[#80654])
Eschew leniency when parsing time zones {es-pull}77267[#77267] (issues: {es-issue}73955[#73955], {es-issue}76415[#76415])
Fix ingest timezone parsing {es-pull}63876[#63876] (issue: {es-issue}63458[#63458])
Stricter UpdateSettingsRequest parsing on the REST layer {es-pull}79228[#79228] (issue: {es-issue}29268[#29268])
Fix flood stage with system indices {es-pull}80674[#80674]
Audit job open failures and stop any corresponding datafeeds {es-pull}80665[#80665] (issues: {es-issue}48934[#48934], {es-issue}80621[#80621])
Fix acceptable model snapshot versions in ML deprecation checker {es-pull}81060[#81060] (issues: {es-issue}79387[#79387], {es-issue}81039[#81039], {es-issue}119745[#119745])
Fix autoscaling capacity consistency {es-pull}81181[#81181]
Fix bug in inference stats persister for when feature reset is called {es-pull}77213[#77213] (issue: {es-issue}77182[#77182])
Fix datafeed preview with remote indices {es-pull}81099[#81099] (issue: {es-issue}77109[#77109])
Fix language identification bug when multi-languages are present {es-pull}80675[#80675]
Fix model snapshot sorting when sorting by min_version {es-pull}80596[#80596] (issue: {es-issue}80561[#80561])
ML legacy index templates that are no longer needed should be deleted {es-pull}80874[#80874] (issue: {es-issue}80876[#80876])
Need to tolerate .ml-config being an alias {es-pull}80025[#80025]
Parent datafeed actions to the datafeed’s persistent task {es-pull}81143[#81143]
Wait for .ml-state-write alias to be readable {es-pull}79731[#79731] (issue: {es-issue}79636[#79636])
Improve the estimates of hyperparameter importance in data frame analytics and avoid incorrectly stopping the hyperparameter search prematurely {ml-pull}2073[#2073]
Fix numerical instability in hyperparameter optimization for training regression and classification models {ml-pull}2078[#2078]
Fix numerical stability issues in time series modeling {ml-pull}2083[#[2083]]
Fix NULLS FIRST/LAST for aggregations {es-pull}77750[#77750] (issue: {es-issue}34550[#34550])
Fix use of requestTimeout and pageTimeout query parameters {es-pull}79360[#79360] (issue: {es-issue}72151[#72151])
Swap JDBC page.timeout and query.timeout properties in query requests {es-pull}79491[#79491] (issue: {es-issue}79430[#79430])
Minimize search source of shard level search requests {es-pull}80634[#80634] (issue: {es-issue}80187[#80187])
Prevent NullPointerException in SourceConfirmedTextQuery {es-pull}80472[#80472] (issue: {es-issue}80419[#80419])
_terms_enum API index_filter doesn’t work with _tier field on upgraded cluster {es-pull}79553[#79553] (issue: {es-issue}79200[#79200])
Undeprecate the auto complete thread pool {es-pull}80204[#80204]
Wildcard field regex query fix {es-pull}78839[#78839] (issue: {es-issue}78391[#78391])
Fix Queued Snapshot Clone not Starting after Data Node Drops Out {es-pull}77111[#77111] (issue: {es-issue}77101[#77101])
Fix Temporarily Leaking Shard Level Metadata Blobs in some Cases {es-pull}76562[#76562]
Fix after restore Lucene.pruneUnreferencedFiles() conditional {es-pull}81047[#81047] (issues: {es-issue}68821[#68821], {es-issue}75308[#75308])
Improve handling of corrupt index.latest blob {es-pull}77339[#77339]
Submit GCS delete batch requests incrementally {es-pull}80540[#80540]
Fix repository-azure for empty settings on reload {es-pull}79559[#79559]
Fix watcher check that determines when to serialize indices options {es-pull}78070[#78070] (issue: {es-issue}78035[#78035])
Fix index action simulation when indexing several documents {es-pull}76820[#76820] (issues: {es-issue}66735[#66735], {es-issue}74148[#74148])
Preserve request headers in a mixed version cluster {es-pull}79412[#79412] (issue: {es-issue}79354[#79354])
Try set operator user header on each node {es-pull}79528[#79528]
Add bucket_count_ks_test results reader for internode communication {es-pull}79063[#79063]
Fix cancellation of named pipe connection on Linux if the remote end does not connect within the configured timeout period {ml-pull}2102[#2102]
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Search
Fix bug with significant terms background count {es-pull}76730[#76730] (issue: {es-issue}76729[#76729])
Fix aggregation memory leak for CCS {es-pull}78404[#78404] (issue: {es-issue}72309[#72309])
Match IPv6 addresses without compressed id from settings {es-pull}77404[#77404] (issue: {es-issue}72091[#72091])
Change single node disk watermark deprecation to a warning {es-pull}77166[#77166] (issue: {es-issue}73733[#73733])
Make feature factory more resilient to invalid polygons {es-pull}77200[#77200] (issue: {es-issue}77071[#77071])
Support for aggregation names with dots in vector tiles {es-pull}77477[#77477] (issue: {es-issue}77361[#77361])
Add vector tile endpoint support for source parameters in the body of requests {es-pull}77377[#77377] (issues: {es-issue}77264[#77264], {es-issue}77365[#77365])
Change geo_shape mapping created before version 6.6.0 to use the legacy mapper {es-pull}77881[#77881] (issue: {es-issue}77857[#77857])
Ensure Node Shutdown doesn’t stall when all nodes in the cluster have a copy of a shard {es-pull}78578[#78578]
Handle master failure in NodeSeenService {es-pull}77220[#77220] (issue: {es-issue}76689[#76689])
Add support for QueryString-parsed wildcard queries on runtime keyword fields {es-pull}76867[#76867] (issue: {es-issue}76838[#76838])
Propagate original indices in NodeTermsEnumRequest {es-pull}77776[#77776] (issue: {es-issue}77508[#77508])
Choose postings format from FieldMapper instead of MappedFieldType {es-pull}77234[#77234] (issue: {es-issue}77183[#77183])
Fix issue where snapshot can get stuck if queued after a delete operation where a shard is in a MISSING state {es-pull}78587[#78587]
Fix AzureBlobStore#convertStreamToByteBuffer chunking in Windows {es-pull}78772[#78772]
Change the name of the shards field in _node/stats API to shard_stats {es-pull}78531[#78531] (issues: {es-issue}75433[#75433], {es-issue}78311[#78311])
Detect when a deserialized Map is immutable before changing it in IndexDiskUsageStats (#77219) {es-pull}77390[#77390] (issues: {es-issue}77219[#77219], {es-issue}77327[#77327])
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Aggregations: In {es} 7.14.0–7.15.0, when a {ccs} ({ccs-init}) request is proxied, the memory for the aggregations on the
proxy node will not be freed. The trigger is {ccs} using aggregations where minimize
roundtrips is not effective (for example, when minimize roundtrips is explicitly disabled, or implicitly disabled
when using scroll, async and point-in-time searches).
This affects {kib} {ccs-init} aggregations because {kib}
uses async search by default. This issue can also happen in all modes of remote connections
configured for {ccs} (sniff and proxy). In sniff mode, we only connect to a subset of the
remote nodes (by default 3). So if the remote node we want to send a request to is not one of those 3,
we must send the request as a proxy request. The workaround is to periodically restart nodes with heap pressure.
We have fixed this issue in {es} 7.15.1 and later versions. For more details,
see {es-pull}78404[#78404].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Infra/Core
Support 2b and 2y prefixes in bcrypt {es-pull}76083[#76083] (issues: {es-issue}51132[#51132], {es-issue}56086[#56086])
Support password_hash for Change Password API {es-pull}75500[#75500]
Fix privileges for GetRollupIndexCapabilities API {es-pull}75614[#75614] (issue: {es-issue}74779[#74779])
Granting kibana_system reserved role access to "all" privileges to .internal.alerts* index {es-pull}76624[#76624]
Add phase configs to ILM telemetry {es-pull}74575[#74575] (issue: {es-issue}69152[#69152])
Add validation of the number_of_shards parameter in Shrink Action of ILM {es-pull}74219[#74219] (issue: {es-issue}72724[#72724])
Allow ILM move-to-step without action or name {es-pull}75435[#75435] (issue: {es-issue}58128[#58128])
Update ILM message for out of order phases error {es-pull}75099[#75099] (issue: {es-issue}70336[#70336])
Script: Fields API for Sort and Score scripts {es-pull}75863[#75863] (issue: {es-issue}61388[#61388])
Script: Mangle user function names {es-pull}72892[#72892] (issue: {es-issue}69742[#69742])
Script: ulong via fields API {es-pull}76519[#76519] (issue: {es-issue}64361[#64361])
Configurable media_type for mustache template encoding on append processor {es-pull}76210[#76210]
Json processor: add_to_root_conflict_strategy option {es-pull}74967[#74967]
Json processor: allow duplicate keys {es-pull}74956[#74956]
Map iteration support for ForEach processor {es-pull}64062[#64062] (issue: {es-issue}55215[#55215])
Support for wildcards and override option for dot_expander processor {es-pull}74601[#74601]
Adding new p_value scoring heuristic to significant terms aggregation {es-pull}75313[#75313]
Delete expired annotations {es-pull}75617[#75617] (issue: {es-issue}75572[#75572])
Deleting a job now deletes the datafeed if necessary {es-pull}76010[#76010]




    

Integrating ML with the node shutdown API {es-pull}75188[#75188]
Throttle job audit msgs if delayed data occurs for consecutive buckets {es-pull}75815[#75815] (issue: {es-issue}73679[#73679])
Speed up training of regression and classification models on very large data sets {ml-pull}1941[#1941]
Improve regression and classification training accuracy for small data sets {ml-pull}1960[#1960]
Prune models for split fields (by, partition) that haven’t seen data updates for a given period of time {ml-pull}1962[#1962]
Ensure indexing_data is compressed appropriately {es-pull}76321[#76321] (issue: {es-issue}73497[#73497])
Respond with same compression scheme received {es-pull}76372[#76372] (issue: {es-issue}73497[#73497])
Accept settings in snake case in Docker image {es-pull}74327[#74327] (issue: {es-issue}74036[#74036])
Change env var prefix in Docker settings support {es-pull}76192[#76192] (issues: {es-issue}74327[#74327], {es-issue}76148[#76148])
Reduce default Docker image size in 7.x {es-pull}75079[#75079]
Tighten up write permissions in Docker image {es-pull}70635[#70635]
Add peer recoveries using snapshot files when possible {es-pull}76237[#76237] (issue: {es-issue}73496[#73496])
Add peer recovery planners that take into account available snapshots {es-pull}75840[#75840]
Compute latest snapshot directly in TransportGetShardSnapshotAction {es-pull}76254[#76254] (issue: {es-issue}73496[#73496])
Keep track of data recovered from snapshots in RecoveryState {es-pull}76499[#76499] (issue: {es-issue}73496[#73496])
Allow specifying index in pinned queries {es-pull}74873[#74873] (issue: {es-issue}67855[#67855])
Compress async search responses before storing {es-pull}74766[#74766] (issue: {es-issue}67594[#67594])
Emit multiple fields from a runtime field script {es-pull}75108[#75108] (issue: {es-issue}68203[#68203])
Replaced field_masking_span occurrences with respective ParseField {es-pull}74718[#74718] (issue: {es-issue}63527[#63527])
Search performance - better caching logic for queries on wildcard field {es-pull}76035[#76035] (issue: {es-issue}75848[#75848])
Support search slicing with point-in-time {es-pull}74457[#74457] (issue: {es-issue}65740[#65740])
Track Lucene field usage {es-pull}74227[#74227] (issue: {es-issue}73944[#73944])
Unsigned long should accept value with zero fraction {es-pull}75646[#75646] (issue: {es-issue}67565[#67565])
A new search API for API keys - core search function {es-pull}75335[#75335] (issues: {es-issue}71023[#71023], {es-issue}73705[#73705])
Add sort and pagination support for QueryApiKey API {es-pull}76144[#76144] (issue: {es-issue}71023[#71023])
HLRC support for query API key API {es-pull}76520[#76520] (issues: {es-issue}71023[#71023], {es-issue}75335[#75335], {es-issue}76144[#76144])
Query API key - Rest spec and yaml tests {es-pull}76238[#76238] (issue: {es-issue}71023[#71023])
Return file-backed service tokens from all nodes {es-pull}75200[#75200] (issue: {es-issue}74530[#74530])
OnChange listener now only runs when there is actual change {es-pull}75207[#75207] (issue: {es-issue}44701[#44701])
Add the ability to fetch the latest successful shard snapshot {es-pull}75080[#75080] (issue: {es-issue}73496[#73496])
Fix SnapshotInfo#toXContent delegation {es-pull}75899[#75899]
Implement Numeric Offset Parameter in Get Snapshots API {es-pull}76233[#76233] (issue: {es-issue}74350[#74350])
Include extra snapshot details in logs/APIs {es-pull}75917[#75917]
Prevent searchable snapshots indices to be shrunk/split {es-pull}75227[#75227] (issue: {es-issue}56595[#56595])
Return Total Result Count and Remaining Count in Get Snapshots Response {es-pull}76150[#76150]
Add KeyUsage, ExtendedKeyUsage, CipherSuite & Protocol to SSL diagnos… {es-pull}65634[#65634] (issue: {es-issue}63784[#63784])
Solved issue "certutil: large passwords not set" #30944 {es-pull}36689[#36689]
Align transform checkpoint range with date_histogram interval for better performance {es-pull}74004[#74004] (issue: {es-issue}62746[#62746])
Changing hard coded 10k page size limit to 65k {es-pull}74651[#74651] (issue: {es-issue}57719[#57719])
Improve performance by using point in time API for search {es-pull}74984[#74984] (issue: {es-issue}73481[#73481])
Optimize composite agg execution using ordered groupings {es-pull}75424[#75424]
Fix docCountError calculation for multiple reduces {es-pull}76391[#76391] (issues: {es-issue}43874[#43874], {es-issue}75667[#75667])
Fix wrong error upper bound when performing incremental reductions {es-pull}43874[#43874] (issue: {es-issue}40005[#40005])
Add system data streams to feature state snapshots {es-pull}75902[#75902] (issue: {es-issue}75860[#75860])
Fix for JarHell Bootstrap Check can yield false positives {es-pull}76217[#76217] (issue: {es-issue}75701[#75701])
Allow for larger models in the inference step for data frame analytics {es-pull}76116[#76116] (issue: {es-issue}76093[#76093])
Ignore exceptions while opening job after SIGTERM to JVM {es-pull}75850[#75850]
Prevent accidentally asking for more resources when scaling down and improve scaling size estimations {es-pull}74691[#74691] (issue: {es-issue}74709[#74709])
When setting upgrade mode ensure that internal actions don’t throw unnecessary permissions errors {es-pull}75880[#75880]
Fix potential "process stopped unexpectedly: Fatal error" for training regression and classification models  {ml-pull}1997[#1997] (issue: {ml-issue}1956[#1956])
Ensure replica requests are marked as index_data (#75008) {es-pull}75014[#75014] (issue: {es-issue}73497[#73497])
Fix memory/breaker leaks for outbound responses (#76474) {es-pull}76536[#76536] (issues: {es-issue}65921[#65921], {es-issue}76474[#76474])
Fix Get Snapshots Request Cancellation with ignore_unavailable=true {es-pull}78004[#78004] (issue: {es-issue}77980[#77980])
Fix Spurious Warnings During Snapshot Delete {es-pull}75911[#75911]
Include full blob key in Azure read operations exceptions {es-pull}75920[#75920] (issue: {es-issue}75916[#75916])
Not throwing FileNotFoundException if BlobContainer has been deleted {es-pull}75991[#75991]
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Aggregations: In {es} 7.14.0–7.15.0, when a {ccs} ({ccs-init}) request is proxied, the memory for the aggregations on the
proxy node will not be freed. The trigger is {ccs} using aggregations where minimize
roundtrips is not effective (for example, when minimize roundtrips is explicitly disabled, or implicitly disabled
when using scroll, async and point-in-time searches).
This affects {kib} {ccs-init} aggregations because {kib}
uses async search by default. This issue can also happen in all modes of remote connections
configured for {ccs} (sniff and proxy). In sniff mode, we only connect to a subset of the
remote nodes (by default 3). So if the remote node we want to send a request to is not one of those 3,
we must send the request as a proxy request. The workaround is to periodically restart nodes with heap pressure.
We have fixed this issue in {es} 7.15.1 and later versions. For more details,
see {es-pull}78404[#78404].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Mapping
Relocating job should not fail if blocked on revert {es-pull}77207[#77207] (issue: {es-issue}75377[#75377])
Retain job task upon fail during opening {es-pull}77206[#77206]
Retry reset if existing task was terminated abruptly {es-pull}77328[#77328] (issue: {es-issue}77207[#77207])
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Aggregations: In {es} 7.14.0–7.15.0, when a {ccs} ({ccs-init}) request is proxied, the memory for the aggregations on the
proxy node will not be freed. The trigger is {ccs} using aggregations where minimize
roundtrips is not effective (for example, when minimize roundtrips is explicitly disabled, or implicitly disabled
when using scroll, async and point-in-time searches).
This affects {kib} {ccs-init} aggregations because {kib}
uses async search by default. This issue can also happen in all modes of remote connections
configured for {ccs} (sniff and proxy). In sniff mode, we only connect to a subset of the
remote nodes (by default 3). So if the remote node we want to send a request to is not one of those 3,
we must send the request as a proxy request. The workaround is to periodically restart nodes with heap pressure.
We have fixed this issue in {es} 7.15.1 and later versions. For more details,
see {es-pull}78404[#78404].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Infra/Plugins
Fix Leaking Http Channel Objects when Http Client Stats are Disabled {es-pull}76257[#76257] (issue: {es-issue}76183[#76183])
Fix memory/breaker leaks for outbound responses {es-pull}76474[#76474] (issue: {es-issue}65921[#65921])
Disallow queries with inner LIMIT that cannot be executed in ES {es-pull}75960[#75960] (issue: {es-issue}75830[#75830])
Fix groupings on empty results and HAVING on local relations {es-pull}74809[#74809] (issue: {es-issue}74311[#74311])
Fix nested ORDER BY {es-pull}76277[#76277] (issues: {es-issue}75960[#75960], {es-issue}76013[#76013])
Fix field capabilities API’s TransportFieldCapabilitiesAction blocking transport thread {es-pull}75022[#75022]
Fork building aggregate index capabilities response to management pool {es-pull}76333[#76333]
Fix Bug Causing Queued Snapshots of Deleted Indices to Never Finalize {es-pull}75942[#75942]
Fix Concurrent Snapshot Repository Corruption from Operations Queued after Failing Operations {es-pull}75733[#75733] (issues: {es-issue}75501[#75501], {es-issue}75598[#75598])
Fix Finalizing Failed Shard Snapshots {es-pull}75953[#75953]
Fix NPE in Cat Snapshots API Default {es-pull}76161[#76161] (issue: {es-issue}76158[#76158])
Fix S3 Streaming Writes Ignoring Relative Paths for Large Writes {es-pull}76273[#76273]
Fix Snapshot State Machine Issues around Failed Clones {es-pull}76419[#76419]
Noop repository update should skip verification {es-pull}76067[#76067] (issue: {es-issue}76012[#76012])
Only start re-assigning persistent tasks if they are not already being reassigned {es-pull}76258[#76258]
Track cancellable tasks by parent ID {es-pull}76186[#76186] (issue: {es-issue}75316[#75316])
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Aggregations: In {es} 7.14.0–7.15.0, when a {ccs} ({ccs-init}) request is proxied, the memory for the aggregations on the
proxy node will not be freed. The trigger is {ccs} using aggregations where minimize
roundtrips is not effective (for example, when minimize roundtrips is explicitly disabled, or implicitly disabled
when using scroll, async and point-in-time searches).
This affects {kib} {ccs-init} aggregations because {kib}
uses async search by default. This issue can also happen in all modes of remote connections
configured for {ccs} (sniff and proxy). In sniff mode, we only connect to a subset of the
remote nodes (by default 3). So if the remote node we want to send a request to is not one of those 3,
we must send the request as a proxy request. The workaround is to periodically restart nodes with heap pressure.
We have fixed this issue in {es} 7.15.1 and later versions. For more details,
see {es-pull}78404[#78404].
Snapshot and restore: If a running snapshot is cancelled while a
previously-started snapshot is still ongoing and a later snapshot is enqueued
then there is a risk that some shard data may be lost from the repository. This
will cause future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1 to prevent concurrent snapshot
operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.14.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}75598[#75598].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Add entry to deprecation API for CLUSTER_ROUTING_ALLOCATION_INCLUDE_RELOCATIONS_SETTING {es-pull}73552[#73552] (issue: {es-issue}47717[#47717])
Deprecations for single data node setting {es-pull}73733[#73733] (issue: {es-issue}55805[#55805])
Deprecate camelCase parameters used by SAML APIs {es-pull}73984[#73984] (issue: {es-issue}73543[#73543])
Deprecate security implicitly disabled on trial/basic {es-pull}72339[#72339]
Add support for range aggregations on histogram mapped fields {es-pull}74146[#74146] (issue: {es-issue}74071[#74071])
Only enable "filter by filter" optimization for terms, date_histogram, range, and fitlers aggregation when we’re sure it’ll be faster {es-pull}74260[#74260]
Docvalueformat errors {es-pull}73121[#73121] (issue: {es-issue}72040[#72040])
Optimize lone single bucket date_histogram {es-pull}71180[#71180] (issue: {es-issue}69377[#69377])
Read aggregations directly from pooled buffers {es-pull}72309[#72309]
Reduce agg buckets only if competitive {es-pull}74096[#74096]
Service Accounts - add service token type to audit log {es-pull}73399[#73399] (issues: {es-issue}72198[#72198], {es-issue}73135[#73135])
Service Accounts - audit for security config change {es-pull}72555[#72555] (issue: {es-issue}72198[#72198])
Service Accounts - audit logging for service token name {es-pull}72198[#72198]
Service Accounts - enforcing token secret min length at authc time {es-pull}72519[#72519]
ApiKeyAuthCache now expires after access instead of write {es-pull}73982[#73982]
Granting kibana_system reserved role access to "all" privileges to .alerts* and .siem-signals* index {es-pull}72181[#72181]
Improve error when handling unexpected wildcards {es-pull}73079[#73079] (issues: {es-issue}43015[#43015], {es-issue}61245[#61245])
Make RBACEngine.resolveAuthorizedIndicesFromRole Return Set for Lookups {es-pull}72598[#72598]




    

Service Accounts - Disallow oauth2 creation {es-pull}72553[#72553]
Service Accounts - no roles in denial error message {es-pull}72517[#72517]
Support shard request cache for queries with DLS and FLS {es-pull}70191[#70191] (issue: {es-issue}44581[#44581])
Increase PeerFinder verbosity on persistent failure {es-pull}73128[#73128] (issue: {es-issue}72968[#72968])
Log elapsed time for host resolution timeouts {es-pull}72484[#72484]
Add X-Elastic-Product header on all HTTP responses {es-pull}73434[#73434] (issue: {es-issue}73424[#73424])
Add meta field to deprecation issue definition {es-pull}74085[#74085] (issue: {es-issue}73089[#73089])
Better out-of-the-box mappings for logs, metrics and synthetics {es-pull}64978[#64978] (issue: {es-issue}64400[#64400])
Make ILM Steps use Infinite Master Timeout {es-pull}74143[#74143] (issue: {es-issue}72085[#72085])
Retry ILM force merge step on shard failures {es-pull}73762[#73762] (issue: {es-issue}73142[#73142])
Add template snippets support for KV ingest processor {es-pull}73758[#73758] (issue: {es-issue}73377[#73377])
Enable GeoIP downloader by default {es-pull}74323[#74323]
Change GeoIP downloader policy after 30 days of no updates {es-pull}74099[#74099]
Expose Community ID processor in Painless {es-pull}73963[#73963] (issue: {es-issue}73346[#73346])
Expose URI parts processor in Painless {es-pull}73634[#73634] (issue: {es-issue}73346[#73346])
Verify that main info response returns correct product headers {es-pull}73910[#73910] (issue: {es-issue}73434[#73434])
Change GET method to POST in Searchtemplate {es-pull}72851[#72851] (issues: {es-issue}72073[#72073], {es-issue}72397[#72397])
Adds new running_state field to datafeed stats (#73926) {es-pull}74025[#74025]
Adds support for reset job API {es-pull}74254[#74254]
Add thread pool for critical operations on system indices {es-pull}72625[#72625] (issue: {es-issue}69251[#69251])
Add unenroll_timeout/unenrolled_reason field to Fleet system indices {es-pull}74180[#74180]
Add warnings if timer thread is late to wake up {es-pull}72465[#72465]
Log slow executions on scheduler thread {es-pull}72606[#72606] (issue: {es-issue}72465[#72465])
Protect newly introduced system indices fully {es-pull}74186[#74186] (issue: {es-issue}72572[#72572])
RestController not using thread context directly from thread pool {es-pull}74293[#74293]
Don’t assign persistent tasks to nodes shutting down {es-pull}72260[#72260] (issue: {es-issue}70338[#70338])
Make ILM aware of node shutdown {es-pull}73690[#73690] (issue: {es-issue}70338[#70338])
Add new bucket_correlation aggregation with initial count_correlation function {es-pull}72133[#72133]
Add new ml_standard tokenizer for ML categorization {es-pull}72744[#72744]
Adding running_state to datafeed stats object {es-pull}73926[#73926]
Adding new KS test pipeline aggregation {es-pull}73334[#73334]
Adds latest record timestamp to model snapshot deprecation warning {es-pull}73066[#73066]
Closing an anomaly detection job now automatically stops its datafeed if necessary {es-pull}74257[#74257]
Further increase memory estimates for categorization {es-pull}73370[#73370] (issue: {es-issue}68859[#68859])
Make ml_standard tokenizer create single tokens for email addresses {es-pull}73052[#73052]
Make ml_standard tokenizer the default for new categorization jobs {es-pull}72805[#72805] (issue: {es-issue}1724[#1724])
Optimize inference step when there are no test docs {es-pull}74315[#74315]
Reset anomaly detection job API {es-pull}73908[#73908]
Switch ML internal index templates to composable templates {es-pull}73232[#73232] (issue: {es-issue}65437[#65437])
Give higher weight to multiple adjacent dictionary words when performing categorization {ml-pull}1903[#1903]
Add a cluster deprecation check for index templates containing multiple types {es-pull}72540[#72540]
Enhance error message for copy_to {es-pull}72820[#72820] (issue: {es-issue}49344[#49344])
Make intervals queries fully pluggable through field mappers {es-pull}71429[#71429]
DynamicFieldType to expose its known subfields names {es-pull}73530[#73530]
FieldTypeLookup to support dynamic runtime fields {es-pull}73519[#73519]
Add search_after support to new termsEnum API {es-pull}72933[#72933] (issue: {es-issue}72910[#72910])
Be cleverer about extracting nested sources {es-pull}73157[#73157]
Integrate circuit breaker in AsyncTaskIndexService {es-pull}73862[#73862] (issues: {es-issue}67594[#67594], {es-issue}73638[#73638])
PIT: Make validation error actionable {es-pull}74224[#74224] (issue: {es-issue}74223[#74223])
Support field collapsing with search_after {es-pull}73023[#73023] (issue: {es-issue}53115[#53115])
Support much larger source filters {es-pull}72277[#72277]
Write async response directly to XContent to reduce memory usage {es-pull}73707[#73707] (issue: {es-issue}67594[#67594])
Add REST API specification for SAML APIs {es-pull}72839[#72839] (issue: {es-issue}67189[#67189])
Cache API key hashing results on creation time {es-pull}74106[#74106]
Expose API Key metadata to SetSecurityUser ingest processor {es-pull}72137[#72137] (issue: {es-issue}71024[#71024])
Move hashing on API key creation to crypto thread pool {es-pull}74165[#74165] (issue: {es-issue}74106[#74106])
Service Accounts - show token name for name validation failures {es-pull}73131[#73131] (issue: {es-issue}73081[#73081])
Introduce next field in paginated GetSnapshots Response {es-pull}74236[#74236] (issue: {es-issue}73952[#73952])
Introduce SNAPSHOT_META thread pool for fetching repository metadata {es-pull}73172[#73172]
Make large bulk snapshot deletes more memory efficient {es-pull}72788[#72788]
Make GetSnapshotsAction cancellable {es-pull}72644[#72644]
Make SnapshotStatusAction cancellable {es-pull}73818[#73818] (issue: {es-issue}72644[#72644])
Pagination and sorting for get snapshots API {es-pull}73952[#73952]
Prevent deletion of repositories that are used by snapshot-backed indices {es-pull}73714[#73714]
Reroute when new repository is registered {es-pull}73761[#73761] (issues: {es-issue}73669[#73669], {es-issue}73714[#73714])
Save memory on large repository metadata blob writes {es-pull}74313[#74313]
Identify cancelled tasks in list tasks API {es-pull}72931[#72931] (issue: {es-issue}72907[#72907])
Log at DEBUG only on disconnect during cancellation {es-pull}74042[#74042] (issues: {es-issue}65443[#65443], {es-issue}72968[#72968])
Add support for top metrics {es-pull}71850[#71850] (issues: {es-issue}51925[#51925], {es-issue}52236[#52236])
Improve error message when user lacks privilege in _preview endpoint {es-pull}72002[#72002] (issue: {es-issue}72715[#72715])
Optmize histogam group_by change detection {es-pull}74031[#74031] (issue: {es-issue}63801[#63801])
Prevent date_histogram from OOMing {es-pull}72081[#72081] (issue: {es-issue}71758[#71758])
Properly size empty filters {es-pull}71864[#71864]
Only enable "filter by filter" optimization for terms, date_histogram,
range, and filters aggregation when we’re sure it’ll be faster {es-pull}74260[#74260]
Dissect parsing: An % occurring in the delimiter causes incorrect capture of the ${key} that follows {es-pull}72876[#72876]
Fix ignore_missing takes no effect in rename ingest processor {es-pull}74248[#74248] (issue: {es-issue}74241[#74241])
Do not over-allocate when resizing in GeoHashTiler with bounds {es-pull}72539[#72539] (issue: {es-issue}72521[#72521])
Handle properly precision 0 for BoundedGeoTileGrid {es-pull}72800[#72800]
[Geopoint] Grid aggregations with bounds should exclude touching tiles {es-pull}72493[#72493] (issue: {es-issue}72295[#72295])
[Geoshape] Grid aggregations with bounds should exclude touching tiles {es-pull}72295[#72295]
GeoShapeIndexer#prepareForIndex should be called for computing the doc value centroid {es-pull}73856[#73856] (issue: {es-issue}73836[#73836])
Fix plain highlighter ordering for none {es-pull}74084[#74084] (issue: {es-issue}58236[#58236])
Fix highlighting for match_phrase_prefix query inside nested {es-pull}73775[#73775] (issue: {es-issue}70922[#70922])
Dynamic runtime to not dynamically create objects {es-pull}74234[#74234] (issue: {es-issue}65489[#65489])
TermsEnum API - allow null search strings {es-pull}73144[#73144] (issue: {es-issue}73141[#73141])
Fix edge-case threading bug in TransportMountSearchableSnapshotAction {es-pull}73196[#73196]
Fix SnapshotInfo.fromXContentInternal not fully consuming parser {es-pull}73268[#73268] (issue: {es-issue}73149[#73149])
Fix SnapshotShardFailure.toXContent serialization issue {es-pull}72801[#72801]
A memory disclosure vulnerability was identified in {es}'s error reporting. A
user with the ability to submit arbitrary queries to {es} could submit a
malformed query that would result in an error message returned containing
previously used portions of a data buffer. This buffer could contain sensitive
information, such as {es} documents or authentication details. All versions of
{es} prior to 7.13.4 are affected by this flaw. There is no known workaround for
this issue. You must upgrade to {es} version 7.13.4 to obtain the fix.
CVE-2021-22145
Known issues
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Snapshot and restore: If a running snapshot is cancelled while a
previously-started snapshot is still ongoing and a later snapshot is enqueued
then there is a risk that some shard data may be lost from the repository. This
will cause future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1 to prevent concurrent snapshot
operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.14.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}75598[#75598].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Mapping
An uncontrolled recursion vulnerability that could lead to a
denial of service attack was identified in the {es} Grok parser.
A user with the ability to submit arbitrary queries to {es} could create
a malicious Grok query that will crash the {es} node.
All versions of {es} prior to 7.13.3 are affected by this flaw.
You must upgrade to {es} version 7.13.3 to obtain the fix.
CVE-2021-22144
Known issues
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Snapshot and restore: If a running snapshot is cancelled while a
previously-started snapshot is still ongoing and a later snapshot is enqueued
then there is a risk that some shard data may be lost from the repository. This
will cause future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1 to prevent concurrent snapshot
operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.14.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}75598[#75598].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Autoscaling
Autoscale frozen tier into existence {es-pull}73435[#73435] (issue: {es-issue}72771[#72771])
Avoid scaling empty tier unnecessarily {es-pull}74086[#74086]
Remove "fields" section from sequence in-progress searches {es-pull}74824[#74824] (issue: {es-issue}74582[#74582])
Remove "yet" from unsupported pipe error message {es-pull}74850[#74850] (issue: {es-issue}70844[#70844])
Fix literal projection with condition {es-pull}74083[#74083] (issues: {es-issue}64567[#64567], {es-issue}74064[#74064])
Fix querying of indices without columns {es-pull}74312[#74312] (issue: {es-issue}53001[#53001])
Disable query cache for FunctionScoreQuery and ScriptScoreQuery {es-pull}74060[#74060] (issue: {es-issue}73925[#73925])
Fix CombinedFieldQuery (Lucene 9999) {es-pull}74678[#74678]
Fix error in FieldCapabilitiesResponse serialization {es-pull}74504[#74504]
Use min version when storing async search response {es-pull}74642[#74642]
Fix snapshots recording incorrect max segment counts {es-pull}74291[#74291] (issue: {es-issue}74249[#74249])
Shared cache’s recovery range should be aligned with page size {es-pull}74439[#74439] (issue: {es-issue}74372[#74372])
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Snapshot and restore: If a running snapshot is cancelled while a
previously-started snapshot is still ongoing and a later snapshot is enqueued
then there is a risk that some shard data may be lost from the repository. This
will cause future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1 to prevent concurrent snapshot
operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.14.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}75598[#75598].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])




    

The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Aggregations
Always handle non-complete AsyncActionStep execution {es-pull}73796[#73796] (issue: {es-issue}73794[#73794])
Copy all execution state in CopyExecutionStateStep {es-pull}73792[#73792] (issues: {es-issue}64883[#64883], {es-issue}73791[#73791])
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Snapshot and restore: If a running snapshot is cancelled while a
previously-started snapshot is still ongoing and a later snapshot is enqueued
then there is a risk that some shard data may be lost from the repository. This
will cause future restore operations to fail. To mitigate this problem, set
snapshot.max_concurrent_operations: 1 to prevent concurrent snapshot
operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.14.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}75598[#75598].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Engine
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
If autoscaling is enabled for machine learning, the administrator of the
cluster should increase the cluster setting xpack.ml.max_open_jobs to the
maximum value of 512. This allows autoscaling to run reliably as it relies on
assigning jobs only via memory. Having xpack.ml.max_open_jobs as a small
number may cause autoscaling to behave unexpectedly.
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
If local and remote clusters are on different patch releases, response
serialization fails for requests to a remote cluster that use the
field capabilities API with CCS. Because {kib} uses this
API internally, requests to CCS index patterns will also fail.
This issue is fixed in {es} version 7.13.3 and later. For more details, see
{es-issue}74504[#74504].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Deprecations
Aggregations
Add migration check for legacy role settings {es-pull}71197[#71197] (issues: {es-issue}54998[#54998], {es-issue}71143[#71143])
Add multiple data paths deprecation to the deprecation API {es-pull}71209[#71209] (issue: {es-issue}71205[#71205])
Deprecate multiple path.data entries {es-pull}71207[#71207] (issue: {es-issue}71205[#71205])
Add clear deprecation around legacy role settings {es-pull}71143[#71143] (issue: {es-issue}54998[#54998])
Add deprecation warning for default value of action.destructive_requires_name {es-pull}70932[#70932] (issues: {es-issue}66908[#66908], {es-issue}67543[#67543])
Add support for validating IPv4/IPv6 addresses to Convert processor {es-pull}69989[#69989] (issue: {es-issue}36145[#36145])
Add registered domain processor {es-pull}67611[#67611]
Improve handling of incompatible after key types in composite aggregations {es-pull}70839[#70839] (issue: {es-issue}70480[#70480])
Increase search.max_bucket default value by one {es-pull}70645[#70645] (issue: {es-issue}57042[#57042])
Modest memory savings in a date_histogram followed by a terms aggregation {es-pull}68592[#68592]
Speed up top_metrics on hot shards {es-pull}70579[#70579] (issue: {es-issue}70453[#70453])
Speed up aggregations with sub-aggregations {es-pull}69806[#69806] (issues: {es-issue}63643[#63643], {es-issue}68871[#68871])
Speed up terms aggregation when alone {es-pull}69377[#69377] (issue: {es-issue}68871[#68871])
Speed up terms aggregation when not force merged {es-pull}71241[#71241] (issue: {es-issue}71086[#71086])
Use #updateTop to speed up InternalComposite#reduce {es-pull}71278[#71278]
Add a deprecation message if a REST wrapper implementing plugin presents {es-pull}66827[#66827]
Service Accounts - Authentication with file tokens {es-pull}70543[#70543]
Service Accounts - Fleet integration {es-pull}70724[#70724]
Service Accounts - Get service account API {es-pull}71315[#71315]
Service Accounts - Initial bootstrap plumbing to add essential classes {es-pull}70391[#70391]
Service Accounts - New CLI tool for managing file tokens {es-pull}70454[#70454]
Service Accounts - delete index backed service account token {es-pull}71165[#71165]
Service Accounts - token name in response to Authenticate API {es-pull}71382[#71382]
Support metadata on API keys {es-pull}70292[#70292] (issue: {es-issue}48182[#48182])
Include node roles in cluster state JSON response {es-pull}71386[#71386] (issue: {es-issue}71385[#71385])
Remove node attributes from cluster membership messages {es-pull}69811[#69811]
Allow Unicode escape sequences in strings {es-pull}70514[#70514] (issue: {es-issue}62832[#62832])
Improve null handling in the optimizer {es-pull}70557[#70557]
Add max_single_primary_size as a condition for the ILM rollover action {es-pull}68917[#68917] (issues: {es-issue}63026[#63026], {es-issue}67842[#67842])
Reject creating ILM policies with phase timings that are not greater than or equal to the previous phase {es-pull}70089[#70089] (issue: {es-issue}70032[#70032])
Switch built-in policies to max_primary_shard_size {es-pull}69995[#69995] (issue: {es-issue}63026[#63026])
Introduce separate shard limit for frozen shards {es-pull}71392[#71392] (issues: {es-issue}34021[#34021], {es-issue}71042[#71042])
Support specifying multiple templates names in delete component template api {es-pull}70314[#70314] (issue: {es-issue}69973[#69973])
Support specifying multiple templates names in delete composable index template api {es-pull}70094[#70094] (issue: {es-issue}69973[#69973])
Accept more ingest simulate params as integers or strings {es-pull}66197[#66197] (issues: {es-issue}23823[#23823], {es-issue}65992[#65992])
Extract device type from user agent info {es-pull}69322[#69322]
Network direction processor additions {es-pull}68712[#68712]
Summary option for listing ingest pipelines without their definitions {es-pull}69756[#69756] (issue: {es-issue}31954[#31954])
MurmurHash3 support for fingerprint processor {es-pull}70632[#70632] (issue: {es-issue}69182[#69182])
Add info on each HTTP client to HTTP stats {es-pull}64561[#64561] (issue: {es-issue}61609[#61609])
Make indices stats requests cancellable {es-pull}69174[#69174] (issue: {es-issue}55550[#55550])
Make recovery APIs cancellable {es-pull}69177[#69177] (issue: {es-issue}55550[#55550])
Total data set size in stats {es-pull}70625[#70625] (issue: {es-issue}69820[#69820])
Add Runtime Fields Contexts to Painless Execute API {es-pull}71374[#71374] (issue: {es-issue}70467[#70467])
Add a new ANTLR lexer for Painless suggestions {es-pull}70517[#70517]
Improve null def access error message {es-pull}69226[#69226] (issue: {es-issue}53129[#53129])
Make the available ScriptContexts accessible from ScriptService {es-pull}70465[#70465]
Whitelist the CIDR convenience API {es-pull}71258[#71258] (issue: {es-issue}60668[#60668])
Add runtime mappings to data frame analytics source config {es-pull}69183[#69183] (issue: {es-issue}65056[#65056])
Adding new _preview endpoint for data frame analytics {es-pull}69453[#69453]
Adding support for composite aggregations in anomaly detection {es-pull}69970[#69970]
Allow datafeed and job configs for datafeed preview API {es-pull}70836[#70836] (issue: {es-issue}70264[#70264])
Improve messages related to assigning machine learning jobs {es-pull}69752[#69752]
Add put and delete trained model alias APIs to high-level REST client {es-pull}69214[#69214]
Speed up training of regression and classification models for data sets with many features {ml-pull}1746[#1746]
Adjust the syscall filter to allow mremap and avoid spurious audit logging {ml-pull}1819[#1819]
Avoid overfitting in final training by scaling regularizers to account for the difference in the number of training examples. This results in a better match between train and test errors for classification and regression and often slightly improved test errors {ml-pull}1755[#1755]
Allow specify dynamic templates in bulk request {es-pull}69948[#69948] (issue: {es-issue}61939[#61939])
Change default format for date_nanos field {es-pull}70463[#70463] (issues: {es-issue}67063[#67063], {es-issue}69192[#69192])
Expose if a field is a metadata field in the field capabilities response {es-pull}69977[#69977]
Field capabilities index action should not fork its execution {es-pull}69865[#69865]
Improve error message for invalid field name {es-pull}70972[#70972] (issue: {es-issue}70960[#70960])
New queryable _tier metadata field {es-pull}69288[#69288] (issue: {es-issue}68135[#68135])
Output script stats for indexed fields {es-pull}71219[#71219]
Preserve half_float precision in fields API {es-pull}70653[#70653] (issue: {es-issue}70260[#70260])
Support fetching flattened subfields {es-pull}70916[#70916] (issue: {es-issue}70605[#70605])
Add access to dense_vector values {es-pull}71313[#71313] (issue: {es-issue}51964[#51964])
Make wildcard field use constant scoring queries for wildcard queries {es-pull}70452[#70452] (issue: {es-issue}69604[#69604])
Add _size and _doc_count to fields output {es-pull}70575[#70575] (issue: {es-issue}63569[#63569])
Add positive_score_impact to rank_features type {es-pull}69994[#69994] (issue: {es-issue}68619[#68619])
Add earlier validation for some SearchSourceBuilder settings {es-pull}69548[#69548] (issue: {es-issue}54958[#54958])
Allow format sort values of date fields {es-pull}70357[#70357] (issue: {es-issue}69192[#69192])
Cancel searches earlier {es-pull}69795[#69795]
Close search contexts on reassigned shard {es-pull}68539[#68539]
Improve lookup for include_unmapped field pattern {es-pull}69984[#69984] (issue: {es-issue}69983[#69983])
Support fetching _tier field value {es-pull}71379[#71379] (issues: {es-issue}63569[#63569], {es-issue}68135[#68135])
Change tier preference for shared_cache searchable snapshots to frozen only {es-pull}70786[#70786] (issue: {es-issue}70341[#70341])
Enforce data_frozen for partial searchable snapshot _tier_preference {es-pull}71155[#71155] (issues: {es-issue}70786[#70786], {es-issue}71014[#71014])
Forbid dedicated frozen nodes w/ unfrozen indices {es-pull}71395[#71395]
Include min/max/average file size in Searchable Snapshots Stats API {es-pull}70294[#70294]
Make searchable snapshot cache size effectively zero on non-frozen nodes {es-pull}71134[#71134] (issues: {es-issue}70341[#70341], {es-issue}70846[#70846], {es-issue}71013[#71013])
Skip TRANSLOG stage for searchable snapshots recovery stage {es-pull}70311[#70311] (issue: {es-issue}65531[#65531])
Use default application credentials for GCS repositories {es-pull}71239[#71239]
Redirect transform actions to transform and remote_cluster_client node when needed {es-pull}70125[#70125]
Report warnings in _preview response {es-pull}68396[#68396] (issue: {es-issue}70059[#70059])
Significant text aggregation - return empty results rather than error if field unmapped {es-pull}70778[#70778] (issue: {es-issue}69809[#69809])
Stop terms aggregation from losing buckets {es-pull}70493[#70493] (issues: {es-issue}68871[#68871], {es-issue}70449[#70449])
Add RateLimitingFiltering to plaintext deprecation logs {es-pull}69190[#69190] (issues: {es-issue}61474[#61474], {es-issue}69188[#69188])
Do not throttle deprecated field logs {es-pull}70009[#70009] (issue: {es-issue}55115[#55115])
Consider xpack.ml.max_ml_node_size in effective_model_memory_limit {es-pull}70473[#70473] (issue: {es-issue}70069[#70069])
Do not create machine learning annotations index in upgrade mode {es-pull}71175[#71175]
Do not track machine learning usage when collecting monitoring {es-pull}71314[#71314]
Ensure auc_roc curve is monotonic {es-pull}70628[#70628]
Exclude nested fields in data frame analytics {es-pull}71400[#71400]
Improve readability of messages written when assigning machine learning jobs to nodes {es-pull}69629[#69629] (issue: {es-issue}59602[#59602])
Ensure the same hyperparameters are chosen if classification or regression training
is stopped and restarted, for example, if the node fails {ml-pull}1848[#1848]
Fail gracefully if insufficient data is supplied for classification or regression training {ml-pull}1855[#1855]
Fail gracefully on encountering unexpected state in restore from snapshot for anomaly detection {ml-pull}1872[#1872]
Use appropriate memory ordering flags for aarch64 with string store to avoid excessive string duplication {ml-pull}1888[#1888]
Fix autoscaling bug where many jobs take a long time to open {es-pull}72423[#72423]
Use appropriate master timeouts for master actions {es-pull}72492[#72492]
Fix empty overall_buckets response {es-pull}72542[#72542]
Check the out stream exists before consuming it {es-pull}72455[#72455]
Prevent data frame analytics freeze after loading data {es-pull}72412[#72412]
Fix binary docvalue_fields with padding {es-pull}70826[#70826] (issue: {es-issue}70244[#70244])
Propagate index errors in field_caps {es-pull}70245[#70245] (issue: {es-issue}68994[#68994])
Correct service time parameter in ARS formula {es-pull}70283[#70283] (issue: {es-issue}65838[#65838])
In ARS, correct default number of outstanding requests {es-pull}71022[#71022] (issue: {es-issue}70283[#70283])
Prevent aliased fields being used for index sorts {es-pull}70879[#70879]
Fix bug where group_by ordering could break when serializing between nodes {es-pull}72016[#72016]
Avoid transform failure during rolling upgrade {es-pull}72533[#72533]




    

Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Allow closing a write index of a data stream {es-pull}70908[#70908] (issues: {es-issue}70861[#70861], {es-issue}70903[#70903])
Improve data stream rollover and simplify cluster metadata validation for data streams {es-pull}70934[#70934] (issue: {es-issue}70905[#70905])
Adjust the length of blob cache docs for Lucene metadata files {es-pull}69431[#69431] (issue: {es-issue}69283[#69283])
Always use CacheService for caching metadata blobs {es-pull}70668[#70668] (issues: {es-issue}70728[#70728], {es-issue}70763[#70763])
Lazily load soft-deletes for searchable snapshot shards {es-pull}69203[#69203]
Fix handling of non-integer port values in community_id processor {es-pull}70148[#70148] (issue: {es-issue}70131[#70131])
Fix typo in validation for destination port of community ID processor {es-pull}70883[#70883]
Templates match indices with date math expressions {es-pull}71433[#71433] (issue: {es-issue}69727[#69727])
URI parts processor handles URLs containing spaces {es-pull}71559[#71559] (issue: {es-issue}70947[#70947])
Fix geo_line agg behavior with missing values {es-pull}69395[#69395] (issue: {es-issue}69346[#69346])
Fix infinite loop when polygonizing a circle with centre on the pole {es-pull}70875[#70875]
Fix overflow bug in SortingNumericDocValues {es-pull}70154[#70154]
Enforce and document dedicated client version compatibility {es-pull}70451[#70451] (issue: {es-issue}70400[#70400])
Fix manifest version tag in Tableau connector {es-pull}71524[#71524]
Resolve attributes recursively for improved subquery support {es-pull}69765[#69765] (issue:  {es-issue}67237[#67237])
Verify binary fields found in non-project to have the doc_values {es-pull}69128[#69128] (issue: {es-issue}68229[#68229])
Fix exception when merging completion suggestions {es-pull}70414[#70414] (issue: {es-issue}70328[#70328])
Fix query cache reporting negative used memory {es-pull}70273[#70273] (issue: {es-issue}55434[#55434])
Fix search states of CCS requests in mixed cluster {es-pull}70948[#70948] (issue: {es-issue}52741[#52741])
Avoid atomic overwrite tests on FS repositories {es-pull}70483[#70483] (issue: {es-issue}70303[#70303])
Drop alloc filters on mount of searchable snapshot {es-pull}70007[#70007] (issue: {es-issue}69759[#69759])
Fix source only snapshot permanently broken on broken _snapshot directory {es-pull}71459[#71459]
Fix isDedicatedVotingOnlyNode {es-pull}71358[#71358] (issue: {es-issue}71352[#71352])
Fix human readable xcontent for snapshots in progress and deletion {es-pull}70256[#70256]
Fix wrongly computed offset in checksum {es-pull}69441[#69441] (issues: {es-issue}69415[#69415], {es-issue}69437[#69437])
Only allocate partial shards to nodes with cache {es-pull}69904[#69904]
Optimized read footer checksum from FileInfo {es-pull}69415[#69415]
Reduce memory use of parallel Azure blob deletes {es-pull}71330[#71330] (issue: {es-issue}71267[#71267])
Stop blocking snapshot deletes due to concurrency limits {es-pull}71050[#71050]
A document disclosure flaw was found in the {es} suggester and
profile API when Document and Field Level Security are enabled.
The suggester and profile API are normally disabled for an index when document
level security is enabled on the index. Certain queries are able to enable the
profiler and suggester which could lead to disclosing the existence of documents
and fields the attacker should not be able to view.
All versions of {es} before 6.8.15 and 7.11.2 are affected by this flaw.
You must upgrade to 6.8.15 or 7.11.2 to obtain the fix.
CVE-2021-22137
Known issues
Frozen tier: (Windows only) The frozen data tier relies on multiple caching mechanisms
to speed up access to searchable snapshot files. One of these caches uses
sparse files to avoid creating large
files on disk when it is not strictly required. A bug prevented files from being
created with the right options to enable sparse support on Windows, leading {es} to
create potentially large files that can end up consuming all the disk space.
This issue is fixed in {es} versions 7.15.2 and later. There is no known workaround
for earlier versions. Filesystems that enable sparse files by default are not affected.
For more details, see {es-issue}79371[#79371].
If autoscaling is enabled for machine learning, the administrator of the cluster
should increase the cluster setting xpack.ml.max_open_jobs. This allows autoscaling
to run reliably as it relies on assigning jobs only via memory. Having
xpack.ml.max_open_jobs as a small number may cause autoscaling to behave unexpectedly.
If autoscaling is enabled and job assignment takes an inordinate amount of time, scaling
sizes may increase much higher than required. Elasticsearch 7.13.0 contains a fix for this.
For more details, see {es-issue}72509[#72509]
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Mapping
Introduce ~ grammar for case-insensitive functions {es-pull}67869[#67869] (issue: {es-issue}67868[#67868])
Introduce like and regex keywords {es-pull}68791[#68791] (issue: {es-issue}68639[#68639])
Add support for partial searchable snapshots to ILM {es-pull}68714[#68714] (issues: {es-issue}68509[#68509], {es-issue}68605[#68605])
Add the frozen tier node role and ILM phase {es-pull}68605[#68605] (issue: {es-issue}60848[#60848])
Support max_single_primary_size in resize action and expose in ILM {es-pull}67705[#67705] (issue: {es-issue}65714[#65714])
Network community_id processor for ingest pipelines {es-pull}66534[#66534] (issue: {es-issue}55685[#55685])
Network direction processor {es-pull}66644[#66644]
Add minimum compatibility version to SearchRequest {es-pull}65896[#65896] (issue: {es-issue}63304[#63304])
Sort field tiebreaker for point in time (PIT) readers {es-pull}66093[#66093] (issue: {es-issue}56828[#56828])
Drop gateway.recover_after_nodes from default conf {es-pull}68000[#68000] (issue: {es-issue}53646[#53646])
Make InternalClusterInfoService async {es-pull}66993[#66993]
Add more context to cluster access denied messages {es-pull}66900[#66900] (issues: {es-issue}42166[#42166], {es-issue}60357[#60357])
Add more context to index access denied errors {es-pull}60357[#60357] (issue: {es-issue}42166[#42166])
Allow Kibana to create Fleet Server indices {es-pull}68152[#68152]
Phase 2 support for operator privileges: Cluster settings {es-pull}66684[#66684]
view_index_metadata and manage privs now grant access to field capabilities {es-pull}67392[#67392] (issue: {es-issue}66867[#66867])
Extend default probe connect/handshake timeouts {es-pull}68059[#68059] (issue: {es-issue}42636[#42636])
Skip cluster state serialization to closed channel {es-pull}67413[#67413]
Assign id to searcher using ids of segments {es-pull}66668[#66668] (issue: {es-issue}63963[#63963])
Use merging fieldsreader when restoring versionmap during recovery {es-pull}66944[#66944]
Make the rest of the forcemerge action steps retryable {es-pull}66352[#66352] (issue: {es-issue}48183[#48183])
Make the unfollow action and CCR related steps retryable {es-pull}66356[#66356] (issue: {es-issue}48183[#48183])
Skip unfollow action if the index is not a follower {es-pull}68690[#68690]
Add max_single_primary_size as a condition for the rollover index API {es-pull}67842[#67842] (issue: {es-issue}63026[#63026])
Make template conflict warning deterministic {es-pull}67066[#67066] (issue: {es-issue}66820[#66820])
Add support for Spatial Relationships to geo_point field {es-pull}67631[#67631] (issue: {es-issue}52382[#52382])
Implement IndexOrDocValuesQuery for geo_shape field {es-pull}64688[#64688]
Add enumsetting to org.elasticsearch.common.settings.Setting {es-pull}66826[#66826] (issue: {es-issue}65335[#65335])
Support removing archived settings if cluster has read only blocks {es-pull}64113[#64113]
Add new multi custom processor for data frame analytics and model inference {es-pull}67362[#67362]
Allow data frame analytics memory estimation on non-ML nodes {es-pull}68146[#68146] (issue: {es-issue}67840[#67840])
Automatic management for machine learning system indices {es-pull}68044[#68044]
Expand regression and classification hyperparameters {es-pull}67950[#67950]
Improve resuming a data frame analytics job stopped during inference {es-pull}67623[#67623]
Move find file structure to a new API endpoint {es-pull}67123[#67123] (issue: {es-issue}67001[#67001])
Preserve inference progress when starting data frame analytics {es-pull}68222[#68222]
Write notification messages indicating required capacity when a job is not assigned to a node {es-pull}67181[#67181]
Fix edge case which could cause spurious anomalies early in the learning process if the time series has non-diurnal seasonality {ml-pull}1634[#1634]
Compute importance of hyperparameters optimized in the fine parameter tuning step {ml-pull}1627[#1627]
Early stopping for the fine parameter tuning step of classification and regression model training {ml-pull}1676[#1676]
Correct upgrade for pre-6.3 state for lat_long anomaly anomaly detectors {ml-pull}1681[#1681]
Per tree feature bag to speed up training of regression and classification models and improve scalability for large numbers of features {ml-pull}1733[#1733]
Adapt nested fields extraction from fields API output to the new un-flattened structure {es-pull}68745[#68745] (issue: {es-issue}68722[#68722])
Simplify arithmetic operations in binary comps {es-pull}66022[#66022] (issue: {es-issue}65394[#65394])
Add grok and dissect methods to runtime fields {es-pull}68088[#68088] (issue: {es-issue}67825[#67825])
Allow deletion of async searches with the manage privilege {es-pull}67965[#67965]
Avoid duplicate serialization for TermsQueryBuilder {es-pull}67223[#67223] (issue: {es-issue}67132[#67132])
Early detection of circuit breaker exception in the coordinating node {es-pull}67431[#67431] (issue: {es-issue}62884[#62884])
Limit the depth of nested bool queries {es-pull}66204[#66204] (issue: {es-issue}55303[#55303])
Remove unnecessary optimizations for TermsSetQueryBuilder {es-pull}67637[#67637] (issue: {es-issue}67223[#67223])
Retry point in time on other copy when possible {es-pull}66713[#66713] (issue: {es-issue}61062[#61062])
Slightly speed up scripts {es-pull}68478[#68478]
Use a mapping snapshot for fetching nested docs {es-pull}66877[#66877] (issue: {es-issue}66295[#66295])
Allow searchable snapshots to work on source-only repositories {es-pull}67975[#67975] (issue: {es-issue}67936[#67936])
Avoid async cache-size fetch on partial shards {es-pull}68644[#68644]
Forbid removing write block from searchable snapshot index {es-pull}68036[#68036]
Ignore disk watermarks on partial shards {es-pull}68673[#68673]
Improve error message on incompatible repo format {es-pull}67776[#67776]
Introduce repository UUIDs {es-pull}67829[#67829] (issue: {es-issue}66431[#66431])
Introduce repository test kit/analyser {es-pull}67247[#67247]
Permit rename of repository of searchable snapshot {es-pull}67968[#67968] (issue: {es-issue}66431[#66431])
Reject remounting snapshot of a searchable snapshot {es-pull}68816[#68816] (issue: {es-issue}68792[#68792])
Add support for search-time runtime fields {es-pull}67643[#67643] (issue: {es-issue}65147[#65147])
Automatic management for transform system indices {es-pull}68590[#68590]
Implement retention policy to delete data from a transform {es-pull}67832[#67832] (issue: {es-issue}67916[#67916])
Refactor cat transform to show more useful information {es-pull}68232[#68232] (issues: {es-issue}66367[#66367], {es-issue}66718[#66718])
Report last search time in transform stats {es-pull}66718[#66718] (issues: {es-issue}66367[#66367], {es-issue}66410[#66410], {es-issue}66718[#66718])
Make find_structure validate lines_to_sample at least 2 {es-pull}68199[#68199] (issue: {es-issue}68128[#68128])
Return 400 status for invalid charset in find_structure {es-pull}68201[#68201] (issue: {es-issue}68130[#68130])
Return status 400 for grok_pattern errors in find_structure {es-pull}68205[#68205] (issue: {es-issue}68132[#68132])
Fix a source of instability in time series modeling for anomaly detection. This has been observed to cause spurious anomalies for a partition which no longer receives any data {ml-pull}1675[#1675]
Ensure that we stop modeling seasonality for data which flatlines. This is important for count and sum detectors which treat empty buckets as zero. Before this change, we could sometimes detect spurious anomalies in realtime detection after a partition no longer received any data {ml-pull}1654[#1654]
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])




    

Enhancements
Authorization
Async processors and final pipelines are broken {es-pull}69818[#69818] (issue: {es-issue}52339[#52339])
Copy_from on set processor should deep copy non-primitive mutable types {es-pull}69349[#69349] (issue: {es-issue}69348[#69348])
Avoid memory tracker race condition {es-pull}69290[#69290] (issue: {es-issue}69289[#69289])
Fix logic for moving .ml-state-write alias from legacy to new {es-pull}69039[#69039] (issue: {es-issue}68925[#68925])
Fix the inconsistent behaviour of ISO_WEEK_YEAR() {es-pull}68758[#68758] (issue: {es-issue}67872[#67872])
Make RestSqlQueryAction thread-safe {es-pull}69895[#69895] (issue: {es-issue}69866[#69866])
Remove blocking on generic thread pool in GET snapshots {es-pull}69101[#69101] (issue: {es-issue}69099[#69099])
URL repos and searchable snapshots don’t mix {es-pull}69197[#69197] (issue: {es-issue}68918[#68918])
Stop transform regardless of transform nodes {es-pull}69419[#69419] (issue: {es-issue}69260[#69260])
Prevent concurrent state persistence when indexer gets triggered during shutdown {es-pull}69551[#69551] (issue: {es-issue}67121[#67121])
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Features/Indices APIs
Improve shard evictions in searchable snapshot cache service {es-pull}67160[#67160] (issues: {es-issue}66730[#66730], {es-issue}66958[#66958])
Make blob cache have async durability {es-pull}66687[#66687]
Check if delete phase has actions {es-pull}66664[#66664] (issue: {es-issue}65847[#65847])
Fix handling of configurations with a combination of both maximum and expire-after retention {es-pull}68352[#68352]
Fix searchable snapshot action to wait for the restored index {es-pull}68309[#68309] (issue: {es-issue}67879[#67879])
Ignore clusterChanged events if state not recovered {es-pull}67507[#67507] (issue: {es-issue}67506[#67506])
ShrinkStep ignores the isAcknowledged flag on the response {es-pull}67591[#67591] (issue: {es-issue}53111[#53111])
Skip rollover if the data stream is rolled over already {es-pull}67778[#67778] (issue: {es-issue}67777[#67777])
Fix an error that occurs while starting the service in Windows OS under a path with a space in it {es-pull}61895[#61895] (issue: {es-issue}61891[#61891])
Fix an issue with MSI installation on Windows that prevents {es} starting #402 (issue: {es-issue}68914[#68914])
Fix elasticsearch-sql-cli under Docker {es-pull}67737[#67737] (issue: {es-issue}57744[#57744])
Fix the MINUTE_OF_DAY() function that throws exception when used in comparisons {es-pull}68783[#68783] (issues: {es-issue}67872[#67872], {es-issue}68788[#68788])
Integration with Active Directory realms and
LDAP realms is impacted by an issue that prevents
Elasticsearch from starting. If you have configured an Active Directory or
LDAP realm, then Elasticseach will fail to start with an error message
indicating that Could not initialize class com.unboundid.util.Debug. This
exception is fatal. If you encounter this during an upgrade, because
Elasticsearch failed during node construction, you can safely downgrade to
your previous version of Elasticsearch. Note: these downgrade instructions
only apply if you encounter this specific error message; in general,
downgrades are not safe. Elasticsearch 7.11.1 will contain a fix for this
issue. For more details, see {es-issue}68838[#68838].
If autoscaling is enabled for machine learning, the administrator of the cluster
should increase the cluster setting xpack.ml.max_open_jobs to the maximum value of 512. This allows autoscaling
to run reliably as it relies on assigning jobs only via memory. Having
xpack.ml.max_open_jobs as a small number may cause autoscaling to behave unexpectedly.
If autoscaling is enabled and job assignment takes an inordinate amount of time, scaling
sizes may increase much higher than required. Elasticsearch 7.13.0 contains a fix for this.
For more details, see {es-issue}72509[#72509]
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
FIPS 140-2 compliance
In some cases, such as when using the Bouncy Castle FIPS module in
approved only mode, {es} may raise unexpected exceptions that prevent startup.
In {es} 7.11.0, we added a new
{ref}/security-settings.html#password-hashing-algorithms[PBKDF2-compatible
hashing algorithm] to fix this. For more information, see the
{ref}/fips-140-compliance.html[{es} FIPS 140-2 documentation].
Breaking changes
Machine Learning
Index templates with data stream enabled can no longer contain index aliases
or component templates with index aliases. A bug in {es} 7.10 and 7.9 previously
allowed this. {es-pull}67886[#67886]
Deprecate the 'local' parameter of /_cat/indices {es-pull}62198[#62198] (issue: {es-issue}60718[#60718])
Deprecate the 'local' parameter of /_cat/shards {es-pull}62197[#62197] (issue: {es-issue}60718[#60718])
Support global ordinals in top_metrics {es-pull}64967[#64967] (issue: {es-issue}64774[#64774])
Add doc_count field mapper {es-pull}64503[#64503] (issue: {es-issue}58339[#58339])
Add hard_bounds support for histogram field-based histograms {es-pull}64246[#64246] (issue: {es-issue}62124[#62124])
Add support for histogram fields to rate aggregation {es-pull}63289[#63289] (issue: {es-issue}62939[#62939])
Add supports for upper and lower values on boxplot based on the IQR value {es-pull}63617[#63617] (issue: {es-issue}60466[#60466])
Add value_count mode to rate agg {es-pull}63687[#63687] (issue: {es-issue}63575[#63575])
Allow mixing set-based and regexp-based include and exclude {es-pull}63325[#63325] (issue: {es-issue}62246[#62246])
Consider query when optimizing date rounding {es-pull}63403[#63403]
Speed up date_histogram without children {es-pull}63643[#63643] (issue: {es-issue}61467[#61467])
Speed up interval rounding {es-pull}63245[#63245]
Use global ordinals in Cardinality aggregation when it makes sense {es-pull}62560[#62560]
Adding API for generating SAML SP metadata {es-pull}64517[#64517] (issue: {es-issue}49018[#49018])
Adds realm name OIDC _security/oidc/prepare and _security/oidc/authenticate APIs responses {es-pull}64966[#64966] (issue: {es-issue}53161[#53161])
Introduce an additional hasher (PBKDF2_STRETCH) {es-pull}65328[#65328]
Returning tokenGroups attribute as SID string instead of byte array {es-pull}63509[#63509] (issue: {es-issue}61173[#61173])
Add wildcard functionality to : operator {es-pull}65188[#65188] (issue: {es-issue}65154[#65154])
Introduce list declaration for : operator {es-pull}65230[#65230] (issue: {es-issue}64388[#64388])
Add custom metadata support to data steams {es-pull}63991[#63991] (issue: {es-issue}59195[#59195])
Alow data streams to be marked hidden {es-pull}63987[#63987] (issue: {es-issue}63889[#63889])
Include date in data stream backing index names {es-pull}65205[#65205] (issue: {es-issue}65012[#65012])
Migrate aliased indices to data stream {es-pull}61525[#61525] (issue: {es-issue}61046[#61046])
REST endpoint and tests for data stream migration {es-pull}64415[#64415] (issue: {es-issue}61046[#61046])
Add validation of the SLM schedule frequency {es-pull}64452[#64452] (issue: {es-issue}55450[#55450])
Allow readonly in the hot phase for ILM policies {es-pull}64381[#64381] (issues: {es-issue}52073[#52073], {es-issue}58289[#58289], {es-issue}64008[#64008])
Allow shrink in the hot phase for ILM policies {es-pull}64008[#64008] (issues: {es-issue}52073[#52073], {es-issue}56377[#56377])
Add support for the searchable_snapshot action in the hot phase {es-pull}64883[#64883] (issue: {es-issue}64656[#64656])
Validate policy and actions against current license {es-pull}65412[#65412] (issue: {es-issue}60208[#60208])
Make SLM Run Snapshot Deletes in Parallel {es-pull}62284[#62284] (issue: {es-issue}59655[#59655])
Use data stream for ILM history {es-pull}64521[#64521]
Add a template parameter to override auto_create_index value {es-pull}61858[#61858] (issue: {es-issue}20640[#20640])
Make legacy template noop updates not change cluster state {es-pull}64493[#64493] (issues: {es-issue}57662[#57662], {es-issue}57851[#57851])
Mark component and composable index template APIs as stable {es-pull}65013[#65013]
Add copy_from parameter for set ingest processor {es-pull}63540[#63540] (issues: {es-issue}51046[#51046], {es-issue}55682[#55682], {es-issue}56985[#56985])
Add resource_name field to attachment ingest processor to aid file type recognition {es-pull}64389[#64389]
Fix IngestDocument.deepCopy to support sets {es-pull}63067[#63067] (issue: {es-issue}63066[#63066])
Enable geo_distance and geo_bounding_box queries on geo_shape field type {es-pull}64224[#64224] (issue: {es-issue}54628[#54628])
geo_point runtime field implementation {es-pull}63164[#63164]
Add deprecation check for Java version {es-pull}64996[#64996] (issues: {es-issue}40754[#40754], {es-issue}40756[#40756], {es-issue}41092[#41092])
Add infrastructure for managing system indices {es-pull}65604[#65604] (issue: {es-issue}61656[#61656])
Add stream serialisation for the OffsetTime values {es-pull}63568[#63568] (issue: {es-issue}63521[#63521])
Add validation in policy files for missing codebases {es-pull}64841[#64841]
Use different G1GC options for small heaps {es-pull}59667[#59667]
Add new setting xpack.ml.use_auto_machine_memory_percent for auto calculating native memory percentage allowed for jobs {es-pull}63887[#63887] (issue: {es-issue}63795[#63795])
Add new snapshot upgrader API for upgrading older snapshots {es-pull}64665[#64665] (issue: {es-issue}64154[#64154])
Add search runtime_mappings to datafeed configuration {es-pull}65606[#65606]
Add total ML memory to ML info {es-pull}65195[#65195] (issue: {es-issue}64225[#64225])
Adding result_type and mlcategory fields to category definitions {es-pull}63326[#63326] (issue: {es-issue}60108[#60108])
Increase log level for forecast disk storage problems {es-pull}64766[#64766] (issue: {es-issue}58806[#58806])
Provide a way to revert an {anomaly-job} to an empty snapshot {es-pull}65431[#65431]
During regression and classification training prefer smaller models if performance is similar {ml-pull}1516[#1516]
Add a response mechanism for commands sent to the native controller {ml-pull}1520[#1520], {es-pull}63542[#63542] (issue: {es-issue}62823[#62823])
Speed up anomaly detection for seasonal data. This is particularly effective for jobs using longer bucket lengths {ml-pull}1549[#1549]
Fix an edge case which could cause typical and model plot bounds to blow up to around max double {ml-pull}1551[#1551]
Estimate upper bound of potential gains before splitting a decision tree node to avoid  unnecessary computation {ml-pull}1537[#1537]
Improvements to time series modeling particularly in relation to adaption to change {ml-pull})1614[#1614]
Warn and error log throttling {ml-pull}1615[#1615]
Soften the effect of fluctuations in anomaly detection job memory usage on node assignment and add assignment_memory_basis to model_size_stats {ml-pull}1623[#1623], {es-pull}65561[#65561] (issue: {es-issue}63163[#63163])
Add xpack info and usage endpoints for runtime fields {es-pull}65600[#65600] (issue: {es-issue}59332[#59332])
Enable collapse on unsigned_long field {es-pull}63495[#63495] (issue: {es-issue}60050[#60050])
Ensure field types consistency on supporting text queries {es-pull}63487[#63487]
Introduce dynamic runtime setting {es-pull}65489[#65489]
Introduce runtime section in mappings {es-pull}62906[#62906] (issue: {es-issue}59332[#59332])
Improve error message in case of invalid dynamic templates {es-pull}60870[#60870] (issue: {es-issue}51233[#51233])
Support unmapped fields in search fields option {es-pull}65386[#65386] (issue: {es-issue}63690[#63690])
Autodetermine heap settings based on node roles and total system memory {es-pull}65905[#65905]
Clarify usage of jvm.options in its comments {es-pull}61456[#61456] (issue: {es-issue}51882[#51882])
Combine multiple equal queries into IN {es-pull}65353[#65353] (issues: {es-issue}46477[#46477], {es-issue}62804[#62804])
Improve expression normalization {es-pull}65419[#65419] (issue: {es-issue}65353[#65353])
Add method args to PERCENTILE / PERCENTILE_RANK {es-pull}65026[#65026] (issue: {es-issue}63567[#63567])
Enhance IN operator support for formatted date fields. Extend allowed conversions {es-pull}63483[#63483] (issue: {es-issue}58932[#58932])
Add runtime_mappings to search request {es-pull}64374[#64374] (issue: {es-issue}59332[#59332])
Add default scripts for runtime geo-point fields {es-pull}65586[#65586]
Add support for runtime fields {es-pull}61776[#61776] (issue: {es-issue}59332[#59332])
Apply can match phase on coordinator when the min max field data is available at the coordinator {es-pull}65583[#65583] (issue: {es-issue}65689[#65689])
Cancel search on shard failure when partial results disallowed {es-pull}63520[#63520] (issue: {es-issue}60278[#60278])
Do not skip not available shard exception in search response {es-pull}64337[#64337] (issue: {es-issue}47700[#47700])
Add CacheFile#fsync() method to ensure cached data are written on disk {es-pull}64201[#64201]
Allow searchable snapshot cache service to periodically fsync cache files {es-pull}64696[#64696] (issue: {es-issue}64201[#64201])
Allow adding existing cache files in searchable snapshots cache service {es-pull}65538[#65538]
Allow creating a SparseFileTracker with ranges already present {es-pull}65501[#65501]
Expose the list of completed ranges in SparseFileTracker {es-pull}64145[#64145]
Limit the number of snapshots in a BlobStoreRepository {es-pull}64461[#64461]
Record timestamp field range in index metadata {es-pull}65564[#65564]
Upgrade Azure repository SDK to v12 {es-pull}65140[#65140]
Wait for prewarm when relocating searchable snapshot shards {es-pull}65531[#65531]
Add new exclude_generated flag to GET transform {es-pull}63093[#63093] (issue: {es-issue}63055[#63055])
Add support for "missing" aggregation {es-pull}63651[#63651]




    

Add support for median absolute deviation {es-pull}64634[#64634]
Improve continuous transform date_histogram group_by with ingest timestamps {es-pull}63315[#63315] (issues: {es-issue}54254[#54254], {es-issue}59061[#59061])
Use ISO dates in output instead of epoch millis {es-pull}65584[#65584] (issue: {es-issue}63787[#63787])
Don’t invalidate refresh token a second time {es-pull}64259[#64259] (issue: {es-issue}56903[#56903])
Fix a NPE bug caused by code keep executing after listener returns {es-pull}64762[#64762] (issue: {es-issue}64692[#64692])
Fix remove alias with must_exist {es-pull}65141[#65141] (issues: {es-issue}58100[#58100], {es-issue}62642[#62642])
Preserve backing index ordering for data streams {es-pull}63749[#63749] (issue: {es-issue}61046[#61046])
Compute polygon orientation using signed area {es-pull}64095[#64095] (issue: {es-issue}26286[#26286])
Fixes GeoLineAggregator bugs {es-pull}65521[#65521] (issue: {es-issue}65473[#65473])
Handle degenerated rectangles while indexing {es-pull}64122[#64122]
Add ignore_above for message.raw field in notifications index mappings {es-pull}64455[#64455] (issue: {es-issue}63888[#63888])
Fix edge case for data frame analytics where a field mapped as a keyword actually has boolean and string values in the _source {es-pull}64826[#64826]
Fix job ID in C++ logs for normalize and memory estimation {es-pull}63874[#63874] (issues: {es-issue}54636[#54636], {es-issue}60395[#60395])
Truncate long audit messages {es-pull}64849[#64849] (issue: {es-issue}64570[#64570])
Fix potential cause for log errors from CXMeansOnline1d {ml-pull}1586[#1586]
Fix scaling of some hyperparameters for Bayesian optimization {ml-pull}1612[#1612]
Fix missing state in persist and restore for anomaly detection. This caused suboptimal modeling after a job was closed and reopened or failed over to a different node {ml-pull}1668[#1668]
Count only mapped fields towards docvalue_fields limit {es-pull}63806[#63806] (issue: {es-issue}63730[#63730])
Fix exception when building exists query for nested search-as-you-type field {es-pull}64630[#64630] (issue: {es-issue}64609[#64609])
Correctly handle mixed object paths in XContentMapValues {es-pull}65539[#65539] (issue: {es-issue}65499[#65499])
Drop boost from runtime distance feature query {es-pull}63949[#63949] (issue: {es-issue}63767[#63767])
Handle range query edge case {es-pull}63397[#63397] (issue: {es-issue}63386[#63386])
Return partial failures if search was cancelled {es-pull}64382[#64382] (issues: {es-issue}63520[#63520], {es-issue}64367[#64367])
_mtermvectors should continue request on item error {es-pull}65324[#65324] (issue: {es-issue}65228[#65228])
Fix inconsistent API behavior when cluster never had a snapshot repository configured {es-pull}65535[#65535] (issue: {es-issue}65511[#65511])
Fix two snapshot clone state machine bugs {es-pull}65042[#65042]
Correct the number of searchable snapshot prewarmers {es-pull}63919[#63919] (issue: {es-issue}59313[#59313])
Stricter check for snapshot restore version compatibility {es-pull}65580[#65580] (issue: {es-issue}65567[#65567])
Make state handling more robust when stop is called while indexer shuts down {es-pull}64922[#64922] (issue: {es-issue}62204[#62204])
Weighted average should map to double {es-pull}64586[#64586]
An information disclosure flaw was found in the {es} async search API.
Users who execute an async search will store the HTTP headers.
A user with the ability to read the .tasks index could obtain
sensitive request headers of other users in the cluster.
All versions of {es} between 7.7.0 and 7.10.1 are affected by this flaw.
You must upgrade to {es} version 7.10.2 to obtain the fix.
CVE-2021-22132
Known issues
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Fix cat tasks api params in spec and handler {es-pull}66272[#66272] (issue: {es-issue}59493[#59493])
Mark Cat Tasks API as experimental in rest-api-spec {es-pull}66536[#66536] (issues: {es-issue}51628[#51628], {es-issue}65823[#65823])
Mark Task APIs as experimental in rest-api-spec {es-pull}65823[#65823] (issue: {es-issue}51628[#51628])
Correctly determine defaults of settings which depend on other settings {es-pull}65989[#65989] (issue: {es-issue}47890[#47890])
Do not interpret SecurityException in KeystoreAwareCommand {es-pull}65366[#65366]
Ensure notify when proxy connections disconnect {es-pull}65697[#65697] (issue: {es-issue}65443[#65443])
Fix AbstractClient#execute Listener Leak {es-pull}65415[#65415] (issue: {es-issue}65405[#65405])
Abort sorting in case of local agg sort queue overflow {es-pull}65687[#65687] (issue: {es-issue}65685[#65685])
Verify filter’s condition type {es-pull}66268[#66268] (issue: {es-issue}66254[#66254])
Fix regressions around nested hits and disabled _source {es-pull}66572[#66572] (issues: {es-issue}60494[#60494], {es-issue}66524[#66524])
Make sure shared source always represents the top-level root document {es-pull}66725[#66725] (issues: {es-issue}60494[#60494], {es-issue}66577[#66577])
With multiple layers of nested inner_hits, we can fail to load the _source. ({es-issue}66577[#66577])
With nested inner_hits, the fast vector highlighter may load snippets from the wrong document. ({es-issue}65533[#65533])
When _source is disabled, we can fail load nested inner_hits and top_hits. ({es-issue}66572[#66572])
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Allocation
Allow null tiebreakers inside ordinals/sequences {es-pull}65033[#65033] (issue: {es-issue}64706[#64706])
Fix "resource not found" exception on existing EQL async search {es-pull}65167[#65167] (issue: {es-issue}65108[#65108])
Fix aggressive/incorrect until policy in sequences {es-pull}65156[#65156]
Extract dependent variable’s mapping correctly in case of a multi-field {es-pull}63813[#63813]
Fix bug with data frame analytics classification test data sampling when using custom feature processors {es-pull}64727[#64727]
Fix custom feature processor extraction bugs around boolean fields and custom one_hot feature output order {es-pull}64937[#64937]
Protect against stack overflow while loading data frame analytics data {es-pull}64947[#64947]
Fix a bug where the peak_model_bytes value of the model_size_stats object was not restored from the anomaly detector job snapshots {ml-pull}1572[#1572]
Correctly serialize search-as-you-type analyzer {es-pull}65359[#65359] (issue: {es-issue}65319[#65319])
Unused boost parameter should not throw mapping exception {es-pull}64999[#64999] (issue: {es-issue}64982[#64982])
Fix cacheability of custom LongValuesSource in TermsSetQueryBuilder {es-pull}65367[#65367]
SourceValueFetcher should check all possible source fields {es-pull}65375[#65375]
Fix Broken Error Handling in CacheFile#acquire {es-pull}65342[#65342] (issue: {es-issue}65302[#65302])
Fix Two Snapshot Clone State Machine Bugs {es-pull}65042[#65042]
{es} versions before 7.10.0 and 6.8.14 have an information
disclosure issue when audit logging and the emit_request_body option are
enabled. The {es} audit log could contain sensitive information,
such as password hashes or authentication tokens. This could allow an
{es} administrator to view these details.
You must upgrade to {es} version 7.10.0 to obtain the fix.
CVE-2020-7021
Known issues
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
There were several regressions around loading nested documents. These have been addressed in {es} 7.10.2.
With multiple layers of nested inner_hits, we can fail to load the _source. ({es-issue}66577[#66577])
With nested inner_hits, the fast vector highlighter may load snippets from the wrong document. ({es-issue}65533[#65533])
When _source is disabled, we can fail load nested inner_hits and top_hits. ({es-issue}66572[#66572])
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Authentication
Add data tiers (hot, warm, cold, frozen) as custom node roles {es-pull}60994[#60994] (issue: {es-issue}60848[#60848])
Allocate newly created indices on data_hot tier nodes {es-pull}61342[#61342] (issue: {es-issue}60848[#60848])
Adds hard_bounds to histogram aggregations {es-pull}59175[#59175] (issue: {es-issue}50109[#50109])
Allocate slightly less per bucket {es-pull}59740[#59740]
Improve reduction of terms aggregations {es-pull}61779[#61779] (issue: {es-issue}51857[#51857])
Speed up date_histogram by precomputing ranges {es-pull}61467[#61467]
Cache API key doc to reduce traffic to the security index {es-pull}59376[#59376] (issues: {es-issue}53940[#53940], {es-issue}55836[#55836])
Include authentication type for the authenticate response {es-pull}61247[#61247] (issue: {es-issue}61130[#61130])
Oidc additional client auth types {es-pull}58708[#58708]
Warn about unlicensed realms if no auth token can be extracted {es-pull}61402[#61402] (issue: {es-issue}61090[#61090])
Add DEBUG logging for undefined role mapping field {es-pull}61246[#61246] (issue: {es-issue}48562[#48562])
Add more context to index access denied errors {es-pull}60357[#60357] (issue: {es-issue}42166[#42166])
Add aggregation list to node info {es-pull}60074[#60074] (issue: {es-issue}52057[#52057])
Adding new require_alias option to indexing requests {es-pull}58917[#58917] (issue: {es-issue}55267[#55267])
Allow_duplicates option for append processor {es-pull}61916[#61916] (issue: {es-issue}57543[#57543])
Configurable output format for date processor {es-pull}61324[#61324] (issue: {es-issue}42523[#42523])
Enhance the ingest node simulate verbose output  {es-pull}60433[#60433] (issue: {es-issue}56004[#56004])
Per processor description for verbose simulate {es-pull}58207[#58207] (issue: {es-issue}57906[#57906])
Preserve grok pattern ordering and add sort option {es-pull}61671[#61671] (issue: {es-issue}40819[#40819])
Header warning logging refactoring {es-pull}55941[#55941] (issues: {es-issue}52369[#52369], {es-issue}55699[#55699])
Write deprecation logs to a data stream {es-pull}61484[#61484] (issues: {es-issue}46106[#46106], {es-issue}61474[#61474])
Augment String with sha1 and sha256 {es-pull}59671[#59671] (issue: {es-issue}59633[#59633])
Converts casting and def support {es-pull}61350[#61350] (issue: {es-issue}59647[#59647])
Add a "verbose" option to the data frame analytics stats endpoint {es-pull}59589[#59589] (issue: {es-issue}59125[#59125])
Add new include flag to get trained models API for model training metadata {es-pull}61922[#61922]
Add new feature_processors field for data frame analytics {es-pull}60528[#60528] (issue: {es-issue}59327[#59327])
Add new n_gram_encoding custom processor {es-pull}61578[#61578]
During nightly maintenance delete jobs whose original deletion tasks were lost {es-pull}60121[#60121] (issue: {es-issue}42840[#42840])
Suspend persistence of trained model stats when ML upgrade mode is enabled {es-pull}61143[#61143]
Calculate total feature importance to store with model metadata {ml-pull}1387[#1387]
Change outlier detection feature_influence format to array with nested objects {ml-pull}1475[#1475], {es-pull}62068[#62068]
Add timeouts to named pipe connections {ml-pull}1514[#1514], {es-pull}62993[#62993] (issue: {ml-issue}1504[#1504])
Add field type for version strings {es-pull}59773[#59773] (issue: {es-issue}48878[#48878])
Allow [null] values in [null_value] {es-pull}61798[#61798] (issues: {es-issue}7978[#7978], {es-issue}58823[#58823])
Allow metadata fields in the _source {es-pull}61590[#61590] (issue: {es-issue}58339[#58339])
Improve deserialization failure logging {es-pull}60577[#60577] (issue: {es-issue}38939[#38939])
Log and track open/close of transport connections {es-pull}60297[#60297]
Add option to provide the delimiter for the CSV format {es-pull}59907[#59907] (issue: {es-issue}41634[#41634])
Implement DATE_PARSE function for parsing strings into DATE values {es-pull}57391[#57391] (issue: {es-issue}54962[#54962])
Implement FORMAT function {es-pull}55454[#55454] (issue: {es-issue}54965[#54965])
Avoid reloading _source for every inner hit {es-pull}60494[#60494] (issue: {es-issue}32818[#32818])
Cancel multisearch when http connection closed {es-pull}61399[#61399]
Enable cancellation for msearch requests {es-pull}61337[#61337]
Executes incremental reduce in the search thread pool {es-pull}58461[#58461] (issues: {es-issue}51857[#51857], {es-issue}53411[#53411])
Introduce point in time APIs in x-pack basic {es-pull}61062[#61062] (issues: {es-issue}26472[#26472], {es-issue}46523[#46523])




    

ParametrizedFieldMapper to run validators against default value {es-pull}60042[#60042] (issue: {es-issue}59332[#59332])
Add case insensitive flag for "term" family of queries {es-pull}61596[#61596] (issue: {es-issue}61546[#61546])
Add case insensitive support for regex queries {es-pull}59441[#59441]
Tweak toXContent implementation of ParametrizedFieldMapper {es-pull}59968[#59968]
Implement fields value fetching for the text, search_as_you_type and token_count field types {es-pull}63515[#63515]
Make term/prefix/wildcard/regex query parsing more lenient, with respect to the case_insensitive flag {es-pull}63926[#63926] (issue: {es-issue}63893[#63893])
Determine shard size before allocating shards recovering from snapshots {es-pull}61906[#61906]
Introduce index based snapshot blob cache for Searchable Snapshots {es-pull}60522[#60522]
Validate snapshot UUID during restore {es-pull}59601[#59601] (issue: {es-issue}50999[#50999])
Fix AOOBE when setting min_doc_count to 0 in significant_terms {es-pull}60823[#60823] (issues: {es-issue}60683[#60683], {es-issue}60824[#60824])
Make sure non-collecting aggs include sub-aggs {es-pull}64214[#64214] (issue: {es-issue}64142[#64142])
Composite aggregation must check live docs when the index is sorted {es-pull}63864[#63864]
Fix broken parent and child aggregator {es-pull}63811[#63811]
Report anonymous roles in authenticate response {es-pull}61355[#61355] (issues: {es-issue}47195[#47195], {es-issue}53453[#53453], {es-issue}57711[#57711], {es-issue}57853[#57853])
Add view_index_metadata privilege over metricbeat-* for monitoring agent {es-pull}63750[#63750] (issue: {es-issue}63750[#63750])
Fix ILM history index settings {es-pull}61880[#61880] (issues: {es-issue}61457[#61457], {es-issue}61863[#61863])
Ensure cancelled SLM jobs do not continue to run {es-pull}63762[#63762] (issue: {es-issue}63754[#63754])
Correct the query dsl for watching elasticsearch version {es-pull}58321[#58321] (issue: {es-issue}58261[#58261])
Fix passing params to template or script failed in watcher {es-pull}58559[#58559] (issue: {es-issue}57625[#57625])
Throws IndexNotFoundException in TransportGetAction for unknown System indices {es-pull}61785[#61785] (issue: {es-issue}57936[#57936])
Handle missing logstash index exceptions {es-pull}63698[#63698]
XPack Usage API should run on MANAGEMENT threads {es-pull}64160[#64160]
Allow running the Docker image with a non-default group {es-pull}61194[#61194] (issue: {es-issue}60864[#60864])
Set the systemd initial timeout to 75 seconds {es-pull}60345[#60345] (issue: {es-issue}60140[#60140])
Adjusting inference processor to support foreach usage {es-pull}60915[#60915] (issue: {es-issue}60867[#60867])
Get data frame analytics jobs stats API can return multiple responses if more than one error {es-pull}60900[#60900] (issue: {es-issue}60876[#60876])
Do not mark the data frame analytics job as FAILED when a failure occurs after the node is shutdown {es-pull}61331[#61331] (issue: {es-issue}60596[#60596])
Improve handling of exception while starting data frame analytics process {es-pull}61838[#61838] (issue: {es-issue}61704[#61704])
Fix progress on resume after final training has completed for classification and regression. Previously, progress was shown stuck at zero for final training. {ml-pull}1443[#1443]
Avoid potential "Failed to compute quantile" and "No values added to quantile sketch" log errors training regression and classification models if there are features with mostly missing values {ml-pull}1500[#1500]
Correct the anomaly detection job model state min_version {ml-pull}1546[#1546]
Let isInetAddress utility understand the scope ID on ipv6 {es-pull}60172[#60172] (issue: {es-issue}60115[#60115])
Suppress noisy SSL exceptions {es-pull}61359[#61359]
Allows nanosecond resolution in search_after {es-pull}60328[#60328] (issue: {es-issue}52424[#52424])
Consolidate validation for 'docvalue_fields' {es-pull}59473[#59473]
Correct how field retrieval handles multifields and copy_to {es-pull}61309[#61309] (issue: {es-issue}61033[#61033])
Apply boost only once for distance_feature query {es-pull}63767[#63767]
Fixed NullPointerException in significant_text aggregation when field does not exist {es-pull}64144[#64144] (issue: {es-issue}64045[#64045])
Fix async search to retry updates on version conflict {es-pull}63652[#63652] (issue: {es-issue}63213[#63213])
Fix sorted query when date_nanos is used as the numeric_type {es-pull}64183[#64183] (issue: {es-issue}63719[#63719])
Avoid listener call under SparseFileTracker#mutex {es-pull}61626[#61626] (issue: {es-issue}61520[#61520])
Ensure repo not in use for wildcard repo deletes {es-pull}60947[#60947]
Fix Test Failure in testCorrectCountsForDoneShards {es-pull}60254[#60254] (issue: {es-issue}60247[#60247])
Minimize cache file locking during prewarming {es-pull}61837[#61837] (issue: {es-issue}58658[#58658])
Prevent snapshots to be mounted as system indices {es-pull}61517[#61517] (issue: {es-issue}60522[#60522])
Make Searchable Snapshot’s CacheFile Lock less {es-pull}63911[#63911] (issue: {es-issue}63586[#63586])
Don’t Generate an Index Setting History UUID unless it’s supported {es-pull}64213[#64213] (issue: {es-issue}64152[#64152])
Allow unescaped wildcard (*) in LIKE pattern {es-pull}63428[#63428] (issue: {es-issue}55108[#55108])
Validate integer paramete in string functions {es-pull}63728[#63728] (issue: {es-issue}58923[#58923])
Remove filter from field_caps requests {es-pull}63840[#63840] (issue: {es-issue}63832[#63832])
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Bug fixes
Allocation
Handle error conditions when simulating ingest pipelines with verbosity enabled {es-pull}63327[#63327] (issue: {es-issue}63199[#63199])
Make for each processor resistant to field modification {es-pull}62791[#62791] (issue: {es-issue}62790[#62790])
Fix online updates with custom rules referencing filters {es-pull}63057[#63057] (issue: {es-issue}62948[#62948])
Reset reindexing progress when data frame analytics job resumes with incomplete reindexing {es-pull}62772[#62772]
Fix possible NPE if transform task has no node assigned {es-pull}62946[#62946] (issue: {es-issue}62847[#62847])
Filter null objects from field caps request {es-pull}62945[#62945]
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Deprecations
Infra/Plugins
Always validate that only a create op is allowed in bulk api for data streams {es-pull}62766[#62766] (issue: {es-issue}62762[#62762])
Fix NPE when deleting multiple backing indices on a data stream {es-pull}62274[#62274] (issue: {es-issue}62272[#62272])
Fix data stream wildcard resolution bug in eql search api. {es-pull}61904[#61904] (issue: {es-issue}60828[#60828])
Prohibit the usage of create index api in namespaces managed by data stream templates {es-pull}62527[#62527]
Fix reporting of peak memory usage in memory stats for data frame analytics {ml-pull}1468[#1468]
Fix reporting of peak memory usage in model size stats for anomaly detection {ml-pull}1484[#1484]
Allow empty null values for date and IP field mappers {es-pull}62487[#62487] (issues: {es-issue}57666[#57666], {es-issue}62363[#62363])
Take resolution into account when parsing date null value {es-pull}61994[#61994]
Fix disabling allow_leading_wildcard {es-pull}62300[#62300] (issues: {es-issue}60959[#60959], {es-issue}62267[#62267])
Search memory leak {es-pull}61788[#61788]
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
New features
Search
Make endsWith function use a wildcard ES query wherever possible {es-pull}61160[#61160] (issue: {es-issue}61154[#61154])
Make stringContains function use a wildcard ES query wherever possible {es-pull}61189[#61189] (issue: {es-issue}58922[#58922])
Fix handling of alias filter in SearchService#canMatch {es-pull}59368[#59368] (issue: {es-issue}59367[#59367])
QL: Add filtering Query DSL support to IndexResolver {es-pull}60514[#60514] (issue: {es-issue}57358[#57358])
Relax ShardFollowTasksExecutor validation {es-pull}60054[#60054] (issue: {es-issue}59625[#59625])
Set timeout of auto put-follow request to unbounded {es-pull}61679[#61679] (issue: {es-issue}56891[#56891])
Set timeout of master node requests on follower to unbounded {es-pull}60070[#60070] (issue: {es-issue}56891[#56891])
"no such index [null]" when indexing into data stream with op_type=index [ISSUE] {es-pull}60581[#60581]
Data streams: throw ResourceAlreadyExists exception {es-pull}60518[#60518]
Track backing indices in data streams stats from cluster state {es-pull}59817[#59817]
Fix handling of final pipelines when destination is changed {es-pull}59522[#59522] (issue: {es-issue}57968[#57968])
Fix wrong pipeline name in debug log {es-pull}58817[#58817] (issue: {es-issue}58478[#58478])
Fix wrong result when executing bulk requests with and without pipeline {es-pull}60818[#60818] (issue: {es-issue}60437[#60437])
Update regex file for es user agent node processor {es-pull}59697[#59697] (issue: {es-issue}59694[#59694])
Always write prediction_probability and prediction_score for classification inference {es-pull}60335[#60335]
Ensure .ml-config index is updated before clearing anomaly job’s finished_time {es-pull}61064[#61064] (issue: {es-issue}61157[#61157])
Ensure annotations index mappings are up to date {es-pull}61107[#61107] (issue: {es-issue}74935[#74935])
Handle node closed exception in ML result processing {es-pull}60238[#60238] (issue: {es-issue}60130[#60130])
Recover data frame extraction search from latest sort key {es-pull}61544[#61544]
Fix NPE on ambiguous GROUP BY {es-pull}59370[#59370] (issues: {es-issue}46396[#46396], {es-issue}56489[#56489])
Fix SYS COLUMNS schema in ODBC mode {es-pull}59513[#59513] (issue: {es-issue}59506[#59506])
Cleanly Handle S3 SDK Exceptions in Request Counting {es-pull}61686[#61686] (issue: {es-issue}61670[#61670])
Fix Concurrent Snapshot Create+Delete + Delete Index {es-pull}61770[#61770] (issue: {es-issue}61762[#61762])
A field disclosure flaw was found in {es} when running a scrolling search with
field level security. If a user runs the same query another more privileged user
recently ran, the scrolling search can leak fields that should be hidden. This
could result in an attacker gaining additional permissions against a restricted
index. All versions of {es} before 7.9.0 and 6.8.12 are affected by this flaw.
You must upgrade to {es} version 7.9.0 or 6.8.12 to obtain the fix.
CVE-2020-7019
Known issues
Upgrading to 7.9.0 from an earlier version will result in incorrect mappings
on the {ml} annotations index, and possibly also on the {ml} config index. This
will lead to some pages in the {ml} UI not displaying correctly, and may prevent
{ml-jobs} being created or updated. The best way to avoid this problem if you
read about this known issue before upgrading is to manually update the mappings
on these indices in your old {es} version before upgrading to 7.9.0. If you
find out about the issue after upgrading then reindexing is required to recover.
Full details of the mitigations are in
{ml-docs}/ml-troubleshooting.html#ml-troubleshooting-mappings[Upgrade to 7.9.0 causes incorrect mappings].
Lucene 8.6.0, on which Elasticsearch 7.9.0 is based,
contains a memory
leak. This memory leak manifests in Elasticsearch when a single document is
updated repeatedly with a forced refresh. The cluster state storage layer in
Elasticsearch is based on Lucene and does use single-document updates with
forced refreshes, meaning that this memory leak manifests in Elasticsearch under
normal conditions. It also manifests when user-controlled workloads update a
single document in an index repeatedly with a forced refresh. In both cases,
the memory leak is around 500 bytes per update, so it does take some time for
the leak to show any meaningful impact on the system. Symptoms of this memory
leak are the size of the used heap slowly rising over time, requests
eventually being rejected by the real memory circuit breaker, and potentially
out-of-memory errors. A workaround is to restart any nodes exhibiting these
symptoms.  We are actively working with the Lucene community to release a
fix in Lucene 8.6.2 to
deliver in Elasticsearch 7.9.1 that will address this memory leak.




    

SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Snapshot and restore: If an index is deleted while the cluster is
concurrently taking more than one snapshot then there is a risk that one of the
snapshots may never complete and also that some shard data may be lost from the
repository, causing future restore operations to fail. To mitigate this
problem, set snapshot.max_concurrent_operations: 1 to prevent concurrent
snapshot operations:
PUT _cluster/settings
  "persistent" : {
    "snapshot.max_concurrent_operations" : 1
This issue is fixed in {es} versions 7.13.1 and later. It is not possible to
repair a repository once it is affected by this issue, so you must restore the
repository from a backup, or clear the repository by executing
DELETE _snapshot/<repository name>/*, or move to a fresh repository. For more
details, see {es-issue}73456[#73456].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Script Cache
Restoring from a snapshot (which is a particular form of recovery) is now
properly taking recovery throttling into account (i.e. the
indices.recovery.max_bytes_per_sec setting).
The max_restore_bytes_per_sec setting is also now defaulting to
unlimited, whereas previously it was set to 40mb, which is the
default that’s used for indices.recovery.max_bytes_per_sec. This means
that no behavioral change will be observed by clusters where the recovery
and restore settings had not been adapted from the defaults. {es-pull}58658[#58658]
The WRITE thread pool default queue size (thread_pool.write.size) has been
increased from 200 to 10000. A small queue size (200) caused issues when users
wanted to send small indexing requests with a high client count. Additional
memory-oriented back pressure has been introduced with the
indexing_pressure.memory.limit setting. This setting configures a limit to
the number of bytes allowed to be consumed by outstanding indexing requests.
{es-issue}59263[#59263]
Automatically importing dangling indices is now deprecated, disabled by
default, and will be removed in {es} 8.0. See the
migration notes.
{es-pull}58176[#58176] {es-pull}58898[#58898] (issue: {es-issue}48366[#48366])
Add moving percentiles pipeline aggregation {es-pull}55441[#55441] (issue: {es-issue}49452[#49452])
Add normalize pipeline aggregation {es-pull}56399[#56399] (issue: {es-issue}51005[#51005])
Add variable width histogram aggregation {es-pull}42035[#42035] (issues: {es-issue}9572[#9572], {es-issue}50863[#50863])
Add pipeline inference aggregation {es-pull}58193[#58193]
Speed up time interval arounding around daylight savings time (DST) {es-pull}56371[#56371] (issue: {es-issue}55559[#55559])
Add update data frame analytics jobs API {es-pull}58302[#58302] (issue: {es-issue}45720[#45720])
Introduce model_plot_config.annotations_enabled setting for anomaly detection jobs {es-pull}57539[#57539] (issue: {es-issue}55781[#55781])
Report significant changes to anomaly detection models in annotations of the results {ml-pull}1247[#1247], {es-pull}56342[#56342], {es-pull}56417[#56417], {es-pull}57144[#57144], {es-pull}57278[#57278], {es-pull}57539[#57539]
Merge mappings for composable index templates {es-pull}58521[#58521] (issue: {es-issue}53101[#53101])
Wildcard field optimised for wildcard queries {es-pull}49993[#49993] (issue: {es-issue}48852[#48852])
Add support for numeric range keys {es-pull}56452[#56452] (issue: {es-issue}56402[#56402])
Added standard deviation / variance sampling to extended stats {es-pull}49782[#49782] (issue: {es-issue}49554[#49554])
Give significance lookups their own home {es-pull}57903[#57903]
Increase search.max_buckets to 65,535 {es-pull}57042[#57042] (issue: {es-issue}51731[#51731])
Optimize date_histograms across daylight savings time {es-pull}55559[#55559]
Return clear error message if aggregation type is invalid {es-pull}58255[#58255] (issue: {es-issue}58146[#58146])
Save memory on numeric significant terms when not top {es-pull}56789[#56789] (issue: {es-issue}55873[#55873])
Save memory when auto_date_histogram is not on top {es-pull}57304[#57304] (issue: {es-issue}56487[#56487])
Save memory when date_histogram is not on top {es-pull}56921[#56921] (issues: {es-issue}55873[#55873], {es-issue}56487[#56487])
Save memory when histogram agg is not on top {es-pull}57277[#57277]
Save memory when numeric terms agg is not top {es-pull}55873[#55873]
Save memory when parent and child are not on top {es-pull}57892[#57892] (issue: {es-issue}55873[#55873])
Save memory when rare_terms is not on top {es-pull}57948[#57948] (issue: {es-issue}55873[#55873])
Save memory when significant_text is not on top {es-pull}58145[#58145] (issue: {es-issue}55873[#55873])
Save memory when string terms are not on top {es-pull}57758[#57758]
Speed up reducing auto_date_histo with a time zone {es-pull}57933[#57933] (issue: {es-issue}56124[#56124])
Speed up rounding in auto_date_histogram {es-pull}56384[#56384] (issue: {es-issue}55559[#55559])
Add max_token_length setting to the CharGroupTokenizer {es-pull}56860[#56860] (issue: {es-issue}56676[#56676])
Expose discard_compound_token option to kuromoji_tokenizer {es-pull}57421[#57421]
Support multiple tokens on LHS in stemmer_override rules (#56113) {es-pull}56484[#56484] (issue: {es-issue}56113[#56113])
Add http proxy support for OIDC realm {es-pull}57039[#57039] (issue: {es-issue}53379[#53379])
Improve threadpool usage and error handling for API key validation {es-pull}58090[#58090] (issue: {es-issue}58088[#58088])
Support handling LogoutResponse from SAML idP {es-pull}56316[#56316] (issues: {es-issue}40901[#40901], {es-issue}43264[#43264])
Add cache for application privileges {es-pull}55836[#55836] (issue: {es-issue}54317[#54317])
Add monitor and view_index_metadata privileges to built-in kibana_system role {es-pull}57755[#57755]
Improve role cache efficiency for API key roles {es-pull}58156[#58156] (issue: {es-issue}53939[#53939])
Add support for snapshot and restore to data streams {es-pull}57675[#57675] (issues: {es-issue}53100[#53100], {es-issue}57127[#57127])
Data stream creation validation allows for prefixed indices {es-pull}57750[#57750] (issue: {es-issue}53100[#53100])
Disallow deletion of composable template if in use by data stream {es-pull}57957[#57957] (issue: {es-issue}57004[#57004])
Validate alias operations don’t target data streams {es-pull}58327[#58327] (issue: {es-issue}53100[#53100])
Add data stream support to searchable snapshot action {es-pull}57873[#57873] (issue: {es-issue}53100[#53100])
Add data stream support to the shrink action {es-pull}57616[#57616] (issue: {es-issue}53100[#53100])
Add support for rolling over data streams  {es-pull}57295[#57295] (issues: {es-issue}53100[#53100], {es-issue}53488[#53488])
Check the managed index is not a data stream write index {es-pull}58239[#58239] (issue: {es-issue}53100[#53100])
Add default composable templates for new indexing strategy {es-pull}57629[#57629] (issue: {es-issue}56709[#56709])
Add index block api {es-pull}58094[#58094]
Add new flag to check whether alias exists on remove {es-pull}58100[#58100]
Add prefer_v2_templates parameter to reindex {es-pull}56253[#56253] (issue: {es-issue}53101[#53101])
Add template simulation API for simulating template composition {es-pull}56842[#56842] (issues: {es-issue}53101[#53101], {es-issue}55686[#55686], {es-issue}56255[#56255], {es-issue}56390[#56390])
Add ignore_empty_value parameter in set ingest processor {es-pull}57030[#57030] (issue: {es-issue}54783[#54783])
Support if_seq_no and if_primary_term for ingest {es-pull}55430[#55430] (issue: {es-issue}41255[#41255])
Add isRunning method to RestClient {es-pull}57973[#57973] (issue: {es-issue}42133[#42133])
Add RequestConfig support to RequestOptions {es-pull}57972[#57972]
Adds WKT geometry detection in find_file_structure {es-pull}57014[#57014] (issue: {es-issue}56967[#56967])
Calculate cache misses for inference and return in stats {es-pull}58252[#58252]
Delete auto-generated annotations when job is deleted. {es-pull}58169[#58169] (issue: {es-issue}57976[#57976])
Delete auto-generated annotations when model snapshot is reverted {es-pull}58240[#58240] (issue: {es-issue}57982[#57982])
Delete expired data by job {es-pull}57337[#57337]
Introduce Annotation.event field {es-pull}57144[#57144] (issue: {es-issue}55781[#55781])
Add support for larger forecasts in memory via max_model_memory setting {ml-pull}1238[#1238], {es-pull}57254[#57254]
Don’t lose precision when saving model state {ml-pull}1274[#1274]
Parallelize the feature importance calculation for classification and regression over trees {ml-pull}1277[#1277]
Add an option to do categorization independently for each partition {ml-pull}1293[#1293], {ml-pull}1318[#1318], {ml-pull}1356[#1356], {es-pull}57683[#57683]
Memory usage is reported during job initialization {ml-pull}1294[#1294]
More realistic memory estimation for classification and regression means that these analyses will require lower memory limits than before {ml-pull}1298[#1298]
Checkpoint state to allow efficient failover during coarse parameter search for classification and regression {ml-pull}1300[#1300]
Improve data access patterns to speed up classification and regression {ml-pull}1312[#1312]
Performance improvements for classification and regression, particularly running multithreaded {ml-pull}1317[#1317]
Improve runtime and memory usage training deep trees for classification and regression {ml-pull}1340[#1340]
Improvement in handling large inference model definitions {ml-pull}1349[#1349]
Add a peak_model_bytes field to model_size_stats {ml-pull}1389[#1389]
Add regex query support to wildcard field {es-pull}55548[#55548] (issue: {es-issue}54725[#54725])
Make keyword a family of field types {es-pull}58315[#58315] (issue: {es-issue}53175[#53175])
Store parsed mapping settings in IndexSettings {es-pull}57492[#57492] (issue: {es-issue}57395[#57395])
Wildcard field - add support for custom null values {es-pull}57047[#57047]
Make the number of transport threads equal to the number of available CPUs {es-pull}56488[#56488]
Share Netty event loops between transports {es-pull}46346[#46346]
Implement TIME_PARSE function for parsing strings into TIME values {es-pull}55223[#55223] (issues: {es-issue}54963[#54963], {es-issue}55095[#55095])
Implement TOP as an alternative to LIMIT {es-pull}57428[#57428] (issue: {es-issue}41195[#41195])
Implement TRIM function {es-pull}57518[#57518] (issue: {es-issue}41195[#41195])
Improve performances of LTRIM/RTRIM {es-pull}57603[#57603] (issue: {es-issue}57594[#57594])
Make CASTing string to DATETIME more lenient {es-pull}57451[#57451]
Redact credentials in connection exceptions {es-pull}58650[#58650] (issue: {es-issue}56474[#56474])
Relax parsing of date/time escaped literals {es-pull}58336[#58336] (issue: {es-issue}58262[#58262])
Add support for scalars within LIKE/RLIKE {es-pull}56495[#56495] (issue: {es-issue}55058[#55058])
Add description to submit and get async search, as well as cancel tasks {es-pull}57745[#57745]
Add matchBoolPrefix static method in query builders {es-pull}58637[#58637] (issue: {es-issue}58388[#58388])
Add range query support to wildcard field {es-pull}57881[#57881] (issue: {es-issue}57816[#57816])
Group docIds by segment in FetchPhase to better use LRU cache {es-pull}57273[#57273]
Improve error handling when decoding async execution ids {es-pull}56285[#56285]
Specify reason whenever async search gets cancelled {es-pull}57761[#57761]
Use index sort range query when possible. {es-pull}56657[#56657] (issue: {es-issue}48665[#48665])
Deduplicate Index Metadata in BlobStore {es-pull}50278[#50278] (issues: {es-issue}45736[#45736], {es-issue}46250[#46250], {es-issue}49800[#49800])
Default to zero replicas for searchable snapshots {es-pull}57802[#57802] (issue: {es-issue}50999[#50999])
Enable fully concurrent snapshot operations {es-pull}56911[#56911]
Support cloning of searchable snapshot indices {es-pull}56595[#56595]
Track GET/LIST Azure Storage API calls  {es-pull}56773[#56773]
Track GET/LIST GoogleCloudStorage API calls {es-pull}56585[#56585]
Track PUT/PUT_BLOCK operations on AzureBlobStore. {es-pull}56936[#56936]
Track multipart/resumable uploads GCS API calls {es-pull}56821[#56821]
Track upload requests on S3 repositories {es-pull}56826[#56826]
Fix bug in faster interval rounding {es-pull}56433[#56433] (issue: {es-issue}56400[#56400])
Fix bug in parent and child aggregators when parent field not defined {es-pull}57089[#57089] (issue: {es-issue}42997[#42997])
Fix missing null values for std_deviation_bounds in ext. stats aggs {es-pull}58000[#58000]
Fix local translog recovery not updating safe commit in edge case {es-pull}57350[#57350] (issue: {es-issue}57010[#57010])
Hide AlreadyClosedException on IndexCommit release {es-pull}57986[#57986] (issue: {es-issue}57797[#57797])
Don’t allow invalid template combinations {es-pull}56397[#56397] (issues: {es-issue}53101[#53101], {es-issue}56314[#56314])
Handle cluster.max_shards_per_node in YAML config {es-pull}57234[#57234] (issue: {es-issue}40803[#40803])
Check for degenerated lines when calculating the centroid {es-pull}58027[#58027] (issue: {es-issue}55851[#55851])
Fix bug in circuit-breaker check for geoshape grid aggregations {es-pull}57962[#57962] (issue: {es-issue}57847[#57847])
Make waiting for renormalization optional for internally flushing job {es-pull}58537[#58537] (issue: {es-issue}58395[#58395])
Tail the C++ logging pipe before connecting other pipes {es-pull}56632[#56632] (issue: {es-issue}56366[#56366])
Fix numerical issues leading to blow up of the model plot bounds {ml-pull}1268[#1268]
Fix causes for inverted forecast confidence interval bounds {ml-pull}1369[#1369] (issue: {ml-issue}1357[#1357])
Restrict growth of max matching string length for categories {ml-pull}1406[#1406]
Don’t omit empty arrays when filtering _source {es-pull}56527[#56527] (issues: {es-issue}20736[#20736], {es-issue}22593[#22593], {es-issue}23796[#23796])
Fix casting of scaled_float in sorts {es-pull}57207[#57207]
Account for recovery throttling when restoring snapshot {es-pull}58658[#58658] (issue: {es-issue}57023[#57023])
Fix noisy logging during snapshot delete {es-pull}56264[#56264]
Fix S3ClientSettings leak {es-pull}56703[#56703] (issue: {es-issue}56702[#56702])
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
License
Make noop template updates be cluster state noops {es-pull}57851[#57851] (issue: {es-issue}57662[#57662])
Rename template V2 classes to ComposableTemplate {es-pull}57183[#57183] (issue: {es-issue}56609[#56609])
Allow read operations to be executed without waiting for full range to be written in cache {es-pull}58728[#58728] (issues: {es-issue}58164[#58164], {es-issue}58477[#58477])
Allows SparseFileTracker to progressively execute listeners during Gap processing {es-pull}58477[#58477] (issue: {es-issue}58164[#58164])
Do not wrap CacheFile reentrant r/w locks with ReleasableLock {es-pull}58244[#58244] (issue: {es-issue}58164[#58164])




    

Use snapshot information to build searchable snapshot store MetadataSnapshot {es-pull}56289[#56289]
Fix issue reading template mappings after cluster restart {es-pull}58964[#58964] (issues: {es-issue}58521[#58521], {es-issue}58643[#58643], {es-issue}58883[#58883])
ITV2: disallow duplicate dynamic templates {es-pull}56291[#56291] (issues: {es-issue}28988[#28988], {es-issue}53101[#53101], {es-issue}53326[#53326])
Fix max-int limit for number of points reduced in geo_centroid {es-pull}56370[#56370] (issue: {es-issue}55992[#55992])
Re-enable support for array-valued geo_shape fields. {es-pull}58786[#58786]
Allow unran/incomplete forecasts to be deleted for stopped/failed jobs {es-pull}57152[#57152] (issue: {es-issue}56419[#56419])
Fix inference .ml-stats-write alias creation {es-pull}58947[#58947] (issue: {es-issue}58662[#58662])
Fix race condition when force stopping data frame analytics job {es-pull}57680[#57680]
Handle broken setup with state alias being an index {es-pull}58999[#58999] (issue: {es-issue}58482[#58482])
Mark forecasts for force closed/failed jobs as failed {es-pull}57143[#57143] (issue: {es-issue}56419[#56419])
Better interrupt handling during named pipe connection {ml-pull}1311[#1311]
Trap potential cause of SIGFPE {ml-pull}1351[#1351] (issue: {ml-issue}1348[#1348])
Correct inference model definition for MSLE regression models {ml-pull}1375[#1375]
Fix cause of SIGSEGV of classification and regression {ml-pull}1379[#1379]
Fix restoration of change detectors after seasonality change {ml-pull}1391[#1391]
Fix potential SIGSEGV when forecasting {ml-pull}1402[#1402] (issue: {ml-issue}1401[#1401])
Fix bug in resolving aliases against filters {es-pull}58399[#58399] (issues: {es-issue}57270[#57270], {es-issue}57417[#57417])
Fix handling of escaped chars in JDBC connection string {es-pull}58429[#58429] (issue: {es-issue}57927[#57927])
Handle MIN and MAX functions on dates in Painless scripts {es-pull}57605[#57605] (issue: {es-issue}57581[#57581])
Filter empty fields in SearchHit#toXContent {es-pull}58418[#58418] (issue: {es-issue}41656[#41656])
Fix exists query on unmapped field in query_string {es-pull}58804[#58804] (issues: {es-issue}55785[#55785], {es-issue}58737[#58737])
Fix handling of terminate_after when size is 0 {es-pull}58212[#58212] (issue: {es-issue}57624[#57624])
Fix possible NPE on search phase failure {es-pull}57952[#57952] (issues: {es-issue}51708[#51708], {es-issue}57945[#57945])
Handle failures with no explicit cause in async search {es-pull}58319[#58319] (issues: {es-issue}57925[#57925], {es-issue}58311[#58311])
Improve error handling in async search code {es-pull}57925[#57925] (issue: {es-issue}58995[#58995])
Prevent BigInteger serialization errors in term queries {es-pull}57987[#57987] (issue: {es-issue}57917[#57917])
Submit async search to not require read privilege {es-pull}58942[#58942]
Fix Incorrect Snapshot Shar Status for DONE Shards in Running Snapshots {es-pull}58390[#58390]
Fix Memory Leak From Master Failover During Snapshot {es-pull}58511[#58511] (issue: {es-issue}56911[#56911])
Fix NPE in SnapshotService CS Application {es-pull}58680[#58680]
Fix Snapshot Abort Not Waiting for Data Nodes {es-pull}58214[#58214]
Remove Overly Strict Safety Mechnism in Shard Snapshot Logic {es-pull}57227[#57227] (issue: {es-issue}57198[#57198])
Cancel persistent task recheck when no longer master {es-pull}58539[#58539] (issue: {es-issue}58531[#58531])
Ensure unregister child node if failed to register task {es-pull}56254[#56254] (issues: {es-issue}54312[#54312], {es-issue}55875[#55875])
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Aggregations
Disallow changing 'enabled' on the root mapper {es-pull}54463[#54463] (issue: {es-issue}33933[#33933])
Fix updating include_in_parent/include_in_root of nested field {es-pull}54386[#54386] (issue: {es-issue}53792[#53792])
Add xpack setting deprecations to deprecation API {es-pull}56290[#56290] (issue: {es-issue}54745[#54745])
Deprecate disabling basic-license features {es-pull}54816[#54816] (issue: {es-issue}54745[#54745])
Deprecated xpack "enable" settings should be no-ops {es-pull}55416[#55416] (issues: {es-issue}54745[#54745], {es-issue}54816[#54816])
Make xpack.ilm.enabled setting a no-op {es-pull}55592[#55592] (issues: {es-issue}54745[#54745], {es-issue}54816[#54816], {es-issue}55416[#55416])
Make xpack.monitoring.enabled setting a no-op {es-pull}55617[#55617] (issues: {es-issue}54745[#54745], {es-issue}54816[#54816], {es-issue}55416[#55416], {es-issue}55461[#55461], {es-issue}55592[#55592])
Restore xpack.ilm.enabled and xpack.slm.enabled settings {es-pull}57383[#57383] (issues: {es-issue}54745[#54745], {es-issue}55416[#55416], {es-issue}55592[#55592])
Add Student’s t-test aggregation support {es-pull}54469[#54469] (issue: {es-issue}53692[#53692])
Add support for filters to t-test aggregation {es-pull}54980[#54980] (issue: {es-issue}53692[#53692])
Histogram field type support for Sum aggregation {es-pull}55681[#55681] (issue: {es-issue}53285[#53285])
Histogram field type support for ValueCount and Avg aggregations {es-pull}55933[#55933] (issue: {es-issue}53285[#53285])
Implement DATETIME_FORMAT function for date/time formatting {es-pull}54832[#54832] (issue: {es-issue}53714[#53714])
Implement DATETIME_PARSE function for parsing strings {es-pull}54960[#54960] (issue: {es-issue}53714[#53714])
Implement scripting inside aggs {es-pull}55241[#55241] (issues: {es-issue}29980[#29980], {es-issue}36865[#36865], {es-issue}37271[#37271])
Expose aggregation usage in Feature Usage API {es-pull}55732[#55732] (issue: {es-issue}53746[#53746])
Reduce memory for big aggregations run against many shards {es-pull}54758[#54758]
Save memory in on aggs in async search {es-pull}55683[#55683]
Add preserve_original setting in edge ngram token filter {es-pull}55766[#55766] (issue: {es-issue}55767[#55767])
Add pre-configured “lowercase” normalizer {es-pull}53882[#53882] (issue: {es-issue}53872[#53872])
Add HLRC support for simulate index template api {es-pull}55936[#55936] (issue: {es-issue}53101[#53101])
Add prefer_v2_templates flag and index setting {es-pull}55411[#55411] (issue: {es-issue}53101[#53101])
Add warnings/errors when V2 templates would match same indices as V1 {es-pull}54367[#54367] (issue: {es-issue}53101[#53101])
Disallow merging existing mapping field definitions in templates {es-pull}57701[#57701] (issues: {es-issue}55607[#55607], {es-issue}55982[#55982], {es-issue}57393[#57393])
Emit deprecation warning if multiple v1 templates match with a new index {es-pull}55558[#55558] (issue: {es-issue}53101[#53101])
Guard adding the index.prefer_v2_templates settings for pre-7.8 nodes {es-pull}55546[#55546] (issues: {es-issue}53101[#53101], {es-issue}55411[#55411], {es-issue}55539[#55539])
Handle merging dotted object names when merging V2 template mappings {es-pull}55982[#55982] (issue: {es-issue}53101[#53101])
Throw exception on duplicate mappings metadata fields when merging templates {es-pull}57835[#57835] (issue: {es-issue}57701[#57701])
Update template v2 api rest spec {es-pull}55948[#55948] (issue: {es-issue}53101[#53101])
Use V2 index templates during index creation {es-pull}54669[#54669] (issue: {es-issue}53101[#53101])
Use V2 templates when reading duplicate aliases and ingest pipelines {es-pull}54902[#54902] (issue: {es-issue}53101[#53101])
Validate V2 templates more strictly {es-pull}56170[#56170] (issues: {es-issue}43737[#43737], {es-issue}46045[#46045], {es-issue}53101[#53101], {es-issue}53970[#53970])
Ensure that the output of node roles are sorted {es-pull}54376[#54376] (issue: {es-issue}54370[#54370])
Reintroduce system index APIs for Kibana {es-pull}54858[#54858] (issues: {es-issue}52385[#52385], {es-issue}53912[#53912])
Schedule commands in current thread context {es-pull}54187[#54187] (issue: {es-issue}17143[#17143])
Start resource watcher service early {es-pull}54993[#54993] (issue: {es-issue}54867[#54867])
Add effective max model memory limit to ML info {es-pull}55529[#55529] (issue: {es-issue}63942[#63942])
Add loss_function to regression {es-pull}56118[#56118]
Add new inference_config field to trained model config {es-pull}54421[#54421]
Add failed_category_count to model_size_stats {es-pull}55716[#55716] (issue: {es-issue}1130[#1130])
Add prediction_field_type to inference config {es-pull}55128[#55128]
Allow a certain number of ill-formatted rows when delimited format is specified {es-pull}55735[#55735] (issue: {es-issue}38890[#38890])
Apply default timeout in StopDataFrameAnalyticsAction.Request {es-pull}55512[#55512]
Create an annotation when a model snapshot is stored {es-pull}53783[#53783] (issue: {es-issue}52149[#52149])
Do not execute ML CRUD actions when upgrade mode is enabled {es-pull}54437[#54437] (issue: {es-issue}54326[#54326])
Make find_file_structure recognize Kibana CSV report timestamps {es-pull}55609[#55609] (issue: {es-issue}55586[#55586])
More advanced model snapshot retention options {es-pull}56125[#56125] (issue: {es-issue}52150[#52150])
Return assigned node in start/open job/datafeed response {es-pull}55473[#55473] (issue: {es-issue}54067[#54067])
Skip daily maintenance activity if upgrade mode is enabled {es-pull}54565[#54565] (issue: {es-issue}54326[#54326])
Start gathering and storing inference stats {es-pull}53429[#53429]
Unassign data frame analytics tasks in SetUpgradeModeAction {es-pull}54523[#54523] (issue: {es-issue}54326[#54326])
Speed up anomaly detection for the lat_long function {ml-pull}1102[#1102]
Reduce CPU scheduling priority of native analysis processes to favor the ES
JVM when CPU is constrained. This change is implemented only for Linux and macOS,
not for Windows {ml-pull}1109[#1109]
Take training_percent into account when estimating memory usage for
classification and regression {ml-pull}1111[#1111]
Support maximize minimum recall when assigning class labels for multiclass
classification {ml-pull}1113[#1113]
Improve robustness of anomaly detection to bad input data {ml-pull}1114[#1114]
Add new num_matches and preferred_to_categories fields to category output
{ml-pull}1062[#1062]
Add mean squared logarithmic error (MSLE) for regression {ml-pull}1101[#1101]
Add pseudo-Huber loss for regression {ml-pull}1168[#1168]
Reduce peak memory usage and memory estimates for classification and regression
{ml-pull}1125[#1125].)
Reduce variability of classification and regression results across our target
operating systems {ml-pull}1127[#1127]
Switch data frame analytics model memory estimates from kilobytes to
megabytes {ml-pull}1126[#1126] (issue: {es-issue}54506[#54506])
Add a {ml} native code build for Linux on AArch64 {ml-pull}1132[#1132],
{ml-pull}1135[#1135]
Improve data frame analytics runtime by optimising memory alignment for intrinsic
operations {ml-pull}1142[#1142]
Fix spurious anomalies for count and sum functions after no data are received
for long periods of time {ml-pull}1158[#1158]
Improve false positive rates from periodicity test for time series anomaly
detection {ml-pull}1177[#1177]
Break progress reporting of data frame analyses into multiple phases {ml-pull}1179[#1179]
Really centre the data before training for classification and regression begins. This
means we can choose more optimal smoothing bias and should reduce the number of trees
{ml-pull}1192[#1192]
Avoid copying file chunks in peer recovery {es-pull}56072[#56072] (issue: {es-issue}55353[#55353])
Retry failed peer recovery due to transient errors {es-pull}55353[#55353]
Exists queries to MatchNoneQueryBuilder when the field is unmapped  {es-pull}54857[#54857]
Rewrite wrapper queries to match_none if possible {es-pull}55271[#55271]
SearchService#canMatch takes into consideration the alias filter {es-pull}55120[#55120] (issue: {es-issue}55090[#55090])
Allocate searchable snapshots with the balancer {es-pull}54889[#54889] (issues: {es-issue}50999[#50999], {es-issue}54729[#54729])
Allow bulk snapshot deletes to abort {es-pull}56009[#56009] (issue: {es-issue}55773[#55773])
Allow deleting multiple snapshots at once {es-pull}55474[#55474]
Allow searching of snapshot taken while indexing {es-pull}55511[#55511] (issue: {es-issue}50999[#50999])
Allow to prewarm the cache for searchable snapshot shards {es-pull}55322[#55322]
Enable prewarming by default for searchable snapshots {es-pull}56201[#56201] (issue: {es-issue}55952[#55952])
Permit searches to be concurrent to prewarming {es-pull}55795[#55795]
Reduce contention in CacheFile.fileLock() method {es-pull}55662[#55662]
Require soft deletes for searchable snapshots {es-pull}55453[#55453]
Searchable Snapshots should respect max_restore_bytes_per_sec {es-pull}55952[#55952]
Update the HDFS version used by HDFS Repo {es-pull}53693[#53693]
Use streaming reads for GCS {es-pull}55506[#55506] (issue: {es-issue}55505[#55505])
Use workers to warm cache parts {es-pull}55793[#55793] (issue: {es-issue}55322[#55322])
Broadcast cancellation to only nodes have outstanding child tasks {es-pull}54312[#54312] (issues: {es-issue}50990[#50990], {es-issue}51157[#51157])
Support hierarchical task cancellation {es-pull}54757[#54757] (issue: {es-issue}50990[#50990])
Add analytics plugin usage stats to _xpack/usage {es-pull}54911[#54911] (issue: {es-issue}54847[#54847])
Aggregation support for Value Scripts that change types {es-pull}54830[#54830] (issue: {es-issue}54655[#54655])
Allow terms agg to default to depth first {es-pull}54845[#54845]
Clean up how pipeline aggs check for multi-bucket {es-pull}54161[#54161] (issue: {es-issue}53215[#53215])
Fix auto_date_histogram serialization bug {es-pull}54447[#54447] (issues: {es-issue}54382[#54382], {es-issue}54429[#54429])
Fix error massage for unknown value type {es-pull}55821[#55821] (issue: {es-issue}55727[#55727])
Fix scripted metric in CCS {es-pull}54776[#54776] (issue: {es-issue}54758[#54758])
Use Decimal formatter for Numeric ValuesSourceTypes {es-pull}54366[#54366] (issue: {es-issue}54365[#54365])
Fix creating filtered alias using now in a date_nanos range query failed {es-pull}54785[#54785] (issue: {es-issue}54315[#54315])
Fix simulating index templates without specified index {es-pull}56295[#56295] (issues: {es-issue}53101[#53101], {es-issue}56255[#56255])
Validate non-negative priorities for V2 index templates {es-pull}56139[#56139] (issue: {es-issue}53101[#53101])
Fix GET _ml/inference so size param is respected {es-pull}57303[#57303] (issue: {es-issue}57298[#57298])
Fix file structure finder multiline merge max for delimited formats {es-pull}56023[#56023]
Validate at least one feature is available for DF analytics {es-pull}55876[#55876] (issue: {es-issue}55593[#55593])
Trap and fail if insufficient features are supplied to data frame analyses.
Otherwise, classification and regression got stuck at zero analyzing progress
{ml-pull}1160[#1160] (issue: {es-issue}55593[#55593])
Make categorization respect the model_memory_limit {ml-pull}1167[#1167]
(issue: {ml-issue}1130[#1130])
Respect user overrides for max_trees for classification and regression
{ml-pull}1185[#1185]
Reset memory status from soft_limit to ok when pruning is no longer required
{ml-pull}1193[#1193] (issue: {ml-issue}1131[#1131])
Fix restore from training state for classification and regression
{ml-pull}1197[#1197]
Improve the initialization of seasonal components for anomaly detection
{ml-pull}1201[#1201] (issue: {ml-issue}#1178[#1178])
Don’t expand default_field in query_string before required {es-pull}55158[#55158] (issue: {es-issue}53789[#53789])
Fix time_zone for  query_string and date fields {es-pull}55881[#55881] (issue: {es-issue}55813[#55813])
Fix count when matching exact ids {es-pull}56544[#56544] (issue: {es-issue}56196[#56196])
Fix http status code when bad scripts are provided {es-pull}56117[#56117] (issue: {es-issue}55994[#55994])
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])




    

The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Enhancements
Authorization
Ensure no circular reference in translog tragic exception {es-pull}55959[#55959] (issue: {es-issue}55893[#55893])
Update translog policy before the next safe commit {es-pull}54839[#54839] (issue: {es-issue}52223[#52223])
Allow removing replicas setting on closed indices {es-pull}56680[#56680] (issues: {es-issue}56656[#56656], {es-issue}56675[#56675])
Allow removing index.number_of_replicas setting {es-pull}56656[#56656] (issue: {es-issue}56501[#56501])
Fix enrich coordinator to reject documents instead of deadlocking {es-pull}56247[#56247] (issue: {es-issue}55634[#55634])
EnrichProcessorFactory should not throw NPE if missing metadata {es-pull}55977[#55977]
Prevent stack overflow for numerous grok patterns. {es-pull}55899[#55899]
Fix empty_value handling in CsvProcessor {es-pull}55649[#55649] (issue: {es-issue}55643[#55643])
Fix incorrect log warning when exporting monitoring via HTTP without authentication {es-pull}56958[#56958] (issue: {es-issue}56810[#56810])
Ensure that the monitoring export exceptions are logged. {es-pull}56237[#56237]
Ensure that .watcher-history-11* template is in installed prior to use {es-pull}56734[#56734] (issue: {es-issue}56732[#56732])
Fix smtp.ssl.trust setting for watcher email {es-pull}56090[#56090] (issues: {es-issue}45272[#45272], {es-issue}52153[#52153])
Prevent unexpected native controller output hanging the process {es-pull}56491[#56491] (issue: {es-issue}56366[#56366])
Add method to check if object is generically writeable in stream {es-pull}54936[#54936] (issue: {es-issue}54708[#54708])
Fix background persistence of categorizer state. {ml-pull}1137[#1137] (issue: {ml-issue}1136[#1136])
Fix classification job failures when number of classes in configuration differs from the number of classes present in the training data. {ml-pull}1144[#1144]
Fix underlying cause for "Failed to calculate splitting significance" log errors. {ml-pull}1157[#1157]
Fix possible root cause for "Bad variance scale nan" log errors. {ml-pull}1225[#1225]
Change data frame analytics instrumentation timestamp resolution to milliseconds. {ml-pull}1237[#1237]
Fix "autodetect process stopped unexpectedly: Fatal error: 'terminate called after throwing an instance of 'std::bad_function_call'". {ml-pull}1246[#1246] (issue: {ml-issue}1245[#1245])
Fix monitoring if orphaned anomaly detector persistent tasks exist {es-pull}57235[#57235] (issue: {es-issue}51888[#51888])
Fix delete_expired_data/nightly maintenance when many model snapshots need deleting {es-pull}57041[#57041] (issue: {es-issue}47103[#47103])
Ensure class is represented when its cardinality is low {es-pull}56783[#56783]
Use non-zero timeout when force stopping DF analytics {es-pull}56423[#56423]
Reduce InferenceProcessor.Factory log spam by not parsing pipelines {es-pull}56020[#56020] (issue: {es-issue}55985[#55985])
Audit when unassigned datafeeds are stopped {es-pull}55656[#55656] (issue: {es-issue}55521[#55521])
Fix use of password protected PKCS#8 keys for SSL {es-pull}55457[#55457] (issue: {es-issue}8[#8])
Add support for more named curves {es-pull}55179[#55179] (issue: {es-issue}55031[#55031])
Fix unecessary evaluation for CASE/IIF {es-pull}57159[#57159] (issue: {es-issue}49672[#49672])
JDBC: fix access to the Manifest for non-entry JAR URLs {es-pull}56797[#56797] (issue: {es-issue}56759[#56759])
Fix JDBC url pattern in docs and error message {es-pull}56612[#56612] (issue: {es-issue}56476[#56476])
Fix serialization of JDBC prep statement date/time params {es-pull}56492[#56492] (issue: {es-issue}56084[#56084])
Fix issue with date range queries and timezone {es-pull}56115[#56115] (issue: {es-issue}56049[#56049])
SubSelect unresolved bugfix {es-pull}55956[#55956]
Don’t run sort optimization on size=0 {es-pull}57044[#57044] (issue: {es-issue}56923[#56923])
Fix bool query behaviour on null value {es-pull}56817[#56817] (issue: {es-issue}56812[#56812])
Fix validate query listener invocation bug {es-pull}56157[#56157]
Async Search: correct shards counting {es-pull}55758[#55758]
For constant_keyword, make sure exists query handles missing values. {es-pull}55757[#55757] (issue: {es-issue}53545[#53545])
Fix (de)serialization of async search failures {es-pull}55688[#55688]
Fix expiration time in async search response {es-pull}55435[#55435]
Return true for can_match on idle search shards {es-pull}55428[#55428] (issues: {es-issue}27500[#27500], {es-issue}50043[#50043])
Fix NPE in Partial Snapshot Without Global State {es-pull}55776[#55776] (issue: {es-issue}50234[#50234])
Fix Path Style Access Setting Priority {es-pull}55439[#55439] (issue: {es-issue}55407[#55407])
SQL: If a WHERE clause contains at least two relational operators joined by
AND, of which one is a comparison (⇐, <, >=, >) and another one is
an inequality (!=, <>), both against literals or foldable expressions, the
inequality will be ignored. The workaround is to substitute the inequality
with a NOT IN operator.
We have fixed this issue in {es} 7.10.1 and later versions. For more details,
see {es-issue}65488[#65488].
Parsing a request when the last element in an array is filtered out
(for instance using _source_includes) fails. This
is due to a bug in Jackson parser.
Fixed in {es} 8.6.1 ({es-pull}92480[#91456])
The deprecated index.mapper.dynamic setting can break your cluster. It can only
be set using the Update index settings API. Symptoms include nodes failing to start
or shards failing to allocate. Do not use this setting in versions prior to 7.17.22.
The bug is fixed in 7.17.22.
(issue: {es-issue}109160[#109160])
Breaking changes
Highlighting
Dynamic mappings in indices created on 8.0 and later have stricter validation at mapping update time and
results in a deprecation warning for indices created in Elasticsearch 7.7.0 and later.
(e.g. incorrect analyzer settings or unknown field types). {es-pull}51233[#51233] (issues: {es-issue}17411[#17411], {es-issue}24419[#24419])
Make range query rounding consistent {es-pull}50237[#50237] (issue: {es-issue}50009[#50009])
Pipeline aggregation validation errors that used to return HTTP
500s/Internal Server Errors now return 400/Bad Request {es-pull}53669[#53669].
As a bonus we now return a list of validation errors rather than returning
the first one we encounter.
Add deprecation check for listener thread pool {es-pull}53438[#53438] (issues: {es-issue}53049[#53049], {es-issue}53317[#53317])
Deprecate the logstash enabled setting {es-pull}53367[#53367]
Deprecate the listener thread pool {es-pull}53266[#53266] (issue: {es-issue}53049[#53049])
Deprecate creation of dot-prefixed index names except for hidden and system indices {es-pull}49959[#49959]
Emit deprecation warning when TermsLookup contains a type {es-pull}53731[#53731] (issue: {es-issue}41059[#41059])
Deprecate BoolQueryBuilder’s mustNot field {es-pull}53125[#53125]
Support multiple metrics in top_metrics agg {es-pull}52965[#52965] (issue: {es-issue}51813[#51813])
Add size support to top_metrics {es-pull}52662[#52662] (issue: {es-issue}51813[#51813])
HLRC support for string_stats {es-pull}52163[#52163]
Add Boxplot Aggregation {es-pull}51948[#51948] (issue: {es-issue}33112[#33112])
Add support for distance queries on geo_shape queries {es-pull}53466[#53466] (issues: {es-issue}13351[#13351], {es-issue}39237[#39237])
Add support for multipoint shape queries {es-pull}52564[#52564] (issue: {es-issue}52133[#52133])
Add support for multipoint geoshape queries {es-pull}52133[#52133] (issue: {es-issue}37318[#37318])
Implement ILM policy for .ml-state* indices {es-pull}52356[#52356] (issue: {es-issue}29938[#29938])
Add instrumentation to report statistics related to {dfanalytics-jobs} such as
progress, memory usage, etc. {ml-pull}906[#906]
Multiclass classification {ml-pull}1037[#1037]
Add optimisations for not-equalities {es-pull}51088[#51088] (issue: {es-issue}49637[#49637])
Add support for passing query parameters in REST API calls {es-pull}51029[#51029] (issue: {es-issue}42916[#42916])
Add a cluster setting to disallow expensive queries {es-pull}51385[#51385] (issue: {es-issue}29050[#29050])
Add new x-pack endpoints to track the progress of a search asynchronously {es-pull}49931[#49931] (issue: {es-issue}49091[#49091])
Speed up partial reduce of terms aggregations {es-pull}53216[#53216] (issue: {es-issue}51857[#51857])
Simplify SiblingPipelineAggregator {es-pull}53144[#53144]
Add histogram field type support to boxplot aggs {es-pull}52265[#52265] (issues: {es-issue}33112[#33112], {es-issue}52233[#52233])
Percentiles aggregation validation checks for range {es-pull}51871[#51871] (issue: {es-issue}51808[#51808])
Begin moving date_histogram to offset rounding (take two) {es-pull}51271[#51271] (issues: {es-issue}50609[#50609], {es-issue}50873[#50873])
Password-protected Keystore Feature Branch PR {es-pull}51123[#51123] (issues: {es-issue}32691[#32691], {es-issue}49340[#49340])
Implement top_metrics agg {es-pull}51155[#51155] (issue: {es-issue}48069[#48069])
Bucket aggregation circuit breaker optimization. {es-pull}46751[#46751]
Add exception metadata for disabled features {es-pull}52811[#52811] (issues: {es-issue}47759[#47759], {es-issue}52311[#52311], {es-issue}55255[#55255])
Validate role templates before saving role mapping {es-pull}52636[#52636] (issue: {es-issue}48773[#48773])
Add support for secondary authentication {es-pull}52093[#52093]
Expose API key name to the ingest pipeline {es-pull}51305[#51305] (issues: {es-issue}46847[#46847], {es-issue}49106[#49106])
Disallow Password Change when authenticated by Token {es-pull}49694[#49694] (issue: {es-issue}48752[#48752])
Allow kibana_system to create and invalidate API keys on behalf of other users {es-pull}53824[#53824] (issue: {es-issue}48716[#48716])
Add "grant_api_key" cluster privilege {es-pull}53527[#53527] (issues: {es-issue}48716[#48716], {es-issue}52886[#52886])
Giving kibana user privileges to create custom link index {es-pull}53221[#53221] (issue: {es-issue}59305[#59305])
Allow kibana to collect APM telemetry in background task {es-pull}52917[#52917] (issue: {es-issue}50757[#50757])
Add the new 'maintenance' privilege containing 4 actions (#29998) {es-pull}50643[#50643]
Shortcut query phase using the results of other shards {es-pull}51852[#51852] (issues: {es-issue}49601[#49601], {es-issue}51708[#51708])
Flush instead of synced-flush inactive shards {es-pull}49126[#49126] (issues: {es-issue}31965[#31965], {es-issue}48430[#48430])
Restore off-heap loading for term dictionary in ReadOnlyEngine {es-pull}53713[#53713] (issues: {es-issue}43158[#43158], {es-issue}51247[#51247])
Separate translog from index deletion conditions {es-pull}52556[#52556]
Always rewrite search shard request outside of the search thread pool {es-pull}51708[#51708] (issue: {es-issue}49601[#49601])
Move the terms index of _id off-heap. {es-pull}52405[#52405] (issue: {es-issue}42838[#42838])
Cache completion stats between refreshes {es-pull}51991[#51991] (issue: {es-issue}51915[#51915])
Use local checkpoint to calculate min translog gen for recovery {es-pull}51905[#51905] (issue: {es-issue}49970[#49970])
Avoid race condition in ILMHistorySotre {es-pull}53039[#53039] (issues: {es-issue}50353[#50353], {es-issue}52853[#52853])
Make FreezeStep retryable {es-pull}52540[#52540]
Make DeleteStep retryable {es-pull}52494[#52494]
Allow forcemerge in the hot phase for ILM policies {es-pull}52073[#52073] (issue: {es-issue}43165[#43165])
Stop policy on last PhaseCompleteStep instead of TerminalPolicyStep {es-pull}51631[#51631] (issue: {es-issue}48431[#48431])
Convert ILM and SLM histories into hidden indices {es-pull}51456[#51456]
Make UpdateSettingsStep retryable {es-pull}51235[#51235] (issues: {es-issue}44135[#44135], {es-issue}48183[#48183])
Expose master timeout for ILM actions {es-pull}51130[#51130] (issue: {es-issue}44136[#44136])
Wait for active shards on rolled index in a separate step {es-pull}50718[#50718] (issues: {es-issue}44135[#44135], {es-issue}48183[#48183])
Adding best_compression {es-pull}49974[#49974]
Reduce log level for pipeline failure {es-pull}54097[#54097] (issue: {es-issue}51459[#51459])
Support array for all string ingest processors {es-pull}53343[#53343] (issue: {es-issue}51087[#51087])
Add empty_value parameter to CSV processor {es-pull}51567[#51567]
Add pipeline name to ingest metadata {es-pull}50467[#50467] (issue: {es-issue}42106[#42106])
SourceExists HLRC uses GetSourceRequest instead of GetRequest {es-pull}51789[#51789] (issue: {es-issue}50885[#50885])
Add async_search.submit to HLRC {es-pull}53592[#53592] (issue: {es-issue}49091[#49091])
Add Get Source API to the HLRC {es-pull}50885[#50885] (issue: {es-issue}47678[#47678])
Secure password for monitoring HTTP exporter {es-pull}50919[#50919] (issue: {es-issue}50197[#50197])
Validate SSL settings at parse time {es-pull}49196[#49196] (issue: {es-issue}47711[#47711])
Make watch history indices hidden {es-pull}52962[#52962] (issue: {es-issue}50251[#50251])
Upgrade to the latest OWASP HTML sanitizer {es-pull}50765[#50765] (issue: {es-issue}50395[#50395])
Allow keystore add to handle multiple settings {es-pull}54229[#54229] (issue: {es-issue}54191[#54191])
Report parser name and location in XContent deprecation warnings {es-pull}53805[#53805]
Report parser name and location in XContent deprecation warnings {es-pull}53752[#53752]
Deprecate all variants of a ParseField with no replacement {es-pull}53722[#53722]
Allow specifying an exclusive set of fields on ObjectParser {es-pull}52893[#52893]
Support joda style date patterns in 7.x {es-pull}52555[#52555]
Implement hidden aliases {es-pull}52547[#52547] (issue: {es-issue}52304[#52304])
Allow ObjectParsers to specify required sets of fields {es-pull}49661[#49661] (issue: {es-issue}48824[#48824])
Use AdoptOpenJDK API to Download JDKs {es-pull}55127[#55127] (issue: {es-issue}55125[#55125])
Introduce aarch64 Docker image {es-pull}53936[#53936] (issue: {es-issue}53914[#53914])
Introduce jvm.options.d for customizing JVM options {es-pull}51882[#51882] (issue: {es-issue}51626[#51626])
Scripting: Context script cache unlimited compile {es-pull}53769[#53769] (issue: {es-issue}50152[#50152])
Scripting: Increase ingest script cache defaults {es-pull}53765[#53765] (issue: {es-issue}50152[#50152])
Scripting: Per-context script cache, default off (#52855) {es-pull}53756[#53756] (issues: {es-issue}50152[#50152], {es-issue}52855[#52855])
Scripting: Per-context script cache, default off {es-pull}52855[#52855] (issue: {es-issue}50152[#50152])
Improve Painless compilation performance for nested conditionals {es-pull}52056[#52056]
Scripting: Add char position of script errors {es-pull}51069[#51069] (issue: {es-issue}50993[#50993])
Allow keystore add-file to handle multiple settings {es-pull}54240[#54240] (issue: {es-issue}54191[#54191])
Settings: AffixSettings as validator dependencies {es-pull}52973[#52973] (issue: {es-issue}52933[#52933])
Simplify ml license checking with XpackLicenseState internals {es-pull}52684[#52684] (issue: {es-issue}52115[#52115])
License removal leads back to a basic license {es-pull}52407[#52407] (issue: {es-issue}45022[#45022])
Refactor license checking {es-pull}52118[#52118] (issue: {es-issue}51864[#51864])
Add enterprise mode and refactor {es-pull}51864[#51864] (issue: {es-issue}51081[#51081])
Verify that the field is aggregatable before attempting cardinality aggregation {es-pull}53874[#53874] (issue: {es-issue}53876[#53876])
Adds multi-class feature importance support {es-pull}53803[#53803]
Data frame analytics analysis stats {es-pull}53788[#53788]
Add a model memory estimation endpoint for anomaly detection {es-pull}53507[#53507] (issue: {es-issue}53219[#53219])
Adds new default_field_map field to trained models {es-pull}53294[#53294]
Improve DF analytics audits and logging {es-pull}53179[#53179]
Add indices_options to datafeed config and update {es-pull}52793[#52793] (issue: {es-issue}48056[#48056])
Parse and report memory usage for DF Analytics {es-pull}52778[#52778]
Adds the class_assignment_objective parameter to classification {es-pull}52763[#52763] (issue: {es-issue}52427[#52427])
Add reason to DataFrameAnalyticsTask updateState log message {es-pull}52659[#52659] (issue: {es-issue}52654[#52654])
Add support for multi-value leaves to the tree model {es-pull}52531[#52531]
Make ml internal indices hidden {es-pull}52423[#52423] (issue: {es-issue}52420[#52420])
Add _cat/ml/data_frame/analytics API {es-pull}52260[#52260] (issue: {es-issue}51413[#51413])
Adds feature importance option to inference processor {es-pull}52218[#52218]
Switch poor categorization audit warning to use status field {es-pull}52195[#52195] (issues: {es-issue}50749[#50749], {es-issue}51146[#51146], {es-issue}51879[#51879])
Retry persisting DF Analytics results {es-pull}52048[#52048]
Improve multiline_start_pattern for CSV in find_file_structure {es-pull}51737[#51737]




    

Add _cat/ml/trained_models API {es-pull}51529[#51529] (issue: {es-issue}51414[#51414])
Add GET _cat/ml/datafeeds {es-pull}51500[#51500] (issue: {es-issue}51411[#51411])
Use CSV ingest processor in find_file_structure ingest pipeline {es-pull}51492[#51492] (issue: {es-issue}56038[#56038])
Add _cat/ml/anomaly_detectors API {es-pull}51364[#51364]
Add tags url param to GET {es-pull}51330[#51330]
Add parsers for inference configuration classes {es-pull}51300[#51300]
Make datafeeds work with nanosecond time fields {es-pull}51180[#51180] (issue: {es-issue}49889[#49889])
Adds support for a global calendars {es-pull}50372[#50372] (issue: {es-issue}45013[#45013])
Speed up computation of feature importance
{ml-pull}1005[1005]
Improve initialization of learn rate for better and more stable results in
regression and classification {ml-pull}948[#948]
Add number of processed training samples to the definition of decision tree
nodes {ml-pull}991[#991]
Add new model_size_stats fields to instrument categorization
{ml-pull}948[#948], {es-pull}51879[#51879] (issue: {es-issue}50794[#50749])
Improve upfront memory estimation for all data frame analyses, which were
higher than necessary. This will improve the allocation of data frame analyses
to cluster nodes {ml-pull}1003[#1003]
Upgrade the compiler used on Linux from gcc 7.3 to gcc 7.5, and the binutils
used in the build from version 2.20 to 2.34 {ml-pull}1013[#1013]
Add instrumentation of the peak memory consumption for {dfanalytics-jobs}
{ml-pull}1022[#1022]
Remove all memory overheads for computing tree SHAP values {ml-pull}1023[#1023]
Distinguish between empty and missing categorical fields in classification and
regression model training {ml-pull}1034[#1034]
Add instrumentation information for supervised learning {dfanalytics-jobs}
{ml-pull}1031[#1031]
Add instrumentation information for {oldetection} data frame analytics jobs
{ml-pull}1068[#1068]
Write out feature importance for multi-class models {ml-pull}1071[#1071]
Enable system call filtering to the native process used with {dfanalytics}
{ml-pull}1098[#1098]
Transfer version compatibility decision to the server {es-pull}53082[#53082] (issue: {es-issue}52766[#52766])
Use a proper error message for queries directed at empty mapping indices {es-pull}52967[#52967] (issue: {es-issue}52865[#52865])
Use calendar_interval of 1d for HISTOGRAMs with 1 DAY intervals {es-pull}52749[#52749] (issue: {es-issue}52713[#52713])
Use a calendar interval for histograms over 1 month intervals {es-pull}52586[#52586] (issue: {es-issue}51538[#51538])
Make parsing of date more lenient {es-pull}52137[#52137] (issue: {es-issue}49379[#49379])
Enhance timestamp escaped literal parsing {es-pull}52097[#52097] (issue: {es-issue}46069[#46069])
Handle uberjar scenario where the ES jdbc driver file is bundled in another jar {es-pull}51856[#51856] (issue: {es-issue}50201[#50201])
Verify Full-Text Search functions not allowed in SELECT {es-pull}51568[#51568] (issue: {es-issue}47446[#47446])
Extend the optimisations for equalities {es-pull}50792[#50792] (issue: {es-issue}49637[#49637])
Add trace logging for search responses coming from server {es-pull}50530[#50530]
Extend DATE_TRUNC to also operate on intervals(elastic - #46632 ) {es-pull}47720[#47720] (issue: {es-issue}46632[#46632])
Reduce performance impact of ExitableDirectoryReader {es-pull}53978[#53978] (issues: {es-issue}52822[#52822], {es-issue}53166[#53166], {es-issue}53496[#53496])
Add heuristics to compute pre_filter_shard_size when unspecified {es-pull}53873[#53873] (issue: {es-issue}39835[#39835])
Add async_search get and delete APIs to HLRC {es-pull}53828[#53828] (issue: {es-issue}49091[#49091])
Increase step between checks for cancellation {es-pull}53712[#53712] (issues: {es-issue}52822[#52822], {es-issue}53496[#53496])
Refine SearchProgressListener internal API {es-pull}53373[#53373]
Check for query cancellation during rewrite {es-pull}53166[#53166] (issue: {es-issue}52822[#52822])
Implement Cancellable DirectoryReader {es-pull}52822[#52822]
Address MinAndMax generics warnings {es-pull}52642[#52642] (issue: {es-issue}49092[#49092])
Clarify when shard iterators get sorted {es-pull}52633[#52633]
Generalize how queries on _index are handled at rewrite time {es-pull}52486[#52486] (issues: {es-issue}49254[#49254], {es-issue}49713[#49713])
Remove the query builder serialization from QueryShardException message {es-pull}51885[#51885] (issues: {es-issue}48910[#48910], {es-issue}51843[#51843])
Short circuited to MatchNone for non-participating  slice {es-pull}51207[#51207]
Add "did you mean" to unknown queries {es-pull}51177[#51177]
Exclude unmapped fields during max clause limit checking for querying {es-pull}49523[#49523] (issue: {es-issue}49002[#49002])
Use Azure Bulk Deletes in Azure Repository {es-pull}53919[#53919] (issue: {es-issue}53865[#53865])
Only link fd* files during source-only snapshot {es-pull}53463[#53463] (issue: {es-issue}50231[#50231])
Add Blob Download Retries to GCS Repository {es-pull}52479[#52479] (issues: {es-issue}46589[#46589], {es-issue}52319[#52319])
Better Incrementality for Snapshots of Unchanged Shards {es-pull}52182[#52182]
Add Region and Signer Algorithm Overrides to S3 Repos {es-pull}52112[#52112] (issue: {es-issue}51861[#51861])
Allow Parallel Snapshot Restore And Delete {es-pull}51608[#51608] (issue: {es-issue}41463[#41463])
Transition Transforms to using hidden indices for notifcations index {es-pull}53773[#53773] (issue: {es-issue}53762[#53762])
Add processing stats to record the time spent for processing results {es-pull}53770[#53770]
Create GET _cat/transforms API Issue {es-pull}53643[#53643] (issue: {es-issue}51412[#51412])
Add support for script in group_by {es-pull}53167[#53167] (issue: {es-issue}43152[#43152])
Implement node.transform to control where to run a transform {es-pull}52712[#52712] (issues: {es-issue}48734[#48734], {es-issue}50033[#50033], {es-issue}52200[#52200])
Add support for filter aggregation {es-pull}52483[#52483] (issue: {es-issue}52151[#52151])
Provide exponential_avg* stats for batch transforms {es-pull}52041[#52041] (issue: {es-issue}52037[#52037])
Improve irrecoverable error detection - part 2 {es-pull}52003[#52003] (issue: {es-issue}51820[#51820])
Mark transform API’s stable {es-pull}51862[#51862]
Improve irrecoverable error detection {es-pull}51820[#51820] (issue: {es-issue}50135[#50135])
Add support for percentile aggs {es-pull}51808[#51808] (issue: {es-issue}51663[#51663])
Disallow fieldnames with a dot at start and/or end {es-pull}51369[#51369]
Avoid mapping problems with index templates {es-pull}51368[#51368] (issue: {es-issue}51321[#51321])
Handle permanent bulk indexing errors {es-pull}51307[#51307] (issue: {es-issue}50122[#50122])
Improve force stop robustness in case of an error {es-pull}51072[#51072]
Decode max and min optimization more carefully {es-pull}52336[#52336] (issue: {es-issue}52220[#52220])
Fix a DST error in date_histogram {es-pull}52016[#52016] (issue: {es-issue}50265[#50265])
Use #name() instead of #simpleName() when generating doc values {es-pull}51920[#51920] (issues: {es-issue}50307[#50307], {es-issue}51847[#51847])
Fix a sneaky bug in rare_terms {es-pull}51868[#51868] (issue: {es-issue}51020[#51020])
Support time_zone on composite’s date_histogram {es-pull}51172[#51172] (issues: {es-issue}45199[#45199], {es-issue}45200[#45200])
Mask wildcard query special characters on keyword queries {es-pull}53127[#53127] (issue: {es-issue}46300[#46300])
Fix caching for PreConfiguredTokenFilter {es-pull}50912[#50912] (issue: {es-issue}50734[#50734])
Respect runas realm for ApiKey security operations {es-pull}52178[#52178] (issue: {es-issue}51975[#51975])
Preserve ApiKey credentials for async verification {es-pull}51244[#51244]
Don’t fallback to anonymous for tokens/apikeys {es-pull}51042[#51042] (issue: {es-issue}50171[#50171])
Fail gracefully on invalid token strings {es-pull}51014[#51014]
Put CCR tasks on (data && remote cluster clients) {es-pull}54146[#54146] (issue: {es-issue}53924[#53924])
Handle no such remote cluster exception in ccr {es-pull}53415[#53415] (issue: {es-issue}53225[#53225])
Fix shard follow task cleaner under security {es-pull}52347[#52347] (issues: {es-issue}44702[#44702], {es-issue}51971[#51971])
Force execution of finish shard bulk request {es-pull}51957[#51957] (issue: {es-issue}51904[#51904])
Block too many concurrent mapping updates {es-pull}51038[#51038] (issue: {es-issue}50670[#50670])
Return 429 status code when there’s a read_only cluster block {es-pull}50166[#50166] (issue: {es-issue}49393[#49393])
Use special XContent registry for node tool {es-pull}54050[#54050] (issue: {es-issue}53549[#53549])
Allow static cluster.max_voting_config_exclusions {es-pull}53717[#53717] (issue: {es-issue}53455[#53455])
Allow joining node to trigger term bump {es-pull}53338[#53338] (issue: {es-issue}53271[#53271])
Ignore timeouts with single-node discovery {es-pull}52159[#52159]
Execute retention lease syncs under system context {es-pull}53838[#53838] (issues: {es-issue}48430[#48430], {es-issue}53751[#53751])
Exclude nested documents in LuceneChangesSnapshot {es-pull}51279[#51279]
Update translog policy before the next safe commit {es-pull}54839[#54839] (issue: {es-issue}52223[#52223])
Fix doc_stats and segment_stats of ReadOnlyEngine {es-pull}53345[#53345] (issues: {es-issue}51303[#51303], {es-issue}51331[#51331])
Do not wrap soft-deletes reader for segment stats {es-pull}51331[#51331] (issues: {es-issue}51192[#51192], {es-issue}51303[#51303])
Account soft-deletes in FrozenEngine {es-pull}51192[#51192] (issue: {es-issue}50775[#50775])
Fixed an index corruption bug that would occur when applying deletes or updates on an index after it has been shrunk. More details can be found on the corresponding issue.
Ensure error handler is called during SLM retention callback failure {es-pull}55252[#55252] (issue: {es-issue}55217[#55217])
Ignore ILM indices in the TerminalPolicyStep {es-pull}55184[#55184] (issue: {es-issue}51631[#51631])
Disallow negative TimeValues {es-pull}53913[#53913] (issue: {es-issue}54041[#54041])
Fix null config in SnapshotLifecyclePolicy.toRequest {es-pull}53328[#53328] (issues: {es-issue}44465[#44465], {es-issue}53171[#53171])
Freeze step retry when not acknowledged {es-pull}53287[#53287]
Make the set-single-node-allocation retryable {es-pull}52077[#52077] (issue: {es-issue}43401[#43401])
Fix the init step to actually be retryable {es-pull}52076[#52076]
Fix ingest pipeline _simulate api with empty docs never returns a response {es-pull}52937[#52937] (issue: {es-issue}52833[#52833])
Handle errors when evaluating if conditions in processors {es-pull}52543[#52543] (issue: {es-issue}52339[#52339])
Fix delete enrich policy bug {es-pull}52179[#52179] (issue: {es-issue}51228[#51228])
Fix ignore_missing in CsvProcessor {es-pull}51600[#51600]
Missing suffix for German Month "Juli" in Grok Pattern MONTH  {es-pull}51591[#51591] (issue: {es-issue}51579[#51579])
Don’t overwrite target field with SetSecurityUserProcessor {es-pull}51454[#51454] (issue: {es-issue}51428[#51428])
Fix AbstractBulkByScrollRequest slices parameter via Rest {es-pull}53068[#53068] (issue: {es-issue}53044[#53044])
Send the fields param via body instead of URL params (elastic#42232) {es-pull}48840[#48840] (issues: {es-issue}42232[#42232], {es-issue}42877[#42877])
Disable Watcher script optimization for stored scripts {es-pull}53497[#53497] (issue: {es-issue}40212[#40212])
The watcher indexing listener didn’t handle document level exceptions. {es-pull}51466[#51466] (issue: {es-issue}32299[#32299])
Make feature usage version aware {es-pull}55246[#55246] (issues: {es-issue}44589[#44589], {es-issue}55248[#55248])
Avoid StackOverflowError if write circular reference exception {es-pull}54147[#54147] (issue: {es-issue}53589[#53589])
Fix Joda compatibility in stream protocol {es-pull}53823[#53823] (issue: {es-issue}53586[#53586])
Avoid self-suppression on grouped action listener {es-pull}53262[#53262] (issue: {es-issue}53174[#53174])
Ignore virtual ethernet devices that disappear {es-pull}51581[#51581] (issue: {es-issue}49914[#49914])
Fix ingest timezone logic {es-pull}51215[#51215] (issue: {es-issue}51108[#51108])
Handle special characters and spaces in JAVA_HOME path in elasticsearch-service.bat {es-pull}52676[#52676]
Limit _FILE env var support to specific vars {es-pull}52525[#52525] (issue: {es-issue}52503[#52503])
Always set default ES_PATH_CONF for package scriptlets {es-pull}51827[#51827] (issues: {es-issue}50246[#50246], {es-issue}50631[#50631])
Fix node serialization on GET df-nalytics stats without id {es-pull}54808[#54808] (issue: {es-issue}54807[#54807])
Allow force stopping failed and stopping DF analytics {es-pull}54650[#54650]
Take more care that normalize processes use unique named pipes {es-pull}54636[#54636] (issue: {es-issue}43830[#43830])
Do not fail Evaluate API when the actual and predicted fields' types differ {es-pull}54255[#54255] (issue: {es-issue}54079[#54079])
Get ML filters size should default to 100 {es-pull}54207[#54207] (issues: {es-issue}39976[#39976], {es-issue}54206[#54206])
Introduce a "starting" datafeed state for lazy jobs {es-pull}53918[#53918] (issue: {es-issue}53763[#53763])
Only retry persistence failures when the failure is intermittent and stop retrying when analytics job is stopping {es-pull}53725[#53725] (issue: {es-issue}53687[#53687])
Fix number inference models returned in x-pack info API {es-pull}53540[#53540]
Make classification evaluation metrics work when there is field mapping type mismatch {es-pull}53458[#53458] (issue: {es-issue}53485[#53485])
Perform evaluation in multiple steps when necessary {es-pull}53295[#53295]
Specifying missing_field_value value and using it instead of empty_string {es-pull}53108[#53108] (issue: {es-issue}1034[#1034])
Use event.timezone in ingest pipeline from find_file_structure {es-pull}52720[#52720] (issue: {es-issue}9458[#9458])
Better error when persistent task assignment disabled {es-pull}52014[#52014] (issue: {es-issue}51956[#51956])
Fix possible race condition starting datafeed {es-pull}51646[#51646] (issues: {es-issue}50886[#50886], {es-issue}51302[#51302])
Fix possible race condition when starting datafeed {es-pull}51302[#51302] (issue: {es-issue}51285[#51285])
Address two edge cases for categorization.GrokPatternCreator#findBestGrokMatchFromExamples {es-pull}51168[#51168]
Calculate results and snapshot retention using latest bucket timestamps {es-pull}51061[#51061]
Use largest ordered subset of categorization tokens for category reverse
search regex {ml-pull}970[#970] (issue: {ml-issue}949[#949])
Account for the data frame’s memory when estimating the peak memory used by
classification and regression model training {ml-pull}996[#996]
Rename classification and regression parameter maximum_number_trees to
max_trees {ml-pull}1047[#1047]
Add support for more named curves {es-pull}55179[#55179] (issue: {es-issue}55031[#55031])
Allow proxy mode server name to be updated {es-pull}54107[#54107]
Invoke response handler on failure to send {es-pull}53631[#53631]
Do not log no-op reconnections at DEBUG {es-pull}53469[#53469]
Fix RemoteConnectionManager size() method {es-pull}52823[#52823] (issue: {es-issue}52029[#52029])
Remove seeds dependency for remote cluster settings {es-pull}52796[#52796]
Add host address to BindTransportException message {es-pull}51269[#51269] (issue: {es-issue}48001[#48001])
Test percolate queries using NOW and sorting {es-pull}52758[#52758] (issues: {es-issue}52618[#52618], {es-issue}52748[#52748])
Don’t index ranges including NOW in percolator {es-pull}52748[#52748] (issue: {es-issue}52617[#52617])
Fix ODBC metadata for DATE & TIME data types {es-pull}55316[#55316] (issue: {es-issue}41086[#41086])
Fix NPE for parameterized LIKE/RLIKE {es-pull}53573[#53573] (issue: {es-issue}53557[#53557])
Add support for index aliases for SYS COLUMNS command {es-pull}53525[#53525] (issue: {es-issue}31609[#31609])
Fix issue with LIKE/RLIKE as painless script {es-pull}53495[#53495] (issue: {es-issue}53486[#53486])
Fix column size for IP data type {es-pull}53056[#53056] (issue: {es-issue}52762[#52762])
Fix sql cli sourcing of x-pack-env {es-pull}52613[#52613] (issue: {es-issue}47803[#47803])
Supplement input checks on received request parameters {es-pull}52229[#52229]
Fix issue with timezone when paginating {es-pull}52101[#52101] (issue: {es-issue}51258[#51258])
Fix ORDER BY on aggregates and GROUPed BY fields {es-pull}51894[#51894] (issue: {es-issue}50355[#50355])
Fix milliseconds handling in intervals {es-pull}51675[#51675] (issue: {es-issue}41635[#41635])
Fix ORDER BY YEAR() function {es-pull}51562[#51562] (issue: {es-issue}51224[#51224])
Change the way unsupported data types fields are handled {es-pull}50823[#50823]
Selecting a literal from grouped by query generates error {es-pull}41964[#41964] (issues: {es-issue}41413[#41413], {es-issue}41951[#41951])
Improve robustness of Query Result serializations {es-pull}54692[#54692] (issue: {es-issue}54665[#54665])
Fix Term Vectors with artificial docs and keyword fields {es-pull}53504[#53504] (issue: {es-issue}53494[#53494])
Fix concurrent requests race over scroll context limit {es-pull}53449[#53449]
Fix pre-sorting of shards in the can_match phase {es-pull}53397[#53397]
Fix potential NPE in FuzzyTermsEnum {es-pull}53231[#53231] (issue: {es-issue}52894[#52894])
Fix inaccurate total hit count in _search/template api {es-pull}53155[#53155] (issue: {es-issue}52801[#52801])
Harden search context id {es-pull}53143[#53143]
Correct boost in script_score query and error on negative scores {es-pull}52478[#52478] (issue: {es-issue}48465[#48465])




    

Exclude Snapshot Shard Status Update Requests from Circuit Breaker {es-pull}55376[#55376] (issue: {es-issue}54714[#54714])
Fix Snapshot Completion Listener Lost on Master Failover {es-pull}54286[#54286]
Fix Non-Verbose Snapshot List Missing Empty Snapshots {es-pull}52433[#52433]
Fix Inconsistent Shard Failure Count in Failed Snapshots {es-pull}51416[#51416] (issue: {es-issue}47550[#47550])
Fix Overly Aggressive Request DeDuplication {es-pull}51270[#51270] (issue: {es-issue}51253[#51253])
Fixing naming in HLRC and _cat to match API content {es-pull}54300[#54300] (issue: {es-issue}53946[#53946])
Transform optmize date histogram {es-pull}54068[#54068] (issue: {es-issue}54254[#54254])
Add version guards around Transform hidden index settings {es-pull}54036[#54036] (issue: {es-issue}53931[#53931])
Fix NPE in derive stats if shouldStopAtNextCheckpoint is set {es-pull}52940[#52940]
Fix mapping deduction for scaled_float {es-pull}51990[#51990] (issue: {es-issue}51780[#51780])
Fix stats can return old state information if security is enabled {es-pull}51732[#51732] (issue: {es-issue}51728[#51728])
Upgrade the bundled JDK to JDK 14 {es-pull}53748[#53748] (issue: {es-issue}53575[#53575])
Upgrade to Jackson 2.10.3 {es-pull}53523[#53523] (issues: {es-issue}27032[#27032], {es-issue}45225[#45225])
Update jackson-databind to 2.8.11.6 {es-pull}53522[#53522] (issue: {es-issue}45225[#45225])
Fix null config in SnapshotLifecyclePolicy.toRequest {es-pull}53328[#53328] (issues: {es-issue}44465[#44465], {es-issue}53171[#53171])
ILM Freeze step retry when not acknowledged {es-pull}53287[#53287]
Fix NPE for parameterized LIKE/RLIKE {es-pull}53573[#53573] (issue: {es-issue}53557[#53557])
Add support for index aliases for SYS COLUMNS command {es-pull}53525[#53525] (issue: {es-issue}31609[#31609])
Fix issue with LIKE/RLIKE as painless script {es-pull}53495[#53495] (issue: {es-issue}53486[#53486])
Fix column size for IP data type {es-pull}53056[#53056] (issue: {es-issue}52762[#52762])
Fix Term Vectors with artificial docs and keyword fields {es-pull}53504[#53504] (issue: {es-issue}53494[#53494])
Fix concurrent requests race over scroll context limit {es-pull}53449[#53449]
Fix pre-sorting of shards in the can_match phase {es-pull}53397[#53397]
Fix potential NPE in FuzzyTermsEnum {es-pull}53231[#53231] (issue: {es-issue}52894[#52894])
Decode max and min optimization more carefully {es-pull}52336[#52336] (issue: {es-issue}52220[#52220])
Fix a DST error in date_histogram {es-pull}52016[#52016] (issue: {es-issue}50265[#50265])
Fix issue with timezone when paginating {es-pull}52101[#52101] (issue: {es-issue}51258[#51258])
Fix ORDER BY on aggregates and GROUPed BY fields {es-pull}51894[#51894] (issue: {es-issue}50355[#50355])
Fix milliseconds handling in intervals {es-pull}51675[#51675] (issue: {es-issue}41635[#41635])
Selecting a literal from grouped by query generates error {es-pull}41964[#41964] (issues: {es-issue}41413[#41413], {es-issue}41951[#41951])
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Slow loggers can cause Log4j loggers to leak over time. When a new index is created,
a new Log4j logger is associated with it. However, when an index is deleted,
 Log4j keeps an internal reference to its loggers that results in a memory leak (issue: {es-issue}56171[#56171])
This issue is fixed in {es} 6.8.10 and 7.7.1.
Week-based date patterns are not working correctly with Y. Using Y with w will result in
a failed request and an exception in the logs (issue: {es-issue}57128[#57128]). Using y with w results in
incorrect date calculations. A workaround is to add the following line to the jvm.options file.
9-:-Djava.locale.providers=SPI,COMPAT
This issue is fixed in {es} 7.7.0 and later versions (issue: {es-issue}50916[#50916]).
Deprecate loading fielddata on _id field {es-pull}49166[#49166] (issues: {es-issue}26472[#26472], {es-issue}43599[#43599])
Update the signature of vector script functions. {es-pull}48604[#48604]
Deprecate the sparse_vector field type. {es-pull}48315[#48315]
Add a deprecation warning regarding allocation awareness in search request {es-pull}48351[#48351] (issue: {es-issue}43453[#43453])
New Histogram field mapper that supports percentiles aggregations. {es-pull}48580[#48580] (issue: {es-issue}48578[#48578])
Implement stats aggregation for string terms {es-pull}47468[#47468]
ILM action to wait for SLM policy execution {es-pull}50454[#50454] (issue: {es-issue}45067[#45067])
Add ILM histore store index {es-pull}50287[#50287] (issue: {es-issue}49180[#49180])
Implement precision and recall metrics for classification evaluation {es-pull}49671[#49671] (issue: {es-issue}48759[#48759])
Explain data frame analytics API {es-pull}49455[#49455]
Machine learning model inference ingest processor {es-pull}49052[#49052]
Implement accuracy metric for multi-class classification {es-pull}47772[#47772] (issue: {es-issue}48759[#48759])
Add feature importance values to classification and regression results (using tree
SHapley Additive exPlanation, or SHAP) {ml-pull}857[#857]
Add reusable HistogramValue object   {es-pull}49799[#49799] (issue: {es-issue}49683[#49683])
Optimize composite aggregation based on index sorting {es-pull}48399[#48399] (issue: {es-issue}48130[#48130])
Do not cancel ongoing recovery for noop copy on broken node {es-pull}48265[#48265] (issue: {es-issue}47974[#47974])
Quieter logging from the DiskThresholdMonitor {es-pull}48115[#48115] (issue: {es-issue}48038[#48038])
Faster access to INITIALIZING/RELOCATING shards {es-pull}47817[#47817] (issues: {es-issue}46941[#46941], {es-issue}48579[#48579])
Check for deprecations when analyzers are built {es-pull}50908[#50908] (issue: {es-issue}42349[#42349])
Make Multiplexer inherit filter chains analysis mode {es-pull}50662[#50662] (issue: {es-issue}50554[#50554])
Allow custom characters in token_chars of ngram tokenizers {es-pull}49250[#49250] (issue: {es-issue}25894[#25894])
Increase Size and lower TTL on DLS BitSet Cache {es-pull}50535[#50535] (issues: {es-issue}43669[#43669], {es-issue}49260[#49260])
Add 'monitor_snapshot' cluster privilege {es-pull}50489[#50489] (issue: {es-issue}50210[#50210])
Remove reserved roles for code search {es-pull}50068[#50068] (issue: {es-issue}49842[#49842])
[Code] Remove code_admin/code_user roles {es-pull}48164[#48164]
Resolve the role query and the number of docs lazily {es-pull}48036[#48036]
Do not warm up searcher in engine constructor {es-pull}48605[#48605] (issue: {es-issue}47186[#47186])
Add a new merge policy that interleaves old and new segments on force merge {es-pull}48533[#48533] (issue: {es-issue}37043[#37043])
Refresh should not acquire readLock {es-pull}48414[#48414] (issue: {es-issue}47186[#47186])
Refresh cached phase policy definition if possible on new poli… {es-pull}50820[#50820] (issue: {es-issue}48431[#48431])
Make the UpdateRolloverLifecycleDateStep retryable {es-pull}50702[#50702] (issue: {es-issue}48183[#48183])
Make InitializePolicyContextStep retryable {es-pull}50685[#50685] (issue: {es-issue}48183[#48183])
ILM retryable async action steps {es-pull}50522[#50522] (issues: {es-issue}44135[#44135], {es-issue}48183[#48183])
Make the TransportRolloverAction execute in one cluster state update {es-pull}50388[#50388]
ILM open/close steps are noop if idx is open/close {es-pull}48614[#48614]
ILM Make the check-rollover-ready step retryable {es-pull}48256[#48256] (issue: {es-issue}44135[#44135])
Replace required pipeline with final pipeline {es-pull}49470[#49470] (issue: {es-issue}49247[#49247])
Add templating support to enrich processor {es-pull}49093[#49093]
Introduce on_failure_pipeline ingest metadata inside on_failure block {es-pull}49076[#49076] (issue: {es-issue}44920[#44920])
Add templating support to pipeline processor. {es-pull}49030[#49030] (issue: {es-issue}39955[#39955])
Add option to split processor for preserving trailing empty fields {es-pull}48664[#48664] (issue: {es-issue}48498[#48498])
Change grok watch dog to be Matcher based instead of thread based. {es-pull}48346[#48346] (issues: {es-issue}43673[#43673], {es-issue}47374[#47374])
update ingest-user-agent regexes.yml {es-pull}47807[#47807]
Validate proxy base path at parse time {es-pull}47912[#47912] (issue: {es-issue}47711[#47711])
Validate index name time format setting at parse time {es-pull}47911[#47911] (issue: {es-issue}47711[#47711])
Validate monitoring header overrides at parse time {es-pull}47848[#47848] (issue: {es-issue}47711[#47711])
Validate monitoring username at parse time {es-pull}47821[#47821] (issue: {es-issue}47711[#47711])
Validate monitoring password at parse time {es-pull}47740[#47740] (issue: {es-issue}47711[#47711])
"CONTAINS" support for BKD-backed geo_shape and shape fields {es-pull}50141[#50141] (issue: {es-issue}41204[#41204])
Adds support for geo-bounds filtering in geogrid aggregations {es-pull}50002[#50002]
Introduce faster approximate sinh/atan math functions {es-pull}49009[#49009] (issue: {es-issue}41166[#41166])
Add IndexOrDocValuesQuery to GeoPolygonQueryBuilder {es-pull}48449[#48449]
Improve resiliency to formatting JSON in server {es-pull}48553[#48553] (issue: {es-issue}48450[#48450])
Don’t close stderr under --quiet {es-pull}47208[#47208] (issue: {es-issue}46900[#46900])
Restrict support for CMS to pre-JDK 14 {es-pull}49123[#49123] (issue: {es-issue}46973[#46973])
Remove parsed JVM settings from general settings in Windows service daemon manager {es-pull}49061[#49061] (issue: {es-issue}48796[#48796])
Package the JDK into jdk.app on macOS {es-pull}48765[#48765]
Add UBI-based Docker images {es-pull}48710[#48710] (issue: {es-issue}48429[#48429])
Report progress of multiple plugin installs {es-pull}51001[#51001] (issue: {es-issue}50924[#50924])
Allow installing multiple plugins as a transaction {es-pull}50924[#50924] (issue: {es-issue}50443[#50443])
Scripting: ScriptFactory not required by compile {es-pull}50344[#50344] (issue: {es-issue}49466[#49466])
Scripting: Cache script results if deterministic {es-pull}50106[#50106] (issue: {es-issue}49466[#49466])
Scripting: Groundwork for caching script results {es-pull}49895[#49895] (issue: {es-issue}49466[#49466])
Scripting: add available languages & contexts API {es-pull}49652[#49652] (issue: {es-issue}49463[#49463])
Scripting: fill in get contexts REST API {es-pull}48319[#48319] (issue: {es-issue}47411[#47411])
Scripting: get context names REST API {es-pull}48026[#48026] (issue: {es-issue}47411[#47411])
Add parameter to make sure that log of updating IndexSetting be more detailed {es-pull}49969[#49969] (issue: {es-issue}49818[#49818])
Enable dependent settings values to be validated {es-pull}49942[#49942]
Do not reference values for filtered settings {es-pull}48066[#48066]
Add setting to restrict license types {es-pull}49418[#49418] (issue: {es-issue}48508[#48508])
Support "enterprise" license types {es-pull}49223[#49223] (issue: {es-issue}48510[#48510])
Add audit warning for 1000 categories found early in job {es-pull}51146[#51146] (issue: {es-issue}50749[#50749])
Add num_top_feature_importance_values param to regression and classification {es-pull}50914[#50914]
Implement force deleting a data frame analytics job {es-pull}50553[#50553] (issue: {es-issue}48124[#48124])
Delete unused data frame analytics state {es-pull}50243[#50243]
Make each analysis report desired field mappings to be copied {es-pull}50219[#50219] (issue: {es-issue}50119[#50119])
Retry bulk indexing of state docs {es-pull}50149[#50149] (issue: {es-issue}50143[#50143])
Persist/restore state for data frame analytics classification {es-pull}50040[#50040]
Introduce randomize_seed setting for regression and classification {es-pull}49990[#49990]
Pass prediction_field_type to C++ analytics process {es-pull}49861[#49861] (issue: {es-issue}49796[#49796])
Add optional source filtering during data frame reindexing {es-pull}49690[#49690] (issue: {es-issue}49531[#49531])
Add default categorization analyzer definition to ML info {es-pull}49545[#49545]
Add graceful retry for anomaly detector result indexing failures {es-pull}49508[#49508] (issue: {es-issue}45711[#45711])
Lower minimum model memory limit value for data frame analytics jobs from 1MB to 1kB {es-pull}49227[#49227] (issue: {es-issue}49168[#49168])
Improve model_memory_limit user experience for data frame analytics jobs {es-pull}44699[#44699]
Improve performance of boosted tree training for both classification and regression {ml-pull}775[#775]
Reduce the peak memory used by boosted tree training and fix an overcounting bug
estimating maximum memory usage {ml-pull}781[#781]
Stratified fractional cross validation for regression {ml-pull}784[#784]
Added geo_point supported output for lat_long function records {ml-pull}809[#809], {es-pull}47050[#47050]
Use a random bag of the data to compute the loss function derivatives for each
new tree which is trained for both regression and classification {ml-pull}811[#811]
Emit prediction_probability field alongside prediction field in ml results {ml-pull}818[#818]
Reduce memory usage of {ml} native processes on Windows {ml-pull}844[#844]
Reduce runtime of classification and regression {ml-pull}863[#863]
Stop early training a classification and regression forest when the validation
error is no longer decreasing {ml-pull}875[#875]
Emit prediction_field_name in data frame analytics results using the type
provided as prediction_field_type parameter {ml-pull}877[#877]
Improve performance updating quantile estimates {ml-pull}881[#881]
Migrate to use Bayesian optimisation for initial hyperparameter value line
searches and stop early if the expected improvement is too small {ml-pull}903[#903]
Stop cross-validation early if the predicted test loss has a small chance of
being smaller than for the best parameter values found so far {ml-pull}915[#915]
Optimize decision threshold for classification to maximize minimum class recall {ml-pull}926[#926]
Include categorization memory usage in the model_bytes field in
model_size_stats, so that it is taken into account in node assignment
decisions {ml-pull}927[#927] (issue: {ml-issue}724[#724])
Do not load SSLService in plugin contructor {es-pull}49667[#49667] (issue: {es-issue}44536[#44536])
Netty4: switch to composite cumulator {es-pull}49478[#49478]
Add the simple strategy to cluster settings {es-pull}49414[#49414] (issue: {es-issue}49067[#49067])
Deprecate misconfigured SSL server config {es-pull}49280[#49280] (issue: {es-issue}45892[#45892])
Improved diagnostics for TLS trust failures {es-pull}48911[#48911]
Use peer recovery retention leases for indices without soft-deletes {es-pull}50351[#50351] (issues: {es-issue}45136[#45136], {es-issue}46959[#46959])
Recovery buffer size 16B smaller {es-pull}50100[#50100]
SQL: Handle uberjar scenario where the ES jdbc driver file is bundled in another jar {es-pull}51856[#51856] (issue: {es-issue}50201[#50201])
SQL: add trace logging for search responses coming from server {es-pull}50530[#50530]
SQL: Add TRUNC alias for TRUNCATE {es-pull}49571[#49571] (issue: {es-issue}41195[#41195])
SQL: binary communication implementation for drivers and the CLI {es-pull}48261[#48261] (issue: {es-issue}47785[#47785])
SQL: Verify Full-Text Search functions not allowed in SELECT {es-pull}51568[#51568] (issue: {es-issue}47446[#47446])
Add Validation for maxQueryTerms to be greater than 0 for MoreLikeThisQuery {es-pull}49966[#49966] (issue: {es-issue}49927[#49927])
Optimize numeric sort on match_all queries {es-pull}49717[#49717] (issue: {es-issue}48804[#48804])
Pre-sort shards based on the max/min value of the primary sort field {es-pull}49092[#49092] (issue: {es-issue}49091[#49091])
Optimize sort on long field {es-pull}48804[#48804]
Search optimisation - add canMatch early aborts for queries on "_index" field {es-pull}48681[#48681] (issue: {es-issue}48473[#48473])
#48475 Pure disjunctions should rewrite to a MatchNoneQueryBuilder {es-pull}48557[#48557]
Disable caching when queries are profiled {es-pull}48195[#48195] (issue: {es-issue}33298[#33298])
BlendedTermQuery’s equals method should consider boosts {es-pull}48193[#48193] (issue: {es-issue}48184[#48184])
Increase the number of vector dims to 2048 {es-pull}46895[#46895]
Use Cluster State to Track Repository Generation {es-pull}49729[#49729] (issue: {es-issue}49060[#49060])
Track Repository Gen. in BlobStoreRepository {es-pull}48944[#48944] (issues: {es-issue}38941[#38941], {es-issue}47520[#47520], {es-issue}47834[#47834], {es-issue}49048[#49048])




    

Restore from Individual Shard Snapshot Files in Parallel {es-pull}48110[#48110] (issue: {es-issue}42791[#42791])
Track Shard-Snapshot Index Generation at Repository Root  {es-pull}46250[#46250] (issues: {es-issue}38941[#38941], {es-issue}45736[#45736])
Improve error handling of script errors {es-pull}48887[#48887] (issue: {es-issue}48467[#48467])
Add wait_for_checkpoint flag to stop {es-pull}47935[#47935] (issue: {es-issue}45293[#45293])
Use #name() instead of #simpleName() when generating doc values {es-pull}51920[#51920] (issues: {es-issue}50307[#50307], {es-issue}51847[#51847])
Fix a sneaky bug in rare_terms {es-pull}51868[#51868] (issue: {es-issue}51020[#51020])
Support time_zone on composite’s date_histogram {es-pull}51172[#51172] (issues: {es-issue}45199[#45199], {es-issue}45200[#45200])
Fix format problem in composite of unmapped {es-pull}50869[#50869] (issue: {es-issue}50600[#50600])
SingleBucket aggs need to reduce their bucket’s pipelines first {es-pull}50103[#50103] (issue: {es-issue}50054[#50054])
Avoid precision loss in DocValueFormat.RAW#parseLong {es-pull}49063[#49063] (issue: {es-issue}38692[#38692])
Fix ignoring missing values in min/max aggregations {es-pull}48970[#48970] (issue: {es-issue}48905[#48905])
Collect shard sizes for closed indices {es-pull}50645[#50645] (issue: {es-issue}33888[#33888])
Auto-expand replicated closed indices {es-pull}48973[#48973]
Ignore dangling indices created in newer versions {es-pull}48652[#48652] (issue: {es-issue}34264[#34264])
Handle negative free disk space in deciders {es-pull}48392[#48392] (issue: {es-issue}48380[#48380])
Fix caching for PreConfiguredTokenFilter {es-pull}50912[#50912] (issue: {es-issue}50734[#50734])
Throw Error on deprecated nGram and edgeNGram custom filters {es-pull}50376[#50376] (issue: {es-issue}50360[#50360])
_analyze api does not correctly use normalizers when specified {es-pull}48866[#48866] (issue: {es-issue}48650[#48650])
Don’t fallback to anonymous for tokens/apikeys {es-pull}51042[#51042] (issue: {es-issue}50171[#50171])
Populate User metadata with OpenIDConnect collections {es-pull}50521[#50521] (issue: {es-issue}50250[#50250])
Always return 401 for not valid tokens {es-pull}49736[#49736] (issue: {es-issue}38866[#38866])
Fix iterate-from-1 bug in smart realm order {es-pull}49473[#49473]
Remove unnecessary details logged for OIDC {es-pull}48746[#48746]
Add owner flag parameter to the rest spec {es-pull}48500[#48500] (issue: {es-issue}48499[#48499])
Fix memory leak in DLS bitset cache {es-pull}50635[#50635] (issue: {es-issue}49261[#49261])
Validate field permissions when creating a role {es-pull}50212[#50212] (issues: {es-issue}46275[#46275], {es-issue}48108[#48108])
Validate field permissions when creating a role {es-pull}48108[#48108] (issue: {es-issue}46275[#46275])
Block too many concurrent mapping updates {es-pull}51038[#51038] (issue: {es-issue}50670[#50670])
Ensure meta and document field maps are never null in GetResult {es-pull}50112[#50112] (issue: {es-issue}48215[#48215])
Replicate write actions before fsyncing them {es-pull}49746[#49746]
Do not mutate request on scripted upsert {es-pull}49578[#49578] (issue: {es-issue}48670[#48670])
Fix Transport Stopped Exception {es-pull}48930[#48930] (issue: {es-issue}42612[#42612])
Return consistent source in updates {es-pull}48707[#48707]
Close query cache on index service creation failure {es-pull}48230[#48230] (issue: {es-issue}48186[#48186])
Make EC2 Discovery Cache Empty Seed Hosts List {es-pull}50607[#50607] (issue: {es-issue}50550[#50550])
Make EC2 Discovery Plugin Retry Requests {es-pull}50550[#50550] (issue: {es-issue}50462[#50462])
Closed shard should never open new engine {es-pull}47186[#47186] (issues: {es-issue}45263[#45263], {es-issue}47060[#47060])
Fix meta version of task index mapping {es-pull}50363[#50363] (issue: {es-issue}48393[#48393])
Do not wrap soft-deletes reader for segment stats {es-pull}51331[#51331] (issues: {es-issue}51192[#51192], {es-issue}51303[#51303])
Account soft-deletes in FrozenEngine {es-pull}51192[#51192] (issue: {es-issue}50775[#50775])
Account trimAboveSeqNo in committed translog generation {es-pull}50205[#50205] (issue: {es-issue}49970[#49970])
Greedily advance safe commit on new global checkpoint {es-pull}48559[#48559] (issue: {es-issue}48532[#48532])
Do not ignore exception when trim unreferenced readers {es-pull}48470[#48470]
Handle failure to retrieve ILM policy step better {es-pull}49193[#49193] (issue: {es-issue}49128[#49128])
Don’t halt policy execution on policy trigger exception {es-pull}49128[#49128]
Re-read policy phase JSON when using ILM’s move-to-step API {es-pull}48827[#48827]
Don’t schedule SLM jobs when services have been stopped {es-pull}48658[#48658] (issue: {es-issue}47749[#47749])
Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48367[#48367]
Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48361[#48361]
Add SLM support to xpack usage and info APIs {es-pull}48096[#48096] (issue: {es-issue}43663[#43663])
Change policy_id to list type in slm.get_lifecycle {es-pull}47766[#47766] (issue: {es-issue}47765[#47765])
Don’t overwrite target field with SetSecurityUserProcessor {es-pull}51454[#51454] (issue: {es-issue}51428[#51428])
Fix ingest simulate response document order if processor executes async {es-pull}50244[#50244]
Allow list of IPs in geoip ingest processor {es-pull}49573[#49573] (issue: {es-issue}46193[#46193])
Do not wrap ingest processor exception with IAE {es-pull}48816[#48816] (issue: {es-issue}48810[#48810])
Introduce dedicated ingest processor exception {es-pull}48810[#48810] (issue: {es-issue}48803[#48803])
Support es7 node http publish_address format {es-pull}49279[#49279] (issue: {es-issue}48950[#48950])
Add slices to delete and update by query in HLRC {es-pull}48420[#48420]
fix incorrect comparison {es-pull}48208[#48208]
Fix HLRC parsing of CancelTasks response {es-pull}47017[#47017]
Prevent deadlock by using separate schedulers {es-pull}48697[#48697] (issues: {es-issue}41451[#41451], {es-issue}47599[#47599])
Validate exporter type is HTTP for HTTP exporter {es-pull}49992[#49992] (issues: {es-issue}47246[#47246], {es-issue}47711[#47711], {es-issue}49942[#49942])
APM system_user {es-pull}47668[#47668] (issues: {es-issue}2708[#2708], {es-issue}40876[#40876])
Guard against null geoBoundingBox {es-pull}50506[#50506] (issue: {es-issue}50505[#50505])
Geo: Switch generated GeoJson type names to camel case (#50285) {es-pull}50400[#50400] (issue: {es-issue}49568[#49568])
Geo: Switch generated WKT to upper case {es-pull}50285[#50285] (issue: {es-issue}49568[#49568])
Fix typo when assigning null_value in GeoPointFieldMapper  {es-pull}49645[#49645]
Fix handling of circles in legacy geo_shape queries {es-pull}49410[#49410] (issue: {es-issue}49296[#49296])
GEO: intersects search for geo_shape return wrong result {es-pull}49017[#49017]
Geo: improve handling of out of bounds points in linestrings {es-pull}47939[#47939] (issue: {es-issue}43916[#43916])
Ignore virtual ethernet devices that disappear {es-pull}51581[#51581] (issue: {es-issue}49914[#49914])
Guess root cause support unwrap {es-pull}50525[#50525] (issue: {es-issue}50417[#50417])
Allow parsing timezone without fully provided time {es-pull}50178[#50178] (issue: {es-issue}49351[#49351])
[Java.time] Retain prefixed date pattern in formatter {es-pull}48703[#48703] (issue: {es-issue}48698[#48698])
Don’t drop user’s MaxDirectMemorySize flag on jdk8/windows {es-pull}48657[#48657] (issues: {es-issue}44174[#44174], {es-issue}48365[#48365])
Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only issue) {es-pull}48365[#48365] (issue: {es-issue}47384[#47384])
[Java.time] Calculate week of a year with ISO rules {es-pull}48209[#48209] (issues: {es-issue}41670[#41670], {es-issue}42588[#42588], {es-issue}43275[#43275], {es-issue}43652[#43652])
Return 400 when handling invalid JSON {es-pull}49552[#49552] (issue: {es-issue}49428[#49428])
Slash missed in indices.put_mapping url {es-pull}49468[#49468]
Validate classification dependent_variable cardinality is at least two {es-pull}51232[#51232]
Do not copy mapping from dependent variable to prediction field in regression analysis {es-pull}51227[#51227]
Handle nested and aliased fields correctly when copying mapping {es-pull}50918[#50918] (issue: {es-issue}50787[#50787])
Fix off-by-one error in ml_classic tokenizer end offset {es-pull}50655[#50655]
Improve uniqueness of result document IDs {es-pull}50644[#50644] (issue: {es-issue}50613[#50613])
Fix accuracy metric in multi-class confusion matrix {es-pull}50310[#50310] (issue: {es-issue}48759[#48759])
Fix race condition when stopping a data frame analytics jobs immediately after starting it {es-pull}50276[#50276] (issues: {es-issue}49680[#49680], {es-issue}50177[#50177])
Apply source query on data frame analytics memory estimation {es-pull}49517[#49517] (issue: {es-issue}49454[#49454])
Fix r_squared eval when variance is 0 {es-pull}49439[#49439]
Blacklist a number of prediction field names {es-pull}49371[#49371] (issue: {es-issue}48808[#48808])
Make data frame analytics more robust for very short-lived analyses {es-pull}49282[#49282] (issue: {es-issue}49095[#49095])
Fixes potential memory corruption when determining seasonality {ml-pull}852[#852]
Prevent prediction_field_name clashing with other fields in {ml} results {ml-pull}861[#861]
Include out-of-order as well as in-order terms in categorization reverse searches {ml-pull}950[#950] (issue: {ml-issue}949[#949])
Ensure that field collapsing works with field aliases. {es-pull}50722[#50722] (issues: {es-issue}32648[#32648], {es-issue}50121[#50121])
Improve DateFieldMapper ignore_malformed handling {es-pull}50090[#50090] (issues: {es-issue}46675[#46675], {es-issue}50081[#50081])
Annotated text type should extend TextFieldType {es-pull}49555[#49555] (issue: {es-issue}49289[#49289])
Ensure parameters are updated when merging flattened mappings. {es-pull}48971[#48971] (issue: {es-issue}48907[#48907])
Correctly handle MSM for nested disjunctions {es-pull}50669[#50669] (issue: {es-issue}50305[#50305])
Fix query analyzer logic for mixed conjunctions of terms and ranges {es-pull}49803[#49803] (issue: {es-issue}49684[#49684])
Check allocation id when failing shard on recovery {es-pull}50656[#50656] (issue: {es-issue}50508[#50508])
Migrate peer recovery from translog to retention lease {es-pull}49448[#49448] (issue: {es-issue}45136[#45136])
Ignore Lucene index in peer recovery if translog corrupted {es-pull}49114[#49114]
SQL: Fix milliseconds handling in intervals {es-pull}51675[#51675] (issue: {es-issue}41635[#41635])
SQL: Fix ORDER BY YEAR() function {es-pull}51562[#51562] (issue: {es-issue}51224[#51224])
SQL: change the way unsupported data types fields are handled {es-pull}50823[#50823]
SQL: Optimisation fixes for conjunction merges {es-pull}50703[#50703] (issue: {es-issue}49637[#49637])
SQL: Fix issue with CAST and NULL checking. {es-pull}50371[#50371] (issue: {es-issue}50191[#50191])
SQL: fix NPE for JdbcResultSet.getDate(param, Calendar) calls {es-pull}50184[#50184] (issue: {es-issue}50174[#50174])
SQL: COUNT DISTINCT returns 0 instead of NULL for no matching docs {es-pull}50037[#50037] (issue: {es-issue}50013[#50013])
Fix LOCATE function optional parameter handling  {es-pull}49666[#49666] (issue: {es-issue}49557[#49557])
Fix NULL handling for FLOOR and CEIL functions {es-pull}49644[#49644] (issue: {es-issue}49556[#49556])
Handle NULL arithmetic operations with INTERVALs {es-pull}49633[#49633] (issue: {es-issue}49297[#49297])
Fix issue with GROUP BY YEAR() {es-pull}49559[#49559] (issue: {es-issue}49386[#49386])
Fix issue with CASE/IIF pre-calculating results {es-pull}49553[#49553] (issue: {es-issue}49388[#49388])
Fix issue with folding of CASE/IIF {es-pull}49449[#49449] (issue: {es-issue}49387[#49387])
Fix issues with WEEK/ISO_WEEK/DATEDIFF {es-pull}49405[#49405] (issues: {es-issue}48209[#48209], {es-issue}49376[#49376])
SQL: Fix issue with mins & hours for DATEDIFF {es-pull}49252[#49252]
SQL: Failing Group By queries due to different ExpressionIds {es-pull}43072[#43072] (issues: {es-issue}33361[#33361], {es-issue}34543[#34543], {es-issue}36074[#36074], {es-issue}37044[#37044], {es-issue}40001[#40001], {es-issue}40240[#40240], {es-issue}41159[#41159], {es-issue}42041[#42041], {es-issue}46316[#46316])
Collect results in a local list when notifying partial results {es-pull}49828[#49828] (issue: {es-issue}49778[#49778])
Fixes a bug in interval filter serialization {es-pull}49793[#49793] (issue: {es-issue}49519[#49519])
Correctly handle duplicates in unordered interval matching {es-pull}49775[#49775]
Correct rewritting of script_score query {es-pull}48425[#48425] (issue: {es-issue}48081[#48081])
Do not throw errors on unknown types in SearchAfterBuilder {es-pull}48147[#48147] (issue: {es-issue}48074[#48074])
Fix Overly Aggressive Request DeDuplication {es-pull}51270[#51270] (issue: {es-issue}51253[#51253])
Guard Repository#getRepositoryData for exception throw  {es-pull}50970[#50970]
Fix Index Deletion During Partial Snapshot Create {es-pull}50234[#50234] (issues: {es-issue}50200[#50200], {es-issue}50202[#50202])
Fix Index Deletion during Snapshot Finalization {es-pull}50202[#50202] (issues: {es-issue}45689[#45689], {es-issue}50200[#50200])
Fix RepoCleanup not Removed on Master-Failover {es-pull}49217[#49217]
Make FsBlobContainer Listing Resilient to Concurrent Modifications {es-pull}49142[#49142] (issue: {es-issue}37581[#37581])
Fix SnapshotShardStatus Reporting for Failed Shard {es-pull}48556[#48556] (issue: {es-issue}48526[#48526])
Cleanup Concurrent RepositoryData Loading {es-pull}48329[#48329] (issue: {es-issue}48122[#48122])
Fix mapping deduction for scaled_float {es-pull}51990[#51990] (issue: {es-issue}51780[#51780])
Fix stats can return old state information if security is enabled {es-pull}51732[#51732] (issue: {es-issue}51728[#51728])
Fail to start/put on missing pipeline {es-pull}50701[#50701] (issue: {es-issue}50135[#50135])
Fix possible audit logging disappearance after rolling upgrade {es-pull}49731[#49731] (issue: {es-issue}49730[#49730])
Do not fail checkpoint creation due to global checkpoint mismatch {es-pull}48423[#48423] (issue: {es-issue}48379[#48379])
Ensure that field collapsing works with field aliases. {es-pull}50722[#50722] (issues: {es-issue}32648[#32648], {es-issue}50121[#50121])
Fix meta version of task index mapping {es-pull}50363[#50363] (issue: {es-issue}48393[#48393])
Optimization fixes for conjunction merges {es-pull}50703[#50703] (issue: {es-issue}49637[#49637])
Fix issue with CAST and NULL checking. {es-pull}50371[#50371] (issue: {es-issue}50191[#50191])
Fix NPE for JdbcResultSet.getDate(param, Calendar) calls {es-pull}50184[#50184] (issue: {es-issue}50174[#50174])
Fix expired job results deletion audit message {es-pull}49560[#49560] (issue: {es-issue}49549[#49549])
Apply source query on data frame analytics memory estimation {es-pull}49527[#49527] (issue: {es-issue}49454[#49454])
Stop timing stats failure propagation {es-pull}49495[#49495]
COUNT DISTINCT returns 0 instead of NULL for no matching docs {es-pull}50037[#50037] (issue: {es-issue}50013[#50013])
Fix LOCATE function optional parameter handling  {es-pull}49666[#49666] (issue: {es-issue}49557[#49557])
Fix NULL handling for FLOOR and CEIL functions {es-pull}49644[#49644] (issue: {es-issue}49556[#49556])
Handle NULL arithmetic operations with INTERVALs {es-pull}49633[#49633] (issue: {es-issue}49297[#49297])
Fix issue with GROUP BY YEAR() {es-pull}49559[#49559] (issue: {es-issue}49386[#49386])
Fix issue with CASE/IIF pre-calculating results {es-pull}49553[#49553] (issue: {es-issue}49388[#49388])
Fix issue with folding of CASE/IIF {es-pull}49449[#49449] (issue: {es-issue}49387[#49387])
Fix issues with WEEK/ISO_WEEK/DATEDIFF {es-pull}49405[#49405] (issues: {es-issue}48209[#48209], {es-issue}49376[#49376])
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Stop all {transforms} during a rolling upgrade to 7.5.
If a {transform} is running during upgrade, the {transform} audit index might disappear.
(issue: {es-issue}/49730[#49730])
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Breaking changes
Search
Add API to execute SLM retention on-demand {es-pull}47405[#47405] (issues: {es-issue}43663[#43663], {es-issue}46508[#46508])
Add retention to Snapshot Lifecycle Management {es-pull}46407[#46407] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663], {es-issue}45362[#45362])
Implement evaluation API for multiclass classification problem {es-pull}47126[#47126] (issue: {es-issue}46735[#46735])
Implement new analysis type: classification {es-pull}46537[#46537] (issue: {es-issue}46735[#46735])




    

Add audit messages for Data Frame Analytics {es-pull}46521[#46521] (issue: {es-issue}184[#184])
Implement DataFrameAnalyticsAuditMessage and DataFrameAnalyticsAuditor {es-pull}45967[#45967]
SQL: Implement DATE_PART function {es-pull}47206[#47206] (issue: {es-issue}46372[#46372])
SQL: Add alias DATETRUNC to DATE_TRUNC function {es-pull}47173[#47173] (issue: {es-issue}46473[#46473])
SQL: Add PIVOT support {es-pull}46489[#46489]
SQL: Implement DATE_TRUNC function {es-pull}46473[#46473] (issue: {es-issue}46319[#46319])
Adjacency_matrix aggregation memory usage optimisation. {es-pull}46257[#46257] (issue: {es-issue}46212[#46212])
Support geotile_grid aggregation in composite agg sources {es-pull}45810[#45810] (issue: {es-issue}40568[#40568])
Do not cancel ongoing recovery for noop copy on broken node {es-pull}48265[#48265] (issue: {es-issue}47974[#47974])
Shrink should not touch max_retries {es-pull}47719[#47719]
Re-fetch shard info of primary when new node joins {es-pull}47035[#47035] (issues: {es-issue}42518[#42518], {es-issue}46959[#46959])
Sequence number based replica allocation {es-pull}46959[#46959] (issue: {es-issue}46318[#46318])
Add support to retrieve all API keys if user has privilege {es-pull}47274[#47274] (issue: {es-issue}46887[#46887])
Add 'create_doc' index privilege {es-pull}45806[#45806]
Reducing privileges needed by built-in beats_admin role {es-pull}41586[#41586]
Add Pause/Resume Auto-Follower APIs to High Level REST Client {es-pull}47989[#47989] (issue: {es-issue}47510[#47510])
Add Pause/Resume Auto Follower APIs {es-pull}47510[#47510] (issue: {es-issue}46665[#46665])
Do not warm up searcher in engine constructor {es-pull}48605[#48605] (issue: {es-issue}47186[#47186])
Refresh should not acquire readLock {es-pull}48414[#48414] (issue: {es-issue}47186[#47186])
Avoid unneeded refresh with concurrent realtime gets {es-pull}47895[#47895]
sync before trimUnreferencedReaders to improve index preformance {es-pull}47790[#47790] (issues: {es-issue}46201[#46201], {es-issue}46203[#46203])
Limit number of retaining translog files for peer recovery {es-pull}47414[#47414]
Remove isRecovering method from Engine {es-pull}47039[#47039]
Separate SLM stop/start/status API from ILM {es-pull}47710[#47710] (issue: {es-issue}43663[#43663])
Set default SLM retention invocation time {es-pull}47604[#47604] (issue: {es-issue}43663[#43663])
ILM: Skip rolling indexes that are already rolled {es-pull}47324[#47324] (issue: {es-issue}44175[#44175])
Add support for POST requests to SLM Execute API  {es-pull}47061[#47061]
Wait for snapshot completion in SLM snapshot invocation {es-pull}47051[#47051] (issues: {es-issue}38461[#38461], {es-issue}43663[#43663])
Add node setting for disabling SLM {es-pull}46794[#46794] (issue: {es-issue}38461[#38461])
ILM: parse origination date from index name {es-pull}46755[#46755] (issues: {es-issue}42449[#42449], {es-issue}46561[#46561])
[ILM] Add date setting to calculate index age {es-pull}46561[#46561] (issue: {es-issue}42449[#42449])
Move ES_TMPDIR substitution into jvm options parser {es-pull}47189[#47189] (issue: {es-issue}47133[#47133])
Clarify missing java error message {es-pull}46160[#46160] (issue: {es-issue}44139[#44139])
Allow setting validation against arbitrary types {es-pull}47264[#47264] (issue: {es-issue}25560[#25560])
Clarify error message on keystore write permissions {es-pull}46321[#46321]
Add more meaningful keystore version mismatch errors {es-pull}46291[#46291] (issue: {es-issue}44624[#44624])
Throw an exception when memory usage estimation endpoint encounters empty data frame. {es-pull}49143[#49143] (issue: {es-issue}49140[#49140])
Change format of MulticlassConfusionMatrix result to be more self-explanatory {es-pull}48174[#48174] (issue: {es-issue}46735[#46735])
Make num_top_classes parameter’s default value equal to 2 {es-pull}48119[#48119] (issue: {es-issue}46735[#46735])
[ML] Add option to stop datafeed that finds no data {es-pull}47922[#47922]
Allow integer types for classification’s dependent variable {es-pull}47902[#47902] (issue: {es-issue}46735[#46735])
[ML] Add lazy assignment job config option {es-pull}47726[#47726]
[ML] Additional outlier detection parameters {es-pull}47600[#47600]
[ML] More accurate job memory overhead {es-pull}47516[#47516]
[ML] Throttle the delete-by-query of expired results {es-pull}47177[#47177] (issues: {es-issue}47003[#47003], {es-issue}47103[#47103])
SQL: make date/datetime and interval types compatible in conditional functions {es-pull}47595[#47595] (issue: {es-issue}46674[#46674])
SQL: use calendar interval of 1y instead of fixed interval for grouping by YEAR and HISTOGRAMs {es-pull}47558[#47558] (issue: {es-issue}40162[#40162])
SQL: Support queries with HAVING over SELECT {es-pull}46709[#46709] (issue: {es-issue}37051[#37051])
SQL: Add support for shape type {es-pull}46464[#46464] (issues: {es-issue}43644[#43644], {es-issue}46412[#46412])
Add builder for distance_feature to QueryBuilders {es-pull}47846[#47846] (issue: {es-issue}47767[#47767])
Fold InitialSearchPhase into AbstractSearchAsyncAction {es-pull}47182[#47182]
max_children exist only in top level nested sort {es-pull}46731[#46731]
First round of optimizations for vector functions. {es-pull}46294[#46294] (issues: {es-issue}45390[#45390], {es-issue}45936[#45936], {es-issue}46103[#46103], {es-issue}46155[#46155], {es-issue}46190[#46190], {es-issue}46202[#46202])
Throw exception in scroll requests using from {es-pull}46087[#46087] (issues: {es-issue}26235[#26235], {es-issue}44493[#44493], {es-issue}9373[#9373])
Track Repository Gen. in BlobStoreRepository {es-pull}48944[#48944] (issues: {es-issue}38941[#38941], {es-issue}47520[#47520], {es-issue}47834[#47834], {es-issue}49048[#49048])
Resume partial download from S3 on connection drop {es-pull}46589[#46589]
More Efficient Ordering of Shard Upload Execution {es-pull}42791[#42791]
[ML-DataFrame] improve error message for timeout case in stop {es-pull}46131[#46131] (issue: {es-issue}45610[#45610])
[ML][Data Frame] add support for wait_for_checkpoint flag on _stop API {es-pull}45469[#45469] (issue: {es-issue}45293[#45293])
Fix ignoring missing values in min/max aggregations {es-pull}48970[#48970] (issue: {es-issue}48905[#48905])
DocValueFormat implementation for date range fields {es-pull}47472[#47472] (issues: {es-issue}47323[#47323], {es-issue}47469[#47469])
Handle negative free disk space in deciders {es-pull}48392[#48392] (issue: {es-issue}48380[#48380])
Dangling indices strip aliases {es-pull}47581[#47581]
Cancel recoveries even if all shards assigned {es-pull}46520[#46520]
Fail allocation of new primaries in empty cluster {es-pull}43284[#43284] (issue: {es-issue}41073[#41073])
Add owner flag parameter to the rest spec {es-pull}48500[#48500] (issue: {es-issue}48499[#48499])
Add populate_user_metadata in OIDC realm {es-pull}48357[#48357] (issue: {es-issue}48217[#48217])
Remove unnecessary details logged for OIDC {es-pull}48271[#48271]
Fix AD realm additional metadata {es-pull}47179[#47179] (issue: {es-issue}45848[#45848])
Fallback to realm authc if ApiKey fails {es-pull}46538[#46538]
PKI realm accept only verified certificates {es-pull}45590[#45590]
Fix security origin for TokenService#findActiveTokensFor… {es-pull}47418[#47418] (issue: {es-issue}47151[#47151])
Use 'should' clause instead of 'filter' when querying native privileges {es-pull}47019[#47019]
Do not rewrite aliases on remove-index from aliases requests {es-pull}46989[#46989]
Validate index and cluster privilege names when creating a role {es-pull}46361[#46361] (issue: {es-issue}29703[#29703])
Validate query field when creating roles {es-pull}46275[#46275] (issue: {es-issue}34252[#34252])
Do not auto-follow closed indices {es-pull}47721[#47721] (issue: {es-issue}47582[#47582])
Relax maxSeqNoOfUpdates assertion in FollowingEngine {es-pull}47188[#47188] (issue: {es-issue}47137[#47137])
Handle lower retaining seqno retention lease error {es-pull}46420[#46420] (issues: {es-issue}46013[#46013], {es-issue}46416[#46416])
Close query cache on index service creation failure {es-pull}48230[#48230] (issue: {es-issue}48186[#48186])
Use optype CREATE for single auto-id index requests {es-pull}47353[#47353]
Ignore replication for noop updates {es-pull}46458[#46458] (issues: {es-issue}41065[#41065], {es-issue}44603[#44603], {es-issue}46366[#46366])
Omit writing index metadata for non-replicated closed indices on data-only node {es-pull}47285[#47285] (issue: {es-issue}47276[#47276])
Assert no exceptions during state application {es-pull}47090[#47090] (issue: {es-issue}47038[#47038])
Remove trailing comma from nodes lists {es-pull}46484[#46484]
Closed shard should never open new engine {es-pull}47186[#47186] (issues: {es-issue}45263[#45263], {es-issue}47060[#47060])
Fix false positive out of sync warning in synced-flush {es-pull}46576[#46576] (issues: {es-issue}28464[#28464], {es-issue}30244[#30244])
Suppress warning logs from background sync on relocated primary {es-pull}46247[#46247] (issues: {es-issue}40800[#40800], {es-issue}42241[#42241])
Don’t schedule SLM jobs when services have been stopped {es-pull}48658[#48658] (issue: {es-issue}47749[#47749])
Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48367[#48367]
Ensure SLM stats does not block an in-place upgrade from 7.4 {es-pull}48361[#48361]
Add SLM support to xpack usage and info APIs {es-pull}48096[#48096] (issue: {es-issue}43663[#43663])
Change policy_id to list type in slm.get_lifecycle {es-pull}47766[#47766] (issue: {es-issue}47765[#47765])
Throw error retrieving non-existent SLM policy {es-pull}47679[#47679] (issue: {es-issue}47664[#47664])
Handle partial failure retrieving segments in SegmentCountStep {es-pull}46556[#46556]
Fixes for API specification {es-pull}46522[#46522]
Do not wrap ingest processor exception with IAE {es-pull}48816[#48816] (issue: {es-issue}48810[#48810])
Introduce dedicated ingest processor exception {es-pull}48810[#48810] (issue: {es-issue}48803[#48803])
Allow dropping documents with auto-generated ID {es-pull}46773[#46773] (issue: {es-issue}46678[#46678])
Expose cache setting in UserAgentPlugin {es-pull}46533[#46533]
Change HLRC count request to accept a QueryBuilder {es-pull}46904[#46904] (issue: {es-issue}46829[#46829])
[HLRC] Send min_score as query string parameter to the count API {es-pull}46829[#46829] (issue: {es-issue}46474[#46474])
HLRC multisearchTemplate forgot params {es-pull}46492[#46492] (issue: {es-issue}46488[#46488])
Added fields for MultiTermVectors (#42232) {es-pull}42877[#42877] (issue: {es-issue}42232[#42232])
[Monitoring] Add new cluster privilege now necessary for the stack monitoring ui {es-pull}47871[#47871]
Validating monitoring hosts setting while parsing {es-pull}47246[#47246] (issue: {es-issue}47125[#47125])
Fix wrong URL encoding in watcher HTTP client {es-pull}45894[#45894] (issue: {es-issue}44970[#44970])
Prevent deadlock by using separate schedulers {es-pull}48697[#48697] (issues: {es-issue}41451[#41451], {es-issue}47599[#47599])
Fix cluster alert for watcher/monitoring IndexOutOfBoundsExcep… {es-pull}45308[#45308] (issue: {es-issue}43184[#43184])
Geo: implement proper handling of out of bounds geo points {es-pull}47734[#47734] (issue: {es-issue}43916[#43916])
Geo: Fixes indexing of linestrings that go around the globe {es-pull}47471[#47471] (issues: {es-issue}43826[#43826], {es-issue}43837[#43837])
Provide better error when updating geo_shape field mapper settings {es-pull}47281[#47281] (issue: {es-issue}47006[#47006])
Geo: fix indexing of west to east linestrings crossing the antimeridian {es-pull}46601[#46601] (issue: {es-issue}43775[#43775])
Reset queryGeometry in ShapeQueryTests {es-pull}45974[#45974] (issue: {es-issue}45628[#45628])
Don’t drop user’s MaxDirectMemorySize flag on jdk8/windows {es-pull}48657[#48657] (issues: {es-issue}44174[#44174], {es-issue}48365[#48365])
Warn when MaxDirectMemorySize may be incorrect (Windows/JDK8 only issue) {es-pull}48365[#48365] (issue: {es-issue}47384[#47384])
Support optional parsers in any order with DateMathParser and roundup {es-pull}46654[#46654] (issue: {es-issue}45284[#45284])
[ML] Fixes for stop datafeed edge cases {es-pull}49191[#49191] (issues: {es-issue}43670[#43670], {es-issue}48931[#48931])
[ML] Avoid NPE when node load is calculated on job assignment {es-pull}49186[#49186] (issue: {es-issue}49150[#49150])
Do not throw exceptions resulting from persisting datafeed timing stats. {es-pull}49044[#49044] (issue: {es-issue}49032[#49032])
[ML] Deduplicate multi-fields for data frame analytics {es-pull}48799[#48799] (issues: {es-issue}48756[#48756], {es-issue}48770[#48770])
[ML] Prevent fetching multi-field from source {es-pull}48770[#48770] (issue: {es-issue}48756[#48756])
[ML] Fix detection of syslog-like timestamp in find_file_structure {es-pull}47970[#47970]
Fix serialization of evaluation response. {es-pull}47557[#47557]
[ML] Reinstate ML daily maintenance actions {es-pull}47103[#47103] (issue: {es-issue}47003[#47003])
[ML] fix two datafeed flush lockup bugs {es-pull}46982[#46982]
SQL: Fix issue with negative literels and parentheses {es-pull}48113[#48113] (issue: {es-issue}48009[#48009])
SQL: add "format" for "full" date range queries {es-pull}48073[#48073] (issue: {es-issue}48033[#48033])
SQL: Fix arg verification for DateAddProcessor {es-pull}48041[#48041]
SQL: Fix Nullability of DATEADD {es-pull}47921[#47921]
SQL: Allow whitespaces in escape patterns {es-pull}47577[#47577] (issue: {es-issue}47401[#47401])
SQL: fix multi full-text functions usage with aggregate functions {es-pull}47444[#47444] (issue: {es-issue}47365[#47365])
SQL: Check case where the pivot limit is reached {es-pull}47121[#47121] (issue: {es-issue}47002[#47002])
SQL: Properly handle indices with no/empty mapping {es-pull}46775[#46775] (issue: {es-issue}46757[#46757])
SQL: improve ResultSet behavior when no rows are available {es-pull}46753[#46753] (issue: {es-issue}46750[#46750])
SQL: use the correct data type for types conversion {es-pull}46574[#46574] (issue: {es-issue}46090[#46090])
SQL: Fix issue with common type resolution {es-pull}46565[#46565] (issue: {es-issue}46551[#46551])
SQL: fix scripting for grouped by datetime functions {es-pull}46421[#46421] (issue: {es-issue}40241[#40241])
SQL: Use null schema response {es-pull}46386[#46386] (issue: {es-issue}46381[#46381])
SQL: Fix issue with IIF function when condition folds {es-pull}46290[#46290] (issue: {es-issue}46268[#46268])
SQL: Fix issue with DataType for CASE with NULL {es-pull}46173[#46173] (issue: {es-issue}46032[#46032])
SQL: Failing Group By queries due to different ExpressionIds {es-pull}43072[#43072] (issues: {es-issue}33361[#33361], {es-issue}34543[#34543], {es-issue}36074[#36074], {es-issue}37044[#37044], {es-issue}40001[#40001], {es-issue}40240[#40240], {es-issue}41159[#41159], {es-issue}42041[#42041], {es-issue}46316[#46316])
SQL: wrong number of values for columns {es-pull}42122[#42122]
Ensure that we don’t call listener twice when detecting a partial failures in _search {es-pull}47694[#47694]
Fix alias field resolution in match query {es-pull}47369[#47369]
Multi-get requests should wait for search active {es-pull}46283[#46283] (issue: {es-issue}27500[#27500])
Resolve the incorrect scroll_current when delete or close index {es-pull}45226[#45226]
Don’t apply the plugin’s reader wrapper in can_match phase {es-pull}47816[#47816] (issue: {es-issue}46817[#46817])
Remove uniqueness constraint for API key name and make it optional {es-pull}47549[#47549] (issue: {es-issue}46646[#46646])
Initialize document subset bit set cache used for DLS {es-pull}46211[#46211] (issue: {es-issue}45147[#45147])
Make FsBlobContainer Listing Resilient to Concurrent Modifications {es-pull}49142[#49142] (issue: {es-issue}37581[#37581])
Fix SnapshotShardStatus Reporting for Failed Shard {es-pull}48556[#48556] (issue: {es-issue}48526[#48526])
Cleanup Concurrent RepositoryData Loading {es-pull}48329[#48329] (issue: {es-issue}48122[#48122])
Fix Bug in Azure Repo Exception Handling {es-pull}47968[#47968]
Make loadShardSnapshot Exceptions Consistent {es-pull}47728[#47728] (issue: {es-issue}47507[#47507])
Fix Snapshot Corruption in Edge Case {es-pull}47552[#47552] (issues: {es-issue}46250[#46250], {es-issue}47550[#47550])
Fix Bug in Snapshot Status Response Timestamps {es-pull}46919[#46919] (issue: {es-issue}46913[#46913])
Normalize Blob Store Repo Paths {es-pull}46869[#46869] (issue: {es-issue}41814[#41814])
GCS deleteBlobsIgnoringIfNotExists should catch StorageException {es-pull}46832[#46832] (issue: {es-issue}46772[#46772])
Execute SnapshotsService Error Callback on Generic Thread {es-pull}46277[#46277]
Make Snapshot Logic Write Metadata after Segments {es-pull}45689[#45689] (issue: {es-issue}41581[#41581])
[Transform] do not fail checkpoint creation due to global checkpoint mismatch {es-pull}48423[#48423] (issue: {es-issue}48379[#48379])
[7.5][Transform] prevent assignment if any node is older than 7.4 {es-pull}48055[#48055] (issue: {es-issue}48019[#48019])
[Transform] prevent assignment to nodes older than 7.4 {es-pull}48044[#48044] (issue: {es-issue}48019[#48019])
[ML][Transforms] fix bwc serialization with 7.3 {es-pull}48021[#48021]
[ML][Transforms] signal listener early on task _stop failure {es-pull}47954[#47954]
[ML][Transform] Use field_caps API for mapping deduction {es-pull}46703[#46703] (issue: {es-issue}46694[#46694])
[ML-DataFrame] Fix off-by-one error in checkpoint operations_behind {es-pull}46235[#46235]
[Java.time] Support partial parsing {es-pull}46814[#46814] (issues: {es-issue}45284[#45284], {es-issue}47473[#47473])




    

Enable ResolverStyle.STRICT for java formatters {es-pull}46675[#46675]
Update AWS SDK for repository-s3 plugin to support IAM Roles for Service Accounts {es-pull}46969[#46969]
Upgrade to Azure SDK 8.4.0 {es-pull}46094[#46094]
sync before trimUnreferencedReaders to improve index preformance {es-pull}47790[#47790] (issues: {es-issue}46201[#46201], {es-issue}46203[#46203])
Limit number of retaining translog files for peer recovery {es-pull}47414[#47414]
Throttle the delete-by-query of expired results {es-pull}47177[#47177] (issues: {es-issue}47003[#47003])
The {ml} native processes are now arranged in a .app directory structure on
macOS, to allow for notarization on macOS Catalina. {ml-pull}593[#593]
Do not auto-follow closed indices {es-pull}47721[#47721] (issue: {es-issue}47582[#47582])
Relax maxSeqNoOfUpdates assertion in FollowingEngine {es-pull}47188[#47188] (issue: {es-issue}47137[#47137])
Reinstate ML daily maintenance actions {es-pull}47103[#47103] (issue: {es-issue}47003[#47003])
Fix possibility of crash when calculating forecasts that overflow to disk {ml-pull}688[#688]
SQL: Fix issue with negative literels and parentheses {es-pull}48113[#48113] (issue: {es-issue}48009[#48009])
SQL: add "format" for "full" date range queries {es-pull}48073[#48073] (issue: {es-issue}48033[#48033])
SQL: Allow whitespaces in escape patterns {es-pull}47577[#47577] (issue: {es-issue}47401[#47401])
SQL: fix multi full-text functions usage with aggregate functions {es-pull}47444[#47444] (issue: {es-issue}47365[#47365])
SQL: wrong number of values for columns {es-pull}42122[#42122]
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Activating the search slow log should be avoided in this version.
Any attempt to log a slow search can throw an AIOOBE due to a bug that
performs concurrent modifications on a shared byte array.
(issue: {es-issue}/48358[#48358])
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Breaking changes
Infra/REST API
Combine task_state and indexer_state in _stats {es-pull}45276[#45276] (issue: {es-issue}45201[#45201])
Improve response format of transform stats endpoint {es-pull}44350[#44350] (issue: {es-issue}43767[#43767])
Add deprecation check for pidfile setting {es-pull}45939[#45939] (issues: {es-issue}45938[#45938], {es-issue}45940[#45940])
Deprecate the pidfile setting {es-pull}45938[#45938]
Add node.processors setting in favor of processors {es-pull}45855[#45855]
Deprecate setting processors to more than available {es-pull}44889[#44889]
Only emit deprecation warning if there was actual change of a datafeed’s job_id. {es-pull}44755[#44755]
Deprecate the ability to update datafeed’s job_id. {es-pull}44691[#44691] (issue: {es-issue}44615[#44615])
PKI realm authentication delegation {es-pull}45906[#45906] (issue: {es-issue}34396[#34396])
PKI Authentication Delegation in new endpoint {es-pull}43796[#43796] (issue: {es-issue}34396[#34396])
[SPATIAL] New ShapeQueryBuilder for querying indexed cartesian geometry {es-pull}45108[#45108] (issue: {es-issue}44980[#44980])
[GEO] New ShapeFieldMapper for indexing cartesian geometries {es-pull}44980[#44980]
Add Circle Processor {es-pull}43851[#43851] (issue: {es-issue}43554[#43554])
New shape field type for indexing Cartesian Geometries {es-pull}43644[#43644]
Allow the user to specify 'query' in Evaluate Data Frame request {es-pull}45775[#45775] (issue: {es-issue}45729[#45729])
Call the new _estimate_memory_usage API endpoint on data frame analytics _start {es-pull}45536[#45536] (issues: {es-issue}44699[#44699], {es-issue}45544[#45544])
HLRC for memory usage estimation API {es-pull}45531[#45531] (issues: {es-issue}44699[#44699], {es-issue}45188[#45188])
Implement ml/data_frame/analytics/_estimate_memory_usage API endpoint {es-pull}45188[#45188] (issue: {es-issue}44699[#44699])
Add more flexibility to MovingFunction window alignment {es-pull}44360[#44360] (issue: {es-issue}42181[#42181])
Optimize Min and Max BKD optimizations {es-pull}44315[#44315] (issue: {es-issue}44290[#44290])
Allow pipeline aggs to select specific buckets from multi-bucket aggs {es-pull}44179[#44179]
Defer reroute when starting shards {es-pull}44433[#44433] (issues: {es-issue}42105[#42105], {es-issue}42738[#42738])
Allow RerouteService to reroute at lower priority {es-pull}44338[#44338]
Auto-release of read-only-allow-delete block when disk utilization fa… {es-pull}42559[#42559] (issue: {es-issue}39334[#39334])
Allow Transport Actions to indicate authN realm {es-pull}45767[#45767] (issue: {es-issue}45331[#45331])
Explicitly fail if a realm only exists in keystore {es-pull}44471[#44471] (issue: {es-issue}44207[#44207])
Add manage_own_api_key cluster privilege {es-pull}45897[#45897] (issue: {es-issue}40031[#40031])
Consider owner flag when retrieving/invalidating keys with API key service {es-pull}45421[#45421] (issue: {es-issue}40031[#40031])
REST API changes for manage-own-api-key privilege {es-pull}44936[#44936] (issue: {es-issue}40031[#40031])
Simplify API key service API {es-pull}44935[#44935] (issue: {es-issue}40031[#40031])
Improve slow logging in MasterService {es-pull}45086[#45086] (issue: {es-issue}45007[#45007])
More logging for slow cluster state application {es-pull}45007[#45007]
Ignore unknown fields if overriding node metadata {es-pull}44689[#44689]
Allow pending tasks before state recovery {es-pull}44685[#44685] (issue: {es-issue}44652[#44652])
Do sync before closeIntoReader when rolling generation to improve index performance {es-pull}45765[#45765] (issue: {es-issue}45371[#45371])
Refactor index engines to manage readers instead of searchers {es-pull}43860[#43860]
Async IO Processor release before notify {es-pull}43682[#43682]
Enable indexing optimization using sequence numbers on replicas {es-pull}43616[#43616] (issue: {es-issue}34099[#34099])
Add node setting for disabling SLM {es-pull}46794[#46794] (issue: {es-issue}38461[#38461])
Include in-progress snapshot for a policy with get SLM policy API {es-pull}45245[#45245]
Add option to filter ILM explain response {es-pull}44777[#44777] (issue: {es-issue}44189[#44189])
Expose index age in ILM explain output {es-pull}44457[#44457] (issue: {es-issue}38988[#38988])
Add XContentType as parameter to HLRC ART#createServerTestInstance {es-pull}46036[#46036] (issue: {es-issue}45970[#45970])
Add CloseIndexResponse to HLRC {es-pull}44349[#44349] (issue: {es-issue}39687[#39687])
Add mapper-extras and the RankFeatureQuery in the hlrc {es-pull}43713[#43713] (issue: {es-issue}43634[#43634])
removing background state update of Request object by RequestConverte… {es-pull}40156[#40156] (issue: {es-issue}39666[#39666])
Add delete aliases API to the high-level REST client {es-pull}32909[#32909] (issue: {es-issue}27205[#27205])
Add SSL/TLS settings for watcher email {es-pull}45272[#45272] (issue: {es-issue}30307[#30307])
Watcher reporting: add email warning if CSV attachment contains values that may be interperted as formulas {es-pull}44460[#44460]
Watcher add stopped listener {es-pull}43939[#43939] (issue: {es-issue}42409[#42409])
Improve CryptoService error message on missing secure file {es-pull}43623[#43623] (issue: {es-issue}43619[#43619])
Add OCI annotations and adjust existing annotations {es-pull}45167[#45167] (issues: {es-issue}45162[#45162], {es-issue}45166[#45166])
Use the full hash in build info {es-pull}45163[#45163] (issue: {es-issue}45162[#45162])
Remove redundant Java check from Sys V init {es-pull}45793[#45793] (issue: {es-issue}45593[#45593])
Notify systemd when Elasticsearch is ready {es-pull}44673[#44673]
Add missing ZonedDateTime methods for joda compat layer {es-pull}44829[#44829] (issue: {es-issue}44411[#44411])
Remove stale permissions from untrusted policy {es-pull}44783[#44783]
Add more meaningful keystore version mismatch errors {es-pull}46291[#46291] (issue: {es-issue}44624[#44624])
Lift the restrictions that uppercase is not allowed in Setting Name. {es-pull}45222[#45222] (issue: {es-issue}43835[#43835])
Normalize environment paths {es-pull}45179[#45179] (issue: {es-issue}45176[#45176])
Introduce formal node ML role {es-pull}45174[#45174] (issues: {es-issue}29943[#29943], {es-issue}43175[#43175])
Improve CSV header row detection in find_file_structure {es-pull}45099[#45099] (issue: {es-issue}45047[#45047])
Outlier detection should only fetch docs that have the analyzed fields {es-pull}44944[#44944]
Persist DatafeedTimingStats with RefreshPolicy.NONE by default {es-pull}44940[#44940] (issue: {es-issue}44792[#44792])
Add result_type field to TimingStats and DatafeedTimingStats documents {es-pull}44812[#44812]
Implement exponential average search time per hour statistics. {es-pull}44683[#44683] (issue: {es-issue}29857[#29857])
Add r_squared eval metric to regression {es-pull}44248[#44248]
Adds support for regression.mean_squared_error to eval API {es-pull}44140[#44140]
Add DatafeedTimingStats.average_search_time_per_bucket_ms and TimingStats.total_bucket_processing_time_ms stats {es-pull}44125[#44125] (issue: {es-issue}29857[#29857])
Add DatafeedTimingStats to datafeed GetDatafeedStatsAction.Response {es-pull}43045[#43045] (issue: {es-issue}29857[#29857])
Better logging for TLS message on non-secure transport channel {es-pull}45835[#45835] (issue: {es-issue}32688[#32688])
Asynchronously connect to remote clusters {es-pull}44825[#44825] (issue: {es-issue}40150[#40150])
Improve errors when TLS files cannot be read {es-pull}44787[#44787] (issue: {es-issue}43079[#43079])
Add per-socket keepalive options {es-pull}44055[#44055]
Move ConnectionManager to async APIs {es-pull}42636[#42636]
Search enhancement: pinned queries {es-pull}44345[#44345] (issue: {es-issue}44074[#44074])
Fix parameter value for calling data.advanceExact {es-pull}44205[#44205]
Add l1norm and l2norm distances for vectors {es-pull}44116[#44116] (issue: {es-issue}37947[#37947])
Ignore translog retention policy if soft-deletes enabled {es-pull}45473[#45473] (issue: {es-issue}45136[#45136])
Only retain reasonable history for peer recoveries {es-pull}45208[#45208] (issue: {es-issue}41536[#41536])
Use index for peer recovery instead of translog {es-pull}45136[#45136] (issues: {es-issue}38904[#38904], {es-issue}41536[#41536], {es-issue}42211[#42211])
Trim local translog in peer recovery {es-pull}44756[#44756]
Make peer recovery send file chunks async {es-pull}44468[#44468] (issues: {es-issue}36195[#36195], {es-issue}44040[#44040])
SQL: Support queries with HAVING over SELECT {es-pull}46709[#46709] (issue: {es-issue}37051[#37051])
SQL: Break TextFormatter/Cursor dependency {es-pull}45613[#45613] (issue: {es-issue}45516[#45516])
SQL: remove deprecated use of "interval" from date_histogram usage {es-pull}45501[#45501] (issue: {es-issue}43922[#43922])
SQL: use hasValue() methods from Elasticsearch’s InspectionHelper classes {es-pull}44745[#44745] (issue: {es-issue}35745[#35745])
Switch from using docvalue_fields to extracting values from _source {es-pull}44062[#44062] (issue: {es-issue}41852[#41852])
Add update transform api endpoint {es-pull}45154[#45154] (issue: {es-issue}43438[#43438])
Add support for bucket_selector {es-pull}44718[#44718] (issues: {es-issue}43744[#43744], {es-issue}44557[#44557])
Add force delete {es-pull}44590[#44590] (issue: {es-issue}43961[#43961])
Add dynamic cluster setting for failure retries {es-pull}44577[#44577]
Add optional defer_validation param to PUT {es-pull}44455[#44455] (issue: {es-issue}43439[#43439])
Add support for geo_bounds aggregation {es-pull}44441[#44441]
Add a frequency option to transform config, default 1m {es-pull}44120[#44120]
Fix early termination of aggregators that run with breadth-first mode {es-pull}44963[#44963] (issue: {es-issue}44909[#44909])
Support BucketScript paths of type string and array. {es-pull}44694[#44694] (issue: {es-issue}44385[#44385])
Avoid overshooting watermarks during relocation {es-pull}46079[#46079] (issue: {es-issue}45177[#45177])
Cluster health should await events plus other things {es-pull}44348[#44348]
Do not copy initial recovery filter during split {es-pull}44053[#44053] (issue: {es-issue}43955[#43955])
Enable reloading of synonym_graph filters {es-pull}45135[#45135] (issue: {es-issue}45127[#45127])
Fix AnalyzeAction response serialization {es-pull}44284[#44284] (issue: {es-issue}44078[#44078])
Give kibana user privileges to create APM agent config index {es-pull}46765[#46765] (issue: {es-issue}45610[#45610])
Add manage_own_api_key cluster privilege {es-pull}45696[#45696] (issue: {es-issue}40031[#40031])
Sparse role queries can throw an NPE {es-pull}45053[#45053]
Clean up ShardFollowTasks for deleted indices {es-pull}44702[#44702] (issue: {es-issue}34404[#34404])
Skip update if leader and follower settings identical {es-pull}44535[#44535] (issue: {es-issue}44521[#44521])
Avoid stack overflow in auto-follow coordinator {es-pull}44421[#44421] (issue: {es-issue}43251[#43251])
Avoid NPE when checking for CCR index privileges {es-pull}44397[#44397] (issue: {es-issue}44172[#44172])
Ignore replication for noop updates {es-pull}46458[#46458] (issues: {es-issue}41065[#41065], {es-issue}44603[#44603], {es-issue}46366[#46366])
Allow _update on write alias {es-pull}45318[#45318] (issue: {es-issue}31520[#31520])
Do not allow version in Rest Update API {es-pull}43516[#43516] (issue: {es-issue}42497[#42497])
Assert no exceptions during state application {es-pull}47090[#47090] (issue: {es-issue}47038[#47038])
Avoid counting votes from master-ineligible nodes {es-pull}43688[#43688]
Fix false positive out of sync warning in synced-flush {es-pull}46576[#46576] (issues: {es-issue}28464[#28464], {es-issue}30244[#30244])
Suppress warning logs from background sync on relocated primary {es-pull}46247[#46247] (issues: {es-issue}40800[#40800], {es-issue}42241[#42241])
Ensure AsyncTask#isScheduled remain false after close {es-pull}45687[#45687] (issue: {es-issue}45576[#45576])
Update translog checkpoint after marking operations as persisted {es-pull}45634[#45634] (issue: {es-issue}29161[#29161])
Fix clock used in update requests {es-pull}45262[#45262] (issue: {es-issue}45254[#45254])
Restore DefaultShardOperationFailedException’s reason during deserialization {es-pull}45203[#45203]
Use IndicesModule named writables in elasticsearch-shard tool {es-pull}45036[#45036] (issue: {es-issue}44628[#44628])
Handle delete document level failures {es-pull}46100[#46100] (issue: {es-issue}46083[#46083])
Handle no-op document level failures {es-pull}46083[#46083]
Remove leniency during replay translog in peer recovery {es-pull}44989[#44989]
Throw TranslogCorruptedException in more cases {es-pull}44217[#44217]
Fail engine if hit document failure on replicas {es-pull}43523[#43523] (issues: {es-issue}40435[#40435], {es-issue}43228[#43228])
Fix SnapshotLifecycleMetadata xcontent serialization {es-pull}46500[#46500] (issue: {es-issue}46499[#46499])
Updated slm API spec parameters and URL {es-pull}44797[#44797]
Fix swapped variables in error message {es-pull}44300[#44300]
Fix a bug where mappings are dropped from rollover requests. {es-pull}45411[#45411] (issue: {es-issue}45399[#45399])
Create index with typeless mapping {es-pull}45120[#45120]
Check shard limit after applying index templates {es-pull}44619[#44619] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567], {es-issue}44619[#44619])
Validate index settings after applying templates {es-pull}44612[#44612] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567])
[HLRC] Send min_score as query string parameter to the count API {es-pull}46829[#46829] (issue: {es-issue}46474[#46474])
HLRC multisearchTemplate forgot params {es-pull}46492[#46492] (issue: {es-issue}46488[#46488])
terminateAfter added to the RequestConverter {es-pull}46474[#46474] (issue: {es-issue}46446[#46446])
[Closes #44045] Added 'slices' parameter when submitting reindex request via Java high level REST client {es-pull}45690[#45690] (issue: {es-issue}44045[#44045])
HLRC: Fix '+' Not Correctly Encoded in GET Req. {es-pull}33164[#33164] (issue: {es-issue}33077[#33077])
Fix wrong URL encoding in watcher HTTP client {es-pull}45894[#45894] (issue: {es-issue}44970[#44970])
Fix watcher HttpClient URL creation {es-pull}45207[#45207] (issue: {es-issue}44970[#44970])
Log write failures for watcher history document. {es-pull}44129[#44129]
Always check that cgroup data is present {es-pull}45606[#45606] (issue: {es-issue}45396[#45396])
Safe publication of DelayedAllocationService and SnapshotShardsService {es-pull}45517[#45517] (issue: {es-issue}38560[#38560])
Add default CLI JVM options {es-pull}44545[#44545] (issues: {es-issue}219[#219], {es-issue}42021[#42021])
Fix decimal point parsing for date_optional_time {es-pull}43859[#43859] (issue: {es-issue}43730[#43730])




    

Improve error message when index settings are not a map {es-pull}45588[#45588] (issue: {es-issue}45126[#45126])
Add is_write_index column to cat.aliases {es-pull}44772[#44772]
Fix URL documentation in API specs {es-pull}44487[#44487]
Throw an error when a datafeed needs CCS but it is not enabled for the node {es-pull}46044[#46044] (issue: {es-issue}46025[#46025])
Handle "null" value of Estimate memory usage API response gracefully. {es-pull}45726[#45726] (issue: {es-issue}44699[#44699])
Remove timeout on waiting for data frame analytics result processor to complete {es-pull}45724[#45724] (issue: {es-issue}45723[#45723])
Check dest index is empty when starting data frame analytics {es-pull}45094[#45094]
Catch any error thrown while closing data frame analytics process {es-pull}44958[#44958]
Treat PostDataActionResponse.DataCounts.bucketCount as incremental rather than absolute (total). {es-pull}44803[#44803] (issue: {es-issue}44792[#44792])
Treat big changes in searchCount as significant and persist the document after such changes {es-pull}44413[#44413] (issues: {es-issue}44196[#44196], {es-issue}44335[#44335])
Update .ml-config mappings before indexing job, datafeed or data frame analytics config {es-pull}44216[#44216] (issue: {es-issue}44263[#44263])
Wait for .ml-config primary before assigning persistent tasks {es-pull}44170[#44170] (issue: {es-issue}44156[#44156])
Fix ML memory tracker lockup when inner step fails {es-pull}44158[#44158] (issue: {es-issue}44156[#44156])
Fix datafeed checks when a concrete remote index is present {es-pull}43923[#43923] (issue: {es-issue}42113[#42113])
Rename outlier detection method values knn and tnn to distance_kth_nn and distance_knn
respectively to match the API. {ml-pull}598[#598]
Fix occasional (non-deterministic) reinitialisation of modeling for the lat_long
function. {ml-pull}641[#641]
Make sure to validate the type before attempting to merge a new mapping. {es-pull}45157[#45157] (issues: {es-issue}29316[#29316], {es-issue}43012[#43012])
Ensure field caps doesn’t error on rank feature fields. {es-pull}44370[#44370] (issue: {es-issue}44330[#44330])
Prevent types deprecation warning for indices.exists requests {es-pull}43963[#43963] (issue: {es-issue}43905[#43905])
Add include_type_name in indices.exitst REST API spec {es-pull}43910[#43910] (issue: {es-issue}43905[#43905])
Fix Broken HTTP Request Breaking Channel Closing {es-pull}45958[#45958] (issues: {es-issue}43362[#43362], {es-issue}43850[#43850])
Fix plaintext on TLS port logging {es-pull}45852[#45852] (issue: {es-issue}32688[#32688])
transport.publish_address should contain CNAME {es-pull}45626[#45626] (issues: {es-issue}32806[#32806], {es-issue}39970[#39970])
Fix bug in copying bytes for socket write {es-pull}45463[#45463] (issue: {es-issue}45444[#45444])
Never release store using CancellableThreads {es-pull}45409[#45409] (issues: {es-issue}45136[#45136], {es-issue}45237[#45237])
Remove leniency in reset engine from translog {es-pull}44711[#44711]
SQL: Properly handle indices with no/empty mapping {es-pull}46775[#46775] (issue: {es-issue}46757[#46757])
SQL: improve ResultSet behavior when no rows are available {es-pull}46753[#46753] (issue: {es-issue}46750[#46750])
SQL: use the correct data type for types conversion {es-pull}46574[#46574] (issue: {es-issue}46090[#46090])
SQL: Fix issue with common type resolution {es-pull}46565[#46565] (issue: {es-issue}46551[#46551])
SQL: fix scripting for grouped by datetime functions {es-pull}46421[#46421] (issue: {es-issue}40241[#40241])
SQL: Use null schema response {es-pull}46386[#46386] (issue: {es-issue}46381[#46381])
SQL: Fix issue with IIF function when condition folds {es-pull}46290[#46290] (issue: {es-issue}46268[#46268])
SQL: Fix issue with DataType for CASE with NULL {es-pull}46173[#46173] (issue: {es-issue}46032[#46032])
SQL: adds format parameter to range queries for constant date comparisons {es-pull}45326[#45326] (issue: {es-issue}45139[#45139])
SQL: uniquely named inner_hits sections for each nested field condition {es-pull}45039[#45039] (issues: {es-issue}33080[#33080], {es-issue}44544[#44544])
SQL: fix URI path being lost in case of hosted ES scenario {es-pull}44776[#44776] (issue: {es-issue}44721[#44721])
SQL: change the size of the list of concrete indices when resolving multiple indices {es-pull}43878[#43878] (issue: {es-issue}43876[#43876])
SQL: handle double quotes escaping {es-pull}43829[#43829] (issue: {es-issue}43810[#43810])
SQL: add pretty printing to JSON format {es-pull}43756[#43756]
SQL: handle SQL not being available in a more graceful way {es-pull}43665[#43665] (issue: {es-issue}41279[#41279])
Multi-get requests should wait for search active {es-pull}46283[#46283] (issue: {es-issue}27500[#27500])
Ensure top docs optimization is fully disabled for queries with unbounded max scores. {es-pull}46105[#46105] (issue: {es-issue}45933[#45933])
Disallow partial results when shard unavailable {es-pull}45739[#45739] (issue: {es-issue}42612[#42612])
Prevent Leaking Search Tasks on Exceptions in FetchSearchPhase and DfsQueryPhase {es-pull}45500[#45500]
Fix an NPE when requesting inner hits and _source is disabled. {es-pull}44836[#44836] (issue: {es-issue}43517[#43517])
Don’t use index_phrases on graph queries {es-pull}44340[#44340] (issue: {es-issue}43976[#43976])
Initialize document subset bit set cache used for DLS {es-pull}46211[#46211] (issue: {es-issue}45147[#45147])
Fix .security-* indices auto-create {es-pull}44918[#44918]
SecurityIndexManager handle RuntimeException while reading mapping {es-pull}44409[#44409]
Do not swallow I/O exception getting authentication {es-pull}44398[#44398] (issues: {es-issue}44172[#44172], {es-issue}44397[#44397])
Use system context for looking up connected nodes {es-pull}43991[#43991] (issue: {es-issue}43974[#43974])
Fix Bug in Snapshot Status Response Timestamps {es-pull}46919[#46919] (issue: {es-issue}46913[#46913])
GCS deleteBlobsIgnoringIfNotExists should catch StorageException {es-pull}46832[#46832] (issue: {es-issue}46772[#46772])
Fix TransportSnapshotsStatusAction ThreadPool Use {es-pull}45824[#45824]
Stop Executing SLM Policy Transport Action on Snapshot Pool {es-pull}45727[#45727] (issue: {es-issue}45594[#45594])
Check again on-going snapshots/restores of indices before closing {es-pull}43873[#43873]
Make Timestamps Returned by Snapshot APIs Consistent {es-pull}43148[#43148] (issue: {es-issue}43074[#43074])
Recursively Delete Unreferenced Index Directories {es-pull}42189[#42189] (issue: {es-issue}13159[#13159])
Use field_caps API for mapping deduction {es-pull}46703[#46703] (issue: {es-issue}46694[#46694])
Fix off-by-one error in checkpoint operations_behind {es-pull}46235[#46235]
Moves failure state transition for MT safety {es-pull}45676[#45676] (issue: {es-issue}45664[#45664])
Fix _start?force=true bug {es-pull}45660[#45660]
Fix failure state transitions and race condition {es-pull}45627[#45627] (issues: {es-issue}45562[#45562], {es-issue}45609[#45609])
Fix starting a batch data frame after stopping at runtime  {es-pull}45340[#45340] (issues: {es-issue}44219[#44219], {es-issue}45339[#45339])
Fix null aggregation handling in indexer {es-pull}45061[#45061] (issue: {es-issue}44906[#44906])
Unify validation exceptions between PUT and _preview {es-pull}44983[#44983] (issue: {es-issue}44953[#44953])
Treat bulk index failures as an indexing failure {es-pull}44351[#44351] (issue: {es-issue}44101[#44101])
Prevent task from attempting to run when failed {es-pull}44239[#44239] (issue: {es-issue}44121[#44121])
Respond with 409 status code when failing _stop {es-pull}44231[#44231] (issue: {es-issue}44103[#44103])
Add index validations to _start data frame transform {es-pull}44191[#44191] (issue: {es-issue}44104[#44104])
Data frame task failure does not make a 500 response {es-pull}44058[#44058] (issue: {es-issue}44011[#44011])
Audit message missing for autostop {es-pull}43984[#43984] (issue: {es-issue}43977[#43977])
Handle delete document level failures {es-pull}46100[#46100] (issue: {es-issue}46083[#46083])
Handle no-op document level failures {es-pull}46083[#46083]
SQL: Fix issue with IIF function when condition folds {es-pull}46290[#46290] (issue: {es-issue}46268[#46268])
SQL: Fix issue with DataType for CASE with NULL {es-pull}46173[#46173] (issue: {es-issue}46032[#46032])
Multi-get requests should wait for search active {es-pull}46283[#46283] (issue: {es-issue}27500[#27500])
Ensure top docs optimization is fully disabled for queries with unbounded max scores. {es-pull}46105[#46105] (issue: {es-issue}45933[#45933])
Fix starting a batch {dataframe-transform} after stopping at runtime
{es-pull}45340[#45340] (issues: {es-issue}44219[#44219], {es-issue}45339[#45339])
Fix null aggregation handling in indexer {es-pull}45061[#45061] (issue: {es-issue}44906[#44906])
Ensure AsyncTask#isScheduled remains false after close {es-pull}45687[#45687] (issue: {es-issue}45576[#45576])
Fix clock used in update requests {es-pull}45262[#45262] (issue: {es-issue}45254[#45254])
Restore DefaultShardOperationFailedException’s reason during deserialization {es-pull}45203[#45203]
Fix a bug where mappings are dropped from rollover requests. {es-pull}45411[#45411] (issue: {es-issue}45399[#45399])
Sparse role queries can throw an NPE {es-pull}45053[#45053]
Only trap the case where more rows are supplied to outlier detection than
expected. Previously, if rows were excluded from the {dataframe-transform} after supplying the row count in the configuration, we detected the inconsistency and
failed outlier detection. However, this situation legitimately happens in cases
where the field values are non-numeric or array valued. {ml-pull}569[#569]
Adds format parameter to range queries for constant date comparisons {es-pull}45326[#45326] (issue: {es-issue}45139[#45139])
Uniquely named inner_hits sections for each nested field condition {es-pull}45039[#45039] (issues: {es-issue}33080[#33080], {es-issue}44544[#44544])
Fix URI path being lost in case of hosted ES scenario {es-pull}44776[#44776] (issue: {es-issue}44721[#44721])
Prevent Leaking Search Tasks on Exceptions in FetchSearchPhase and DfsQueryPhase {es-pull}45500[#45500]
Fix an NPE when requesting inner hits and _source is disabled. {es-pull}44836[#44836] (issue: {es-issue}43517[#43517])
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Breaking changes
Adds a minimum interval to auto_date_histogram. {es-pull}42814[#42814] (issue: {es-issue}41757[#41757])
Add RareTerms aggregation {es-pull}35718[#35718] (issue: {es-issue}20586[#20586])
Allocate memory lazily in BestBucketsDeferringCollector {es-pull}43339[#43339] (issue: {es-issue}43091[#43091])
Reduce the number of docvalues iterator created in the global ordinals fielddata {es-pull}43091[#43091]
Return reloaded analyzers in _reload_search_ananlyzer response {es-pull}43813[#43813] (issue: {es-issue}43804[#43804])
Allow reloading of search time analyzers {es-pull}43313[#43313] (issue: {es-issue}29051[#29051])
Allow reloading of search time analyzers {es-pull}42888[#42888] (issue: {es-issue}29051[#29051])
Allow reloading of search time analyzers {es-pull}42669[#42669] (issue: {es-issue}29051[#29051])
Always attach system user to internal actions {es-pull}43468[#43468] (issue: {es-issue}42215[#42215])
Add kerberos grant_type to get token in exchange for Kerberos ticket {es-pull}42847[#42847] (issue: {es-issue}41943[#41943])
Permit API Keys on Basic License {es-pull}42787[#42787]
Add "manage_api_key" cluster privilege {es-pull}43728[#43728] (issue: {es-issue}42020[#42020])
Use separate BitSet cache in Doc Level Security {es-pull}43669[#43669] (issue: {es-issue}30974[#30974])
Support builtin privileges in get privileges API {es-pull}42134[#42134] (issue: {es-issue}29771[#29771])
Add deduced mappings to _preview response payload {es-pull}43742[#43742] (issue: {es-issue}39250[#39250])
Add support for allow_no_match for endpoints {es-pull}43490[#43490] (issue: {es-issue}42766[#42766])
Add version and create_time to transform config {es-pull}43384[#43384] (issue: {es-issue}43037[#43037])
Have sum map to a double to prevent overflows {es-pull}43213[#43213]
Add new pipeline field to dest config {es-pull}43124[#43124] (issue: {es-issue}43061[#43061])
Write a warning audit on bulk index failures {es-pull}43106[#43106]
Add support for weighted_avg agg {es-pull}42646[#42646]
Use reader attributes to control term dict memory useage {es-pull}42838[#42838] (issue: {es-issue}38390[#38390])
Remove sort by primary term when reading soft-deletes {es-pull}43845[#43845]
Refresh translog stats after translog trimming in NoOpEngine {es-pull}43825[#43825] (issue: {es-issue}43156[#43156])
Expose translog stats in ReadOnlyEngine {es-pull}43752[#43752]
Do not use soft-deletes to resolve indexing strategy {es-pull}43336[#43336] (issues: {es-issue}35230[#35230], {es-issue}42979[#42979], {es-issue}43202[#43202])
Rebuild version map when opening internal engine {es-pull}43202[#43202] (issues: {es-issue}40741[#40741], {es-issue}42979[#42979])
Only load FST off heap if we are actually using mmaps for the term dictionary {es-pull}43158[#43158] (issue: {es-issue}43150[#43150])
Trim translog for closed indices {es-pull}43156[#43156] (issue: {es-issue}42445[#42445])
Also mmap terms index (.tip) files for hybridfs {es-pull}43150[#43150] (issue: {es-issue}42838[#42838])
Add a merge policy that prunes ID postings for soft-deleted but retained documents {es-pull}40741[#40741]
Add _reload_search_analyzers endpoint to HLRC {es-pull}43733[#43733] (issue: {es-issue}43313[#43313])
Bulk processor concurrent requests {es-pull}41451[#41451]
Improve CryptoService error message on missing secure file {es-pull}43623[#43623] (issue: {es-issue}43619[#43619])
Watcher: Allow to execute actions for each element in array {es-pull}41997[#41997] (issue: {es-issue}34546[#34546])
Prevent merging nodes' data paths {es-pull}42665[#42665] (issue: {es-issue}42489[#42489])
Deprecation info for joda-java migration on 7.x {es-pull}42659[#42659] (issue: {es-issue}42010[#42010])
Implement XContentParser.genericMap and XContentParser.genericMapOrdered methods {es-pull}42059[#42059]
Add painless method getByPath, get value from nested collections with dotted path {es-pull}43170[#43170] (issue: {es-issue}42769[#42769])
Add painless method getByPath, get value from nested collections with dotted path {es-pull}43129[#43129] (issue: {es-issue}42769[#42769])
Improve message when native controller cannot connect {es-pull}43565[#43565] (issue: {es-issue}42341[#42341])
Report exponential_avg_bucket_processing_time which gives more weight to recent buckets {es-pull}43189[#43189] (issue: {es-issue}29857[#29857])
Adding support for geo_shape, geo_centroid, geo_point in datafeeds {es-pull}42969[#42969] (issue: {es-issue}42820[#42820])
Report timing stats as part of the Job stats response {es-pull}42709[#42709] (issue: {es-issue}29857[#29857])
Increase maximum forecast interval to 10 years. {es-pull}41082[#41082] (issue: {es-issue}41103[#41103])
Upgrade to a newer version of the Apache Portable Runtime library. {ml-pull}495[#495]
Improve stability of modelling around change points. {ml-pull}496[#496]
Restrict detection of epoch timestamps in find_file_structure {es-pull}43188[#43188]
Better detection of binary input in find_file_structure {es-pull}42707[#42707]
Add a limit on line merging in find_file_structure {es-pull}42501[#42501] (issue: {es-issue}38086[#38086])
Improve file structure finder timestamp format determination {es-pull}41948[#41948] (issues: {es-issue}35132[#35132], {es-issue}35137[#35137], {es-issue}38086[#38086])
Add earliest and latest timestamps to field stats in find_file_structure response {es-pull}42890[#42890]
Change dots in CSV column names to underscores in find_file_structure response {es-pull}42839[#42839] (issue: {es-issue}26800[#26800])
Make peer recovery send file info step async {es-pull}43792[#43792] (issue: {es-issue}36195[#36195])
Make peer recovery clean files step async {es-pull}43787[#43787] (issue: {es-issue}36195[#36195])
Split search in two when made against read-only and write indices {es-pull}42510[#42510] (issue: {es-issue}40900[#40900])
Rename SearchRequest#crossClusterSearch {es-pull}42363[#42363]
Allow fields to be set to * {es-pull}42301[#42301] (issue: {es-issue}39577[#39577])
Search - enable low_level_cancellation by default. {es-pull}42291[#42291] (issue: {es-issue}26258[#26258])
Cut over ClusterSearchShardsGroup to Writeable {es-pull}41788[#41788]
Disable max score optimization for queries with unbounded max scores {es-pull}41361[#41361]
Recursive Delete on BlobContainer {es-pull}43281[#43281] (issue: {es-issue}42189[#42189])




    

Add SAS Token Authentication Support to Azure Repo Plugin {es-pull}42982[#42982] (issue: {es-issue}42117[#42117])
Enable Parallel Deletes in Azure Repository {es-pull}42783[#42783]
Add Ability to List Child Containers to BlobContainer {es-pull}42653[#42653] (issue: {es-issue}42189[#42189])
Add custom metadata to snapshots {es-pull}41281[#41281] (issue: {es-issue}40638[#40638])
Fix incorrect calculation of how many buckets will result from a merge {es-pull}44461[#44461] (issue: {es-issue}43577[#43577])
Set document on script when using Bytes.WithScript {es-pull}43390[#43390]
Bug fix to allow access to top level params in reduce script {es-pull}42096[#42096] (issue: {es-issue}42046[#42046])
Do not copy initial recovery filter during split {es-pull}44053[#44053] (issue: {es-issue}43955[#43955])
Avoid parallel reroutes in DiskThresholdMonitor {es-pull}43381[#43381] (issue: {es-issue}40174[#40174])
Reset failed allocation counter before executing routing commands {es-pull}42658[#42658] (issue: {es-issue}39546[#39546])
Validate routing commands using updated routing state {es-pull}42066[#42066] (issue: {es-issue}41050[#41050])
Fix AnalyzeAction response serialization {es-pull}44284[#44284] (issue: {es-issue}44078[#44078])
Actually close IndexAnalyzers contents {es-pull}43914[#43914]
Issue deprecation warnings for preconfigured delimited_payload_filter {es-pull}43684[#43684] (issues: {es-issue}26625[#26625], {es-issue}43568[#43568])
Use preconfigured filters correctly in Analyze API {es-pull}43568[#43568] (issue: {es-issue}43002[#43002])
Require [articles] setting in elision filter {es-pull}43083[#43083] (issue: {es-issue}43002[#43002])
Skip update if leader and follower settings identical {es-pull}44535[#44535] (issue: {es-issue}44521[#44521])
Avoid stack overflow in auto-follow coordinator {es-pull}44421[#44421] (issue: {es-issue}43251[#43251])
Avoid NPE when checking for CCR index privileges {es-pull}44397[#44397] (issue: {es-issue}44172[#44172])
CCR should not replicate private/internal settings {es-pull}43067[#43067] (issue: {es-issue}41268[#41268])
Reset state recovery after successful recovery {es-pull}42576[#42576] (issue: {es-issue}39172[#39172])
Cluster state from API should always have a master {es-pull}42454[#42454] (issues: {es-issue}38331[#38331], {es-issue}38432[#38432])
Omit non-masters in ClusterFormationFailureHelper {es-pull}41344[#41344]
Treat bulk index failures as an indexing failure {es-pull}44351[#44351] (issue: {es-issue}44101[#44101])
Responding with 409 status code when failing _stop {es-pull}44231[#44231] (issue: {es-issue}44103[#44103])
Adds index validations to _start data frame transform {es-pull}44191[#44191] (issue: {es-issue}44104[#44104])
Data frame task failure do not make a 500 response {es-pull}44058[#44058] (issue: {es-issue}44011[#44011])
Audit message missing for autostop {es-pull}43984[#43984] (issue: {es-issue}43977[#43977])
Add data frame transform cluster privileges to HLRC {es-pull}43879[#43879]
Improve pivot nested field validations {es-pull}43548[#43548]
Adjusting error message {es-pull}43455[#43455]
Size the GET stats search by number of Ids requested {es-pull}43206[#43206] (issue: {es-issue}43203[#43203])
Rewrite start and stop to answer with acknowledged {es-pull}42589[#42589] (issue: {es-issue}42450[#42450])
Set data frame transform task state to stopped when stopping   {es-pull}42516[#42516] (issue: {es-issue}42441[#42441])
Fix DefaultShardOperationFailedException subclass xcontent serialization {es-pull}43435[#43435] (issue: {es-issue}43423[#43423])
Advance checkpoints only after persisting ops {es-pull}43205[#43205]
Avoid loading retention leases while writing them {es-pull}42620[#42620] (issue: {es-issue}41430[#41430])
Do not use ifSeqNo for update requests on mixed cluster {es-pull}42596[#42596] (issue: {es-issue}42561[#42561])
Ensure relocation target still tracked when start handoff {es-pull}42201[#42201]
Account soft deletes for committed segments {es-pull}43126[#43126] (issue: {es-issue}43103[#43103])
Prune _id of only docs below local checkpoint of safe commit {es-pull}43051[#43051] (issues: {es-issue}40741[#40741], {es-issue}42979[#42979])
Improve translog corruption detection {es-pull}42744[#42744] (issue: {es-issue}42661[#42661])
Account for node versions during allocation in ILM Shrink {es-pull}43300[#43300] (issue: {es-issue}41879[#41879])
Narrow period of Shrink action in which ILM prevents stopping {es-pull}43254[#43254] (issue: {es-issue}43253[#43253])
Make ILM force merging best effort {es-pull}43246[#43246] (issues: {es-issue}42824[#42824], {es-issue}43245[#43245])
Check shard limit after applying index templates {es-pull}44619[#44619] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567], {es-issue}44619[#44619])
Validate index settings after applying templates {es-pull}44612[#44612] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567])
Prevent NullPointerException in TransportRolloverAction {es-pull}43353[#43353] (issue: {es-issue}43296[#43296])
NullPointerException when creating a watch with Jira action (#41922) {es-pull}42081[#42081]
fix unlikely bug that can prevent Watcher from restarting {es-pull}42030[#42030]
Add default CLI JVM options {es-pull}44545[#44545] (issues: {es-issue}219[#219], {es-issue}42021[#42021])
scheduleAtFixedRate would hang {es-pull}42993[#42993] (issue: {es-issue}38441[#38441])
Only ignore IOException when fsyncing on dirs {es-pull}42972[#42972] (issue: {es-issue}42950[#42950])
Fix alpha build error message when generate version object from version string {es-pull}40406[#40406]
Bat scripts to work with JAVA_HOME with parantheses {es-pull}39712[#39712] (issues: {es-issue}30606[#30606], {es-issue}33405[#33405], {es-issue}38578[#38578], {es-issue}38624[#38624])
Change licence expiration date pattern {es-pull}39681[#39681] (issue: {es-issue}39136[#39136])
Update .ml-config mappings before indexing job, datafeed or df analytics config {es-pull}44216[#44216] (issue: {es-issue}44263[#44263])
Wait for .ml-config primary before assigning persistent tasks {es-pull}44170[#44170] (issue: {es-issue}44156[#44156])
Fix ML memory tracker lockup when inner step fails {es-pull}44158[#44158] (issue: {es-issue}44156[#44156])
Reduce false positives associated with the multi-bucket feature. {ml-pull}491[#491]
Reduce false positives for sum and count functions on sparse data. {ml-pull}492[#492]
Fix an edge case causing spurious anomalies (false positives) if the variance
in the count of events changed significantly throughout the period of a seasonal
quantity. (See {ml-pull}489[#489].)
Ensure field caps doesn’t error on rank feature fields. {es-pull}44370[#44370] (issue: {es-issue}44330[#44330])
Prevent types deprecation warning for indices.exists requests {es-pull}43963[#43963] (issue: {es-issue}43905[#43905])
Fix index_prefix sub field name on nested text fields {es-pull}43862[#43862] (issue: {es-issue}43741[#43741])
Fix possible NPE in put mapping validators {es-pull}43000[#43000] (issue: {es-issue}37675[#37675])
Allow big integers and decimals to be mapped dynamically. {es-pull}42827[#42827] (issue: {es-issue}37846[#37846])
Reconnect remote cluster when seeds are changed {es-pull}43379[#43379] (issue: {es-issue}37799[#37799])
Don’t require TLS for single node clusters {es-pull}42826[#42826]
Fix Class Load Order in Netty4Plugin {es-pull}42591[#42591] (issue: {es-issue}42532[#42532])
Properly serialize remote query in ReindexRequest {es-pull}43457[#43457] (issues: {es-issue}43406[#43406], {es-issue}43456[#43456])
Fixing handling of auto slices in bulk scroll requests {es-pull}43050[#43050]
Remote reindex failure parse fix {es-pull}42928[#42928]
Fix concurrent search and index delete {es-pull}42621[#42621] (issue: {es-issue}28053[#28053])
Propogate version in reindex from remote search {es-pull}42412[#42412] (issue: {es-issue}31908[#31908])
SQL: change the size of the list of concrete indices when resolving multiple indices {es-pull}43878[#43878] (issue: {es-issue}43876[#43876])
SQL: handle double quotes escaping {es-pull}43829[#43829] (issue: {es-issue}43810[#43810])
SQL: add pretty printing to JSON format {es-pull}43756[#43756]
SQL: handle SQL not being available in a more graceful way {es-pull}43665[#43665] (issue: {es-issue}41279[#41279])
SQL: fix NPE in case of subsequent scrolled requests for a CSV/TSV formatted response {es-pull}43365[#43365] (issue: {es-issue}43327[#43327])
Geo: Add coerce support to libs/geo WKT parser {es-pull}43273[#43273] (issue: {es-issue}43173[#43173])
SQL: Increase hard limit for sorting on aggregates {es-pull}43220[#43220] (issue: {es-issue}43168[#43168])
SQL: Fix wrong results when sorting on aggregate {es-pull}43154[#43154] (issue: {es-issue}42851[#42851])
SQL: cover the Integer type when extracting values from _source {es-pull}42859[#42859] (issue: {es-issue}42858[#42858])
Don’t use index_phrases on graph queries {es-pull}44340[#44340] (issue: {es-issue}43976[#43976])
Fix wrong logic in match_phrase query with multi-word synonyms {es-pull}43941[#43941] (issue: {es-issue}43308[#43308])
Fix UOE on search requests that match a sparse role query {es-pull}43668[#43668] (issue: {es-issue}42857[#42857])
Fix propagation of enablePositionIncrements in QueryStringQueryBuilder {es-pull}43578[#43578] (issue: {es-issue}43574[#43574])
Fix score mode of the MinimumScoreCollector {es-pull}43527[#43527] (issue: {es-issue}43497[#43497])
Fix round up of date range without rounding {es-pull}43303[#43303] (issue: {es-issue}43277[#43277])
SearchRequest#allowPartialSearchResults does not handle successful retries {es-pull}43095[#43095] (issue: {es-issue}40743[#40743])
Wire query cache into sorting nested-filter computation {es-pull}42906[#42906] (issue: {es-issue}42813[#42813])
Fix auto fuzziness in query_string query {es-pull}42897[#42897]
Fix IntervalBuilder#analyzeText to never return null {es-pull}42750[#42750] (issue: {es-issue}42587[#42587])
Fix sorting on nested field with unmapped {es-pull}42451[#42451] (issue: {es-issue}33644[#33644])
Deduplicate alias and concrete fields in query field expansion {es-pull}42328[#42328]
Do not swallow I/O exception getting authentication {es-pull}44398[#44398] (issues: {es-issue}44172[#44172], {es-issue}44397[#44397])
Use system context for looking up connected nodes {es-pull}43991[#43991] (issue: {es-issue}43974[#43974])
SecurityIndexSearcherWrapper doesn’t always carry over caches and similarity {es-pull}43436[#43436]
Detect when security index is closed {es-pull}42191[#42191]
Remove usage of FileSwitchDirectory  {es-pull}42937[#42937] (issue: {es-issue}37111[#37111])
Fix Infinite Loops in ExceptionsHelper#unwrap {es-pull}42716[#42716] (issue: {es-issue}42340[#42340])
Fix suggestions for empty indices {es-pull}42927[#42927] (issue: {es-issue}42473[#42473])
Skip explain phase when only suggestions are requested {es-pull}41739[#41739] (issue: {es-issue}31260[#31260])
Improve message when native controller cannot connect {es-pull}43565[#43565] (issue: {es-issue}42341[#42341])
Introduce a setting for the process connect timeout {es-pull}43234[#43234]
Check shard limit after applying index templates {es-pull}44619[#44619] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567], {es-issue}44619[#44619])
Validate index settings after applying templates {es-pull}44612[#44612] (issues: {es-issue}34021[#34021], {es-issue}44567[#44567])
Prevent NullPointerException in TransportRolloverAction {es-pull}43353[#43353] (issue: {es-issue}43296[#43296])
Don’t persist model state at the end of lookback if the lookback did not generate any input {ml-pull}527[#527] (issue: {ml-issue}519[#519])
Don’t write model size stats when job is closed without any input {ml-pull}516[#516] (issue: {ml-issue}394[#394])
Prevent types deprecation warning for indices.exists requests {es-pull}43963[#43963] (issue: {es-issue}43905[#43905])
Add include_type_name in indices.exitst REST API spec {es-pull}43910[#43910] (issue: {es-issue}43905[#43905])
Fix index_prefix sub field name on nested text fields {es-pull}43862[#43862] (issue: {es-issue}43741[#43741])
Fix NPE in case of subsequent scrolled requests for a CSV/TSV formatted response {es-pull}43365[#43365] (issue: {es-issue}43327[#43327])
Increase hard limit for sorting on aggregates {es-pull}43220[#43220] (issue: {es-issue}43168[#43168])
Fix wrong logic in match_phrase query with multi-word synonyms {es-pull}43941[#43941] (issue: {es-issue}43308[#43308])
Fix UOE on search requests that match a sparse role query {es-pull}43668[#43668] (issue: {es-issue}42857[#42857])
Fix propagation of enablePositionIncrements in QueryStringQueryBuilder {es-pull}43578[#43578] (issue: {es-issue}43574[#43574])
Fix round up of date range without rounding {es-pull}43303[#43303] (issue: {es-issue}43277[#43277])
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Breaking changes
Cluster Coordination
Deprecate using 0 value for min_children in has_child query #41548 {es-pull}41555[#41555] (issue: {es-issue}41548[#41548])
Deprecate support for first line empty in msearch API {es-pull}41442[#41442] (issue: {es-issue}41011[#41011])
Add support for replicating closed indices {es-pull}39499[#39499] (issues: {es-issue}33888[#33888], {es-issue}33903[#33903], {es-issue}37359[#37359], {es-issue}37413[#37413], {es-issue}38024[#38024], {es-issue}38326[#38326], {es-issue}38327[#38327], {es-issue}38329[#38329], {es-issue}38421[#38421], {es-issue}38631[#38631], {es-issue}38767[#38767], {es-issue}38854[#38854], {es-issue}38955[#38955], {es-issue}39006[#39006], {es-issue}39110[#39110], {es-issue}39186[#39186], {es-issue}39249[#39249], {es-issue}39364[#39364])
Add painless string split function (splitOnToken) {es-pull}39772[#39772] (issue: {es-issue}20952[#20952])
Add a Painless Context REST API {es-pull}39382[#39382]
Add initial geo support {es-pull}42031[#42031] (issues: {es-issue}29872[#29872], {es-issue}37206[#37206])
Implement CASE… WHEN… THEN… ELSE… END {es-pull}41349[#41349] (issue: {es-issue}36200[#36200])
Introduce MAD (MedianAbsoluteDeviation) aggregation {es-pull}40048[#40048] (issue: {es-issue}39597[#39597])
Introduce SQL TIME data type {es-pull}39802[#39802] (issue: {es-issue}38174[#38174])
Introduce the columnar option for REST requests {es-pull}39287[#39287] (issue: {es-issue}37702[#37702])
Use the breadth first collection mode for significant terms aggs. {es-pull}29042[#29042] (issue: {es-issue}28652[#28652])
Disallow null/empty or duplicate composite sources {es-pull}41359[#41359] (issue: {es-issue}32414[#32414])
Move top-level pipeline aggs out of QuerySearchResult {es-pull}40319[#40319] (issue: {es-issue}40177[#40177])
Remove throws IOException from PipelineAggregationBuilder#create {es-pull}40222[#40222]
Better error messages when pipelines reference incompatible aggs {es-pull}40068[#40068] (issues: {es-issue}25273[#25273], {es-issue}30152[#30152])
Do not allow Sampler to allocate more than maxDoc size, better CB accounting {es-pull}39381[#39381] (issue: {es-issue}34269[#34269])
Force selection of calendar or fixed intervals in date histo agg {es-pull}33727[#33727]
Reset failed allocation counter before executing routing commands {es-pull}41050[#41050] (issue: {es-issue}39546[#39546])
Supporting automatic release of index blocks. Closes #39334 {es-pull}40338[#40338] (issue: {es-issue}39334[#39334])
Hash token values for storage {es-pull}41792[#41792] (issues: {es-issue}39631[#39631], {es-issue}40765[#40765])
Security Tokens moved to a new separate index {es-pull}40742[#40742] (issue: {es-issue}34454[#34454])
Support concurrent refresh of refresh tokens {es-pull}39631[#39631] (issue: {es-issue}36872[#36872])
Add enabled status for token and api key service {es-pull}38687[#38687] (issue: {es-issue}38535[#38535])
Support mustache templates in role mappings {es-pull}39984[#39984] (issue: {es-issue}36567[#36567])
Add .code_internal-* index pattern to kibana user {es-pull}42247[#42247]
Add granular API key privileges {es-pull}41488[#41488] (issue: {es-issue}40031[#40031])
Add Kibana application privileges for monitoring and ml reserved roles {es-pull}40651[#40651]
Support roles with application privileges against wildcard applications {es-pull}40398[#40398]
Only connect to new nodes on new cluster state {es-pull}39629[#39629] (issues: {es-issue}29025[#29025], {es-issue}31547[#31547])
Add has_voting_exclusions flag to cluster health output {es-pull}38568[#38568]
Persist and restore checkpoint and position {es-pull}41942[#41942] (issue: {es-issue}41752[#41752])
Complete the Data Frame task on stop {es-pull}41752[#41752]
Data Frame stop all {es-pull}41156[#41156]
Data Frame HLRC Get Stats API {es-pull}40327[#40327]
Data Frame HLRC Get API {es-pull}40209[#40209]




    

Data Frame HLRC Preview API {es-pull}40206[#40206]
Data Frame HLRC start & stop APIs {es-pull}40154[#40154] (issue: {es-issue}29546[#29546])
Add Data Frame client to the Java HLRC {es-pull}39921[#39921]
Add index name to cluster block exception {es-pull}41489[#41489] (issue: {es-issue}40870[#40870])
Noop peer recoveries on closed index {es-pull}41400[#41400] (issue: {es-issue}33888[#33888])
Do not trim unsafe commits when open readonly engine {es-pull}41041[#41041] (issue: {es-issue}33888[#33888])
Avoid background sync on relocated primary {es-pull}40800[#40800] (issue: {es-issue}40731[#40731])
No mapper service and index caches for replicated closed indices {es-pull}40423[#40423]
Add support for replicating closed indices {es-pull}39499[#39499] (issues: {es-issue}33888[#33888], {es-issue}33903[#33903], {es-issue}37359[#37359], {es-issue}37413[#37413], {es-issue}38024[#38024], {es-issue}38326[#38326], {es-issue}38327[#38327], {es-issue}38329[#38329], {es-issue}38421[#38421], {es-issue}38631[#38631], {es-issue}38767[#38767], {es-issue}38854[#38854], {es-issue}38955[#38955], {es-issue}39006[#39006], {es-issue}39110[#39110], {es-issue}39186[#39186], {es-issue}39249[#39249], {es-issue}39364[#39364])
Simplify initialization of max_seq_no of updates {es-pull}41161[#41161] (issues: {es-issue}33842[#33842], {es-issue}40249[#40249])
Adjust init map size of user data of index commit {es-pull}40965[#40965]
Don’t mark shard as refreshPending on stats fetching {es-pull}40458[#40458] (issues: {es-issue}33835[#33835], {es-issue}33847[#33847])
Reject illegal flush parameters {es-pull}40213[#40213] (issue: {es-issue}36342[#36342])
Always fail engine if delete operation fails {es-pull}40117[#40117] (issue: {es-issue}33256[#33256])
Combine overriddenOps and skippedOps in translog {es-pull}39771[#39771] (issue: {es-issue}33317[#33317])
Return cached segments stats if include_unloaded_segments is true {es-pull}39698[#39698] (issue: {es-issue}39512[#39512])
Allow inclusion of unloaded segments in stats {es-pull}39512[#39512]
Never block on scheduled refresh if a refresh is running {es-pull}39462[#39462]
Expose external refreshes through the stats API {es-pull}38643[#38643] (issue: {es-issue}36712[#36712])
Make setting index.translog.sync_interval be dynamic {es-pull}37382[#37382] (issue: {es-issue}32763[#32763])
Improve error message for absence of indices {es-pull}39789[#39789] (issues: {es-issue}38964[#38964], {es-issue}39296[#39296])
Improved error message for absence of indices closes #38964 {es-pull}39296[#39296]
Added param ignore_throttled=false when indicesOptions.ignoreThrottle… {es-pull}42393[#42393] (issue: {es-issue}42358[#42358])
Ignore 409 conflict in reindex responses {es-pull}39543[#39543]
Improve accuracy for Geo Centroid Aggregation {es-pull}41033[#41033] (issue: {es-issue}41032[#41032])
Add support for z values to libs/geo classes {es-pull}38921[#38921]
Add ST_WktToSQL function {es-pull}35416[#35416] (issue: {es-issue}29872[#29872])
Validate non-secure settings are not in keystore {es-pull}42209[#42209] (issue: {es-issue}41831[#41831])
Implement XContentParser.genericMap and XContentParser.genericMapOrdered methods {es-pull}42059[#42059]
Remove manual parsing of JVM options {es-pull}41962[#41962] (issue: {es-issue}30684[#30684])
Clarify some ToXContent implementations behaviour {es-pull}41000[#41000] (issue: {es-issue}16347[#16347])
Remove String interning from o.e.index.Index. {es-pull}40350[#40350] (issue: {es-issue}40263[#40263])
Do not swallow exceptions in TimedRunnable {es-pull}39856[#39856] (issue: {es-issue}36137[#36137])
Add validation that rejects duplicate detectors in PutJobAction {es-pull}40967[#40967] (issue: {es-issue}39704[#39704])
Add created_by info to usage stats {es-pull}40518[#40518] (issue: {es-issue}38403[#38403])
Data frame transforms config HLRC objects {es-pull}39691[#39691]
Use scaling thread pool and xpack.ml.max_open_jobs cluster-wide dynamic {es-pull}39320[#39320] (issue: {es-issue}29809[#29809])
Add task recovery on node change  {es-pull}39416[#39416]
Stop tasks on failure {es-pull}39203[#39203]
Add _preview endpoint {es-pull}38924[#38924]
Use hardened compiler options to build 3rd party libraries {ml-pull}453[#453]
Only select more complex trend models for forecasting if there is evidence that they are needed
{ml-pull}463[#463]
Improve residual model selection {ml-pull}468[#468]
Stop linking to libcrypt on Linux {ml-pull}480[#480]
Improvements to hard_limit audit message {ml-pull}486[#486]
Increase maximum forecast interval from 8 weeks to a limit based on the amount
of data seen, up to a maximum of 10 years {ml-pull}214[#214] and
{es-pull}41082[#41082] (issue: {es-issue}41103[#41103])
Updates max dimensions for sparse_vector and dense_vector to 1024. {es-pull}40597[#40597] (issue: {es-issue}40492[#40492])
Add ignore_above in ICUCollationKeywordFieldMapper {es-pull}40414[#40414] (issue: {es-issue}40413[#40413])
Adding a soft limit to the field name length. Closes #33651 {es-pull}40309[#40309] (issue: {es-issue}33651[#33651])
Update ciphers for TLSv1.3 and JDK11 if available {es-pull}42082[#42082] (issues: {es-issue}38646[#38646], {es-issue}41385[#41385], {es-issue}41808[#41808])
Show SSL usage when security is not disabled {es-pull}40672[#40672] (issue: {es-issue}37433[#37433])
Optimize Bulk Message Parsing and Message Length Parsing {es-pull}39634[#39634] (issue: {es-issue}39286[#39286])
Netty transport accept plaintext connections {es-pull}39532[#39532] (issue: {es-issue}39531[#39531])
Chunk + Throttle Netty Writes {es-pull}39286[#39286]
Peer recovery should flush at the end {es-pull}41660[#41660] (issues: {es-issue}33888[#33888], {es-issue}39588[#39588], {es-issue}40024[#40024])
Peer recovery should not indefinitely retry on mapping error {es-pull}41099[#41099] (issue: {es-issue}40913[#40913])
Init global checkpoint after copy commit in peer recovery {es-pull}40823[#40823] (issue: {es-issue}33888[#33888])
Ensure sendBatch not called recursively {es-pull}39988[#39988]
Implement IIF(<cond>, <result1>, <result2>) {es-pull}41420[#41420] (issue: {es-issue}40917[#40917])
Use field caps inside DESCRIBE TABLE as well {es-pull}41377[#41377] (issue: {es-issue}34071[#34071])
Implement CURRENT_TIME/CURTIME functions {es-pull}40662[#40662] (issue: {es-issue}40648[#40648])
Polish behavior of SYS TABLES command {es-pull}40535[#40535] (issue: {es-issue}40348[#40348])
Adjust the precision and scale for drivers {es-pull}40467[#40467] (issue: {es-issue}40357[#40357])
Polish parsing of CAST expression {es-pull}40428[#40428]
Fix classpath discovery on Java 10+ {es-pull}40420[#40420] (issue: {es-issue}40388[#40388])
Spec tests now use classpath discovery {es-pull}40388[#40388] (issue: {es-issue}40358[#40358])
Implement :: cast operator {es-pull}38774[#38774] (issue: {es-issue}38717[#38717])
Shortcut counts on exists queries {es-pull}39570[#39570] (issue: {es-issue}37475[#37475])
Completion suggestions to be reduced once instead of twice {es-pull}39255[#39255]
Rename SearchRequest#withLocalReduction {es-pull}39108[#39108]
Tie break search shard iterator comparisons on cluster alias {es-pull}38853[#38853]
Clean up ShardSearchLocalRequest {es-pull}38574[#38574]
Handle unmapped fields in _field_caps API {es-pull}34071[#34071]
Make 0 as invalid value for min_children in has_child query {es-pull}33073[#33073] (issue: {es-issue}32949[#32949])
Analyze numbers, dates and ips with a whitespace analyzer in text queries {es-pull}27395[#27395]
Add date and date_nanos conversion to the numeric_type sort option {es-pull}40199[#40199]
Add use_field option to intervals query {es-pull}40157[#40157]
Add overlapping, before, after filters to intervals query {es-pull}38999[#38999]
Support multiple repositories in get snapshot request {es-pull}41799[#41799] (issue: {es-issue}41210[#41210])
Implement Bulk Deletes for GCS Repository {es-pull}41368[#41368] (issue: {es-issue}40322[#40322])
Add Bulk Delete Api to BlobStore {es-pull}40322[#40322] (issues: {es-issue}40144[#40144], {es-issue}40250[#40250])
Async Snapshot Repository Deletes {es-pull}40144[#40144] (issues: {es-issue}39656[#39656], {es-issue}39657[#39657])
Allow snapshotting replicated closed indices {es-pull}39644[#39644] (issue: {es-issue}33888[#33888])
Add support for S3 intelligent tiering (#38836) {es-pull}39376[#39376] (issue: {es-issue}38836[#38836])
Update error message for allowed characters in aggregation names {es-pull}41573[#41573] (issue: {es-issue}41567[#41567])
Fix FiltersAggregation NPE when filters is empty {es-pull}41459[#41459] (issue: {es-issue}41408[#41408])
Fix unmapped field handling in the composite aggregation {es-pull}41280[#41280]
Avoid bubbling up failures from a shard that is recovering {es-pull}42287[#42287] (issues: {es-issue}30919[#30919], {es-issue}40107[#40107])
Changed the position of reset counter {es-pull}39678[#39678] (issue: {es-issue}39546[#39546])
Always use IndexAnalyzers in analyze transport action {es-pull}40769[#40769] (issue: {es-issue}29021[#29021])
Fix anaylze NullPointerException when AnalyzeTokenList tokens is null {es-pull}39332[#39332]
Fix anaylze NullPointerException when AnalyzeTokenList tokens is null {es-pull}39180[#39180]
Fix settings prefix for realm truststore password {es-pull}42336[#42336] (issues: {es-issue}30241[#30241], {es-issue}41663[#41663])
Merge claims from userinfo and ID Token correctly {es-pull}42277[#42277]
Do not refresh realm cache unless required {es-pull}42169[#42169] (issue: {es-issue}35218[#35218])
Amend prepareIndexIfNeededThenExecute for security token refresh {es-pull}41697[#41697]
Fix token Invalidation when retries exhausted {es-pull}39799[#39799]
Reset state recovery after successful recovery {es-pull}42576[#42576] (issue: {es-issue}39172[#39172])
Omit non-masters in ClusterFormationFailureHelper {es-pull}41344[#41344]
Rewrite start and stop to answer with acknowledged {es-pull}42589[#42589] (issue: {es-issue}42450[#42450])
Set DF task state to stopped when stopping   {es-pull}42516[#42516] (issue: {es-issue}42441[#42441])
Add support for fixed_interval, calendar_interval, remove interval {es-pull}42427[#42427] (issues: {es-issue}33727[#33727], {es-issue}42297[#42297])
Avoid loading retention leases while writing them {es-pull}42620[#42620] (issue: {es-issue}41430[#41430])
Do not use ifSeqNo for update requests on mixed cluster {es-pull}42596[#42596] (issue: {es-issue}42561[#42561])
Prevent order being lost for _nodes API filters {es-pull}42045[#42045] (issue: {es-issue}41885[#41885])
Ensure flush happen before closing an index {es-pull}40184[#40184] (issue: {es-issue}36342[#36342])
Account soft deletes for committed segments {es-pull}43126[#43126] (issue: {es-issue}43103[#43103])
Fix assertion error when caching the result of a search in a read-only index {es-pull}41900[#41900] (issue: {es-issue}41795[#41795])
Close and acquire commit during reset engine fix {es-pull}41584[#41584] (issue: {es-issue}38561[#38561])
Make ILM force merging best effort {es-pull}43246[#43246] (issues: {es-issue}42824[#42824], {es-issue}43245[#43245])
Narrow period of Shrink action in which ILM prevents stopping {es-pull}43254[#43254] (issue: {es-issue}43253[#43253])
Fixes a bug in AnalyzeRequest.toXContent() {es-pull}42795[#42795] (issues: {es-issue}39670[#39670], {es-issue}42197[#42197])
StackOverflowError when calling BulkRequest#add {es-pull}41672[#41672]
HLRC: Convert xpack methods to client side objects {es-pull}40705[#40705] (issue: {es-issue}40511[#40511])
Rest-High-Level-Client:fix uri encode bug when url path start with '/' {es-pull}34436[#34436] (issue: {es-issue}34433[#34433])
NullPointerException when creating a watch with Jira action (#41922) {es-pull}42081[#42081]
Fix minor watcher bug, unmute test, add additional debug logging {es-pull}41765[#41765] (issues: {es-issue}29893[#29893], {es-issue}30777[#30777], {es-issue}33291[#33291], {es-issue}35361[#35361])
Fix Watcher deadlock that can cause in-abilty to index documents. {es-pull}41418[#41418] (issue: {es-issue}41390[#41390])
Fix roundUp parsing with composite patterns {es-pull}43080[#43080] (issue: {es-issue}42835[#42835])
scheduleAtFixedRate would hang {es-pull}42993[#42993] (issue: {es-issue}38441[#38441])
Only ignore IOException when fsyncing on dirs {es-pull}42972[#42972] (issue: {es-issue}42950[#42950])
Fix node close stopwatch usage {es-pull}41918[#41918]
Make ISO8601 date parser accept timezone when time does not have seconds {es-pull}41896[#41896]
Allow unknown task time in QueueResizingEsTPE {es-pull}41810[#41810] (issue: {es-issue}41448[#41448])
Parse composite patterns using ClassicFormat.parseObject {es-pull}40100[#40100] (issue: {es-issue}39916[#39916])
Don’t create tempdir for cli scripts {es-pull}41913[#41913] (issue: {es-issue}34445[#34445])
Cleanup plugin bin directories {es-pull}41907[#41907] (issue: {es-issue}18109[#18109])
Update lintian overrides {es-pull}41561[#41561] (issue: {es-issue}17185[#17185])
Resolve JAVA_HOME at windows service install time {es-pull}39714[#39714] (issue: {es-issue}30720[#30720])
Fix possible NPE in put mapping validators {es-pull}43000[#43000] (issue: {es-issue}37675[#37675])
Fix merging of text field mappers {es-pull}40627[#40627]
Fix an off-by-one error in the vector field dimension limit. {es-pull}40489[#40489]
Fix not Recognizing Disabled Object Mapper {es-pull}39862[#39862] (issue: {es-issue}39456[#39456])
Avoid copying the field alias lookup structure unnecessarily. {es-pull}39726[#39726]
Handle NaNs when detrending seasonal components {ml-pull}408[#408]
Use translog to estimate number of operations in recovery {es-pull}42211[#42211] (issue: {es-issue}38904[#38904])
Recovery with syncId should verify seqno infos {es-pull}41265[#41265]
Retain history for peer recovery using leases {es-pull}39133[#39133]
Fix concurrent search and index delete {es-pull}42621[#42621] (issue: {es-issue}28053[#28053])
Propogate version in reindex from remote search {es-pull}42412[#42412] (issue: {es-issue}31908[#31908])
Cleanup exceptions thrown during RollupSearch {es-pull}41272[#41272] (issue: {es-issue}38015[#38015])
Validate timezones based on rules not string comparision {es-pull}36237[#36237] (issue: {es-issue}36229[#36229])
Fix wrong results when sorting on aggregate {es-pull}43154[#43154] (issue: {es-issue}42851[#42851])
Cover the Integer type when extracting values from _source {es-pull}42859[#42859] (issue: {es-issue}42858[#42858])
Fix precedence of :: psql like CAST operator {es-pull}40665[#40665]
Fix IntervalBuilder#analyzeText to never return null {es-pull}42750[#42750] (issue: {es-issue}42587[#42587])
Fix sorting on nested field with unmapped {es-pull}42451[#42451] (issue: {es-issue}33644[#33644])
Always set terminated_early if terminate_after is set in the search request {es-pull}40839[#40839] (issue: {es-issue}33949[#33949])
more_like_this query to throw an error if the like fields is not provided {es-pull}40632[#40632]
Fixing 503 Service Unavailable errors during fetch phase  {es-pull}39086[#39086]
Fix IndexSearcherWrapper visibility {es-pull}39071[#39071] (issue: {es-issue}30758[#30758])
Remove Harmful Exists Check from BlobStoreFormat {es-pull}41898[#41898] (issue: {es-issue}41882[#41882])
Restricts naming for repositories {es-pull}41008[#41008] (issue: {es-issue}40817[#40817])
SNAPSHOT: More Resilient Writes to Blob Stores {es-pull}36927[#36927] (issue: {es-issue}25281[#25281])
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.
Bug fixes
Distributed
SQL: Fix issue regarding INTERVAL * number {es-pull}42014[#42014] (issue: {es-issue}41239[#41239])
SQL: Remove CircuitBreaker from parser {es-pull}41835[#41835] (issue: {es-issue}41471[#41471])
These release notes include all changes made in the alpha, beta, and RC
releases of 7.0.0.
Also see Breaking changes in 7.0.
Known issues
Applying deletes or updates on an index after it has been shrunk may corrupt
the index. In order to prevent this issue, it is recommended to stop shrinking
read-write indices. For read-only indices, it is recommended to force-merge
indices after shrinking, which significantly reduces the likeliness of this
corruption in the case that deletes/updates would be applied by mistake. This
bug is fixed in {es} 7.7 and later versions. More details can be found on the
corresponding issue.
Indices created in 6.x with date and date_nanos fields using formats
that are incompatible with java.time patterns will cause parsing errors, incorrect date calculations or wrong search results.
https://github.com/elastic/elasticsearch/pull/52555
This is fixed in {es} 7.7 and later versions.




    

Java based formats (created in 7.x or prefixed with '8') - week based parsing and calculations are using JDK default calendar data provider which is Sunday,1.
Sunday is considered first day of a week and it requires only 1 day in a week for the first week of the year.
It can be worked around by using locale which is based on ISO8601 rule (Monday,4) - for instance en-GB
This issue is fixed in Elasticsearch 7.7 with JDK9+ https://github.com/elastic/elasticsearch/pull/48209
Breaking changes
Aggregations
Remove support for deprecated params._agg/_aggs for scripted metric aggregations {es-pull}32979[#32979] (issues: {es-issue}29328[#29328], {es-issue}31597[#31597])
Percentile/Ranks should return null instead of NaN when empty {es-pull}30460[#30460] (issue: {es-issue}29066[#29066])
Render sum as zero if count is zero for stats aggregation {es-pull}27193[#27193] (issue: {es-issue}26893[#26893])
Remove delimited_payload_filter {es-pull}27705[#27705] (issues: {es-issue}26625[#26625], {es-issue}27704[#27704])
Limit the number of tokens produced by _analyze {es-pull}27529[#27529] (issue: {es-issue}27038[#27038])
Add limits for ngram and shingle settings {es-pull}27211[#27211] (issue: {es-issue}25887[#25887])
Security: remove wrapping in put user response {es-pull}33512[#33512] (issue: {es-issue}32332[#32332])
Remove bwc logic for token invalidation {es-pull}36893[#36893] (issue: {es-issue}36727[#36727])
Remove aliases resolution limitations when security is enabled {es-pull}31952[#31952] (issue: {es-issue}31516[#31516])
Remove implicit index monitor privilege {es-pull}37774[#37774]
Version conflict exception message enhancement {es-pull}29432[#29432] (issue: {es-issue}21278[#21278])
Using ObjectParser in UpdateRequest {es-pull}29293[#29293] (issue: {es-issue}28740[#28740])
Remove support for internal versioning for concurrency control {es-pull}38254[#38254] (issue: {es-issue}1078[#1078])
Forbid negative values for index.unassigned.node_left.delayed_timeout {es-pull}26828[#26828]
Remove cluster state size {es-pull}40061[#40061] (issues: {es-issue}39806[#39806], {es-issue}39827[#39827], {es-issue}39951[#39951], {es-issue}40016[#40016])
Add Configuration Except. Data to Metdata {es-pull}32322[#32322] (issue: {es-issue}27728[#27728])
Add ECS schema for user-agent ingest processor (#37727) {es-pull}37984[#37984] (issues: {es-issue}37329[#37329], {es-issue}37727[#37727])
Remove special handling for ingest plugins {es-pull}36967[#36967] (issues: {es-issue}36898[#36898], {es-issue}36956[#36956])
Remove the suggest metric from stats APIs {es-pull}29635[#29635] (issue: {es-issue}29589[#29589])
Align cat thread pool info to thread pool config {es-pull}29195[#29195] (issue: {es-issue}29123[#29123])
Align thread pool info to thread pool configuration {es-pull}29123[#29123] (issue: {es-issue}29113[#29113])
Introduce durability of circuit breaking exception {es-pull}34460[#34460] (issue: {es-issue}31986[#31986])
Circuit-break based on real memory usage {es-pull}31767[#31767]
CCS: Drop http address from remote cluster info {es-pull}29568[#29568] (issue: {es-issue}29207[#29207])
Remove the index thread pool {es-pull}29556[#29556]
Main response should not have status 503 when okay {es-pull}29045[#29045] (issue: {es-issue}8902[#8902])
Automatically prepare indices for splitting {es-pull}27451[#27451]
Don’t refresh on _flush _force_merge and _upgrade {es-pull}27000[#27000] (issue: {es-issue}26972[#26972])
Remove support for deprecated StoredScript contexts {es-pull}31394[#31394] (issues: {es-issue}27612[#27612], {es-issue}28939[#28939])
Remove getDate methods from ScriptDocValues {es-pull}30690[#30690]
Drop ScriptDocValues#date and ScriptDocValues#dates in 7.0.0 {es-pull}30690[#30690] (issue: {es-issue}23008[#23008])
Match phrase queries against non-indexed fields should throw an exception {es-pull}31060[#31060]
Remove legacy mapping code. {es-pull}29224[#29224]
Reject updates to the default mapping. {es-pull}29165[#29165] (issues: {es-issue}15613[#15613], {es-issue}28248[#28248])
Remove the update_all_types option. {es-pull}28288[#28288]
Remove the default mapping. {es-pull}28248[#28248]
Reject the index_options parameter for numeric fields {es-pull}26668[#26668] (issue: {es-issue}21475[#21475])
Update the default for include_type_name to false. {es-pull}37285[#37285]
Support 'include_type_name' in RestGetIndicesAction {es-pull}37149[#37149]
Remove TLS 1.0 as a default SSL protocol {es-pull}37512[#37512] (issue: {es-issue}36021[#36021])
Security: remove SSL settings fallback {es-pull}36846[#36846] (issue: {es-issue}29797[#29797])
Add minimal sanity checks to custom/scripted similarities. {es-pull}33564[#33564] (issue: {es-issue}33309[#33309])
Scroll queries asking for rescore are considered invalid {es-pull}32918[#32918] (issue: {es-issue}31775[#31775])
Forbid negative scores in function_score query {es-pull}35709[#35709] (issue: {es-issue}33309[#33309])
Forbid negative field boosts in analyzed queries {es-pull}37930[#37930] (issue: {es-issue}33309[#33309])
Remove deprecated url parameters _source_include and _source_exclude {es-pull}35097[#35097] (issues: {es-issue}22792[#22792], {es-issue}33475[#33475])
Disallow negative query boost {es-pull}34486[#34486] (issue: {es-issue}33309[#33309])
Forbid negative weight in Function Score Query {es-pull}33390[#33390] (issue: {es-issue}31927[#31927])
In the field capabilities API, remove support for providing fields in the request body. {es-pull}30185[#30185]
Remove deprecated options for query_string {es-pull}29203[#29203] (issue: {es-issue}25551[#25551])
Fix Laplace scorer to multiply by alpha (and not add) {es-pull}27125[#27125]
Remove _primary and _replica shard preferences {es-pull}26791[#26791] (issue: {es-issue}26335[#26335])
Limit the number of expanded fields it query_string and simple_query_string {es-pull}26541[#26541] (issue: {es-issue}25105[#25105])
Make purely negative queries return scores of 0. {es-pull}26015[#26015] (issue: {es-issue}23449[#23449])
Remove the deprecated _termvector endpoint. {es-pull}36131[#36131] (issues: {es-issue}36098[#36098], {es-issue}8484[#8484])
Remove deprecated Graph endpoints {es-pull}35956[#35956]
Validate metadata on _msearch {es-pull}35938[#35938] (issue: {es-issue}35869[#35869])
Make hits.total an object in the search response {es-pull}35849[#35849] (issue: {es-issue}33028[#33028])
Remove the distinction between query and filter context in QueryBuilders {es-pull}35354[#35354] (issue: {es-issue}35293[#35293])
Throw a parsing exception when boost is set in span_or query (#28390) {es-pull}34112[#34112] (issue: {es-issue}28390[#28390])
Track total hits up to 10,000 by default {es-pull}37466[#37466] (issue: {es-issue}33028[#33028])
Use mappings to format doc-value fields by default. {es-pull}30831[#30831] (issues: {es-issue}26948[#26948], {es-issue}29639[#29639])
Include size of snapshot in snapshot metadata  {es-pull}30890[#30890] (issue: {es-issue}18543[#18543])
Remove azure deprecated settings {es-pull}26099[#26099] (issue: {es-issue}23405[#23405])
Drop elasticsearch-translog for 7.0 {es-pull}33373[#33373] (issues: {es-issue}31389[#31389], {es-issue}32281[#32281])
completely drop index.shard.check_on_startup: fix for 7.0 {es-pull}33194[#33194]
Fix threshold frequency computation in Suggesters {es-pull}34312[#34312] (issue: {es-issue}34282[#34282])
Make Geo Context Mapping Parsing More Strict {es-pull}32821[#32821] (issues: {es-issue}32202[#32202], {es-issue}32412[#32412])
Remove the ability to index or query context suggestions without context {es-pull}31007[#31007] (issue: {es-issue}30712[#30712])
Cluster health to default to cluster level {es-pull}31268[#31268] (issue: {es-issue}29331[#29331])
Remove deprecated API methods {es-pull}31200[#31200] (issue: {es-issue}31069[#31069])
Drop deprecated methods {es-pull}33223[#33223] (issues: {es-issue}29623[#29623], {es-issue}30315[#30315])
Remove support for maxRetryTimeout from low-level REST client {es-pull}38085[#38085] (issues: {es-issue}25951[#25951], {es-issue}31834[#31834], {es-issue}33342[#33342])
Replace parameter unicodeSetFilter with unicode_set_filter  {es-pull}29215[#29215] (issue: {es-issue}22823[#22823])
Replace delimited_payload_filter by delimited_payload {es-pull}26625[#26625] (issue: {es-issue}21978[#21978])
Deprecate Standard Html Strip Analyzer in master {es-pull}26719[#26719] (issue: {es-issue}4704[#4704])
Remove nGram and  edgeNGram token filter names (#38911) {es-pull}39070[#39070] (issues: {es-issue}30209[#30209], {es-issue}38911[#38911])
Deprecate size in cluster state response {es-pull}39951[#39951] (issue: {es-issue}39806[#39806])
Deprecate discovery.zen.* settings {es-pull}38289[#38289], {es-pull}38333[#38333], {es-pull}38350[#38350], {es-pull}37868[#37868]
Deprecate HLRC security methods {es-pull}37883[#37883] (issues: {es-issue}36938[#36938], {es-issue}37540[#37540])
Deprecate HLRC EmptyResponse used by security {es-pull}37540[#37540] (issue: {es-issue}36938[#36938])
Deprecate xpack.watcher.history.cleaner_service.enabled {es-pull}37782[#37782] (issue: {es-issue}32041[#32041])
deprecate types for watcher {es-pull}37594[#37594] (issue: {es-issue}35190[#35190])
Deprecate X-Pack centric ML endpoints {es-pull}36315[#36315] (issue: {es-issue}35958[#35958])
Adding ml_settings entry to HLRC and Docs for deprecation_info {es-pull}38118[#38118]
Datafeed deprecation checks {es-pull}38026[#38026] (issue: {es-issue}37932[#37932])
Remove "8" prefixes from file structure finder timestamp formats {es-pull}38016[#38016]
Adjust structure finder for Joda to Java time migration {es-pull}37306[#37306]
Resolve 7.0.0 TODOs in ML code {es-pull}36842[#36842] (issue: {es-issue}29963[#29963])
Deprecate types in index API {es-pull}36575[#36575] (issues: {es-issue}35190[#35190], {es-issue}35790[#35790])
Deprecate uses of _type as a field name in queries {es-pull}36503[#36503] (issue: {es-issue}35190[#35190])
Deprecate types in update_by_query and delete_by_query {es-pull}36365[#36365] (issue: {es-issue}35190[#35190])
For msearch templates, make sure to use the right name for deprecation logging. {es-pull}36344[#36344]
Deprecate types in termvector and mtermvector requests. {es-pull}36182[#36182]
Deprecate types in update requests. {es-pull}36181[#36181]
Deprecate types in document delete requests. {es-pull}36087[#36087]
Deprecate types in get, exists, and multi get. {es-pull}35930[#35930]
Deprecate types in search and multi search templates. {es-pull}35669[#35669]
Deprecate types in explain requests. {es-pull}35611[#35611]
Deprecate types in validate query requests. {es-pull}35575[#35575]
Deprecate types in count and msearch. {es-pull}35421[#35421] (issue: {es-issue}34041[#34041])
Deprecate types in rollover index API {es-pull}38039[#38039] (issue: {es-issue}35190[#35190])
Deprecate types in get field mapping API {es-pull}37667[#37667] (issue: {es-issue}35190[#35190])
Deprecate types in the put mapping API. {es-pull}37280[#37280] (issues: {es-issue}29453[#29453], {es-issue}37285[#37285])
Support include_type_name in the field mapping and index template APIs. {es-pull}37210[#37210]
Deprecate types in create index requests. {es-pull}37134[#37134] (issues: {es-issue}29453[#29453], {es-issue}37285[#37285])
Deprecate use of the _type field in aggregations. {es-pull}37131[#37131] (issue: {es-issue}36802[#36802])
Deprecate reference to _type in lookup queries {es-pull}37016[#37016] (issue: {es-issue}35190[#35190])
Deprecate the document create endpoint. {es-pull}36863[#36863]
Deprecate types in index API {es-pull}36575[#36575] (issues: {es-issue}35190[#35190], {es-issue}35790[#35790])
Deprecate types in update APIs {es-pull}36225[#36225]
Re-deprecate xpack rollup endpoints {es-pull}36451[#36451] (issue: {es-issue}36044[#36044])
Deprecate X-Pack centric rollup endpoints {es-pull}35962[#35962] (issue: {es-issue}35958[#35958])
Adds deprecation logging to ScriptDocValues#getValues. {es-pull}34279[#34279] (issue: {es-issue}22919[#22919])
Conditionally use java time api in scripting {es-pull}31441[#31441]
Remove X-Pack centric graph endpoints {es-pull}36010[#36010] (issue: {es-issue}35958[#35958])
Deprecate use of type in reindex request body {es-pull}36823[#36823]
Add typless endpoints for get_source and exist_source {es-pull}36426[#36426]
Deprecate X-Pack centric license endpoints {es-pull}35959[#35959] (issue: {es-issue}35958[#35958])
Deprecate /_xpack/security/* in favor of /_security/* {es-pull}36293[#36293] (issue: {es-issue}35958[#35958])
Relax TermVectors API to work with textual fields other than TextFieldType {es-pull}31915[#31915] (issue: {es-issue}31902[#31902])
Add support for inlined user dictionary in Nori {es-pull}36123[#36123] (issue: {es-issue}35842[#35842])
Add a prebuilt ICU Analyzer {es-pull}34958[#34958] (issue: {es-issue}34285[#34285])
Add support for API keys to access Elasticsearch {es-pull}38291[#38291] (issue: {es-issue}34383[#34383])
OIDC realm authentication flows {es-pull}37787[#37787]
OIDC Realm JWT+JWS related functionality {es-pull}37272[#37272] (issues: {es-issue}35339[#35339], {es-issue}37009[#37009])
OpenID Connect Realm base functionality {es-pull}37009[#37009] (issue: {es-issue}35339[#35339])
Allow custom authorization with an authorization engine  {es-pull}38358[#38358] (issues: {es-issue}32435[#32435], {es-issue}36245[#36245], {es-issue}37328[#37328], {es-issue}37495[#37495], {es-issue}37785[#37785], {es-issue}38137[#38137], {es-issue}38219[#38219])
Wildcard IndicesPermissions don’t cover .security {es-pull}36765[#36765]
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}36751[#36751] (issue: {es-issue}35320[#35320])
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}35320[#35320] (issue: {es-issue}32039[#32039])
geotile_grid implementation {es-pull}37842[#37842] (issue: {es-issue}30240[#30240])
Fork Lucene’s LatLonShape Classes to local lucene package {es-pull}36794[#36794]
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}36751[#36751] (issue: {es-issue}35320[#35320])
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}35320[#35320] (issue: {es-issue}32039[#32039])
Add delayed datacheck to the datafeed job runner {es-pull}35387[#35387] (issue: {es-issue}35131[#35131])
Adds set_upgrade_mode API endpoint {es-pull}37837[#37837]
Make typeless APIs usable with indices whose type name is different from _doc {es-pull}35790[#35790] (issue: {es-issue}35190[#35190])
Give precedence to index creation when mixing typed templates with typeless index creation and vice-versa. {es-pull}37871[#37871] (issue: {es-issue}37773[#37773])
Add nanosecond field mapper {es-pull}37755[#37755] (issues: {es-issue}27330[#27330], {es-issue}32601[#32601])
Add support for SYS GEOMETRY_COLUMNS {es-pull}30496[#30496] (issue: {es-issue}29872[#29872])
Introduce HISTOGRAM grouping function {es-pull}36510[#36510] (issue: {es-issue}36509[#36509])
DATABASE() and USER() system functions {es-pull}35946[#35946] (issue: {es-issue}35863[#35863])
Introduce INTERVAL support   {es-pull}35521[#35521] (issue: {es-issue}29990[#29990])
Allow sorting of groups by aggregates {es-pull}38042[#38042] (issue: {es-issue}35118[#35118])
Implement FIRST/LAST aggregate functions {es-pull}37936[#37936] (issue: {es-issue}35639[#35639])
Introduce SQL DATE data type {es-pull}37693[#37693] (issue: {es-issue}37340[#37340])
Add “took” timing info to response for _msearch/template API {es-pull}30961[#30961] (issue: {es-issue}30957[#30957])
Add allow_partial_search_results flag to search requests with default setting true {es-pull}28440[#28440] (issue: {es-issue}27435[#27435])
Enable adaptive replica selection by default {es-pull}26522[#26522] (issue: {es-issue}24915[#24915])
Add intervals query {es-pull}36135[#36135] (issues: {es-issue}29636[#29636], {es-issue}32406[#32406])
Added soft limit to open scroll contexts #25244 {es-pull}36009[#36009] (issue: {es-issue}25244[#25244])
Introduce ability to minimize round-trips in CCS {es-pull}37828[#37828] (issues: {es-issue}32125[#32125], {es-issue}37566[#37566])
Add script filter to intervals {es-pull}36776[#36776]
Add the ability to set the number of hits to track accurately {es-pull}36357[#36357] (issue: {es-issue}33028[#33028])
Add a maximum search request size. {es-pull}26423[#26423]
Make IntervalQuery available via the Query DSL {es-pull}36135[#36135] (issue: {es-issue}29636[#29636])
Uses MergingDigest instead of AVLDigest in percentiles agg {es-pull}28702[#28702] (issue: {es-issue}19528[#19528])
Added keyed response to pipeline percentile aggregations 22302 {es-pull}36392[#36392] (issue: {es-issue}22302[#22302])
Enforce max_buckets limit only in the final reduction phase {es-pull}36152[#36152] (issues: {es-issue}32125[#32125], {es-issue}35921[#35921])
Histogram aggs: add empty buckets only in the final reduce step {es-pull}35921[#35921]
Handles exists query in composite aggs {es-pull}35758[#35758]




    

Added parent validation for auto date histogram {es-pull}35670[#35670]
Add Composite to AggregationBuilders {es-pull}38207[#38207] (issue: {es-issue}38020[#38020])
Allow nested fields in the composite aggregation {es-pull}37178[#37178] (issue: {es-issue}28611[#28611])
Remove single shard optimization when suggesting shard_size {es-pull}37041[#37041] (issue: {es-issue}32125[#32125])
Use List instead of priority queue for stable sorting in bucket sort aggregator {es-pull}36748[#36748] (issue: {es-issue}36322[#36322])
Keys are compared in BucketSortPipelineAggregation so making key type… {es-pull}36407[#36407]
Fail start on obsolete indices documentation {es-pull}37786[#37786] (issue: {es-issue}27073[#27073])
Fail start on invalid index metadata {es-pull}37748[#37748] (issue: {es-issue}27073[#27073])
Fail start of non-data node if node has data {es-pull}37347[#37347] (issue: {es-issue}27073[#27073])
Allow word_delimiter_graph_filter to not adjust internal offsets {es-pull}36699[#36699] (issues: {es-issue}33710[#33710], {es-issue}34741[#34741])
Ensure TokenFilters only produce single tokens when parsing synonyms {es-pull}34331[#34331] (issue: {es-issue}34298[#34298])
Allow word_delimiter_graph_filter to not adjust internal offsets {es-pull}36699[#36699] (issues: {es-issue}33710[#33710], {es-issue}34741[#34741])
Security Audit includes HTTP method for requests {es-pull}37322[#37322] (issue: {es-issue}29765[#29765])
Add X-Forwarded-For to the logfile audit {es-pull}36427[#36427]
Invalidate Token API enhancements - HLRC {es-pull}36362[#36362] (issue: {es-issue}35388[#35388])
Add DEBUG/TRACE logs for LDAP bind {es-pull}36028[#36028]
Add Tests for findSamlRealm {es-pull}35905[#35905]
Add realm information for Authenticate API {es-pull}35648[#35648]
Formal support for "password_hash" in Put User {es-pull}35242[#35242] (issue: {es-issue}34729[#34729])
Propagate auth result to listeners {es-pull}36900[#36900] (issue: {es-issue}30794[#30794])
Reorder realms based on last success {es-pull}36878[#36878]
Improve error message for 6.x style realm settings {es-pull}36876[#36876] (issues: {es-issue}30241[#30241], {es-issue}36026[#36026])
Change missing authn message to not mention tokens {es-pull}36750[#36750]
Invalidate Token API enhancements - HLRC {es-pull}36362[#36362] (issue: {es-issue}35388[#35388])
Enhance Invalidate Token API {es-pull}35388[#35388] (issues: {es-issue}34556[#34556], {es-issue}35115[#35115])
Permission for restricted indices {es-pull}37577[#37577] (issue: {es-issue}34454[#34454])
Remove kibana_user and kibana_dashboard_only_user index privileges {es-pull}37441[#37441]
Create snapshot role {es-pull}35820[#35820] (issue: {es-issue}34454[#34454])
Add time since last auto follow fetch to auto follow stats {es-pull}36542[#36542] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Clean followed leader index UUIDs in auto follow metadata {es-pull}36408[#36408] (issue: {es-issue}33007[#33007])
Change AutofollowCoordinator to use wait_for_metadata_version {es-pull}36264[#36264] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Refactor AutoFollowCoordinator to track leader indices per remote cluster {es-pull}36031[#36031] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Concurrent file chunk fetching for CCR restore {es-pull}38495[#38495]
Tighten mapping syncing in ccr remote restore {es-pull}38071[#38071] (issues: {es-issue}36879[#36879], {es-issue}37887[#37887])
Do not allow put mapping on follower {es-pull}37675[#37675] (issue: {es-issue}30086[#30086])
Added ccr to xpack usage infrastructure {es-pull}37256[#37256] (issue: {es-issue}37221[#37221])
FollowingEngine should fail with 403 if operation has no seqno assigned {es-pull}37213[#37213]
Added auto_follow_exception.timestamp field to auto follow stats {es-pull}36947[#36947]
Add time since last auto follow fetch to auto follow stats {es-pull}36542[#36542] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Reduce retention lease sync intervals {es-pull}40302[#40302]
Renew retention leases while following {es-pull}39335[#39335] (issues: {es-issue}37165[#37165], {es-issue}38718[#38718])
Reduce refresh when lookup term in FollowingEngine {es-pull}39184[#39184]
Integrate retention leases to recovery from remote {es-pull}38829[#38829] (issue: {es-issue}37165[#37165])
Enable removal of retention leases {es-pull}38751[#38751] (issue: {es-issue}37165[#37165])
Introduce forget follower API {es-pull}39718[#39718] (issue: {es-issue}37165[#37165])
Replace usages of AtomicBoolean based block of code by the RunOnce class {es-pull}35553[#35553] (issue: {es-issue}35489[#35489])
Added wait_for_metadata_version parameter to cluster state api. {es-pull}35535[#35535]
Extract RunOnce into a dedicated class {es-pull}35489[#35489]
Introduce elasticsearch-core jar {es-pull}28191[#28191] (issue: {es-issue}27933[#27933])
Rename core module to server {es-pull}28180[#28180] (issue: {es-issue}27933[#27933])
Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm  {es-pull}36757[#36757] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Expose Sequence Number based Optimistic Concurrency Control in the rest layer {es-pull}36721[#36721] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add doc’s sequence number + primary term to GetResult and use it for updates {es-pull}36680[#36680] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add seq no powered optimistic locking support to the index and delete transport actions {es-pull}36619[#36619] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add Seq# based optimistic concurrency control to UpdateRequest {es-pull}37872[#37872] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Introduce ssl settings to reindex from remote {es-pull}37527[#37527] (issues: {es-issue}29755[#29755], {es-issue}37287[#37287])
Use Sequence number powered OCC for processing updates {es-pull}37308[#37308] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Document Seq No powered optimistic concurrency control {es-pull}37284[#37284] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Enable IPv6 URIs in reindex from remote {es-pull}36874[#36874]
Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm  {es-pull}36757[#36757] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Expose Sequence Number based Optimistic Concurrency Control in the rest layer {es-pull}36721[#36721] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add doc’s sequence number + primary term to GetResult and use it for updates {es-pull}36680[#36680] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add seq no powered optimistic locking support to the index and delete transport actions {es-pull}36619[#36619] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Set acking timeout to 0 on dynamic mapping update {es-pull}31140[#31140] (issues: {es-issue}30672[#30672], {es-issue}30844[#30844])
[Close Index API] Mark shard copy as stale if needed during shard verification {es-pull}36755[#36755]
[Close Index API] Refactor MetadataIndexStateService {es-pull}36354[#36354] (issue: {es-issue}36249[#36249])
[Close Index API] Add TransportShardCloseAction for pre-closing verifications {es-pull}36249[#36249]
TransportResyncReplicationAction should not honour blocks {es-pull}35795[#35795] (issues: {es-issue}35332[#35332], {es-issue}35597[#35597])
Expose all permits acquisition in IndexShard and TransportReplicationAction {es-pull}35540[#35540] (issue: {es-issue}33888[#33888])
[RCI] Check blocks while having index shard permit in TransportReplicationAction {es-pull}35332[#35332] (issue: {es-issue}33888[#33888])
Recover retention leases during peer recovery {es-pull}38435[#38435] (issue: {es-issue}37165[#37165])
Lift retention lease expiration to index shard {es-pull}38380[#38380] (issues: {es-issue}37165[#37165], {es-issue}37963[#37963], {es-issue}38070[#38070])
Introduce retention lease background sync {es-pull}38262[#38262] (issue: {es-issue}37165[#37165])
Allow shards of closed indices to be replicated as regular shards {es-pull}38024[#38024] (issue: {es-issue}33888[#33888])
Expose retention leases in shard stats {es-pull}37991[#37991] (issue: {es-issue}37165[#37165])
Introduce retention leases versioning {es-pull}37951[#37951] (issue: {es-issue}37165[#37165])
Soft-deletes policy should always fetch latest leases {es-pull}37940[#37940] (issues: {es-issue}37165[#37165], {es-issue}37375[#37375])
Sync retention leases on expiration {es-pull}37902[#37902] (issue: {es-issue}37165[#37165])
Ignore shard started requests when primary term does not match {es-pull}37899[#37899] (issue: {es-issue}33888[#33888])
Move update and delete by query to use seq# for optimistic concurrency control {es-pull}37857[#37857] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148], {es-issue}37639[#37639])
Introduce retention lease serialization {es-pull}37447[#37447] (issues: {es-issue}37165[#37165], {es-issue}37398[#37398])
Add run under primary permit method {es-pull}37440[#37440] (issue: {es-issue}37398[#37398])
Introduce retention lease syncing {es-pull}37398[#37398] (issue: {es-issue}37165[#37165])
Introduce retention lease persistence {es-pull}37375[#37375] (issue: {es-issue}37165[#37165])
Add validation for retention lease construction {es-pull}37312[#37312] (issue: {es-issue}37165[#37165])
Introduce retention lease expiration {es-pull}37195[#37195] (issue: {es-issue}37165[#37165])
Introduce shard history retention leases {es-pull}37167[#37167] (issue: {es-issue}37165[#37165])
[Close Index API] Add unique UUID to ClusterBlock {es-pull}36775[#36775]
[Close Index API] Mark shard copy as stale if needed during shard verification {es-pull}36755[#36755]
[Close Index API] Propagate tasks ids between Freeze, Close and Verify Shard actions {es-pull}36630[#36630]
Always initialize the global checkpoint {es-pull}34381[#34381]
Introduce retention lease actions {es-pull}38756[#38756] (issue: {es-issue}37165[#37165])
Add dedicated retention lease exceptions {es-pull}38754[#38754] (issue: {es-issue}37165[#37165])
Copy retention leases when trim unsafe commits {es-pull}37995[#37995] (issue: {es-issue}37165[#37165])
Allow retention lease operations under blocks {es-pull}39089[#39089] (issues: {es-issue}34648[#34648], {es-issue}37165[#37165])
Remove retention leases when unfollowing {es-pull}39088[#39088] (issues: {es-issue}34648[#34648], {es-issue}37165[#37165])
Introduce retention lease state file {es-pull}39004[#39004] (issues: {es-issue}37165[#37165], {es-issue}38588[#38588], {es-issue}39032[#39032])
Enable soft-deletes by default for 7.0+ indices {es-pull}38929[#38929] (issue: {es-issue}36141[#36141])
Do retry if primary fails on AsyncAfterWriteAction {es-pull}31857[#31857] (issues: {es-issue}31716[#31716], {es-issue}31755[#31755])
handle AsyncAfterWriteAction exception before listener is registered {es-pull}31755[#31755] (issue: {es-issue}31716[#31716])
Use IndexWriter#flushNextBuffer to free memory {es-pull}27753[#27753]
Remove pre 6.0.0 support from InternalEngine {es-pull}27720[#27720]
Add sequence numbers based optimistic concurrency control support to Engine {es-pull}36467[#36467] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Require soft-deletes when access changes snapshot {es-pull}36446[#36446]
Use delCount of SegmentInfos to calculate numDocs {es-pull}36323[#36323]
Always configure soft-deletes field of IndexWriterConfig {es-pull}36196[#36196] (issue: {es-issue}36141[#36141])
Enable soft-deletes by default on 7.0.0 or later {es-pull}36141[#36141]
Always return false from refreshNeeded on ReadOnlyEngine {es-pull}35837[#35837] (issue: {es-issue}35785[#35785])
Add a _freeze / _unfreeze API {es-pull}35592[#35592] (issue: {es-issue}34352[#34352])
[RCI] Add IndexShardOperationPermits.asyncBlockOperations(ActionListener<Releasable>) {es-pull}34902[#34902] (issue: {es-issue}33888[#33888])
Specialize pre-closing checks for engine implementations {es-pull}38702[#38702]
Ensure that max seq # is equal to the global checkpoint when creating ReadOnlyEngines {es-pull}37426[#37426]
Enable Bulk-Merge if all source remains {es-pull}37269[#37269]
Rename setting to enable mmap {es-pull}37070[#37070] (issue: {es-issue}36668[#36668])
Add hybridfs store type {es-pull}36668[#36668]
Introduce time-based retention policy for soft-deletes {es-pull}34943[#34943] (issue: {es-issue}34908[#34908])
Handle AsyncAfterWriteAction failure on primary in the same way as failures on replicas  {es-pull}31969[#31969] (issues: {es-issue}31716[#31716], {es-issue}31755[#31755])
Explicitly advance max_seq_no before indexing {es-pull}39473[#39473] (issue: {es-issue}38879[#38879])
Also mmap cfs files for hybridfs {es-pull}38940[#38940] (issue: {es-issue}36668[#36668])
Ensure ILM policies run safely on leader indices  {es-pull}38140[#38140] (issue: {es-issue}34648[#34648])
Skip Shrink when numberOfShards not changed {es-pull}37953[#37953] (issue: {es-issue}33275[#33275])
Inject Unfollow before Rollover and Shrink {es-pull}37625[#37625] (issue: {es-issue}34648[#34648])
Add set_priority action to ILM {es-pull}37397[#37397] (issue: {es-issue}36905[#36905])
Add Freeze Action {es-pull}36910[#36910] (issue: {es-issue}34630[#34630])
Add rollover-creation-date setting to rolled over index {es-pull}31144[#31144] (issue: {es-issue}30887[#30887])
add is-write-index flag to aliases {es-pull}30942[#30942]
Make index and bulk APIs work without types. {es-pull}29479[#29479]
Simplify deprecation issue levels {es-pull}36326[#36326]
New mapping signature and mapping string source fixed. {es-pull}37401[#37401]
Add ignore_missing property to foreach filter (#22147) {es-pull}31578[#31578] (issue: {es-issue}22147[#22147])
Compile mustache template only if field includes '{{'' {es-pull}37207[#37207] (issue: {es-issue}37120[#37120])
Move ingest-geoip default databases out of config {es-pull}36949[#36949] (issue: {es-issue}36898[#36898])
Make the ingest-geoip databases even lazier to load {es-pull}36679[#36679]
Updates the grok patterns to be consistent with the logstash {es-pull}27181[#27181]
Fix strict setting exception handling {es-pull}37247[#37247] (issue: {es-issue}37090[#37090])
Use nonblocking entity for requests {es-pull}32249[#32249]
Stats to record how often the ClusterState diff mechanism is used successfully {es-pull}26973[#26973]
Add JVM dns cache expiration config to JvmInfo {es-pull}36372[#36372]
Validate email adresses when storing a watch {es-pull}34042[#34042] (issue: {es-issue}33980[#33980])
Move watcher to use seq# and primary term for concurrency control {es-pull}37977[#37977] (issues: {es-issue}10708[#10708], {es-issue}37872[#37872])
Use ILM for Watcher history deletion {es-pull}37443[#37443] (issue: {es-issue}32041[#32041])
Add whitelist to HttpClient {es-pull}36817[#36817] (issue: {es-issue}29937[#29937])
Remove the index type from internal watcher indexes {es-pull}39761[#39761] (issue: {es-issue}38637[#38637])
Adds a name of the field to geopoint parsing errors {es-pull}36529[#36529] (issue: {es-issue}15965[#15965])
Add support to ShapeBuilders for building Lucene geometry {es-pull}35707[#35707] (issue: {es-issue}35320[#35320])
Add ST_WktToSQL function {es-pull}35416[#35416] (issue: {es-issue}29872[#29872])
Have circuit breaker succeed on unknown mem usage {es-pull}33125[#33125] (issue: {es-issue}31767[#31767])
Account for XContent overhead in in-flight breaker {es-pull}31613[#31613]
Script Stats: Add compilation limit counter to stats {es-pull}26387[#26387]
Improved IndexNotFoundException’s default error message {es-pull}34649[#34649] (issue: {es-issue}34628[#34628])
fix a few versionAdded values in ElasticsearchExceptions {es-pull}37877[#37877]
Add simple method to write collection of writeables {es-pull}37448[#37448] (issue: {es-issue}37398[#37398])
Date/Time parsing: Use java time API instead of exception handling {es-pull}37222[#37222]
[API] spelling: interruptible {es-pull}37049[#37049] (issue: {es-issue}37035[#37035])
Enhancements to IndicesQueryCache. {es-pull}39099[#39099] (issue: {es-issue}37117[#37117])
Change zone formatting for all printers {es-pull}39568[#39568] (issue: {es-issue}38471[#38471])
Trim the JSON source in indexing slow logs {es-pull}38081[#38081] (issue: {es-issue}38080[#38080])
Optimize warning header de-duplication {es-pull}37725[#37725] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530], {es-issue}37597[#37597], {es-issue}37622[#37622])
Remove warn-date from warning headers {es-pull}37622[#37622] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530], {es-issue}37597[#37597])
Add some deprecation optimizations {es-pull}37597[#37597] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530])
Only update response headers if we have a new one {es-pull}37590[#37590] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530])
Change file descriptor limit to 65535 {es-pull}37537[#37537] (issue: {es-issue}35839[#35839])
Exit batch files explictly using ERRORLEVEL {es-pull}29583[#29583] (issue: {es-issue}29582[#29582])
Add no-jdk distributions {es-pull}39882[#39882]
Allow AVX-512 on JDK 11+ {es-pull}40828[#40828] (issue: {es-issue}32138[#32138])
Remove hand-coded XContent duplicate checks {es-pull}34588[#34588] (issues: {es-issue}22073[#22073], {es-issue}22225[#22225], {es-issue}22253[#22253])
Add the include_type_name option to the search and document APIs. {es-pull}29506[#29506] (issue: {es-issue}15613[#15613])
Validate op_type for _create {es-pull}27483[#27483]
Handle missing values in painless {es-pull}32207[#32207] (issue: {es-issue}29286[#29286])




    

Add getZone to JodaCompatibleZonedDateTime {es-pull}37084[#37084]
[Painless] Add boxed type to boxed type casts for method/return {es-pull}36571[#36571]
Add support for CCR Get Auto Follow Pattern apis {es-pull}36049[#36049] (issue: {es-issue}33824[#33824])
Add support for CCR Delete Auto Follow Pattern API {es-pull}35981[#35981] (issue: {es-issue}33824[#33824])
Remove fromXContent from IndexUpgradeInfoResponse {es-pull}35934[#35934]
Add delete expired data API {es-pull}35906[#35906] (issue: {es-issue}29827[#29827])
Execute watch API {es-pull}35868[#35868] (issue: {es-issue}29827[#29827])
Add ability to put user with a password hash {es-pull}35844[#35844] (issue: {es-issue}35242[#35242])
Add ML find file structure API {es-pull}35833[#35833] (issue: {es-issue}29827[#29827])
Add support for get roles API {es-pull}35787[#35787] (issue: {es-issue}29827[#29827])
Added support for CCR Put Auto Follow Pattern API {es-pull}35780[#35780] (issue: {es-issue}33824[#33824])
XPack ML info action {es-pull}35777[#35777] (issue: {es-issue}29827[#29827])
ML Delete event from Calendar {es-pull}35760[#35760] (issue: {es-issue}29827[#29827])
Add ML revert model snapshot API {es-pull}35750[#35750] (issue: {es-issue}29827[#29827])
ML Get Calendar Events {es-pull}35747[#35747] (issue: {es-issue}29827[#29827])
Add high-level REST client API for _freeze and _unfreeze {es-pull}35723[#35723] (issue: {es-issue}34352[#34352])
Fix issue in equals impl for GlobalOperationPrivileges {es-pull}35721[#35721]
ML Delete job from calendar {es-pull}35713[#35713] (issue: {es-issue}29827[#29827])
ML Add Event To Calendar API {es-pull}35704[#35704] (issue: {es-issue}29827[#29827])
Add ML update model snapshot API (#35537) {es-pull}35694[#35694] (issue: {es-issue}29827[#29827])
Add support for CCR Unfollow API {es-pull}35693[#35693] (issue: {es-issue}33824[#33824])
Clean up PutLicenseResponse {es-pull}35689[#35689] (issue: {es-issue}35547[#35547])
Clean up StartBasicResponse {es-pull}35688[#35688] (issue: {es-issue}35547[#35547])
Add support for put privileges API {es-pull}35679[#35679]
ML Add Job to Calendar API {es-pull}35666[#35666] (issue: {es-issue}29827[#29827])
Add support for CCR Resume Follow API {es-pull}35638[#35638] (issue: {es-issue}33824[#33824])
Add support for get application privileges API {es-pull}35556[#35556] (issue: {es-issue}29827[#29827])
Clean up XPackInfoResponse class and related tests {es-pull}35547[#35547]
Add parameters to stopRollupJob API {es-pull}35545[#35545] (issue: {es-issue}34811[#34811])
Add ML delete model snapshot API {es-pull}35537[#35537] (issue: {es-issue}29827[#29827])
Add get watch API {es-pull}35531[#35531] (issue: {es-issue}29827[#29827])
Add ML Update Filter API {es-pull}35522[#35522] (issue: {es-issue}29827[#29827])
Add ml get filters api {es-pull}35502[#35502] (issue: {es-issue}29827[#29827])
Add ML get model snapshots API {es-pull}35487[#35487] (issue: {es-issue}29827[#29827])
Add "_has_privileges" API to Security Client {es-pull}35479[#35479] (issue: {es-issue}29827[#29827])
Add Delete Privileges API to HLRC {es-pull}35454[#35454] (issue: {es-issue}29827[#29827])
Add support for CCR Put Follow API {es-pull}35409[#35409]
Add ML delete filter action {es-pull}35382[#35382] (issue: {es-issue}29827[#29827])
Add delete user action {es-pull}35294[#35294] (issue: {es-issue}29827[#29827])
HLRC for _mtermvectors {es-pull}35266[#35266] (issues: {es-issue}27205[#27205], {es-issue}33447[#33447])
Reindex API with wait_for_completion false {es-pull}35202[#35202] (issue: {es-issue}27205[#27205])
Add watcher stats API {es-pull}35185[#35185] (issue: {es-issue}29827[#29827])
HLRC support for getTask {es-pull}35166[#35166] (issue: {es-issue}27205[#27205])
Add GetRollupIndexCaps API {es-pull}35102[#35102] (issue: {es-issue}29827[#29827])
HLRC: migration api - upgrade {es-pull}34898[#34898] (issue: {es-issue}29827[#29827])
Add stop rollup job support to HL REST Client {es-pull}34702[#34702] (issue: {es-issue}29827[#29827])
Bulk Api support for global parameters {es-pull}34528[#34528] (issue: {es-issue}26026[#26026])
Add delete rollup job support to HL REST Client {es-pull}34066[#34066] (issue: {es-issue}29827[#29827])
Add support for get license basic/trial status API {es-pull}33176[#33176] (issue: {es-issue}29827[#29827])
Add machine learning open job {es-pull}32860[#32860] (issue: {es-issue}29827[#29827])
Add ML HLRC wrapper and put_job API call {es-pull}32726[#32726]
Add Get Snapshots High Level REST API {es-pull}31537[#31537] (issue: {es-issue}27205[#27205])
Require acknowledgement to start_trial license {es-pull}30135[#30135] (issue: {es-issue}30134[#30134])
Handle malformed license signatures {es-pull}37137[#37137] (issue: {es-issue}35340[#35340])
Create the ML annotations index {es-pull}36731[#36731] (issues: {es-issue}26034[#26034], {es-issue}33376[#33376])
Split in batches and migrate all jobs and datafeeds {es-pull}36716[#36716] (issue: {es-issue}32905[#32905])
Add cluster setting to enable/disable config  migration {es-pull}36700[#36700] (issue: {es-issue}32905[#32905])
Add audits when deprecation warnings occur with datafeed start {es-pull}36233[#36233]
Add lazy parsing for DatafeedConfig:Aggs,Query {es-pull}36117[#36117]
Add support for lazy nodes (#29991) {es-pull}34538[#34538] (issue: {es-issue}29991[#29991])
Move ML Optimistic Concurrency Control to Seq No {es-pull}38278[#38278] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add explanation so far to file structure finder exceptions {es-pull}38191[#38191] (issue: {es-issue}29821[#29821])
Add reason field in JobTaskState {es-pull}38029[#38029] (issue: {es-issue}34431[#34431])
Add _meta information to all ML indices {es-pull}37964[#37964]
Add upgrade mode docs, hlrc, and fix bug {es-pull}37942[#37942]
Tighten up use of aliases rather than concrete indices {es-pull}37874[#37874]
Add support for single bucket aggs in Datafeeds {es-pull}37544[#37544] (issue: {es-issue}36838[#36838])
Create the ML annotations index {es-pull}36731[#36731] (issues: {es-issue}26034[#26034], {es-issue}33376[#33376])
Merge the Jindex master feature branch {es-pull}36702[#36702] (issue: {es-issue}32905[#32905])
Add cluster setting to enable/disable config  migration {es-pull}36700[#36700] (issue: {es-issue}32905[#32905])
Allow stop unassigned datafeed and relax unset upgrade mode wait {es-pull}39034[#39034]
Log document id when MapperParsingException occurs {es-pull}37800[#37800] (issue: {es-issue}37658[#37658])
[API] spelling: unknown {es-pull}37056[#37056] (issue: {es-issue}37035[#37035])
Make SourceToParse immutable {es-pull}36971[#36971]
Use index-prefix fields for terms of length min_chars - 1 {es-pull}36703[#36703]
Introduce a parameter suppress_types_warnings. {es-pull}38923[#38923]
Add cors support to NioHttpServerTransport {es-pull}30827[#30827] (issue: {es-issue}28898[#28898])
Reintroduce mandatory http pipelining support {es-pull}30820[#30820]
Make http pipelining support mandatory {es-pull}30695[#30695] (issues: {es-issue}28898[#28898], {es-issue}29500[#29500])
Add nio http server transport {es-pull}29587[#29587] (issue: {es-issue}28898[#28898])
Add class for serializing message to bytes {es-pull}29384[#29384] (issue: {es-issue}28898[#28898])
Selectors operate on channel contexts {es-pull}28468[#28468] (issue: {es-issue}27260[#27260])
Unify nio read / write channel contexts {es-pull}28160[#28160] (issue: {es-issue}27260[#27260])
Create nio-transport plugin for NioTransport {es-pull}27949[#27949] (issue: {es-issue}27260[#27260])
Add elasticsearch-nio jar for base nio classes {es-pull}27801[#27801] (issue: {es-issue}27802[#27802])
Unify transport settings naming {es-pull}36623[#36623]
Add sni name to SSLEngine in netty transport {es-pull}33144[#33144] (issue: {es-issue}32517[#32517])
Add cors support to NioHttpServerTransport {es-pull}30827[#30827] (issue: {es-issue}28898[#28898])
Reintroduce mandatory http pipelining support {es-pull}30820[#30820]
Make http pipelining support mandatory {es-pull}30695[#30695] (issues: {es-issue}28898[#28898], {es-issue}29500[#29500])
Add nio http server transport {es-pull}29587[#29587] (issue: {es-issue}28898[#28898])
Selectors operate on channel contexts {es-pull}28468[#28468] (issue: {es-issue}27260[#27260])
Unify nio read / write channel contexts {es-pull}28160[#28160] (issue: {es-issue}27260[#27260])
Create nio-transport plugin for NioTransport {es-pull}27949[#27949] (issue: {es-issue}27260[#27260])
Add elasticsearch-nio jar for base nio classes {es-pull}27801[#27801] (issue: {es-issue}27802[#27802])
Add NioGroup for use in different transports {es-pull}27737[#27737] (issue: {es-issue}27260[#27260])
Add read timeouts to http module {es-pull}27713[#27713]
Implement byte array reusage in NioTransport {es-pull}27696[#27696] (issue: {es-issue}27563[#27563])
Introduce resizable inbound byte buffer {es-pull}27551[#27551] (issue: {es-issue}27563[#27563])
Decouple nio constructs from the tcp transport {es-pull}27484[#27484] (issue: {es-issue}27260[#27260])
Remove manual tracking of registered channels {es-pull}27445[#27445] (issue: {es-issue}27260[#27260])
Remove tcp profile from low level nio channel {es-pull}27441[#27441] (issue: {es-issue}27260[#27260])
Decouple ChannelFactory from Tcp classes {es-pull}27286[#27286] (issue: {es-issue}27260[#27260])
Enable TLSv1.3 by default for JDKs with support {es-pull}38103[#38103] (issue: {es-issue}32276[#32276])
Make the type parameter optional when percolating existing documents. {es-pull}39987[#39987] (issue: {es-issue}39963[#39963])
Add support for selecting percolator query candidate matches containing geo_point based queries {es-pull}26040[#26040]
SyncedFlushService.getShardRoutingTable() should use metadata to check for index existence {es-pull}37691[#37691] (issue: {es-issue}33888[#33888])
Make prepare engine step of recovery source non-blocking {es-pull}37573[#37573] (issue: {es-issue}37174[#37174])
Make recovery source send operations non-blocking {es-pull}37503[#37503] (issue: {es-issue}37458[#37458])
Prepare to make send translog of recovery non-blocking {es-pull}37458[#37458] (issue: {es-issue}37291[#37291])
Make finalize step of recovery source non-blocking {es-pull}37388[#37388] (issue: {es-issue}37291[#37291])
Make recovery source partially non-blocking {es-pull}37291[#37291] (issue: {es-issue}36195[#36195])
Do not mutate RecoveryResponse {es-pull}37204[#37204] (issue: {es-issue}37174[#37174])
Don’t block on peer recovery on the target side {es-pull}37076[#37076] (issue: {es-issue}36195[#36195])
Reduce recovery time with compress or secure transport {es-pull}36981[#36981] (issue: {es-issue}33844[#33844])
Translog corruption marker {es-pull}33415[#33415] (issue: {es-issue}31389[#31389])
Do not wait for advancement of checkpoint in recovery {es-pull}39006[#39006] (issues: {es-issue}38949[#38949], {es-issue}39000[#39000])
Add non-X-Pack centric rollup endpoints {es-pull}36383[#36383] (issues: {es-issue}35958[#35958], {es-issue}35962[#35962])
Add more diagnostic stats to job {es-pull}35471[#35471]
Add wait_for_completion option to StopRollupJob API {es-pull}34811[#34811] (issue: {es-issue}34574[#34574])
Replace the TreeMap in the composite aggregation {es-pull}36675[#36675]
Make limit on number of expanded fields configurable {es-pull}35284[#35284] (issues: {es-issue}26541[#26541], {es-issue}34778[#34778])
Search: Simply SingleFieldsVisitor {es-pull}34052[#34052]
Don’t count hits via the collector if the hit count can be computed from index stats. {es-pull}33701[#33701]
Limit the number of concurrent requests per node {es-pull}31206[#31206] (issue: {es-issue}31192[#31192])
Default max concurrent search req. numNodes * 5 {es-pull}31171[#31171] (issues: {es-issue}30783[#30783], {es-issue}30994[#30994])
Change ScriptException status to 400 (bad request) {es-pull}30861[#30861] (issue: {es-issue}12315[#12315])
Change default value to true for transpositions parameter of fuzzy query {es-pull}26901[#26901]
Introducing "took" time (in ms) for _msearch {es-pull}23767[#23767] (issue: {es-issue}23131[#23131])
Add copy constructor to SearchRequest {es-pull}36641[#36641] (issue: {es-issue}32125[#32125])
Add raw sort values to SearchSortValues transport serialization {es-pull}36617[#36617] (issue: {es-issue}32125[#32125])
Add sort and collapse info to SearchHits transport serialization {es-pull}36555[#36555] (issue: {es-issue}32125[#32125])
Add default methods to DocValueFormat {es-pull}36480[#36480]
Respect indices options on _msearch {es-pull}35887[#35887]
Allow efficient can_match phases on frozen indices {es-pull}35431[#35431] (issues: {es-issue}34352[#34352], {es-issue}34357[#34357])
Add a new query type - ScriptScoreQuery {es-pull}34533[#34533] (issues: {es-issue}23850[#23850], {es-issue}27588[#27588], {es-issue}30303[#30303])
Tie break on cluster alias when merging shard search failures {es-pull}38715[#38715] (issue: {es-issue}38672[#38672])
Add finalReduce flag to SearchRequest {es-pull}38104[#38104] (issues: {es-issue}37000[#37000], {es-issue}37838[#37838])
Streamline skip_unavailable handling {es-pull}37672[#37672] (issue: {es-issue}32125[#32125])
Expose sequence number and primary terms in search responses {es-pull}37639[#37639]
Add support for merging multiple search responses into one {es-pull}37566[#37566] (issue: {es-issue}32125[#32125])
Allow field types to optimize phrase prefix queries {es-pull}37436[#37436] (issue: {es-issue}31921[#31921])
Add support for providing absolute start time to SearchRequest {es-pull}37142[#37142] (issue: {es-issue}32125[#32125])
Ensure that local cluster alias is never treated as remote {es-pull}37121[#37121] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997])
[API] spelling: cacheable {es-pull}37047[#37047] (issue: {es-issue}37035[#37035])
Add ability to suggest shard_size on coord node rewrite {es-pull}37017[#37017] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997], {es-issue}37000[#37000])
Skip final reduction if SearchRequest holds a cluster alias {es-pull}37000[#37000] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997])
Add support for local cluster alias to SearchRequest {es-pull}36997[#36997] (issue: {es-issue}32125[#32125])
Use SearchRequest copy constructor in ExpandSearchPhase {es-pull}36772[#36772] (issue: {es-issue}36641[#36641])
Add raw sort values to SearchSortValues transport serialization {es-pull}36617[#36617] (issue: {es-issue}32125[#32125])
Avoid BytesRef’s copying in ScriptDocValues’s Strings {es-pull}29581[#29581] (issue: {es-issue}29567[#29567])
Make credentials mandatory when launching xpack/migrate {es-pull}36197[#36197] (issues: {es-issue}29847[#29847], {es-issue}33972[#33972])
Move CAS operations in TokenService to sequence numbers {es-pull}38311[#38311] (issues: {es-issue}10708[#10708], {es-issue}37872[#37872])
Cleanup construction of interceptors {es-pull}38294[#38294]
Add passphrase support to elasticsearch-keystore {es-pull}37472[#37472] (issue: {es-issue}32691[#32691])
Types removal security index template {es-pull}39705[#39705] (issue: {es-issue}38637[#38637])
Types removal security index template {es-pull}39542[#39542] (issue: {es-issue}38637[#38637])
#31608 Add S3 Setting to Force Path Type Access {es-pull}34721[#34721] (issue: {es-issue}31608[#31608])
Allow Parallel Restore Operations {es-pull}36397[#36397]
Repo Creation out of ClusterStateTask {es-pull}36157[#36157] (issue: {es-issue}9488[#9488])
Add read-only repository verification {es-pull}35731[#35731] (issue: {es-issue}35703[#35703])
RestoreService should update primary terms when restoring shards of existing indices {es-pull}38177[#38177] (issue: {es-issue}33888[#33888])
Allow open indices to be restored {es-pull}37733[#37733]
Create specific exception for when snapshots are in progress {es-pull}37550[#37550] (issue: {es-issue}37541[#37541])
Make Atomic Blob Writes Mandatory {es-pull}37168[#37168] (issues: {es-issue}37011[#37011], {es-issue}37066[#37066])
Speed up HDFS Repository Writes {es-pull}37069[#37069]
Implement Atomic Blob Writes for HDFS Repository {es-pull}37066[#37066] (issue: {es-issue}37011[#37011])
[API] spelling: repositories {es-pull}37053[#37053] (issue: {es-issue}37035[#37035])
Use CancellableThreads to Abort {es-pull}35901[#35901] (issue: {es-issue}21759[#21759])
S3 client encryption {es-pull}30513[#30513] (issues: {es-issue}11128[#11128], {es-issue}16843[#16843])
Mark Deleted Snapshot Directories with Tombstones {es-pull}40228[#40228] (issue: {es-issue}39852[#39852])
Add RemoveCorruptedShardDataCommand {es-pull}32281[#32281] (issues: {es-issue}31389[#31389], {es-issue}32279[#32279])
Add option to force load term dict into memory {es-pull}39741[#39741]
Introduce support for NULL values {es-pull}34573[#34573] (issue: {es-issue}32079[#32079])
Extend the ODBC metric by differentiating between 32 and 64bit platforms {es-pull}36753[#36753] (issue: {es-issue}36740[#36740])
Fix wrong appliance of StackOverflow limit for IN {es-pull}36724[#36724] (issue: {es-issue}36592[#36592])
Introduce NOW/CURRENT_TIMESTAMP function {es-pull}36562[#36562] (issue: {es-issue}36534[#36534])
Move requests' parameters to requests JSON body {es-pull}36149[#36149] (issue: {es-issue}35992[#35992])
Make INTERVAL millis optional {es-pull}36043[#36043] (issue: {es-issue}36032[#36032])
Implement data type verification for conditionals {es-pull}35916[#35916] (issue: {es-issue}35907[#35907])
Implement GREATEST and LEAST functions {es-pull}35879[#35879] (issue: {es-issue}35878[#35878])




    

Implement null safe equality operator <⇒ {es-pull}35873[#35873] (issue: {es-issue}35871[#35871])
SYS COLUMNS returns ODBC specific schema {es-pull}35870[#35870] (issue: {es-issue}35376[#35376])
Polish grammar for intervals {es-pull}35853[#35853]
Add filtering to SYS TYPES {es-pull}35852[#35852] (issue: {es-issue}35342[#35342])
Implement NULLIF(expr1, expr2) function {es-pull}35826[#35826] (issue: {es-issue}35818[#35818])
Lock down JDBC driver {es-pull}35798[#35798] (issue: {es-issue}35437[#35437])
Implement NVL(expr1, expr2) {es-pull}35794[#35794] (issue: {es-issue}35782[#35782])
Implement ISNULL(expr1, expr2) {es-pull}35793[#35793] (issue: {es-issue}35781[#35781])
Implement IFNULL variant of COALESCE {es-pull}35762[#35762] (issue: {es-issue}35749[#35749])
XPack FeatureSet functionality {es-pull}35725[#35725] (issue: {es-issue}34821[#34821])
Perform lazy evaluation of mismatched mappings {es-pull}35676[#35676] (issues: {es-issue}35659[#35659], {es-issue}35675[#35675])
Improve validation of unsupported fields {es-pull}35675[#35675] (issue: {es-issue}35673[#35673])
Move internals from Joda to java.time {es-pull}35649[#35649] (issue: {es-issue}35633[#35633])
Allow look-ahead resolution of aliases for WHERE clause {es-pull}38450[#38450] (issue: {es-issue}29983[#29983])
Implement CURRENT_DATE {es-pull}38175[#38175] (issue: {es-issue}38160[#38160])
Generate relevant error message when grouping functions are not used in GROUP BY {es-pull}38017[#38017] (issue: {es-issue}37952[#37952])
Skip the nested and object field types in case of an ODBC request {es-pull}37948[#37948] (issue: {es-issue}37801[#37801])
Add protocol tests and remove jdbc_type from drivers response {es-pull}37516[#37516] (issues: {es-issue}36635[#36635], {es-issue}36882[#36882])
Remove slightly used meta commands {es-pull}37506[#37506] (issue: {es-issue}37409[#37409])
Describe aliases as views {es-pull}37496[#37496] (issue: {es-issue}37422[#37422])
Make FULL non-reserved keyword in the grammar {es-pull}37377[#37377] (issue: {es-issue}37376[#37376])
Use declared source for error messages {es-pull}37161[#37161]
Improve error message when unable to translate to ES query DSL {es-pull}37129[#37129] (issue: {es-issue}37040[#37040])
[API] spelling: subtract {es-pull}37055[#37055] (issue: {es-issue}37035[#37035])
[API] spelling: similar {es-pull}37054[#37054] (issue: {es-issue}37035[#37035])
[API] spelling: input {es-pull}37048[#37048] (issue: {es-issue}37035[#37035])
Enhance message for PERCENTILE[_RANK] with field as 2nd arg {es-pull}36933[#36933] (issue: {es-issue}36903[#36903])
Preserve original source for each expression {es-pull}36912[#36912] (issue: {es-issue}36894[#36894])
Extend the ODBC metric by differentiating between 32 and 64bit platforms {es-pull}36753[#36753] (issue: {es-issue}36740[#36740])
Fix wrong appliance of StackOverflow limit for IN {es-pull}36724[#36724] (issue: {es-issue}36592[#36592])
Enhance checks for inexact fields {es-pull}39427[#39427] (issue: {es-issue}38501[#38501])
Change the default precision for CURRENT_TIMESTAMP function {es-pull}39391[#39391] (issue: {es-issue}39288[#39288])
Add "fuzziness" option to QUERY and MATCH function predicates {es-pull}40529[#40529] (issue: {es-issue}40495[#40495])
Add "validate.properties" property to JDBC’s allowed list of settings {es-pull}39050[#39050] (issue: {es-issue}38068[#38068])
Periodically try to reassign unassigned persistent tasks {es-pull}36069[#36069] (issue: {es-issue}35792[#35792])
Only require task permissions {es-pull}35667[#35667] (issue: {es-issue}35573[#35573])
Retry if task can’t be written {es-pull}35054[#35054] (issue: {es-issue}33764[#33764])
Reconfigure cluster as its membership changes {es-pull}34592[#34592] (issue: {es-issue}33924[#33924])
Fail fast on disconnects {es-pull}34503[#34503]
Add storage-layer disruptions to CoordinatorTests {es-pull}34347[#34347]
Add low-level bootstrap implementation {es-pull}34345[#34345]
Gather votes from all nodes {es-pull}34335[#34335]
Add Cluster State Applier {es-pull}34257[#34257]
Add safety phase to CoordinatorTests {es-pull}34241[#34241]
Integrate FollowerChecker with Coordinator {es-pull}34075[#34075]
Integrate LeaderChecker with Coordinator {es-pull}34049[#34049]
Trigger join when active master detected {es-pull}34008[#34008]
Update PeerFinder term on term bump {es-pull}33992[#33992]
Calculate optimal cluster configuration {es-pull}33924[#33924]
Introduce FollowersChecker {es-pull}33917[#33917]
Integrate publication pipeline into Coordinator {es-pull}33771[#33771]
Add DisruptableMockTransport {es-pull}33713[#33713]
Implement basic cluster formation {es-pull}33668[#33668]
Introduce LeaderChecker {es-pull}33024[#33024]
Add leader-side join handling logic {es-pull}33013[#33013]
Add PeerFinder#onFoundPeersUpdated {es-pull}32939[#32939]
Introduce PreVoteCollector {es-pull}32847[#32847]
Introduce ElectionScheduler {es-pull}32846[#32846]
Introduce ElectionScheduler {es-pull}32709[#32709]
Add HandshakingTransportAddressConnector {es-pull}32643[#32643] (issue: {es-issue}32246[#32246])
Add UnicastConfiguredHostsResolver {es-pull}32642[#32642] (issue: {es-issue}32246[#32246])
Cluster state publication pipeline {es-pull}32584[#32584] (issue: {es-issue}32006[#32006])
Introduce gossip-like discovery of master nodes {es-pull}32246[#32246]
Add core coordination algorithm for cluster state publishing  {es-pull}32171[#32171] (issue: {es-issue}32006[#32006])
Add term and config to cluster state {es-pull}32100[#32100] (issue: {es-issue}32006[#32006])
Add discovery types to cluster stats {es-pull}36442[#36442]
Introduce zen2 discovery type {es-pull}36298[#36298]
Persist cluster states the old way on non-master-eligible nodes {es-pull}36247[#36247] (issue: {es-issue}3[#3])
Storage layer WriteStateException propagation {es-pull}36052[#36052]
Implement Tombstone REST APIs {es-pull}36007[#36007]
Update default for USE_ZEN2 to true {es-pull}35998[#35998]
Add warning if cluster fails to form fast enough {es-pull}35993[#35993]
Allow Setting a List of Bootstrap Nodes to Wait for {es-pull}35847[#35847]
VotingTombstone class {es-pull}35832[#35832]
PersistedState interface implementation {es-pull}35819[#35819]
Support rolling upgrades from Zen1 {es-pull}35737[#35737]
Add lag detector {es-pull}35685[#35685]
Move ClusterState fields to be persisted to ClusterState.Metadata {es-pull}35625[#35625]
Introduce ClusterBootstrapService {es-pull}35488[#35488]
Introduce vote withdrawal {es-pull}35446[#35446]
Add basic Zen1 transport-level BWC {es-pull}35443[#35443]
Add elasticsearch-node detach-cluster tool {es-pull}37979[#37979]
Deprecate minimum_master_nodes {es-pull}37868[#37868]
Step down as master when configured out of voting configuration {es-pull}37802[#37802] (issue: {es-issue}37712[#37712])
Enforce cluster UUIDs {es-pull}37775[#37775]
Bubble exceptions up in ClusterApplierService {es-pull}37729[#37729]
Use m_m_nodes from Zen1 master for Zen2 bootstrap {es-pull}37701[#37701]
Add tool elasticsearch-node unsafe-bootstrap {es-pull}37696[#37696]
Report terms and version if cluster does not form {es-pull}37473[#37473]
Bootstrap a Zen2 cluster once quorum is discovered {es-pull}37463[#37463]
Zen2: Add join validation {es-pull}37203[#37203]
Publish cluster states in chunks {es-pull}36973[#36973]
Fix InternalAutoDateHistogram reproducible failure {es-pull}32723[#32723] (issue: {es-issue}32215[#32215])
fix MultiValuesSourceFieldConfig toXContent {es-pull}36525[#36525] (issue: {es-issue}36474[#36474])
Cache the score of the parent document in the nested agg {es-pull}36019[#36019] (issues: {es-issue}34555[#34555], {es-issue}35985[#35985])
Correct implemented interface of ParsedReverseNested {es-pull}35455[#35455] (issue: {es-issue}35449[#35449])
Handle IndexOrDocValuesQuery in composite aggregation {es-pull}35392[#35392]
Don’t load global ordinals with the map execution_hint {es-pull}37833[#37833] (issue: {es-issue}37705[#37705])
Issue #37303 - Invalid variance fix {es-pull}37384[#37384] (issue: {es-issue}37303[#37303])
Skip sibling pipeline aggregators reduction during non-final reduce {es-pull}40101[#40101] (issue: {es-issue}40059[#40059])
Extend nextDoc to delegate to the wrapped doc-value iterator for date_nanos {es-pull}39176[#39176] (issue: {es-issue}39107[#39107])
Only create MatrixStatsResults on final reduction {es-pull}38130[#38130] (issue: {es-issue}37587[#37587])
Close #26771: beider_morse phonetic encoder failure when languageset unspecified  {es-pull}26848[#26848] (issue: {es-issue}26771[#26771])
Fix PreConfiguredTokenFilters getSynonymFilter() implementations {es-pull}38839[#38839] (issue: {es-issue}38793[#38793])
Fix IndexAuditTrail rolling restart on rollover edge {es-pull}35988[#35988] (issue: {es-issue}33867[#33867])
Fix NPE in Logfile Audit Filter {es-pull}38120[#38120] (issue: {es-issue}38097[#38097])
LoggingAuditTrail correctly handle ReplicatedWriteRequest {es-pull}39925[#39925] (issue: {es-issue}39555[#39555])
Fix kerberos setting registration {es-pull}35986[#35986] (issues: {es-issue}30241[#30241], {es-issue}35942[#35942])
Add support for Kerberos V5 Oid {es-pull}35764[#35764] (issue: {es-issue}34763[#34763])
Enhance parsing of StatusCode in SAML Responses {es-pull}38628[#38628]
Limit token expiry to 1 hour maximum {es-pull}38244[#38244]
Fix expired token message in Exception header {es-pull}37196[#37196]
Fix NPE in CachingUsernamePasswordRealm {es-pull}36953[#36953] (issue: {es-issue}36951[#36951])
Allow non super users to create API keys {es-pull}40028[#40028] (issue: {es-issue}40029[#40029])
Use consistent view of realms for authentication {es-pull}38815[#38815] (issue: {es-issue}30301[#30301])
Correct authenticate response for API key {es-pull}39684[#39684]
Fix security index auto-create and state recovery race {es-pull}39582[#39582]
Fix jdbc jar pom to not include deps {es-pull}36036[#36036] (issue: {es-issue}32014[#32014])
Fix official plugins list {es-pull}35661[#35661] (issue: {es-issue}35623[#35623])
AutoFollowCoordinator should tolerate that auto follow patterns may be removed {es-pull}35945[#35945] (issue: {es-issue}35937[#35937])
Only auto follow indices when all primary shards have started {es-pull}35814[#35814] (issue: {es-issue}35480[#35480])
Avoid NPE in follower stats when no tasks metadata {es-pull}35802[#35802]
Fix the names of CCR stats endpoints in usage API {es-pull}35438[#35438]
Prevent CCR recovery from missing documents {es-pull}38237[#38237]
Fix file reading in ccr restore service {es-pull}38117[#38117]
Correct argument names in update mapping/settings from leader {es-pull}38063[#38063]
Ensure changes requests return the latest mapping version {es-pull}37633[#37633]
Do not set fatal exception when shard follow task is stopped. {es-pull}37603[#37603]
Add fatal_exception field for ccr stats in monitoring mapping {es-pull}37563[#37563]
Do not add index event listener if CCR disabled {es-pull}37432[#37432]
When removing an AutoFollower also mark it as removed. {es-pull}37402[#37402] (issue: {es-issue}36761[#36761])
Make shard follow tasks more resilient for restarts {es-pull}37239[#37239] (issue: {es-issue}37231[#37231])
Resume follow Api should not require a request body {es-pull}37217[#37217] (issue: {es-issue}37022[#37022])
Report error if auto follower tries auto follow a leader index with soft deletes disabled {es-pull}36886[#36886] (issue: {es-issue}33007[#33007])
Remote cluster license checker and no license info. {es-pull}36837[#36837] (issue: {es-issue}36815[#36815])
Make CCR resilient against missing remote cluster connections {es-pull}36682[#36682] (issues: {es-issue}36255[#36255], {es-issue}36667[#36667])
AutoFollowCoordinator and follower index already created {es-pull}36540[#36540] (issue: {es-issue}33007[#33007])
Safe publication of AutoFollowCoordinator {es-pull}40153[#40153] (issue: {es-issue}38560[#38560])
Enable reading auto-follow patterns from x-content {es-pull}40130[#40130] (issue: {es-issue}40128[#40128])
Stop auto-followers on shutdown {es-pull}40124[#40124]
Protect against the leader index being removed {es-pull}39351[#39351] (issue: {es-issue}39308[#39308])
Handle the fact that ShardStats instance may have no commit or seqno stats {es-pull}38782[#38782] (issue: {es-issue}38779[#38779])
Fix LocalIndexFollowingIT#testRemoveRemoteConnection() test {es-pull}38709[#38709] (issue: {es-issue}38695[#38695])
Fix shard follow task startup error handling {es-pull}39053[#39053] (issue: {es-issue}38779[#38779])
Filter out upgraded version index settings when starting index following {es-pull}38838[#38838] (issue: {es-issue}38835[#38835])
Fix CompositeBytesReference#slice to not throw AIOOBE with legal offsets. {es-pull}35955[#35955] (issue: {es-issue}35950[#35950])
Suppress CachedTimeThread in hot threads output {es-pull}35558[#35558] (issue: {es-issue}23175[#23175])
Upgrade to Joda 2.10.1 {es-pull}35410[#35410] (issue: {es-issue}33749[#33749])
Do not perform cleanup if Manifest write fails with dirty exception {es-pull}40519[#40519] (issue: {es-issue}39077[#39077])
Cache compressed cluster state size {es-pull}39827[#39827] (issue: {es-issue}39806[#39806])
Drop node if asymmetrically partitioned from master {es-pull}39598[#39598]
Fixing the custom object serialization bug in diffable utils. {es-pull}39544[#39544]
Clean GatewayAllocator when stepping down as master {es-pull}38885[#38885]
Combine the execution of an exclusive replica operation with primary term update {es-pull}36116[#36116] (issue: {es-issue}35850[#35850])
ActiveShardCount should not fail when closing the index {es-pull}35936[#35936]
TransportVerifyShardBeforeCloseAction should force a flush {es-pull}38401[#38401] (issues: {es-issue}33888[#33888], {es-issue}37961[#37961])
Fix limit on retaining sequence number {es-pull}37992[#37992] (issue: {es-issue}37165[#37165])
Close Index API should force a flush if a sync is needed {es-pull}37961[#37961] (issues: {es-issue}33888[#33888], {es-issue}37426[#37426])
Force Refresh Listeners when Acquiring all Operation Permits {es-pull}36835[#36835]
Replaced the word 'shards' with 'replicas' in an error message. (#36234) {es-pull}36275[#36275] (issue: {es-issue}36234[#36234])
Ignore waitForActiveShards when syncing leases {es-pull}39224[#39224] (issue: {es-issue}39089[#39089])
Fix synchronization in LocalCheckpointTracker#contains {es-pull}38755[#38755] (issues: {es-issue}33871[#33871], {es-issue}38633[#38633])
Enforce retention leases require soft deletes {es-pull}39922[#39922] (issue: {es-issue}39914[#39914])
Treat TransportService stopped error as node is closing {es-pull}39800[#39800] (issue: {es-issue}39584[#39584])
Use cause to determine if node with primary is closing {es-pull}39723[#39723] (issue: {es-issue}39584[#39584])
Don’t ack if unable to remove failing replica {es-pull}39584[#39584] (issue: {es-issue}39467[#39467])
Fix NPE on Stale Index in IndicesService {es-pull}38891[#38891] (issue: {es-issue}38845[#38845])
Set Lucene version upon index creation. {es-pull}36038[#36038] (issue: {es-issue}33826[#33826])
Wrap can_match reader with ElasticsearchDirectoryReader {es-pull}35857[#35857]
Copy checkpoint atomically when rolling generation {es-pull}35407[#35407]
Subclass NIOFSDirectory instead of using FileSwitchDirectory {es-pull}37140[#37140] (issues: {es-issue}36668[#36668], {es-issue}37111[#37111])
Bubble up exception when processing NoOp {es-pull}39338[#39338] (issue: {es-issue}38898[#38898])
ReadOnlyEngine should update translog recovery state information {es-pull}39238[#39238]
Advance max_seq_no before add operation to Lucene {es-pull}38879[#38879] (issue: {es-issue}31629[#31629])
Preserve ILM operation mode when creating new lifecycles {es-pull}38134[#38134] (issues: {es-issue}38229[#38229], {es-issue}38230[#38230])
Retry ILM steps that fail due to SnapshotInProgressException {es-pull}37624[#37624] (issues: {es-issue}37541[#37541], {es-issue}37552[#37552])
Remove indexing_complete when removing policy {es-pull}36620[#36620]
Handle failure to release retention leases in ILM {es-pull}39281[#39281] (issue: {es-issue}39181[#39181])
Correct ILM metadata minimum compatibility version {es-pull}40569[#40569] (issue: {es-issue}40565[#40565])
Handle null retention leases in WaitForNoFollowersStep {es-pull}40477[#40477]
Allow ILM to stop if indices have nonexistent policies {es-pull}40820[#40820] (issue: {es-issue}40824[#40824])
Validate top-level keys for create index request (#23755) {es-pull}23869[#23869] (issue: {es-issue}23755[#23755])
Reject delete index requests with a body {es-pull}37501[#37501] (issue: {es-issue}8217[#8217])
Fix duplicate phrase in shrink/split error message {es-pull}36734[#36734] (issue: {es-issue}36729[#36729])
Get Aliases with wildcard exclusion expression {es-pull}34230[#34230] (issues: {es-issue}33518[#33518], {es-issue}33805[#33805], {es-issue}34144[#34144])
Support unknown fields in ingest pipeline map configuration {es-pull}38352[#38352] (issue: {es-issue}36938[#36938])
Ingest node - user_agent, move device parsing to an object {es-pull}38115[#38115] (issues: {es-issue}37329[#37329], {es-issue}38094[#38094])
Fix on_failure with Drop processor {es-pull}36686[#36686] (issue: {es-issue}36151[#36151])
Support default pipelines + bulk upserts {es-pull}36618[#36618] (issue: {es-issue}36219[#36219])
Ingest ingest then create index {es-pull}39607[#39607] (issues: {es-issue}32758[#32758], {es-issue}32786[#32786], {es-issue}36545[#36545])
Update IndexTemplateMetadata to allow unknown fields {es-pull}38448[#38448] (issue: {es-issue}36938[#36938])




    

if_seq_no and if_primary_term parameters aren’t wired correctly in REST Client’s CRUD API {es-pull}38411[#38411]
Update Rollup Caps to allow unknown fields {es-pull}38339[#38339] (issue: {es-issue}36938[#36938])
Fix ILM explain response to allow unknown fields {es-pull}38054[#38054] (issue: {es-issue}36938[#36938])
Fix ILM status to allow unknown fields {es-pull}38043[#38043] (issue: {es-issue}36938[#36938])
Fix ILM Lifecycle Policy to allow unknown fields {es-pull}38041[#38041] (issue: {es-issue}36938[#36938])
Update authenticate to allow unknown fields {es-pull}37713[#37713] (issue: {es-issue}36938[#36938])
Update verify repository to allow unknown fields {es-pull}37619[#37619] (issue: {es-issue}36938[#36938])
Update get users to allow unknown fields {es-pull}37593[#37593] (issue: {es-issue}36938[#36938])
Update Execute Watch to allow unknown fields {es-pull}37498[#37498] (issue: {es-issue}36938[#36938])
Update Put Watch to allow unknown fields {es-pull}37494[#37494] (issue: {es-issue}36938[#36938])
Update Delete Watch to allow unknown fields {es-pull}37435[#37435] (issue: {es-issue}36938[#36938])
Fix rest reindex test for IPv4 addresses {es-pull}37310[#37310]
Fix weighted_avg parser not found for RestHighLevelClient {es-pull}37027[#37027] (issue: {es-issue}36861[#36861])
Remove I/O pool blocking sniffing call from onFailure callback, add some logic around host exclusion {es-pull}27985[#27985] (issue: {es-issue}27984[#27984])
Fix potential IllegalCapacityException in LLRC when selecting nodes {es-pull}37821[#37821]
Allow built-in monitoring_user role to call GET _xpack API {es-pull}38060[#38060] (issue: {es-issue}37970[#37970])
Don’t emit deprecation warnings on calls to the monitoring bulk API. {es-pull}39805[#39805] (issue: {es-issue}39336[#39336])
Support merge nested Map in list for JIRA configurations {es-pull}37634[#37634] (issue: {es-issue}30068[#30068])
Watcher accounts constructed lazily {es-pull}36656[#36656]
Ensures watch definitions are valid json {es-pull}30692[#30692] (issue: {es-issue}29746[#29746])
Use non-ILM template setting up watch history template & ILM disabled {es-pull}39325[#39325] (issue: {es-issue}38805[#38805])
Only flush Watcher’s bulk processor if Watcher is enabled {es-pull}38803[#38803] (issue: {es-issue}38798[#38798])
Fix Watcher stats class cast exception {es-pull}39821[#39821] (issue: {es-issue}39780[#39780])
Use any index specified by .watches for Watcher {es-pull}39541[#39541] (issue: {es-issue}39478[#39478])
Resolve concurrency with watcher trigger service {es-pull}39092[#39092] (issue: {es-issue}39087[#39087])
Metric on watcher stats is a list not an enum {es-pull}39114[#39114]
More robust handling of ignore_malformed in geoshape parsing {es-pull}35603[#35603] (issues: {es-issue}34047[#34047], {es-issue}34498[#34498])
Better handling of malformed geo_points {es-pull}35554[#35554] (issue: {es-issue}35419[#35419])
Enables coerce support in WKT polygon parser {es-pull}35414[#35414] (issue: {es-issue}35059[#35059])
Fix GeoHash PrefixTree BWC {es-pull}38584[#38584] (issue: {es-issue}38494[#38494])
Do not normalize the longitude with value -180 for Lucene shapes {es-pull}37299[#37299] (issue: {es-issue}37297[#37297])
Geo Point parse error fix {es-pull}40447[#40447] (issue: {es-issue}17617[#17617])
Ensure shard is refreshed once it’s inactive {es-pull}27559[#27559] (issue: {es-issue}27500[#27500])
Bubble-up exceptions from scheduler {es-pull}38317[#38317] (issue: {es-issue}38014[#38014])
Revert back to joda’s multi date formatters {es-pull}36814[#36814] (issues: {es-issue}36447[#36447], {es-issue}36602[#36602])
Propagate Errors in executors to uncaught exception handler {es-pull}36137[#36137] (issue: {es-issue}28667[#28667])
Correct name of basic_date_time_no_millis {es-pull}39367[#39367]
Allow single digit milliseconds in strict date parsing {es-pull}40676[#40676] (issue: {es-issue}40403[#40403])
Parse composite patterns using ClassicFormat.parseObject {es-pull}40100[#40100] (issue: {es-issue}39916[#39916])
Bat scripts to work with JAVA_HOME with parantheses {es-pull}39712[#39712] (issues: {es-issue}30606[#30606], {es-issue}33405[#33405], {es-issue}38578[#38578], {es-issue}38624[#38624])
Change licence expiration date pattern {es-pull}39681[#39681] (issue: {es-issue}39136[#39136])
Fix DateFormatters.parseMillis when no timezone is given {es-pull}39100[#39100] (issue: {es-issue}39067[#39067])
Don’t close caches while there might still be in-flight requests. {es-pull}38958[#38958] (issue: {es-issue}37117[#37117])
Allow single digit milliseconds in strict date parsing {es-pull}40676[#40676] (issue: {es-issue}40403[#40403])
Packaging: Update marker used to allow ELASTIC_PASSWORD {es-pull}37243[#37243] (issue: {es-issue}37240[#37240])
Remove permission editing in postinst {es-pull}37242[#37242] (issue: {es-issue}37143[#37143])
Some elasticsearch-cli tools could not be run not from ES_HOME {es-pull}39937[#39937]
Obsolete pre 7.0 noarch package in rpm {es-pull}39472[#39472] (issue: {es-issue}39414[#39414])
Suppress error message when /proc/sys/vm/max_map_count is not exists. {es-pull}35933[#35933]
Use TAR instead of DOCKER build type before 6.7.0 {es-pull}40723[#40723] (issues: {es-issue}39378[#39378], {es-issue}40511[#40511])
Source additional files correctly in elasticsearch-cli {es-pull}40890[#40890] (issue: {es-issue}40889[#40889])
Reject all requests that have an unconsumed body {es-pull}37504[#37504] (issues: {es-issue}30792[#30792], {es-issue}37501[#37501], {es-issue}8217[#8217])
Fix #38623 remove xpack namespace REST API {es-pull}38625[#38625]
Remove the "xpack" namespace from the REST API {es-pull}38623[#38623]
Update spec files that erroneously documented parts as optional  {es-pull}39122[#39122]
ilm.explain_lifecycle documents human again {es-pull}39113[#39113]
Index on rollup.rollup_search.json is a list {es-pull}39097[#39097]
Remove version read/write logic in Verify Response {es-pull}30879[#30879] (issue: {es-issue}30807[#30807])
Enable muted Repository test {es-pull}30875[#30875] (issue: {es-issue}30807[#30807])
Bad regex in CORS settings should throw a nicer error {es-pull}29108[#29108]
Fix duplicate phrase in shrink/split error message {es-pull}36734[#36734] (issue: {es-issue}36729[#36729])
Raise a 404 exception when document source is not found (#33384) {es-pull}34083[#34083] (issue: {es-issue}33384[#33384])
Fix on_failure with Drop processor {es-pull}36686[#36686] (issue: {es-issue}36151[#36151])
Support default pipelines + bulk upserts {es-pull}36618[#36618] (issue: {es-issue}36219[#36219])
Support default pipeline through an alias {es-pull}36231[#36231] (issue: {es-issue}35817[#35817])
Update versions for start_trial after backport {es-pull}30218[#30218] (issue: {es-issue}30135[#30135])
Do not serialize basic license exp in x-pack info {es-pull}30848[#30848]
Update versions for start_trial after backport {es-pull}30218[#30218] (issue: {es-issue}30135[#30135])
Prevent stack overflow while copying ML jobs and datafeeds {es-pull}36370[#36370] (issue: {es-issue}36360[#36360])
Adjust file structure finder parser config {es-pull}35935[#35935]
Fix find_file_structure NPE with should_trim_fields {es-pull}35465[#35465] (issue: {es-issue}35462[#35462])
Prevent notifications being created on deletion of a non existent job {es-pull}35337[#35337] (issues: {es-issue}34058[#34058], {es-issue}35336[#35336])
Clear Job#finished_time when it is opened (#32605) {es-pull}32755[#32755]
Fix thread leak when waiting for job flush (#32196) {es-pull}32541[#32541] (issue: {es-issue}32196[#32196])
Fix CPoissonMeanConjugate sampling error. {ml-pull}335[#335]
Report index unavailable instead of waiting for lazy node {es-pull}38423[#38423]
Fix error race condition on stop _all datafeeds and close _all jobs {es-pull}38113[#38113] (issue: {es-issue}37959[#37959])
Update ML results mappings on process start {es-pull}37706[#37706] (issue: {es-issue}37607[#37607])
Prevent submit after autodetect worker is stopped {es-pull}37700[#37700] (issue: {es-issue}37108[#37108])
Fix ML datafeed CCS with wildcarded cluster name {es-pull}37470[#37470] (issue: {es-issue}36228[#36228])
Update error message for process update {es-pull}37363[#37363]
Wait for autodetect to be ready in the datafeed {es-pull}37349[#37349] (issues: {es-issue}36810[#36810], {es-issue}37227[#37227])
Stop datafeeds running when their jobs are stale {es-pull}37227[#37227] (issue: {es-issue}36810[#36810])
Order GET job stats response by job id {es-pull}36841[#36841] (issue: {es-issue}36683[#36683])
Make GetJobStats work with arbitrary wildcards and groups {es-pull}36683[#36683] (issue: {es-issue}34745[#34745])
Fix datafeed skipping first bucket after lookback when aggs are … {es-pull}39859[#39859] (issue: {es-issue}39842[#39842])
Refactoring lazy query and agg parsing {es-pull}39776[#39776] (issue: {es-issue}39528[#39528])
Stop the ML memory tracker before closing node {es-pull}39111[#39111] (issue: {es-issue}37117[#37117])
Scrolling datafeed should clear scroll contexts on error {es-pull}40773[#40773] (issue: {es-issue}40772[#40772])
Treat put-mapping calls with _doc as a top-level key as typed calls. {es-pull}38032[#38032]
Correct deprec log in RestGetFieldMappingAction {es-pull}37843[#37843] (issue: {es-issue}37667[#37667])
Restore a noop _all metadata field for 6x indices {es-pull}37808[#37808] (issue: {es-issue}37429[#37429])
Make sure PutMappingRequest accepts content types other than JSON. {es-pull}37720[#37720]
Make sure to use the resolved type in DocumentMapperService#extractMappings. {es-pull}37451[#37451] (issue: {es-issue}36811[#36811])
Improve Precision for scaled_float {es-pull}37169[#37169] (issue: {es-issue}32570[#32570])
Make sure to accept empty unnested mappings in create index requests. {es-pull}37089[#37089]
Stop automatically nesting mappings in index creation requests. {es-pull}36924[#36924]
Rewrite SourceToParse with resolved docType {es-pull}36921[#36921] (issues: {es-issue}35790[#35790], {es-issue}36769[#36769])
Optimise rejection of out-of-range long values {es-pull}40325[#40325] (issues: {es-issue}26137[#26137], {es-issue}40323[#40323])
Make sure to reject mappings with type _doc when include_type_name is false. {es-pull}38270[#38270] (issue: {es-issue}38266[#38266])
Adjust SSLDriver behavior for JDK11 changes {es-pull}32145[#32145] (issues: {es-issue}32122[#32122], {es-issue}32144[#32144])
Netty4SizeHeaderFrameDecoder error {es-pull}31057[#31057]
Fix memory leak in http pipelining {es-pull}30815[#30815] (issue: {es-issue}30801[#30801])
Fix issue with finishing handshake in ssl driver {es-pull}30580[#30580]
Do not resolve addresses in remote connection info {es-pull}36671[#36671] (issue: {es-issue}35658[#35658])
Always compress based on the settings {es-pull}36522[#36522] (issue: {es-issue}36399[#36399])
http.publish_host Should Contain CNAME {es-pull}32806[#32806] (issue: {es-issue}22029[#22029])
Adjust SSLDriver behavior for JDK11 changes {es-pull}32145[#32145] (issues: {es-issue}32122[#32122], {es-issue}32144[#32144])
Add TRACE, CONNECT, and PATCH http methods {es-pull}31035[#31035] (issue: {es-issue}31017[#31017])
Transport client: Don’t validate node in handshake {es-pull}30737[#30737] (issue: {es-issue}30141[#30141])
Fix issue with finishing handshake in ssl driver {es-pull}30580[#30580]
Remove potential nio selector leak {es-pull}27825[#27825]
Fix issue where the incorrect buffers are written {es-pull}27695[#27695] (issue: {es-issue}27551[#27551])
Do not set SO_LINGER on server channels {es-pull}26997[#26997]
Do not set SO_LINGER to 0 when not shutting down {es-pull}26871[#26871] (issue: {es-issue}26764[#26764])
Release pipelined http responses on close {es-pull}26226[#26226]
Reload SSL context on file change for LDAP {es-pull}36937[#36937] (issues: {es-issue}30509[#30509], {es-issue}36923[#36923])
Do not resolve addresses in remote connection info {es-pull}36671[#36671] (issue: {es-issue}35658[#35658])
Fix error message when package install fails due to missing Java {es-pull}36077[#36077] (issue: {es-issue}31845[#31845])
Add missing entries to conffiles  {es-pull}35810[#35810] (issue: {es-issue}35691[#35691])
Create retention leases file during recovery {es-pull}39359[#39359] (issue: {es-issue}37165[#37165])
Recover peers from translog, ignoring soft deletes {es-pull}38904[#38904] (issue: {es-issue}37165[#37165])
Retain history for peer recovery using leases {es-pull}38855[#38855]
Resync should not send operations without sequence number {es-pull}40433[#40433]
Properly support no-offset date formatting {es-pull}36316[#36316] (issue: {es-issue}36306[#36306])
[Painless] Generate Bridge Methods {es-pull}36097[#36097]
Fix serialization bug in painless execute api request {es-pull}36075[#36075] (issue: {es-issue}36050[#36050])
Actually add joda time back to whitelist {es-pull}35965[#35965] (issue: {es-issue}35915[#35915])
Add back joda to whitelist {es-pull}35915[#35915] (issue: {es-issue}35913[#35913])
Ensure realtime _get and _termvectors don’t run on the network thread {es-pull}33814[#33814] (issue: {es-issue}27500[#27500])
[bug] fuzziness custom auto {es-pull}33462[#33462] (issue: {es-issue}33454[#33454])
Fix inner hits retrieval when stored fields are disabled (none) {es-pull}33018[#33018] (issue: {es-issue}32941[#32941])
Set maxScore for empty TopDocs to Nan rather than 0 {es-pull}32938[#32938]
Handle leniency for cross_fields type in multi_match query {es-pull}27045[#27045] (issue: {es-issue}23210[#23210])
Raise IllegalArgumentException instead if query validation failed {es-pull}26811[#26811] (issue: {es-issue}26799[#26799])
Inner hits fail to propagate doc-value format. {es-pull}36310[#36310]
Fix custom AUTO issue with Fuzziness#toXContent {es-pull}35807[#35807] (issue: {es-issue}33462[#33462])
Fix analyzed prefix query in query_string {es-pull}35756[#35756] (issue: {es-issue}31702[#31702])
Fix problem with MatchNoDocsQuery in disjunction queries {es-pull}35726[#35726] (issue: {es-issue}34708[#34708])
Fix phrase_slop in query_string query {es-pull}35533[#35533] (issue: {es-issue}35125[#35125])
Add a More Like This query routing requirement check (#29678) {es-pull}33974[#33974]
Look up connection using the right cluster alias when releasing contexts {es-pull}38570[#38570]
Fix fetch source option in expand search phase {es-pull}37908[#37908] (issue: {es-issue}23829[#23829])
Change rational to saturation in script_score {es-pull}37766[#37766] (issue: {es-issue}37714[#37714])
Throw if two inner_hits have the same name {es-pull}37645[#37645] (issue: {es-issue}37584[#37584])
Ensure either success or failure path for SearchOperationListener is called {es-pull}37467[#37467] (issue: {es-issue}37185[#37185])
query_string should use indexed prefixes {es-pull}36895[#36895]
Avoid duplicate types deprecation messages in search-related APIs. {es-pull}36802[#36802]
Serialize top-level pipeline aggs as part of InternalAggregations {es-pull}40177[#40177] (issues: {es-issue}40059[#40059], {es-issue}40101[#40101])
CCS: Skip empty search hits when minimizing round-trips {es-pull}40098[#40098] (issues: {es-issue}32125[#32125], {es-issue}40067[#40067])
CCS: Disable minimizing round-trips when dfs is requested {es-pull}40044[#40044] (issue: {es-issue}32125[#32125])
Fix Fuzziness#asDistance(String) {es-pull}39643[#39643] (issue: {es-issue}39614[#39614])
Fix alias resolution runtime complexity. {es-pull}40263[#40263] (issue: {es-issue}40248[#40248])
Remove license state listeners on closeables {es-pull}36308[#36308] (issues: {es-issue}33328[#33328], {es-issue}35627[#35627], {es-issue}35628[#35628])
Fix exit code for Security CLI tools  {es-pull}37956[#37956] (issue: {es-issue}37841[#37841])
Fix potential NPE in UsersTool {es-pull}37660[#37660]
Remove dynamic objects from security index {es-pull}40499[#40499] (issue: {es-issue}35460[#35460])
Fix libs:ssl-config project setup {es-pull}39074[#39074]
Do not create the missing index when invoking getRole {es-pull}39039[#39039]
Upgrade GCS Dependencies to 1.55.0 {es-pull}36634[#36634] (issues: {es-issue}35229[#35229], {es-issue}35459[#35459])
Improve Resilience SnapshotShardService {es-pull}36113[#36113] (issue: {es-issue}32265[#32265])
Keep SnapshotsInProgress State in Sync with Routing Table {es-pull}35710[#35710]
Ensure that gcs client creation is privileged {es-pull}25938[#25938] (issue: {es-issue}25932[#25932])
Make calls to CloudBlobContainer#exists privileged {es-pull}25937[#25937] (issue: {es-issue}25931[#25931])
Fix Concurrent Snapshot Ending And Stabilize Snapshot Finalization {es-pull}38368[#38368] (issue: {es-issue}38226[#38226])
Fix Two Races that Lead to Stuck Snapshots {es-pull}37686[#37686] (issues: {es-issue}32265[#32265], {es-issue}32348[#32348])
Fix Race in Concurrent Snapshot Delete and Create {es-pull}37612[#37612] (issue: {es-issue}37581[#37581])
Streamline S3 Repository- and Client-Settings {es-pull}37393[#37393]
Blob store compression fix {es-pull}39073[#39073]
Fix translation of LIKE/RLIKE keywords {es-pull}36672[#36672] (issues: {es-issue}36039[#36039], {es-issue}36584[#36584])
Scripting support for casting functions CAST and CONVERT {es-pull}36640[#36640] (issue: {es-issue}36061[#36061])
Fix translation to painless for conditionals {es-pull}36636[#36636] (issue: {es-issue}36631[#36631])
Concat should be always not nullable {es-pull}36601[#36601] (issue: {es-issue}36169[#36169])
Fix MOD() for long and integer arguments {es-pull}36599[#36599] (issue: {es-issue}36364[#36364])




    

Fix issue with complex HAVING and GROUP BY ordinal {es-pull}36594[#36594] (issue: {es-issue}36059[#36059])
Be lenient for tests involving comparison to H2 but strict for csv spec tests {es-pull}36498[#36498] (issue: {es-issue}36483[#36483])
Non ISO 8601 versions of DAY_OF_WEEK and WEEK_OF_YEAR functions {es-pull}36358[#36358] (issue: {es-issue}36263[#36263])
Do not ignore all fields whose names start with underscore {es-pull}36214[#36214] (issue: {es-issue}36206[#36206])
Fix issue with wrong data type for scripted Grouping keys {es-pull}35969[#35969] (issue: {es-issue}35662[#35662])
Fix translation of math functions to painless {es-pull}35910[#35910] (issue: {es-issue}35654[#35654])
Fix jdbc jar to include deps {es-pull}35602[#35602]
Fix query translation for scripted queries {es-pull}35408[#35408] (issue: {es-issue}35232[#35232])
Clear the cursor if nested inner hits are enough to fulfill the query required limits {es-pull}35398[#35398] (issue: {es-issue}35176[#35176])
Introduce IsNull node to simplify expressions {es-pull}35206[#35206] (issues: {es-issue}34876[#34876], {es-issue}35171[#35171])
The SSL default configuration shouldn’t override the https protocol if used {es-pull}34635[#34635] (issue: {es-issue}33817[#33817])
Minor fix for javadoc {es-pull}32573[#32573] (issue: {es-issue}32553[#32553])
Prevent grouping over grouping functions {es-pull}38649[#38649] (issue: {es-issue}38308[#38308])
Relax StackOverflow circuit breaker for constants {es-pull}38572[#38572] (issue: {es-issue}38571[#38571])
Fix issue with IN not resolving to underlying keyword field {es-pull}38440[#38440] (issue: {es-issue}38424[#38424])
Change the Intervals milliseconds precision to 3 digits {es-pull}38297[#38297] (issue: {es-issue}37423[#37423])
Fix esType for DATETIME/DATE and INTERVALS {es-pull}38179[#38179] (issue: {es-issue}38051[#38051])
Added SSL configuration options tests {es-pull}37875[#37875] (issue: {es-issue}37711[#37711])
Fix casting from date to numeric type to use millis {es-pull}37869[#37869] (issue: {es-issue}37655[#37655])
Fix BasicFormatter NPE {es-pull}37804[#37804]
Return Intervals in SQL format for CLI {es-pull}37602[#37602] (issues: {es-issue}29970[#29970], {es-issue}36186[#36186], {es-issue}36432[#36432])
Fix object extraction from sources {es-pull}37502[#37502] (issue: {es-issue}37364[#37364])
Fix issue with field names containing "." {es-pull}37364[#37364] (issue: {es-issue}37128[#37128])
Fix bug regarding alias fields with dots {es-pull}37279[#37279] (issue: {es-issue}37224[#37224])
Proper handling of COUNT(field_name) and COUNT(DISTINCT field_name) {es-pull}37254[#37254] (issue: {es-issue}30285[#30285])
Fix COUNT DISTINCT filtering {es-pull}37176[#37176] (issue: {es-issue}37086[#37086])
Fix issue with wrong NULL optimization {es-pull}37124[#37124] (issue: {es-issue}35872[#35872])
Fix issue with complex expression as args of PERCENTILE/_RANK {es-pull}37102[#37102] (issue: {es-issue}37099[#37099])
Handle the bwc Joda ZonedDateTime scripting class in Painless {es-pull}37024[#37024] (issue: {es-issue}37023[#37023])
Fix bug regarding histograms usage in scripting {es-pull}36866[#36866]
Fix issue with always false filter involving functions {es-pull}36830[#36830] (issue: {es-issue}35980[#35980])
Protocol returns ISO 8601 String formatted dates instead of Long for JDBC/ODBC requests {es-pull}36800[#36800] (issue: {es-issue}36756[#36756])
Enhance Verifier to prevent aggregate or grouping functions from {es-pull}36799[#36799] (issue: {es-issue}36798[#36798])
Fix translation of LIKE/RLIKE keywords {es-pull}36672[#36672] (issues: {es-issue}36039[#36039], {es-issue}36584[#36584])
Scripting support for casting functions CAST and CONVERT {es-pull}36640[#36640] (issue: {es-issue}36061[#36061])
Concat should be always not nullable {es-pull}36601[#36601] (issue: {es-issue}36169[#36169])
Fix issue with complex HAVING and GROUP BY ordinal {es-pull}36594[#36594] (issue: {es-issue}36059[#36059])
Add missing handling of IP field in JDBC {es-pull}40384[#40384] (issue: {es-issue}40358[#40358])
Fix metric aggs on date/time to not return double {es-pull}40377[#40377] (issues: {es-issue}39492[#39492], {es-issue}40376[#40376])
CAST supports both SQL and ES types {es-pull}40365[#40365] (issue: {es-issue}40282[#40282])
Fix RLIKE bug and improve testing for RLIKE statement {es-pull}40354[#40354] (issues: {es-issue}34609[#34609], {es-issue}39931[#39931])
Unwrap the first value in an array in case of array leniency {es-pull}40318[#40318] (issue: {es-issue}40296[#40296])
Preserve original source for cast/convert function {es-pull}40271[#40271] (issue: {es-issue}40239[#40239])
Fix LIKE function equality by considering its pattern as well {es-pull}40260[#40260] (issue: {es-issue}39931[#39931])
Fix issue with optimization on queries with ORDER BY/LIMIT {es-pull}40256[#40256] (issue: {es-issue}40211[#40211])
Rewrite ROUND and TRUNCATE functions with a different optional parameter handling method {es-pull}40242[#40242] (issue: {es-issue}40001[#40001])
Fix issue with getting DATE type in JDBC {es-pull}40207[#40207]
Fix issue with date columns returned always in UTC {es-pull}40163[#40163] (issue: {es-issue}40152[#40152])
Add multi_value_field_leniency inside FieldHitExtractor {es-pull}40113[#40113] (issue: {es-issue}39700[#39700])
Fix incorrect ordering of groupings (GROUP BY) based on orderings (ORDER BY) {es-pull}40087[#40087] (issue: {es-issue}39956[#39956])
Fix bug with JDBC timezone setting and DATE type {es-pull}39978[#39978] (issue: {es-issue}39915[#39915])
Use underlying exact field for LIKE/RLIKE {es-pull}39443[#39443] (issue: {es-issue}39442[#39442])
Fix display size for DATE/DATETIME {es-pull}40669[#40669]
Have LIKE/RLIKE use wildcard and regexp queries {es-pull}40628[#40628] (issue: {es-issue}40557[#40557])
Fix getTime() methods in JDBC {es-pull}40484[#40484]
SYS TABLES: enumerate tables of requested types {es-pull}40535[#40535] (issue: {es-issue}40348[#40348])
Passing an input to the CLI "freezes" the CLI after displaying an error message {es-pull}40164[#40164] (issue: {es-issue}40557[#40557])
Wrap ZonedDateTime parameters inside scripts {es-pull}39911[#39911] (issue: {es-issue}39877[#39877])
ConstantProcessor can now handle NamedWriteable {es-pull}39876[#39876] (issue: {es-issue}39875[#39875])
Extend the multi dot field notation extraction to lists of values {es-pull}39823[#39823] (issue: {es-issue}39738[#39738])
Values in datetime script aggs should be treated as long {es-pull}39773[#39773] (issue: {es-issue}37042[#37042])
Don’t allow inexact fields for MIN/MAX {es-pull}39563[#39563] (issue: {es-issue}39427[#39427])
Fix merging of incompatible multi-fields {es-pull}39560[#39560] (issue: {es-issue}39547[#39547])
Fix COUNT DISTINCT column name {es-pull}39537[#39537] (issue: {es-issue}39511[#39511])
Enable accurate hit tracking on demand {es-pull}39527[#39527] (issue: {es-issue}37971[#37971])
Ignore UNSUPPORTED fields for JDBC and ODBC modes in 'SYS COLUMNS' {es-pull}39518[#39518] (issue: {es-issue}39471[#39471])
Enforce JDBC driver - ES server version parity {es-pull}38972[#38972] (issue: {es-issue}38775[#38775])
Fall back to using the field name for column label {es-pull}38842[#38842] (issue: {es-issue}38831[#38831])
Fix Watcher NotificationService’s secure settings {es-pull}35610[#35610] (issue: {es-issue}35378[#35378])
Fix integration tests to ensure correct start/stop of Watcher {es-pull}35271[#35271] (issues: {es-issue}29877[#29877], {es-issue}30705[#30705], {es-issue}33291[#33291], {es-issue}34448[#34448], {es-issue}34462[#34462])
Cancel GetDiscoveredNodesAction when bootstrapped {es-pull}36423[#36423] (issues: {es-issue}36380[#36380], {es-issue}36381[#36381])
Only elect master-eligible nodes {es-pull}35996[#35996]
Remove duplicate discovered peers {es-pull}35505[#35505]
Fix size of rolling-upgrade bootstrap config {es-pull}38031[#38031]
Always return metadata version if metadata is requested {es-pull}37674[#37674]
Elect freshest master in upgrade {es-pull}37122[#37122] (issue: {es-issue}40[#40])
Fix cluster state persistence for single-node discovery {es-pull}36825[#36825]
Restore date aggregation performance in UTC case {es-pull}38221[#38221] (issue: {es-issue}37826[#37826])
Speed up converting of temporal accessor to zoned date time {es-pull}37915[#37915] (issue: {es-issue}37826[#37826])
Fix Netty Leaks by upgrading to 4.1.28 {es-pull}32511[#32511] (issue: {es-issue}32487[#32487])
Upgrade Netty 4.3.32.Final {es-pull}36102[#36102] (issue: {es-issue}35360[#35360])
Allow retention lease operations under blocks {es-pull}39089[#39089] (issues: {es-issue}34648[#34648], {es-issue}37165[#37165])
Remove retention leases when unfollowing {es-pull}39088[#39088] (issues: {es-issue}34648[#34648], {es-issue}37165[#37165])
Introduce retention lease state file {es-pull}39004[#39004] (issues: {es-issue}37165[#37165], {es-issue}38588[#38588], {es-issue}39032[#39032])
Enable soft-deletes by default for 7.0+ indices {es-pull}38929[#38929] (issue: {es-issue}36141[#36141])
SQL: add "fuzziness" option to QUERY and MATCH function predicates {es-pull}40529[#40529] (issue: {es-issue}40495[#40495])
SQL: add "validate.properties" property to JDBC’s allowed list of settings {es-pull}39050[#39050] (issue: {es-issue}38068[#38068])
Types removal security index template {es-pull}39705[#39705] (issue: {es-issue}38637[#38637])
Types removal security index template {es-pull}39542[#39542] (issue: {es-issue}38637[#38637])
Fix shard follow task startup error handling {es-pull}39053[#39053] (issue: {es-issue}38779[#38779])
Filter out upgraded version index settings when starting index following {es-pull}38838[#38838] (issue: {es-issue}38835[#38835])
Do not perform cleanup if Manifest write fails with dirty exception {es-pull}40519[#40519] (issue: {es-issue}39077[#39077])
Cache compressed cluster state size {es-pull}39827[#39827] (issue: {es-issue}39806[#39806])
Drop node if asymmetrically partitioned from master {es-pull}39598[#39598]
Fixing the custom object serialization bug in diffable utils. {es-pull}39544[#39544]
Clean GatewayAllocator when stepping down as master {es-pull}38885[#38885]
Enforce retention leases require soft deletes {es-pull}39922[#39922] (issue: {es-issue}39914[#39914])
Treat TransportService stopped error as node is closing {es-pull}39800[#39800] (issue: {es-issue}39584[#39584])
Use cause to determine if node with primary is closing {es-pull}39723[#39723] (issue: {es-issue}39584[#39584])
Don’t ack if unable to remove failing replica {es-pull}39584[#39584] (issue: {es-issue}39467[#39467])
Fix NPE on Stale Index in IndicesService {es-pull}38891[#38891] (issue: {es-issue}38845[#38845])
Correct ILM metadata minimum compatibility version {es-pull}40569[#40569] (issue: {es-issue}40565[#40565])
Handle null retention leases in WaitForNoFollowersStep {es-pull}40477[#40477]
Fix Watcher stats class cast exception {es-pull}39821[#39821] (issue: {es-issue}39780[#39780])
Use any index specified by .watches for Watcher {es-pull}39541[#39541] (issue: {es-issue}39478[#39478])
Resolve concurrency with watcher trigger service {es-pull}39092[#39092] (issue: {es-issue}39087[#39087])
Allow single digit milliseconds in strict date parsing {es-pull}40676[#40676] (issue: {es-issue}40403[#40403])
Parse composite patterns using ClassicFormat.parseObject {es-pull}40100[#40100] (issue: {es-issue}39916[#39916])
Bat scripts to work with JAVA_HOME with parantheses {es-pull}39712[#39712] (issues: {es-issue}30606[#30606], {es-issue}33405[#33405], {es-issue}38578[#38578], {es-issue}38624[#38624])
Change licence expiration date pattern {es-pull}39681[#39681] (issue: {es-issue}39136[#39136])
Fix DateFormatters.parseMillis when no timezone is given {es-pull}39100[#39100] (issue: {es-issue}39067[#39067])
Don’t close caches while there might still be in-flight requests. {es-pull}38958[#38958] (issue: {es-issue}37117[#37117])
[ML] Fix datafeed skipping first bucket after lookback when aggs are … {es-pull}39859[#39859] (issue: {es-issue}39842[#39842])
[ML] refactoring lazy query and agg parsing {es-pull}39776[#39776] (issue: {es-issue}39528[#39528])
[ML] Stop the ML memory tracker before closing node {es-pull}39111[#39111] (issue: {es-issue}37117[#37117])
Recover peers from translog, ignoring soft deletes {es-pull}38904[#38904] (issue: {es-issue}37165[#37165])
Retain history for peer recovery using leases {es-pull}38855[#38855]
SQL: have LIKE/RLIKE use wildcard and regexp queries {es-pull}40628[#40628] (issue: {es-issue}40557[#40557])
SQL: Fix getTime() methods in JDBC {es-pull}40484[#40484]
SQL: SYS TABLES: enumerate tables of requested types {es-pull}40535[#40535] (issue: {es-issue}40348[#40348])
SQL: passing an input to the CLI "freezes" the CLI after displaying an error message {es-pull}40164[#40164] (issue: {es-issue}40557[#40557])
SQL: Wrap ZonedDateTime parameters inside scripts {es-pull}39911[#39911] (issue: {es-issue}39877[#39877])
SQL: ConstantProcessor can now handle NamedWriteable {es-pull}39876[#39876] (issue: {es-issue}39875[#39875])
SQL: Extend the multi dot field notation extraction to lists of values {es-pull}39823[#39823] (issue: {es-issue}39738[#39738])
SQL: values in datetime script aggs should be treated as long {es-pull}39773[#39773] (issue: {es-issue}37042[#37042])
SQL: Don’t allow inexact fields for MIN/MAX {es-pull}39563[#39563] (issue: {es-issue}39427[#39427])
SQL: Fix merging of incompatible multi-fields {es-pull}39560[#39560] (issue: {es-issue}39547[#39547])
SQL: fix COUNT DISTINCT column name {es-pull}39537[#39537] (issue: {es-issue}39511[#39511])
SQL: Enable accurate hit tracking on demand {es-pull}39527[#39527] (issue: {es-issue}37971[#37971])
SQL: ignore UNSUPPORTED fields for JDBC and ODBC modes in 'SYS COLUMNS' {es-pull}39518[#39518] (issue: {es-issue}39471[#39471])
SQL: enforce JDBC driver - ES server version parity {es-pull}38972[#38972] (issue: {es-issue}38775[#38775])
SQL: fall back to using the field name for column label {es-pull}38842[#38842] (issue: {es-issue}38831[#38831])
Remove dynamic objects from security index {es-pull}40499[#40499] (issue: {es-issue}35460[#35460])
Fix libs:ssl-config project setup {es-pull}39074[#39074]
Do not create the missing index when invoking getRole {es-pull}39039[#39039]
Renew retention leases while following {es-pull}39335[#39335] (issues: {es-issue}37165[#37165], {es-issue}38718[#38718])
Reduce refresh when lookup term in FollowingEngine {es-pull}39184[#39184]
Integrate retention leases to recovery from remote {es-pull}38829[#38829] (issue: {es-issue}37165[#37165])
Enable removal of retention leases {es-pull}38751[#38751] (issue: {es-issue}37165[#37165])
Introduce retention lease actions {es-pull}38756[#38756] (issue: {es-issue}37165[#37165])
Add dedicated retention lease exceptions {es-pull}38754[#38754] (issue: {es-issue}37165[#37165])
Copy retention leases when trim unsafe commits {es-pull}37995[#37995] (issue: {es-issue}37165[#37165])
Make the type parameter optional when percolating existing documents. {es-pull}39987[#39987] (issue: {es-issue}39963[#39963])
Add support for selecting percolator query candidate matches containing geo_point based queries {es-pull}26040[#26040]
Enhance checks for inexact fields {es-pull}39427[#39427] (issue: {es-issue}38501[#38501])
Change the default precision for CURRENT_TIMESTAMP function {es-pull}39391[#39391] (issue: {es-issue}39288[#39288])
Skip sibling pipeline aggregators reduction during non-final reduce {es-pull}40101[#40101] (issue: {es-issue}40059[#40059])
Extend nextDoc to delegate to the wrapped doc-value iterator for date_nanos {es-pull}39176[#39176] (issue: {es-issue}39107[#39107])
Only create MatrixStatsResults on final reduction {es-pull}38130[#38130] (issue: {es-issue}37587[#37587])
Allow non super users to create API keys {es-pull}40028[#40028] (issue: {es-issue}40029[#40029])
Use consistent view of realms for authentication {es-pull}38815[#38815] (issue: {es-issue}30301[#30301])
Safe publication of AutoFollowCoordinator {es-pull}40153[#40153] (issue: {es-issue}38560[#38560])
Enable reading auto-follow patterns from x-content {es-pull}40130[#40130] (issue: {es-issue}40128[#40128])
Stop auto-followers on shutdown {es-pull}40124[#40124]
Protect against the leader index being removed {es-pull}39351[#39351] (issue: {es-issue}39308[#39308])
Handle the fact that ShardStats instance may have no commit or seqno stats {es-pull}38782[#38782] (issue: {es-issue}38779[#38779])
Fix LocalIndexFollowingIT#testRemoveRemoteConnection() test {es-pull}38709[#38709] (issue: {es-issue}38695[#38695])
Ignore waitForActiveShards when syncing leases {es-pull}39224[#39224] (issue: {es-issue}39089[#39089])
Fix synchronization in LocalCheckpointTracker#contains {es-pull}38755[#38755] (issues: {es-issue}33871[#33871], {es-issue}38633[#38633])
Bubble up exception when processing NoOp {es-pull}39338[#39338] (issue: {es-issue}38898[#38898])
ReadOnlyEngine should update translog recovery state information {es-pull}39238[#39238]
Use non-ILM template setting up watch history template & ILM disabled {es-pull}39325[#39325] (issue: {es-issue}38805[#38805])
Only flush Watcher’s bulk processor if Watcher is enabled {es-pull}38803[#38803] (issue: {es-issue}38798[#38798])
Obsolete pre 7.0 noarch package in rpm {es-pull}39472[#39472] (issue: {es-issue}39414[#39414])
Suppress error message when /proc/sys/vm/max_map_count is not exists. {es-pull}35933[#35933]
Add missing handling of IP field in JDBC {es-pull}40384[#40384] (issue: {es-issue}40358[#40358])
Fix metric aggs on date/time to not return double {es-pull}40377[#40377] (issues: {es-issue}39492[#39492], {es-issue}40376[#40376])
CAST supports both SQL and ES types {es-pull}40365[#40365] (issue: {es-issue}40282[#40282])




    

Fix RLIKE bug and improve testing for RLIKE statement {es-pull}40354[#40354] (issues: {es-issue}34609[#34609], {es-issue}39931[#39931])
Unwrap the first value in an array in case of array leniency {es-pull}40318[#40318] (issue: {es-issue}40296[#40296])
Preserve original source for cast/convert function {es-pull}40271[#40271] (issue: {es-issue}40239[#40239])
Fix LIKE function equality by considering its pattern as well {es-pull}40260[#40260] (issue: {es-issue}39931[#39931])
Fix issue with optimization on queries with ORDER BY/LIMIT {es-pull}40256[#40256] (issue: {es-issue}40211[#40211])
Rewrite ROUND and TRUNCATE functions with a different optional parameter handling method {es-pull}40242[#40242] (issue: {es-issue}40001[#40001])
Fix issue with getting DATE type in JDBC {es-pull}40207[#40207]
Fix issue with date columns returned always in UTC {es-pull}40163[#40163] (issue: {es-issue}40152[#40152])
Add multi_value_field_leniency inside FieldHitExtractor {es-pull}40113[#40113] (issue: {es-issue}39700[#39700])
Fix incorrect ordering of groupings (GROUP BY) based on orderings (ORDER BY) {es-pull}40087[#40087] (issue: {es-issue}39956[#39956])
Fix bug with JDBC timezone setting and DATE type {es-pull}39978[#39978] (issue: {es-issue}39915[#39915])
Use underlying exact field for LIKE/RLIKE {es-pull}39443[#39443] (issue: {es-issue}39442[#39442])
Serialize top-level pipeline aggs as part of InternalAggregations {es-pull}40177[#40177] (issues: {es-issue}40059[#40059], {es-issue}40101[#40101])
CCS: Skip empty search hits when minimizing round-trips {es-pull}40098[#40098] (issues: {es-issue}32125[#32125], {es-issue}40067[#40067])
CCS: Disable minimizing round-trips when dfs is requested {es-pull}40044[#40044] (issue: {es-issue}32125[#32125])
Add ECS schema for user-agent ingest processor (#37727) {es-pull}37984[#37984] (issues: {es-issue}37329[#37329], {es-issue}37727[#37727])
Remove special handling for ingest plugins {es-pull}36967[#36967] (issues: {es-issue}36898[#36898], {es-issue}36956[#36956])
Make sure to reject mappings with type _doc when include_type_name is false. {es-pull}38270[#38270] (issue: {es-issue}38266[#38266])
Update the default for include_type_name to false. {es-pull}37285[#37285]
Support 'include_type_name' in RestGetIndicesAction {es-pull}37149[#37149]
Remove TLS 1.0 as a default SSL protocol {es-pull}37512[#37512] (issue: {es-issue}36021[#36021])
Security: remove SSL settings fallback {es-pull}36846[#36846] (issue: {es-issue}29797[#29797])
Track total hits up to 10,000 by default {es-pull}37466[#37466] (issue: {es-issue}33028[#33028])
Use mappings to format doc-value fields by default. {es-pull}30831[#30831] (issues: {es-issue}26948[#26948], {es-issue}29639[#29639])
Deprecate HLRC security methods {es-pull}37883[#37883] (issues: {es-issue}36938[#36938], {es-issue}37540[#37540])
Deprecate HLRC EmptyResponse used by security {es-pull}37540[#37540] (issue: {es-issue}36938[#36938])
Deprecate xpack.watcher.history.cleaner_service.enabled {es-pull}37782[#37782] (issue: {es-issue}32041[#32041])
deprecate types for watcher {es-pull}37594[#37594] (issue: {es-issue}35190[#35190])
[ML] Remove "8" prefixes from file structure finder timestamp formats {es-pull}38016[#38016]
[ML] Adjust structure finder for Joda to Java time migration {es-pull}37306[#37306]
[ML] Resolve 7.0.0 TODOs in ML code {es-pull}36842[#36842] (issue: {es-issue}29963[#29963])
Deprecate types in rollover index API {es-pull}38039[#38039] (issue: {es-issue}35190[#35190])
Deprecate types in get field mapping API {es-pull}37667[#37667] (issue: {es-issue}35190[#35190])
Deprecate types in the put mapping API. {es-pull}37280[#37280] (issues: {es-issue}29453[#29453], {es-issue}37285[#37285])
Support include_type_name in the field mapping and index template APIs. {es-pull}37210[#37210]
Deprecate types in create index requests. {es-pull}37134[#37134] (issues: {es-issue}29453[#29453], {es-issue}37285[#37285])
Deprecate use of the _type field in aggregations. {es-pull}37131[#37131] (issue: {es-issue}36802[#36802])
Deprecate reference to _type in lookup queries {es-pull}37016[#37016] (issue: {es-issue}35190[#35190])
Deprecate the document create endpoint. {es-pull}36863[#36863]
Deprecate types in index API {es-pull}36575[#36575] (issues: {es-issue}35190[#35190], {es-issue}35790[#35790])
Deprecate types in update APIs {es-pull}36225[#36225]
Add support for API keys to access Elasticsearch {es-pull}38291[#38291] (issue: {es-issue}34383[#34383])
OIDC realm authentication flows {es-pull}37787[#37787]
[WIP] OIDC Realm JWT+JWS related functionality {es-pull}37272[#37272] (issues: {es-issue}35339[#35339], {es-issue}37009[#37009])
OpenID Connect Realm base functionality {es-pull}37009[#37009] (issue: {es-issue}35339[#35339])
Allow custom authorization with an authorization engine  {es-pull}38358[#38358] (issues: {es-issue}32435[#32435], {es-issue}36245[#36245], {es-issue}37328[#37328], {es-issue}37495[#37495], {es-issue}37785[#37785], {es-issue}38137[#38137], {es-issue}38219[#38219])
WIldcard IndicesPermissions don’t cover .security {es-pull}36765[#36765]
[Geo] Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}36751[#36751] (issue: {es-issue}35320[#35320])
[Geo] Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}35320[#35320] (issue: {es-issue}32039[#32039])
Give precedence to index creation when mixing typed templates with typeless index creation and vice-versa. {es-pull}37871[#37871] (issue: {es-issue}37773[#37773])
Add nanosecond field mapper {es-pull}37755[#37755] (issues: {es-issue}27330[#27330], {es-issue}32601[#32601])
SQL: Allow sorting of groups by aggregates {es-pull}38042[#38042] (issue: {es-issue}35118[#35118])
SQL: Implement FIRST/LAST aggregate functions {es-pull}37936[#37936] (issue: {es-issue}35639[#35639])
SQL: Introduce SQL DATE data type {es-pull}37693[#37693] (issue: {es-issue}37340[#37340])
Introduce ability to minimize round-trips in CCS {es-pull}37828[#37828] (issues: {es-issue}32125[#32125], {es-issue}37566[#37566])
Add script filter to intervals {es-pull}36776[#36776]
Add the ability to set the number of hits to track accurately {es-pull}36357[#36357] (issue: {es-issue}33028[#33028])
Add a maximum search request size. {es-pull}26423[#26423]
Add Composite to AggregationBuilders {es-pull}38207[#38207] (issue: {es-issue}38020[#38020])
Allow nested fields in the composite aggregation {es-pull}37178[#37178] (issue: {es-issue}28611[#28611])
Remove single shard optimization when suggesting shard_size {es-pull}37041[#37041] (issue: {es-issue}32125[#32125])
Use List instead of priority queue for stable sorting in bucket sort aggregator {es-pull}36748[#36748] (issue: {es-issue}36322[#36322])
Keys are compared in BucketSortPipelineAggregation so making key type… {es-pull}36407[#36407]
Fail start on obsolete indices documentation {es-pull}37786[#37786] (issue: {es-issue}27073[#27073])
Fail start on invalid index metadata {es-pull}37748[#37748] (issue: {es-issue}27073[#27073])
Fail start of non-data node if node has data {es-pull}37347[#37347] (issue: {es-issue}27073[#27073])
Security Audit includes HTTP method for requests {es-pull}37322[#37322] (issue: {es-issue}29765[#29765])
Add X-Forwarded-For to the logfile audit {es-pull}36427[#36427]
Security: propagate auth result to listeners {es-pull}36900[#36900] (issue: {es-issue}30794[#30794])
Security: reorder realms based on last success {es-pull}36878[#36878]
Improve error message for 6.x style realm settings {es-pull}36876[#36876] (issues: {es-issue}30241[#30241], {es-issue}36026[#36026])
Change missing authn message to not mention tokens {es-pull}36750[#36750]
Invalidate Token API enhancements - HLRC {es-pull}36362[#36362] (issue: {es-issue}35388[#35388])
Enhance Invalidate Token API {es-pull}35388[#35388] (issues: {es-issue}34556[#34556], {es-issue}35115[#35115])
Permission for restricted indices {es-pull}37577[#37577] (issue: {es-issue}34454[#34454])
Remove kibana_user and kibana_dashboard_only_user index privileges {es-pull}37441[#37441]
Create snapshot role {es-pull}35820[#35820] (issue: {es-issue}34454[#34454])
Tighten mapping syncing in ccr remote restore {es-pull}38071[#38071] (issues: {es-issue}36879[#36879], {es-issue}37887[#37887])
Do not allow put mapping on follower {es-pull}37675[#37675] (issue: {es-issue}30086[#30086])
Added ccr to xpack usage infrastructure {es-pull}37256[#37256] (issue: {es-issue}37221[#37221])
[CCR] FollowingEngine should fail with 403 if operation has no seqno assigned {es-pull}37213[#37213]
[CCR] Added auto_follow_exception.timestamp field to auto follow stats {es-pull}36947[#36947]
[CCR] Add time since last auto follow fetch to auto follow stats {es-pull}36542[#36542] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Add Seq# based optimistic concurrency control to UpdateRequest {es-pull}37872[#37872] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Introduce ssl settings to reindex from remote {es-pull}37527[#37527] (issues: {es-issue}29755[#29755], {es-issue}37287[#37287])
Use Sequence number powered OCC for processing updates {es-pull}37308[#37308] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Document Seq No powered optimistic concurrency control {es-pull}37284[#37284] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Enable IPv6 URIs in reindex from remote {es-pull}36874[#36874]
Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm  {es-pull}36757[#36757] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Expose Sequence Number based Optimistic Concurrency Control in the rest layer {es-pull}36721[#36721] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add doc’s sequence number + primary term to GetResult and use it for updates {es-pull}36680[#36680] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add seq no powered optimistic locking support to the index and delete transport actions {es-pull}36619[#36619] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Set acking timeout to 0 on dynamic mapping update {es-pull}31140[#31140] (issues: {es-issue}30672[#30672], {es-issue}30844[#30844])
Recover retention leases during peer recovery {es-pull}38435[#38435] (issue: {es-issue}37165[#37165])
Lift retention lease expiration to index shard {es-pull}38380[#38380] (issues: {es-issue}37165[#37165], {es-issue}37963[#37963], {es-issue}38070[#38070])
Introduce retention lease background sync {es-pull}38262[#38262] (issue: {es-issue}37165[#37165])
Allow shards of closed indices to be replicated as regular shards {es-pull}38024[#38024] (issue: {es-issue}33888[#33888])
Expose retention leases in shard stats {es-pull}37991[#37991] (issue: {es-issue}37165[#37165])
Introduce retention leases versioning {es-pull}37951[#37951] (issue: {es-issue}37165[#37165])
Soft-deletes policy should always fetch latest leases {es-pull}37940[#37940] (issues: {es-issue}37165[#37165], {es-issue}37375[#37375])
Sync retention leases on expiration {es-pull}37902[#37902] (issue: {es-issue}37165[#37165])
Ignore shard started requests when primary term does not match {es-pull}37899[#37899] (issue: {es-issue}33888[#33888])
Move update and delete by query to use seq# for optimistic concurrency control {es-pull}37857[#37857] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148], {es-issue}37639[#37639])
Introduce retention lease serialization {es-pull}37447[#37447] (issues: {es-issue}37165[#37165], {es-issue}37398[#37398])
Add run under primary permit method {es-pull}37440[#37440] (issue: {es-issue}37398[#37398])
Introduce retention lease syncing {es-pull}37398[#37398] (issue: {es-issue}37165[#37165])
Introduce retention lease persistence {es-pull}37375[#37375] (issue: {es-issue}37165[#37165])
Add validation for retention lease construction {es-pull}37312[#37312] (issue: {es-issue}37165[#37165])
Introduce retention lease expiration {es-pull}37195[#37195] (issue: {es-issue}37165[#37165])
Introduce shard history retention leases {es-pull}37167[#37167] (issue: {es-issue}37165[#37165])
[Close Index API] Add unique UUID to ClusterBlock {es-pull}36775[#36775]
[Close Index API] Mark shard copy as stale if needed during shard verification {es-pull}36755[#36755]
[Close Index API] Propagate tasks ids between Freeze, Close and Verify Shard actions {es-pull}36630[#36630]
Always initialize the global checkpoint {es-pull}34381[#34381]
Ensure that max seq # is equal to the global checkpoint when creating ReadOnlyEngines {es-pull}37426[#37426]
Enable Bulk-Merge if all source remains {es-pull}37269[#37269]
Rename setting to enable mmap {es-pull}37070[#37070] (issue: {es-issue}36668[#36668])
Add hybridfs store type {es-pull}36668[#36668]
Introduce time-based retention policy for soft-deletes {es-pull}34943[#34943] (issue: {es-issue}34908[#34908])
handle AsyncAfterWriteAction failure on primary in the same way as failures on replicas  {es-pull}31969[#31969] (issues: {es-issue}31716[#31716], {es-issue}31755[#31755])
Ensure ILM policies run safely on leader indices  {es-pull}38140[#38140] (issue: {es-issue}34648[#34648])
Skip Shrink when numberOfShards not changed {es-pull}37953[#37953] (issue: {es-issue}33275[#33275])
Inject Unfollow before Rollover and Shrink {es-pull}37625[#37625] (issue: {es-issue}34648[#34648])
Add set_priority action to ILM {es-pull}37397[#37397] (issue: {es-issue}36905[#36905])
[ILM] Add Freeze Action {es-pull}36910[#36910] (issue: {es-issue}34630[#34630])
ingest: compile mustache template only if field includes '{{'' {es-pull}37207[#37207] (issue: {es-issue}37120[#37120])
Move ingest-geoip default databases out of config {es-pull}36949[#36949] (issue: {es-issue}36898[#36898])
Make the ingest-geoip databases even lazier to load {es-pull}36679[#36679]
Updates the grok patterns to be consistent with the logstash {es-pull}27181[#27181]
HLRC: Fix strict setting exception handling {es-pull}37247[#37247] (issue: {es-issue}37090[#37090])
HLRC: Use nonblocking entity for requests {es-pull}32249[#32249]
Move watcher to use seq# and primary term for concurrency control {es-pull}37977[#37977] (issues: {es-issue}10708[#10708], {es-issue}37872[#37872])
Use ILM for Watcher history deletion {es-pull}37443[#37443] (issue: {es-issue}32041[#32041])
Watcher: Add whitelist to HttpClient {es-pull}36817[#36817] (issue: {es-issue}29937[#29937])
Add simple method to write collection of writeables {es-pull}37448[#37448] (issue: {es-issue}37398[#37398])
Date/Time parsing: Use java time API instead of exception handling {es-pull}37222[#37222]
[API] spelling: interruptible {es-pull}37049[#37049] (issue: {es-issue}37035[#37035])
Trim the JSON source in indexing slow logs {es-pull}38081[#38081] (issue: {es-issue}38080[#38080])
Optimize warning header de-duplication {es-pull}37725[#37725] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530], {es-issue}37597[#37597], {es-issue}37622[#37622])
Remove warn-date from warning headers {es-pull}37622[#37622] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530], {es-issue}37597[#37597])
Add some deprecation optimizations {es-pull}37597[#37597] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530])
Only update response headers if we have a new one {es-pull}37590[#37590] (issues: {es-issue}35754[#35754], {es-issue}37530[#37530])
Change file descriptor limit to 65535 {es-pull}37537[#37537] (issue: {es-issue}35839[#35839])
Exit batch files explictly using ERRORLEVEL {es-pull}29583[#29583] (issue: {es-issue}29582[#29582])
Move ML Optimistic Concurrency Control to Seq No {es-pull}38278[#38278] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
[ML] Add explanation so far to file structure finder exceptions {es-pull}38191[#38191] (issue: {es-issue}29821[#29821])
ML: Add reason field in JobTaskState {es-pull}38029[#38029] (issue: {es-issue}34431[#34431])
[ML] Add _meta information to all ML indices {es-pull}37964[#37964]
ML: Add upgrade mode docs, hlrc, and fix bug {es-pull}37942[#37942]
[ML] Tighten up use of aliases rather than concrete indices {es-pull}37874[#37874]
ML: Add support for single bucket aggs in Datafeeds {es-pull}37544[#37544] (issue: {es-issue}36838[#36838])
[ML] Create the ML annotations index {es-pull}36731[#36731] (issues: {es-issue}26034[#26034], {es-issue}33376[#33376])
[ML] Merge the Jindex master feature branch {es-pull}36702[#36702] (issue: {es-issue}32905[#32905])
[FEATURE][ML] Add cluster setting to enable/disable config  migration {es-pull}36700[#36700] (issue: {es-issue}32905[#32905])
Log document id when MapperParsingException occurs {es-pull}37800[#37800] (issue: {es-issue}37658[#37658])
[API] spelling: unknown {es-pull}37056[#37056] (issue: {es-issue}37035[#37035])
Make SourceToParse immutable {es-pull}36971[#36971]
Use index-prefix fields for terms of length min_chars - 1 {es-pull}36703[#36703]
SyncedFlushService.getShardRoutingTable() should use metadata to check for index existence {es-pull}37691[#37691] (issue: {es-issue}33888[#33888])
Make prepare engine step of recovery source non-blocking {es-pull}37573[#37573] (issue: {es-issue}37174[#37174])
Make recovery source send operations non-blocking {es-pull}37503[#37503] (issue: {es-issue}37458[#37458])
Prepare to make send translog of recovery non-blocking {es-pull}37458[#37458] (issue: {es-issue}37291[#37291])
Make finalize step of recovery source non-blocking {es-pull}37388[#37388] (issue: {es-issue}37291[#37291])
Make recovery source partially non-blocking {es-pull}37291[#37291] (issue: {es-issue}36195[#36195])
Do not mutate RecoveryResponse {es-pull}37204[#37204] (issue: {es-issue}37174[#37174])




    

Don’t block on peer recovery on the target side {es-pull}37076[#37076] (issue: {es-issue}36195[#36195])
Reduce recovery time with compress or secure transport {es-pull}36981[#36981] (issue: {es-issue}33844[#33844])
Translog corruption marker {es-pull}33415[#33415] (issue: {es-issue}31389[#31389])
SQL: Allow look-ahead resolution of aliases for WHERE clause {es-pull}38450[#38450] (issue: {es-issue}29983[#29983])
SQL: Implement CURRENT_DATE {es-pull}38175[#38175] (issue: {es-issue}38160[#38160])
SQL: Generate relevant error message when grouping functions are not used in GROUP BY {es-pull}38017[#38017] (issue: {es-issue}37952[#37952])
SQL: Skip the nested and object field types in case of an ODBC request {es-pull}37948[#37948] (issue: {es-issue}37801[#37801])
SQL: Add protocol tests and remove jdbc_type from drivers response {es-pull}37516[#37516] (issues: {es-issue}36635[#36635], {es-issue}36882[#36882])
SQL: Remove slightly used meta commands {es-pull}37506[#37506] (issue: {es-issue}37409[#37409])
SQL: Describe aliases as views {es-pull}37496[#37496] (issue: {es-issue}37422[#37422])
SQL: Make FULL non-reserved keyword in the grammar {es-pull}37377[#37377] (issue: {es-issue}37376[#37376])
SQL: Use declared source for error messages {es-pull}37161[#37161]
SQL: Improve error message when unable to translate to ES query DSL {es-pull}37129[#37129] (issue: {es-issue}37040[#37040])
[API] spelling: subtract {es-pull}37055[#37055] (issue: {es-issue}37035[#37035])
[API] spelling: similar {es-pull}37054[#37054] (issue: {es-issue}37035[#37035])
[API] spelling: input {es-pull}37048[#37048] (issue: {es-issue}37035[#37035])
SQL: Enhance message for PERCENTILE[_RANK] with field as 2nd arg {es-pull}36933[#36933] (issue: {es-issue}36903[#36903])
SQL: Preserve original source for each expression {es-pull}36912[#36912] (issue: {es-issue}36894[#36894])
SQL: Extend the ODBC metric by differentiating between 32 and 64bit platforms {es-pull}36753[#36753] (issue: {es-issue}36740[#36740])
SQL: Fix wrong appliance of StackOverflow limit for IN {es-pull}36724[#36724] (issue: {es-issue}36592[#36592])
Tie break on cluster alias when merging shard search failures {es-pull}38715[#38715] (issue: {es-issue}38672[#38672])
Add finalReduce flag to SearchRequest {es-pull}38104[#38104] (issues: {es-issue}37000[#37000], {es-issue}37838[#37838])
Streamline skip_unavailable handling {es-pull}37672[#37672] (issue: {es-issue}32125[#32125])
Expose sequence number and primary terms in search responses {es-pull}37639[#37639]
Add support for merging multiple search responses into one {es-pull}37566[#37566] (issue: {es-issue}32125[#32125])
Allow field types to optimize phrase prefix queries {es-pull}37436[#37436] (issue: {es-issue}31921[#31921])
Add support for providing absolute start time to SearchRequest {es-pull}37142[#37142] (issue: {es-issue}32125[#32125])
Ensure that local cluster alias is never treated as remote {es-pull}37121[#37121] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997])
[API] spelling: cacheable {es-pull}37047[#37047] (issue: {es-issue}37035[#37035])
Add ability to suggest shard_size on coord node rewrite {es-pull}37017[#37017] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997], {es-issue}37000[#37000])
Skip final reduction if SearchRequest holds a cluster alias {es-pull}37000[#37000] (issues: {es-issue}32125[#32125], {es-issue}36997[#36997])
Add support for local cluster alias to SearchRequest {es-pull}36997[#36997] (issue: {es-issue}32125[#32125])
Use SearchRequest copy constructor in ExpandSearchPhase {es-pull}36772[#36772] (issue: {es-issue}36641[#36641])
Add raw sort values to SearchSortValues transport serialization {es-pull}36617[#36617] (issue: {es-issue}32125[#32125])
Move CAS operations in TokenService to sequence numbers {es-pull}38311[#38311] (issues: {es-issue}10708[#10708], {es-issue}37872[#37872])
Cleanup construction of interceptors {es-pull}38294[#38294]
Add passphrase support to elasticsearch-keystore {es-pull}37472[#37472] (issue: {es-issue}32691[#32691])
RestoreService should update primary terms when restoring shards of existing indices {es-pull}38177[#38177] (issue: {es-issue}33888[#33888])
Allow open indices to be restored {es-pull}37733[#37733]
Create specific exception for when snapshots are in progress {es-pull}37550[#37550] (issue: {es-issue}37541[#37541])
SNAPSHOT: Make Atomic Blob Writes Mandatory {es-pull}37168[#37168] (issues: {es-issue}37011[#37011], {es-issue}37066[#37066])
SNAPSHOT: Speed up HDFS Repository Writes {es-pull}37069[#37069]
Implement Atomic Blob Writes for HDFS Repository {es-pull}37066[#37066] (issue: {es-issue}37011[#37011])
[API] spelling: repositories {es-pull}37053[#37053] (issue: {es-issue}37035[#37035])
SNAPSHOT: Use CancellableThreads to Abort {es-pull}35901[#35901] (issue: {es-issue}21759[#21759])
WIP: S3 client encryption {es-pull}30513[#30513] (issues: {es-issue}11128[#11128], {es-issue}16843[#16843])
Step down as master when configured out of voting configuration {es-pull}37802[#37802] (issue: {es-issue}37712[#37712])
Enforce cluster UUIDs {es-pull}37775[#37775]
Bubble exceptions up in ClusterApplierService {es-pull}37729[#37729]
Use m_m_nodes from Zen1 master for Zen2 bootstrap {es-pull}37701[#37701]
Add tool elasticsearch-node unsafe-bootstrap {es-pull}37696[#37696]
Report terms and version if cluster does not form {es-pull}37473[#37473]
Bootstrap a Zen2 cluster once quorum is discovered {es-pull}37463[#37463]
Zen2: Add join validation {es-pull}37203[#37203]
Publish cluster states in chunks {es-pull}36973[#36973]
Don’t load global ordinals with the map execution_hint {es-pull}37833[#37833] (issue: {es-issue}37705[#37705])
Issue #37303 - Invalid variance fix {es-pull}37384[#37384] (issue: {es-issue}37303[#37303])
When removing an AutoFollower also mark it as removed. {es-pull}37402[#37402] (issue: {es-issue}36761[#36761])
[CCR] Make shard follow tasks more resilient for restarts {es-pull}37239[#37239] (issue: {es-issue}37231[#37231])
[CCR] Resume follow Api should not require a request body {es-pull}37217[#37217] (issue: {es-issue}37022[#37022])
[CCR] Report error if auto follower tries auto follow a leader index with soft deletes disabled {es-pull}36886[#36886] (issue: {es-issue}33007[#33007])
Remote cluster license checker and no license info. {es-pull}36837[#36837] (issue: {es-issue}36815[#36815])
Make CCR resilient against missing remote cluster connections {es-pull}36682[#36682] (issues: {es-issue}36255[#36255], {es-issue}36667[#36667])
[CCR] AutoFollowCoordinator and follower index already created {es-pull}36540[#36540] (issue: {es-issue}33007[#33007])
TransportVerifyShardBeforeCloseAction should force a flush {es-pull}38401[#38401] (issues: {es-issue}33888[#33888], {es-issue}37961[#37961])
Fix limit on retaining sequence number {es-pull}37992[#37992] (issue: {es-issue}37165[#37165])
Close Index API should force a flush if a sync is needed {es-pull}37961[#37961] (issues: {es-issue}33888[#33888], {es-issue}37426[#37426])
Force Refresh Listeners when Acquiring all Operation Permits {es-pull}36835[#36835]
Replaced the word 'shards' with 'replicas' in an error message. (#36234) {es-pull}36275[#36275] (issue: {es-issue}36234[#36234])
Preserve ILM operation mode when creating new lifecycles {es-pull}38134[#38134] (issues: {es-issue}38229[#38229], {es-issue}38230[#38230])
Retry ILM steps that fail due to SnapshotInProgressException {es-pull}37624[#37624] (issues: {es-issue}37541[#37541], {es-issue}37552[#37552])
Remove indexing_complete when removing policy {es-pull}36620[#36620]
Reject delete index requests with a body {es-pull}37501[#37501] (issue: {es-issue}8217[#8217])
Fix duplicate phrase in shrink/split error message {es-pull}36734[#36734] (issue: {es-issue}36729[#36729])
Get Aliases with wildcard exclusion expression {es-pull}34230[#34230] (issues: {es-issue}33518[#33518], {es-issue}33805[#33805], {es-issue}34144[#34144])
Support unknown fields in ingest pipeline map configuration {es-pull}38352[#38352] (issue: {es-issue}36938[#36938])
Ingest node - user_agent, move device parsing to an object {es-pull}38115[#38115] (issues: {es-issue}37329[#37329], {es-issue}38094[#38094])
ingest: fix on_failure with Drop processor {es-pull}36686[#36686] (issue: {es-issue}36151[#36151])
ingest: support default pipelines + bulk upserts {es-pull}36618[#36618] (issue: {es-issue}36219[#36219])
Update IndexTemplateMetadata to allow unknown fields {es-pull}38448[#38448] (issue: {es-issue}36938[#36938])
if_seq_no and if_primary_term parameters aren’t wired correctly in REST Client’s CRUD API {es-pull}38411[#38411]
Update Rollup Caps to allow unknown fields {es-pull}38339[#38339] (issue: {es-issue}36938[#36938])
Fix ILM explain response to allow unknown fields {es-pull}38054[#38054] (issue: {es-issue}36938[#36938])
Fix ILM status to allow unknown fields {es-pull}38043[#38043] (issue: {es-issue}36938[#36938])
Fix ILM Lifecycle Policy to allow unknown fields {es-pull}38041[#38041] (issue: {es-issue}36938[#36938])
Update authenticate to allow unknown fields {es-pull}37713[#37713] (issue: {es-issue}36938[#36938])
Update verify repository to allow unknown fields {es-pull}37619[#37619] (issue: {es-issue}36938[#36938])
Update get users to allow unknown fields {es-pull}37593[#37593] (issue: {es-issue}36938[#36938])
Update Execute Watch to allow unknown fields {es-pull}37498[#37498] (issue: {es-issue}36938[#36938])
Update Put Watch to allow unknown fields {es-pull}37494[#37494] (issue: {es-issue}36938[#36938])
Update Delete Watch to allow unknown fields {es-pull}37435[#37435] (issue: {es-issue}36938[#36938])
Fix rest reindex test for IPv4 addresses {es-pull}37310[#37310]
Fix weighted_avg parser not found for RestHighLevelClient {es-pull}37027[#37027] (issue: {es-issue}36861[#36861])
Support merge nested Map in list for JIRA configurations {es-pull}37634[#37634] (issue: {es-issue}30068[#30068])
Watcher accounts constructed lazily {es-pull}36656[#36656]
Ensures watch definitions are valid json {es-pull}30692[#30692] (issue: {es-issue}29746[#29746])
Bubble-up exceptions from scheduler {es-pull}38317[#38317] (issue: {es-issue}38014[#38014])
Core: Revert back to joda’s multi date formatters {es-pull}36814[#36814] (issues: {es-issue}36447[#36447], {es-issue}36602[#36602])
Propagate Errors in executors to uncaught exception handler {es-pull}36137[#36137] (issue: {es-issue}28667[#28667])
Packaging: Update marker used to allow ELASTIC_PASSWORD {es-pull}37243[#37243] (issue: {es-issue}37240[#37240])
Packaging: Remove permission editing in postinst {es-pull}37242[#37242] (issue: {es-issue}37143[#37143])
ML: Fix error race condition on stop _all datafeeds and close _all jobs {es-pull}38113[#38113] (issue: {es-issue}37959[#37959])
[ML] Update ML results mappings on process start {es-pull}37706[#37706] (issue: {es-issue}37607[#37607])
[ML] Prevent submit after autodetect worker is stopped {es-pull}37700[#37700] (issue: {es-issue}37108[#37108])
[ML] Fix ML datafeed CCS with wildcarded cluster name {es-pull}37470[#37470] (issue: {es-issue}36228[#36228])
[ML] Update error message for process update {es-pull}37363[#37363]
[ML] Wait for autodetect to be ready in the datafeed {es-pull}37349[#37349] (issues: {es-issue}36810[#36810], {es-issue}37227[#37227])
[ML] Stop datafeeds running when their jobs are stale {es-pull}37227[#37227] (issue: {es-issue}36810[#36810])
[ML] Order GET job stats response by job id {es-pull}36841[#36841] (issue: {es-issue}36683[#36683])
[ML] Make GetJobStats work with arbitrary wildcards and groups {es-pull}36683[#36683] (issue: {es-issue}34745[#34745])
Treat put-mapping calls with _doc as a top-level key as typed calls. {es-pull}38032[#38032]
Correct deprec log in RestGetFieldMappingAction {es-pull}37843[#37843] (issue: {es-issue}37667[#37667])
Restore a noop _all metadata field for 6x indices {es-pull}37808[#37808] (issue: {es-issue}37429[#37429])
Make sure PutMappingRequest accepts content types other than JSON. {es-pull}37720[#37720]
Make sure to use the resolved type in DocumentMapperService#extractMappings. {es-pull}37451[#37451] (issue: {es-issue}36811[#36811])
MAPPING: Improve Precision for scaled_float {es-pull}37169[#37169] (issue: {es-issue}32570[#32570])
Make sure to accept empty unnested mappings in create index requests. {es-pull}37089[#37089]
Stop automatically nesting mappings in index creation requests. {es-pull}36924[#36924]
Rewrite SourceToParse with resolved docType {es-pull}36921[#36921] (issues: {es-issue}35790[#35790], {es-issue}36769[#36769])
Reload SSL context on file change for LDAP {es-pull}36937[#36937] (issues: {es-issue}30509[#30509], {es-issue}36923[#36923])
Do not resolve addresses in remote connection info {es-pull}36671[#36671] (issue: {es-issue}35658[#35658])
SQL: Prevent grouping over grouping functions {es-pull}38649[#38649] (issue: {es-issue}38308[#38308])
SQL: Relax StackOverflow circuit breaker for constants {es-pull}38572[#38572] (issue: {es-issue}38571[#38571])
SQL: Fix issue with IN not resolving to underlying keyword field {es-pull}38440[#38440] (issue: {es-issue}38424[#38424])
SQL: change the Intervals milliseconds precision to 3 digits {es-pull}38297[#38297] (issue: {es-issue}37423[#37423])
SQL: Fix esType for DATETIME/DATE and INTERVALS {es-pull}38179[#38179] (issue: {es-issue}38051[#38051])
SQL: Added SSL configuration options tests {es-pull}37875[#37875] (issue: {es-issue}37711[#37711])
SQL: Fix casting from date to numeric type to use millis {es-pull}37869[#37869] (issue: {es-issue}37655[#37655])
SQL: Fix BasicFormatter NPE {es-pull}37804[#37804]
SQL: Return Intervals in SQL format for CLI {es-pull}37602[#37602] (issues: {es-issue}29970[#29970], {es-issue}36186[#36186], {es-issue}36432[#36432])
SQL: fix object extraction from sources {es-pull}37502[#37502] (issue: {es-issue}37364[#37364])
SQL: Fix issue with field names containing "." {es-pull}37364[#37364] (issue: {es-issue}37128[#37128])
SQL: Fix bug regarding alias fields with dots {es-pull}37279[#37279] (issue: {es-issue}37224[#37224])
SQL: Proper handling of COUNT(field_name) and COUNT(DISTINCT field_name) {es-pull}37254[#37254] (issue: {es-issue}30285[#30285])
SQL: fix COUNT DISTINCT filtering {es-pull}37176[#37176] (issue: {es-issue}37086[#37086])
SQL: Fix issue with wrong NULL optimization {es-pull}37124[#37124] (issue: {es-issue}35872[#35872])
SQL: Fix issue with complex expression as args of PERCENTILE/_RANK {es-pull}37102[#37102] (issue: {es-issue}37099[#37099])
SQL: Handle the bwc Joda ZonedDateTime scripting class in Painless {es-pull}37024[#37024] (issue: {es-issue}37023[#37023])
SQL: Fix bug regarding histograms usage in scripting {es-pull}36866[#36866]
SQL: Fix issue with always false filter involving functions {es-pull}36830[#36830] (issue: {es-issue}35980[#35980])
SQL: protocol returns ISO 8601 String formatted dates instead of Long for JDBC/ODBC requests {es-pull}36800[#36800] (issue: {es-issue}36756[#36756])
SQL: Enhance Verifier to prevent aggregate or grouping functions from {es-pull}36799[#36799] (issue: {es-issue}36798[#36798])
SQL: Fix translation of LIKE/RLIKE keywords {es-pull}36672[#36672] (issues: {es-issue}36039[#36039], {es-issue}36584[#36584])
SQL: Scripting support for casting functions CAST and CONVERT {es-pull}36640[#36640] (issue: {es-issue}36061[#36061])
SQL: Concat should be always not nullable {es-pull}36601[#36601] (issue: {es-issue}36169[#36169])
SQL: Fix issue with complex HAVING and GROUP BY ordinal {es-pull}36594[#36594] (issue: {es-issue}36059[#36059])
Look up connection using the right cluster alias when releasing contexts {es-pull}38570[#38570]
Fix fetch source option in expand search phase {es-pull}37908[#37908] (issue: {es-issue}23829[#23829])
Change rational to saturation in script_score {es-pull}37766[#37766] (issue: {es-issue}37714[#37714])
Throw if two inner_hits have the same name {es-pull}37645[#37645] (issue: {es-issue}37584[#37584])
Ensure either success or failure path for SearchOperationListener is called {es-pull}37467[#37467] (issue: {es-issue}37185[#37185])
query_string should use indexed prefixes {es-pull}36895[#36895]
Avoid duplicate types deprecation messages in search-related APIs. {es-pull}36802[#36802]
Fix exit code for Security CLI tools  {es-pull}37956[#37956] (issue: {es-issue}37841[#37841])
Fix potential NPE in UsersTool {es-pull}37660[#37660]
Fix Concurrent Snapshot Ending And Stabilize Snapshot Finalization {es-pull}38368[#38368] (issue: {es-issue}38226[#38226])
Fix Two Races that Lead to Stuck Snapshots {es-pull}37686[#37686] (issues: {es-issue}32265[#32265], {es-issue}32348[#32348])
Fix Race in Concurrent Snapshot Delete and Create {es-pull}37612[#37612] (issue: {es-issue}37581[#37581])
Streamline S3 Repository- and Client-Settings {es-pull}37393[#37393]
[Zen2] Elect freshest master in upgrade {es-pull}37122[#37122] (issue: {es-issue}40[#40])
Fix cluster state persistence for single-node discovery {es-pull}36825[#36825]
Restore date aggregation performance in UTC case {es-pull}38221[#38221] (issue: {es-issue}37826[#37826])
Speed up converting of temporal accessor to zoned date time {es-pull}37915[#37915] (issue: {es-issue}37826[#37826])
Remove the deprecated _termvector endpoint. {es-pull}36131[#36131] (issues: {es-issue}36098[#36098], {es-issue}8484[#8484])
Remove deprecated Graph endpoints {es-pull}35956[#35956]
Validate metadata on _msearch {es-pull}35938[#35938] (issue: {es-issue}35869[#35869])
Make hits.total an object in the search response {es-pull}35849[#35849] (issue: {es-issue}33028[#33028])
Remove the distinction between query and filter context in QueryBuilders {es-pull}35354[#35354] (issue: {es-issue}35293[#35293])




    

Throw a parsing exception when boost is set in span_or query (#28390) {es-pull}34112[#34112] (issue: {es-issue}28390[#28390])
Deprecate types in index API {es-pull}36575[#36575] (issues: {es-issue}35190[#35190], {es-issue}35790[#35790])
Deprecate uses of _type as a field name in queries {es-pull}36503[#36503] (issue: {es-issue}35190[#35190])
Deprecate types in update_by_query and delete_by_query {es-pull}36365[#36365] (issue: {es-issue}35190[#35190])
For msearch templates, make sure to use the right name for deprecation logging. {es-pull}36344[#36344]
Deprecate types in termvector and mtermvector requests. {es-pull}36182[#36182]
Deprecate types in update requests. {es-pull}36181[#36181]
Deprecate types in document delete requests. {es-pull}36087[#36087]
Deprecate types in get, exists, and multi get. {es-pull}35930[#35930]
Deprecate types in search and multi search templates. {es-pull}35669[#35669]
Deprecate types in explain requests. {es-pull}35611[#35611]
Deprecate types in validate query requests. {es-pull}35575[#35575]
Deprecate types in count and msearch. {es-pull}35421[#35421] (issue: {es-issue}34041[#34041])
Re-deprecate xpack rollup endpoints {es-pull}36451[#36451] (issue: {es-issue}36044[#36044])
Deprecate X-Pack centric rollup endpoints {es-pull}35962[#35962] (issue: {es-issue}35958[#35958])
Adds deprecation logging to ScriptDocValues#getValues. {es-pull}34279[#34279] (issue: {es-issue}22919[#22919])
Conditionally use java time api in scripting {es-pull}31441[#31441]
Deprecate X-Pack centric license endpoints {es-pull}35959[#35959] (issue: {es-issue}35958[#35958])
Deprecate /_xpack/security/* in favor of /_security/* {es-pull}36293[#36293] (issue: {es-issue}35958[#35958])
Add support for inlined user dictionary in Nori {es-pull}36123[#36123] (issue: {es-issue}35842[#35842])
Add a prebuilt ICU Analyzer {es-pull}34958[#34958] (issue: {es-issue}34285[#34285])
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}36751[#36751] (issue: {es-issue}35320[#35320])
Integrate Lucene’s LatLonShape (BKD Backed GeoShapes) as default geo_shape indexing approach {es-pull}35320[#35320] (issue: {es-issue}32039[#32039])
Introduce HISTOGRAM grouping function {es-pull}36510[#36510] (issue: {es-issue}36509[#36509])
DATABASE() and USER() system functions {es-pull}35946[#35946] (issue: {es-issue}35863[#35863])
Introduce INTERVAL support   {es-pull}35521[#35521] (issue: {es-issue}29990[#29990])
Add intervals query {es-pull}36135[#36135] (issues: {es-issue}29636[#29636], {es-issue}32406[#32406])
Added soft limit to open scroll contexts #25244 {es-pull}36009[#36009] (issue: {es-issue}25244[#25244])
Added keyed response to pipeline percentile aggregations 22302 {es-pull}36392[#36392] (issue: {es-issue}22302[#22302])
Enforce max_buckets limit only in the final reduction phase {es-pull}36152[#36152] (issues: {es-issue}32125[#32125], {es-issue}35921[#35921])
Histogram aggs: add empty buckets only in the final reduce step {es-pull}35921[#35921]
Handles exists query in composite aggs {es-pull}35758[#35758]
Added parent validation for auto date histogram {es-pull}35670[#35670]
Allow word_delimiter_graph_filter to not adjust internal offsets {es-pull}36699[#36699] (issues: {es-issue}33710[#33710], {es-issue}34741[#34741])
Ensure TokenFilters only produce single tokens when parsing synonyms {es-pull}34331[#34331] (issue: {es-issue}34298[#34298])
Invalidate Token API enhancements - HLRC {es-pull}36362[#36362] (issue: {es-issue}35388[#35388])
Add DEBUG/TRACE logs for LDAP bind {es-pull}36028[#36028]
Add Tests for findSamlRealm {es-pull}35905[#35905]
Add realm information for Authenticate API {es-pull}35648[#35648]
Formal support for "password_hash" in Put User {es-pull}35242[#35242] (issue: {es-issue}34729[#34729])
Add time since last auto follow fetch to auto follow stats {es-pull}36542[#36542] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Clean followed leader index UUIDs in auto follow metadata {es-pull}36408[#36408] (issue: {es-issue}33007[#33007])
Change AutofollowCoordinator to use wait_for_metadata_version {es-pull}36264[#36264] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Refactor AutoFollowCoordinator to track leader indices per remote cluster {es-pull}36031[#36031] (issues: {es-issue}33007[#33007], {es-issue}35895[#35895])
Replace usages of AtomicBoolean based block of code by the RunOnce class {es-pull}35553[#35553] (issue: {es-issue}35489[#35489])
Added wait_for_metadata_version parameter to cluster state api. {es-pull}35535[#35535]
Extract RunOnce into a dedicated class {es-pull}35489[#35489]
Introduce elasticsearch-core jar {es-pull}28191[#28191] (issue: {es-issue}27933[#27933])
Rename core module to server {es-pull}28180[#28180] (issue: {es-issue}27933[#27933])
Rename seq# powered optimistic concurrency control parameters to ifSeqNo/ifPrimaryTerm  {es-pull}36757[#36757] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Expose Sequence Number based Optimistic Concurrency Control in the rest layer {es-pull}36721[#36721] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add doc’s sequence number + primary term to GetResult and use it for updates {es-pull}36680[#36680] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Add seq no powered optimistic locking support to the index and delete transport actions {es-pull}36619[#36619] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
[Close Index API] Mark shard copy as stale if needed during shard verification {es-pull}36755[#36755]
[Close Index API] Refactor MetadataIndexStateService {es-pull}36354[#36354] (issue: {es-issue}36249[#36249])
[Close Index API] Add TransportShardCloseAction for pre-closing verifications {es-pull}36249[#36249]
TransportResyncReplicationAction should not honour blocks {es-pull}35795[#35795] (issues: {es-issue}35332[#35332], {es-issue}35597[#35597])
Expose all permits acquisition in IndexShard and TransportReplicationAction {es-pull}35540[#35540] (issue: {es-issue}33888[#33888])
[RCI] Check blocks while having index shard permit in TransportReplicationAction {es-pull}35332[#35332] (issue: {es-issue}33888[#33888])
Add sequence numbers based optimistic concurrency control support to Engine {es-pull}36467[#36467] (issues: {es-issue}10708[#10708], {es-issue}36148[#36148])
Require soft-deletes when access changes snapshot {es-pull}36446[#36446]
Use delCount of SegmentInfos to calculate numDocs {es-pull}36323[#36323]
Always configure soft-deletes field of IndexWriterConfig {es-pull}36196[#36196] (issue: {es-issue}36141[#36141])
Enable soft-deletes by default on 7.0.0 or later {es-pull}36141[#36141]
Always return false from refreshNeeded on ReadOnlyEngine {es-pull}35837[#35837] (issue: {es-issue}35785[#35785])
Add a _freeze / _unfreeze API {es-pull}35592[#35592] (issue: {es-issue}34352[#34352])
[RCI] Add IndexShardOperationPermits.asyncBlockOperations(ActionListener<Releasable>) {es-pull}34902[#34902] (issue: {es-issue}33888[#33888])
Add support for CCR Get Auto Follow Pattern apis {es-pull}36049[#36049] (issue: {es-issue}33824[#33824])
Add support for CCR Delete Auto Follow Pattern API {es-pull}35981[#35981] (issue: {es-issue}33824[#33824])
Remove fromXContent from IndexUpgradeInfoResponse {es-pull}35934[#35934]
Add delete expired data API {es-pull}35906[#35906] (issue: {es-issue}29827[#29827])
Execute watch API {es-pull}35868[#35868] (issue: {es-issue}29827[#29827])
Add ability to put user with a password hash {es-pull}35844[#35844] (issue: {es-issue}35242[#35242])
Add ML find file structure API {es-pull}35833[#35833] (issue: {es-issue}29827[#29827])
Add support for get roles API {es-pull}35787[#35787] (issue: {es-issue}29827[#29827])
Added support for CCR Put Auto Follow Pattern API {es-pull}35780[#35780] (issue: {es-issue}33824[#33824])
XPack ML info action {es-pull}35777[#35777] (issue: {es-issue}29827[#29827])
ML Delete event from Calendar {es-pull}35760[#35760] (issue: {es-issue}29827[#29827])
Add ML revert model snapshot API {es-pull}35750[#35750] (issue: {es-issue}29827[#29827])
ML Get Calendar Events {es-pull}35747[#35747] (issue: {es-issue}29827[#29827])
Add high-level REST client API for _freeze and _unfreeze {es-pull}35723[#35723] (issue: {es-issue}34352[#34352])
Fix issue in equals impl for GlobalOperationPrivileges {es-pull}35721[#35721]
ML Delete job from calendar {es-pull}35713[#35713] (issue: {es-issue}29827[#29827])
ML Add Event To Calendar API {es-pull}35704[#35704] (issue: {es-issue}29827[#29827])
Add ML update model snapshot API (#35537) {es-pull}35694[#35694] (issue: {es-issue}29827[#29827])
Add support for CCR Unfollow API {es-pull}35693[#35693] (issue: {es-issue}33824[#33824])
Clean up PutLicenseResponse {es-pull}35689[#35689] (issue: {es-issue}35547[#35547])
Clean up StartBasicResponse {es-pull}35688[#35688] (issue: {es-issue}35547[#35547])
Add support for put privileges API {es-pull}35679[#35679]
ML Add Job to Calendar API {es-pull}35666[#35666] (issue: {es-issue}29827[#29827])
Add support for CCR Resume Follow API {es-pull}35638[#35638] (issue: {es-issue}33824[#33824])
Add support for get application privileges API {es-pull}35556[#35556] (issue: {es-issue}29827[#29827])
Clean up XPackInfoResponse class and related tests {es-pull}35547[#35547]
Add parameters to stopRollupJob API {es-pull}35545[#35545] (issue: {es-issue}34811[#34811])
Add ML delete model snapshot API {es-pull}35537[#35537] (issue: {es-issue}29827[#29827])
Add get watch API {es-pull}35531[#35531] (issue: {es-issue}29827[#29827])
Add ML Update Filter API {es-pull}35522[#35522] (issue: {es-issue}29827[#29827])
Add ml get filters api {es-pull}35502[#35502] (issue: {es-issue}29827[#29827])
Add ML get model snapshots API {es-pull}35487[#35487] (issue: {es-issue}29827[#29827])
Add "_has_privileges" API to Security Client {es-pull}35479[#35479] (issue: {es-issue}29827[#29827])
Add Delete Privileges API to HLRC {es-pull}35454[#35454] (issue: {es-issue}29827[#29827])
Add support for CCR Put Follow API {es-pull}35409[#35409]
Add ML delete filter action {es-pull}35382[#35382] (issue: {es-issue}29827[#29827])
Add delete user action {es-pull}35294[#35294] (issue: {es-issue}29827[#29827])
HLRC for _mtermvectors {es-pull}35266[#35266] (issues: {es-issue}27205[#27205], {es-issue}33447[#33447])
Reindex API with wait_for_completion false {es-pull}35202[#35202] (issue: {es-issue}27205[#27205])
Add watcher stats API {es-pull}35185[#35185] (issue: {es-issue}29827[#29827])
HLRC support for getTask {es-pull}35166[#35166] (issue: {es-issue}27205[#27205])
Add GetRollupIndexCaps API {es-pull}35102[#35102] (issue: {es-issue}29827[#29827])
HLRC: migration api - upgrade {es-pull}34898[#34898] (issue: {es-issue}29827[#29827])
Add stop rollup job support to HL REST Client {es-pull}34702[#34702] (issue: {es-issue}29827[#29827])
Bulk Api support for global parameters {es-pull}34528[#34528] (issue: {es-issue}26026[#26026])
Add delete rollup job support to HL REST Client {es-pull}34066[#34066] (issue: {es-issue}29827[#29827])
Add support for get license basic/trial status API {es-pull}33176[#33176] (issue: {es-issue}29827[#29827])
Add machine learning open job {es-pull}32860[#32860] (issue: {es-issue}29827[#29827])
Add ML HLRC wrapper and put_job API call {es-pull}32726[#32726]
Add Get Snapshots High Level REST API {es-pull}31537[#31537] (issue: {es-issue}27205[#27205])
Adds a name of the field to geopoint parsing errors {es-pull}36529[#36529] (issue: {es-issue}15965[#15965])
Add support to ShapeBuilders for building Lucene geometry {es-pull}35707[#35707] (issue: {es-issue}35320[#35320])
Add ST_WktToSQL function {es-pull}35416[#35416] (issue: {es-issue}29872[#29872])
Create the ML annotations index {es-pull}36731[#36731] (issues: {es-issue}26034[#26034], {es-issue}33376[#33376])
Split in batches and migrate all jobs and datafeeds {es-pull}36716[#36716] (issue: {es-issue}32905[#32905])
Add cluster setting to enable/disable config  migration {es-pull}36700[#36700] (issue: {es-issue}32905[#32905])
Add audits when deprecation warnings occur with datafeed start {es-pull}36233[#36233]
Add lazy parsing for DatafeedConfig:Aggs,Query {es-pull}36117[#36117]
Add support for lazy nodes (#29991) {es-pull}34538[#34538] (issue: {es-issue}29991[#29991])
Add sni name to SSLEngine in netty transport {es-pull}33144[#33144] (issue: {es-issue}32517[#32517])
Add cors support to NioHttpServerTransport {es-pull}30827[#30827] (issue: {es-issue}28898[#28898])
Reintroduce mandatory http pipelining support {es-pull}30820[#30820]
Make http pipelining support mandatory {es-pull}30695[#30695] (issues: {es-issue}28898[#28898], {es-issue}29500[#29500])
Add nio http server transport {es-pull}29587[#29587] (issue: {es-issue}28898[#28898])
Selectors operate on channel contexts {es-pull}28468[#28468] (issue: {es-issue}27260[#27260])
Unify nio read / write channel contexts {es-pull}28160[#28160] (issue: {es-issue}27260[#27260])
Create nio-transport plugin for NioTransport {es-pull}27949[#27949] (issue: {es-issue}27260[#27260])
Add elasticsearch-nio jar for base nio classes {es-pull}27801[#27801] (issue: {es-issue}27802[#27802])
Add NioGroup for use in different transports {es-pull}27737[#27737] (issue: {es-issue}27260[#27260])
Add read timeouts to http module {es-pull}27713[#27713]
Implement byte array reusage in NioTransport {es-pull}27696[#27696] (issue: {es-issue}27563[#27563])
Introduce resizable inbound byte buffer {es-pull}27551[#27551] (issue: {es-issue}27563[#27563])
Decouple nio constructs from the tcp transport {es-pull}27484[#27484] (issue: {es-issue}27260[#27260])
Remove manual tracking of registered channels {es-pull}27445[#27445] (issue: {es-issue}27260[#27260])
Remove tcp profile from low level nio channel {es-pull}27441[#27441] (issue: {es-issue}27260[#27260])
Decouple ChannelFactory from Tcp classes {es-pull}27286[#27286] (issue: {es-issue}27260[#27260])
Add non-X-Pack centric rollup endpoints {es-pull}36383[#36383] (issues: {es-issue}35958[#35958], {es-issue}35962[#35962])
Add more diagnostic stats to job {es-pull}35471[#35471]
Add wait_for_completion option to StopRollupJob API {es-pull}34811[#34811] (issue: {es-issue}34574[#34574])
Add copy constructor to SearchRequest {es-pull}36641[#36641] (issue: {es-issue}32125[#32125])
Add raw sort values to SearchSortValues transport serialization {es-pull}36617[#36617] (issue: {es-issue}32125[#32125])
Add sort and collapse info to SearchHits transport serialization {es-pull}36555[#36555] (issue: {es-issue}32125[#32125])
Add default methods to DocValueFormat {es-pull}36480[#36480]
Respect indices options on _msearch {es-pull}35887[#35887]
Allow efficient can_match phases on frozen indices {es-pull}35431[#35431] (issues: {es-issue}34352[#34352], {es-issue}34357[#34357])
Add a new query type - ScriptScoreQuery {es-pull}34533[#34533] (issues: {es-issue}23850[#23850], {es-issue}27588[#27588], {es-issue}30303[#30303])
Repo Creation out of ClusterStateTask {es-pull}36157[#36157] (issue: {es-issue}9488[#9488])
Add read-only repository verification {es-pull}35731[#35731] (issue: {es-issue}35703[#35703])
Extend the ODBC metric by differentiating between 32 and 64bit platforms {es-pull}36753[#36753] (issue: {es-issue}36740[#36740])
Fix wrong appliance of StackOverflow limit for IN {es-pull}36724[#36724] (issue: {es-issue}36592[#36592])
Introduce NOW/CURRENT_TIMESTAMP function {es-pull}36562[#36562] (issue: {es-issue}36534[#36534])
Move requests' parameters to requests JSON body {es-pull}36149[#36149] (issue: {es-issue}35992[#35992])
Make INTERVAL millis optional {es-pull}36043[#36043] (issue: {es-issue}36032[#36032])
Implement data type verification for conditionals {es-pull}35916[#35916] (issue: {es-issue}35907[#35907])
Implement GREATEST and LEAST functions {es-pull}35879[#35879] (issue: {es-issue}35878[#35878])
Implement null safe equality operator <⇒ {es-pull}35873[#35873] (issue: {es-issue}35871[#35871])
SYS COLUMNS returns ODBC specific schema {es-pull}35870[#35870] (issue: {es-issue}35376[#35376])
Polish grammar for intervals {es-pull}35853[#35853]
Add filtering to SYS TYPES {es-pull}35852[#35852] (issue: {es-issue}35342[#35342])
Implement NULLIF(expr1, expr2) function {es-pull}35826[#35826] (issue: {es-issue}35818[#35818])
Lock down JDBC driver {es-pull}35798[#35798] (issue: {es-issue}35437[#35437])
Implement NVL(expr1, expr2) {es-pull}35794[#35794] (issue: {es-issue}35782[#35782])
Implement ISNULL(expr1, expr2) {es-pull}35793[#35793] (issue: {es-issue}35781[#35781])
Implement IFNULL variant of COALESCE {es-pull}35762[#35762] (issue: {es-issue}35749[#35749])
XPack FeatureSet functionality {es-pull}35725[#35725] (issue: {es-issue}34821[#34821])
Perform lazy evaluation of mismatched mappings {es-pull}35676[#35676] (issues: {es-issue}35659[#35659], {es-issue}35675[#35675])
Improve validation of unsupported fields {es-pull}35675[#35675] (issue: {es-issue}35673[#35673])
Move internals from Joda to java.time {es-pull}35649[#35649] (issue: {es-issue}35633[#35633])
Periodically try to reassign unassigned persistent tasks {es-pull}36069[#36069] (issue: {es-issue}35792[#35792])
Only require task permissions {es-pull}35667[#35667] (issue: {es-issue}35573[#35573])
Retry if task can’t be written {es-pull}35054[#35054] (issue: {es-issue}33764[#33764])
Zen2: Persist cluster states the old way on non-master-eligible nodes {es-pull}36247[#36247] (issue: {es-issue}3[#3])




    

[Zen2] Storage layer WriteStateException propagation {es-pull}36052[#36052]
[Zen2] Implement Tombstone REST APIs {es-pull}36007[#36007]
[Zen2] Update default for USE_ZEN2 to true {es-pull}35998[#35998]
[Zen2] Add warning if cluster fails to form fast enough {es-pull}35993[#35993]
[Zen2] Allow Setting a List of Bootstrap Nodes to Wait for {es-pull}35847[#35847]
[Zen2] VotingTombstone class {es-pull}35832[#35832]
[Zen2] PersistedState interface implementation {es-pull}35819[#35819]
[Zen2] Support rolling upgrades from Zen1 {es-pull}35737[#35737]
[Zen2] Add lag detector {es-pull}35685[#35685]
[Zen2] Move ClusterState fields to be persisted to ClusterState.Metadata {es-pull}35625[#35625]
[Zen2] Introduce ClusterBootstrapService {es-pull}35488[#35488]
[Zen2] Introduce vote withdrawal {es-pull}35446[#35446]
Zen2: Add basic Zen1 transport-level BWC {es-pull}35443[#35443]
fix MultiValuesSourceFieldConfig toXContent {es-pull}36525[#36525] (issue: {es-issue}36474[#36474])
Cache the score of the parent document in the nested agg {es-pull}36019[#36019] (issues: {es-issue}34555[#34555], {es-issue}35985[#35985])
Correct implemented interface of ParsedReverseNested {es-pull}35455[#35455] (issue: {es-issue}35449[#35449])
Handle IndexOrDocValuesQuery in composite aggregation {es-pull}35392[#35392]
Fix kerberos setting registration {es-pull}35986[#35986] (issues: {es-issue}30241[#30241], {es-issue}35942[#35942])
Add support for Kerberos V5 Oid {es-pull}35764[#35764] (issue: {es-issue}34763[#34763])
Fix jdbc jar pom to not include deps {es-pull}36036[#36036] (issue: {es-issue}32014[#32014])
Fix official plugins list {es-pull}35661[#35661] (issue: {es-issue}35623[#35623])
AutoFollowCoordinator should tolerate that auto follow patterns may be removed {es-pull}35945[#35945] (issue: {es-issue}35937[#35937])
Only auto follow indices when all primary shards have started {es-pull}35814[#35814] (issue: {es-issue}35480[#35480])
Avoid NPE in follower stats when no tasks metadata {es-pull}35802[#35802]
Fix the names of CCR stats endpoints in usage API {es-pull}35438[#35438]
Fix CompositeBytesReference#slice to not throw AIOOBE with legal offsets. {es-pull}35955[#35955] (issue: {es-issue}35950[#35950])
Suppress CachedTimeThread in hot threads output {es-pull}35558[#35558] (issue: {es-issue}23175[#23175])
Upgrade to Joda 2.10.1 {es-pull}35410[#35410] (issue: {es-issue}33749[#33749])
Combine the execution of an exclusive replica operation with primary term update {es-pull}36116[#36116] (issue: {es-issue}35850[#35850])
ActiveShardCount should not fail when closing the index {es-pull}35936[#35936]
Set Lucene version upon index creation. {es-pull}36038[#36038] (issue: {es-issue}33826[#33826])
Wrap can_match reader with ElasticsearchDirectoryReader {es-pull}35857[#35857]
Copy checkpoint atomically when rolling generation {es-pull}35407[#35407]
More robust handling of ignore_malformed in geoshape parsing {es-pull}35603[#35603] (issues: {es-issue}34047[#34047], {es-issue}34498[#34498])
Better handling of malformed geo_points {es-pull}35554[#35554] (issue: {es-issue}35419[#35419])
Enables coerce support in WKT polygon parser {es-pull}35414[#35414] (issue: {es-issue}35059[#35059])
Fix duplicate phrase in shrink/split error message {es-pull}36734[#36734] (issue: {es-issue}36729[#36729])
Raise a 404 exception when document source is not found (#33384) {es-pull}34083[#34083] (issue: {es-issue}33384[#33384])
Fix on_failure with Drop processor {es-pull}36686[#36686] (issue: {es-issue}36151[#36151])
Support default pipelines + bulk upserts {es-pull}36618[#36618] (issue: {es-issue}36219[#36219])
Support default pipeline through an alias {es-pull}36231[#36231] (issue: {es-issue}35817[#35817])
Prevent stack overflow while copying ML jobs and datafeeds {es-pull}36370[#36370] (issue: {es-issue}36360[#36360])
Adjust file structure finder parser config {es-pull}35935[#35935]
Fix find_file_structure NPE with should_trim_fields {es-pull}35465[#35465] (issue: {es-issue}35462[#35462])
Prevent notifications being created on deletion of a non existent job {es-pull}35337[#35337] (issues: {es-issue}34058[#34058], {es-issue}35336[#35336])
Clear Job#finished_time when it is opened (#32605) {es-pull}32755[#32755]
Fix thread leak when waiting for job flush (#32196) {es-pull}32541[#32541] (issue: {es-issue}32196[#32196])
Fix CPoissonMeanConjugate sampling error. {ml-pull}335[#335]
Do not resolve addresses in remote connection info {es-pull}36671[#36671] (issue: {es-issue}35658[#35658])
Always compress based on the settings {es-pull}36522[#36522] (issue: {es-issue}36399[#36399])
http.publish_host Should Contain CNAME {es-pull}32806[#32806] (issue: {es-issue}22029[#22029])
Adjust SSLDriver behavior for JDK11 changes {es-pull}32145[#32145] (issues: {es-issue}32122[#32122], {es-issue}32144[#32144])
Add TRACE, CONNECT, and PATCH http methods {es-pull}31035[#31035] (issue: {es-issue}31017[#31017])
Transport client: Don’t validate node in handshake {es-pull}30737[#30737] (issue: {es-issue}30141[#30141])
Fix issue with finishing handshake in ssl driver {es-pull}30580[#30580]
Remove potential nio selector leak {es-pull}27825[#27825]
Fix issue where the incorrect buffers are written {es-pull}27695[#27695] (issue: {es-issue}27551[#27551])
Do not set SO_LINGER on server channels {es-pull}26997[#26997]
Do not set SO_LINGER to 0 when not shutting down {es-pull}26871[#26871] (issue: {es-issue}26764[#26764])
Release pipelined http responses on close {es-pull}26226[#26226]
Fix error message when package install fails due to missing Java {es-pull}36077[#36077] (issue: {es-issue}31845[#31845])
Add missing entries to conffiles  {es-pull}35810[#35810] (issue: {es-issue}35691[#35691])
Properly support no-offset date formatting {es-pull}36316[#36316] (issue: {es-issue}36306[#36306])
[Painless] Generate Bridge Methods {es-pull}36097[#36097]
Fix serialization bug in painless execute api request {es-pull}36075[#36075] (issue: {es-issue}36050[#36050])
Actually add joda time back to whitelist {es-pull}35965[#35965] (issue: {es-issue}35915[#35915])
Add back joda to whitelist {es-pull}35915[#35915] (issue: {es-issue}35913[#35913])
Fix translation of LIKE/RLIKE keywords {es-pull}36672[#36672] (issues: {es-issue}36039[#36039], {es-issue}36584[#36584])
Scripting support for casting functions CAST and CONVERT {es-pull}36640[#36640] (issue: {es-issue}36061[#36061])
Fix translation to painless for conditionals {es-pull}36636[#36636] (issue: {es-issue}36631[#36631])
Concat should be always not nullable {es-pull}36601[#36601] (issue: {es-issue}36169[#36169])
Fix MOD() for long and integer arguments {es-pull}36599[#36599] (issue: {es-issue}36364[#36364])
Fix issue with complex HAVING and GROUP BY ordinal {es-pull}36594[#36594] (issue: {es-issue}36059[#36059])
Be lenient for tests involving comparison to H2 but strict for csv spec tests {es-pull}36498[#36498] (issue: {es-issue}36483[#36483])
Non ISO 8601 versions of DAY_OF_WEEK and WEEK_OF_YEAR functions {es-pull}36358[#36358] (issue: {es-issue}36263[#36263])
Do not ignore all fields whose names start with underscore {es-pull}36214[#36214] (issue: {es-issue}36206[#36206])
Fix issue with wrong data type for scripted Grouping keys {es-pull}35969[#35969] (issue: {es-issue}35662[#35662])
Fix translation of math functions to painless {es-pull}35910[#35910] (issue: {es-issue}35654[#35654])
Fix jdbc jar to include deps {es-pull}35602[#35602]
Fix query translation for scripted queries {es-pull}35408[#35408] (issue: {es-issue}35232[#35232])
Clear the cursor if nested inner hits are enough to fulfill the query required limits {es-pull}35398[#35398] (issue: {es-issue}35176[#35176])
Introduce IsNull node to simplify expressions {es-pull}35206[#35206] (issues: {es-issue}34876[#34876], {es-issue}35171[#35171])
The SSL default configuration shouldn’t override the https protocol if used {es-pull}34635[#34635] (issue: {es-issue}33817[#33817])
Minor fix for javadoc {es-pull}32573[#32573] (issue: {es-issue}32553[#32553])
Fix custom AUTO issue with Fuzziness#toXContent {es-pull}35807[#35807] (issue: {es-issue}33462[#33462])
Fix analyzed prefix query in query_string {es-pull}35756[#35756] (issue: {es-issue}31702[#31702])
Fix problem with MatchNoDocsQuery in disjunction queries {es-pull}35726[#35726] (issue: {es-issue}34708[#34708])
Fix phrase_slop in query_string query {es-pull}35533[#35533] (issue: {es-issue}35125[#35125])
Add a More Like This query routing requirement check (#29678) {es-pull}33974[#33974]
Upgrade GCS Dependencies to 1.55.0 {es-pull}36634[#36634] (issues: {es-issue}35229[#35229], {es-issue}35459[#35459])
Improve Resilience SnapshotShardService {es-pull}36113[#36113] (issue: {es-issue}32265[#32265])
Keep SnapshotsInProgress State in Sync with Routing Table {es-pull}35710[#35710]
Ensure that gcs client creation is privileged {es-pull}25938[#25938] (issue: {es-issue}25932[#25932])
Make calls to CloudBlobContainer#exists privileged {es-pull}25937[#25937] (issue: {es-issue}25931[#25931])
Fix Watcher NotificationService’s secure settings {es-pull}35610[#35610] (issue: {es-issue}35378[#35378])
Fix integration tests to ensure correct start/stop of Watcher {es-pull}35271[#35271] (issues: {es-issue}29877[#29877], {es-issue}30705[#30705], {es-issue}33291[#33291], {es-issue}34448[#34448], {es-issue}34462[#34462])
Cancel GetDiscoveredNodesAction when bootstrapped {es-pull}36423[#36423] (issues: {es-issue}36380[#36380], {es-issue}36381[#36381])
[Zen2] Only elect master-eligible nodes {es-pull}35996[#35996]
[Zen2] Remove duplicate discovered peers {es-pull}35505[#35505]
The changes listed below have been released for the first time in Elasticsearch 7.0.0-alpha1.
Breaking changes
Aggregations
Remove support for deprecated params._agg/_aggs for scripted metric aggregations {es-pull}32979[#32979] (issues: {es-issue}29328[#29328], {es-issue}31597[#31597])
Percentile/Ranks should return null instead of NaN when empty {es-pull}30460[#30460] (issue: {es-issue}29066[#29066])
Render sum as zero if count is zero for stats aggregation {es-pull}27193[#27193] (issue: {es-issue}26893[#26893])
Remove delimited_payload_filter {es-pull}27705[#27705] (issues: {es-issue}26625[#26625], {es-issue}27704[#27704])
Limit the number of tokens produced by _analyze {es-pull}27529[#27529] (issue: {es-issue}27038[#27038])
Add limits for ngram and shingle settings {es-pull}27211[#27211] (issue: {es-issue}25887[#25887])
Version conflict exception message enhancement {es-pull}29432[#29432] (issue: {es-issue}21278[#21278])
Using ObjectParser in UpdateRequest {es-pull}29293[#29293] (issue: {es-issue}28740[#28740])
Remove the suggest metric from stats APIs {es-pull}29635[#29635] (issue: {es-issue}29589[#29589])
Align cat thread pool info to thread pool config {es-pull}29195[#29195] (issue: {es-issue}29123[#29123])
Align thread pool info to thread pool configuration {es-pull}29123[#29123] (issue: {es-issue}29113[#29113])
Introduce durability of circuit breaking exception {es-pull}34460[#34460] (issue: {es-issue}31986[#31986])
Circuit-break based on real memory usage {es-pull}31767[#31767]
CCS: Drop http address from remote cluster info {es-pull}29568[#29568] (issue: {es-issue}29207[#29207])
Remove the index thread pool {es-pull}29556[#29556]
Main response should not have status 503 when okay {es-pull}29045[#29045] (issue: {es-issue}8902[#8902])
Automatically prepare indices for splitting {es-pull}27451[#27451]
Don’t refresh on _flush _force_merge and _upgrade {es-pull}27000[#27000] (issue: {es-issue}26972[#26972])
Remove support for deprecated StoredScript contexts {es-pull}31394[#31394] (issues: {es-issue}27612[#27612], {es-issue}28939[#28939])
Scripting: Remove getDate methods from ScriptDocValues {es-pull}30690[#30690]
Handle missing and multiple values in script {es-pull}29611[#29611] (issue: {es-issue}29286[#29286])
Drop ScriptDocValues#date and ScriptDocValues#dates in 7.0.0 [ISSUE] {es-pull}23008[#23008]
Match phrase queries against non-indexed fields should throw an exception {es-pull}31060[#31060]
Remove legacy mapping code. {es-pull}29224[#29224]
Reject updates to the default mapping. {es-pull}29165[#29165] (issues: {es-issue}15613[#15613], {es-issue}28248[#28248])
Remove the update_all_types option. {es-pull}28288[#28288]
Remove the default mapping. {es-pull}28248[#28248]
Reject the index_options parameter for numeric fields {es-pull}26668[#26668] (issue: {es-issue}21475[#21475])
Network: Remove http.enabled setting {es-pull}29601[#29601] (issue: {es-issue}12792[#12792])
Remove HTTP max content length leniency {es-pull}29337[#29337]
Add minimal sanity checks to custom/scripted similarities. {es-pull}33564[#33564] (issue: {es-issue}33309[#33309])
Scroll queries asking for rescore are considered invalid {es-pull}32918[#32918] (issue: {es-issue}31775[#31775])
Remove deprecated url parameters _source_include and _source_exclude {es-pull}35097[#35097] (issues: {es-issue}22792[#22792], {es-issue}33475[#33475])
Disallow negative query boost {es-pull}34486[#34486] (issue: {es-issue}33309[#33309])
Forbid negative weight in Function Score Query {es-pull}33390[#33390] (issue: {es-issue}31927[#31927])
In the field capabilities API, remove support for providing fields in the request body. {es-pull}30185[#30185]
Remove deprecated options for query_string {es-pull}29203[#29203] (issue: {es-issue}25551[#25551])
Fix Laplace scorer to multiply by alpha (and not add) {es-pull}27125[#27125]
Remove _primary and _replica shard preferences {es-pull}26791[#26791] (issue: {es-issue}26335[#26335])
Limit the number of expanded fields it query_string and simple_query_string {es-pull}26541[#26541] (issue: {es-issue}25105[#25105])
Make purely negative queries return scores of 0. {es-pull}26015[#26015] (issue: {es-issue}23449[#23449])
Include size of snapshot in snapshot metadata  {es-pull}30890[#30890] (issue: {es-issue}18543[#18543])
Remove azure deprecated settings {es-pull}26099[#26099] (issue: {es-issue}23405[#23405])
drop elasticsearch-translog for 7.0 {es-pull}33373[#33373] (issues: {es-issue}31389[#31389], {es-issue}32281[#32281])
completely drop index.shard.check_on_startup: fix for 7.0 {es-pull}33194[#33194]
Fix threshold frequency computation in Suggesters {es-pull}34312[#34312] (issue: {es-issue}34282[#34282])
Make Geo Context Mapping Parsing More Strict {es-pull}32821[#32821] (issues: {es-issue}32202[#32202], {es-issue}32412[#32412])
Make Geo Context Parsing More Strict {es-pull}32412[#32412] (issue: {es-issue}32202[#32202])
Remove the ability to index or query context suggestions without context {es-pull}31007[#31007] (issue: {es-issue}30712[#30712])
REST hl client: cluster health to default to cluster level {es-pull}31268[#31268] (issue: {es-issue}29331[#29331])
REST high-level Client: remove deprecated API methods {es-pull}31200[#31200] (issue: {es-issue}31069[#31069])
Replace parameter unicodeSetFilter with unicode_set_filter  {es-pull}29215[#29215] (issue: {es-issue}22823[#22823])
Replace delimited_payload_filter by delimited_payload {es-pull}26625[#26625] (issue: {es-issue}21978[#21978])
Add “took” timing info to response for _msearch/template API {es-pull}30961[#30961] (issue: {es-issue}30957[#30957])
Expose the lucene Matches API to searches [ISSUE] {es-pull}29631[#29631]
Add allow_partial_search_results flag to search requests with default setting true {es-pull}28440[#28440] (issue: {es-issue}27435[#27435])
Enable adaptive replica selection by default {es-pull}26522[#26522] (issue: {es-issue}24915[#24915])
do retry if primary fails on AsyncAfterWriteAction {es-pull}31857[#31857] (issues: {es-issue}31716[#31716], {es-issue}31755[#31755])
handle AsyncAfterWriteAction exception before listener is registered {es-pull}31755[#31755] (issue: {es-issue}31716[#31716])
Use IndexWriter#flushNextBuffer to free memory {es-pull}27753[#27753]
Remove pre 6.0.0 support from InternalEngine {es-pull}27720[#27720]
Add rollover-creation-date setting to rolled over index {es-pull}31144[#31144] (issue: {es-issue}30887[#30887])
add is-write-index flag to aliases {es-pull}30942[#30942]
Make index and bulk APIs work without types. {es-pull}29479[#29479]
Have circuit breaker succeed on unknown mem usage {es-pull}33125[#33125] (issue: {es-issue}31767[#31767])
Account for XContent overhead in in-flight breaker {es-pull}31613[#31613]
Script Stats: Add compilation limit counter to stats {es-pull}26387[#26387]
Improved IndexNotFoundException’s default error message {es-pull}34649[#34649] (issue: {es-issue}34628[#34628])
Set a bounded default for http.max_warning_header_count [ISSUE] {es-pull}33479[#33479]
Remove hand-coded XContent duplicate checks {es-pull}34588[#34588] (issues: {es-issue}22073[#22073], {es-issue}22225[#22225], {es-issue}22253[#22253])
Add the include_type_name option to the search and document APIs. {es-pull}29506[#29506] (issue: {es-issue}15613[#15613])
Validate op_type for _create {es-pull}27483[#27483]
Add cors support to NioHttpServerTransport {es-pull}30827[#30827] (issue: {es-issue}28898[#28898])
Reintroduce mandatory http pipelining support {es-pull}30820[#30820]
Make http pipelining support mandatory {es-pull}30695[#30695] (issues: {es-issue}28898[#28898], {es-issue}29500[#29500])
Add nio http server transport {es-pull}29587[#29587] (issue: {es-issue}28898[#28898])
Add class for serializing message to bytes {es-pull}29384[#29384] (issue: {es-issue}28898[#28898])
Selectors operate on channel contexts {es-pull}28468[#28468] (issue: {es-issue}27260[#27260])
Unify nio read / write channel contexts {es-pull}28160[#28160] (issue: {es-issue}27260[#27260])
Create nio-transport plugin for NioTransport {es-pull}27949[#27949] (issue: {es-issue}27260[#27260])
Add elasticsearch-nio jar for base nio classes {es-pull}27801[#27801] (issue: {es-issue}27802[#27802])
Make limit on number of expanded fields configurable {es-pull}35284[#35284] (issues: {es-issue}26541[#26541], {es-issue}34778[#34778])
Search: Simply SingleFieldsVisitor {es-pull}34052[#34052]
Don’t count hits via the collector if the hit count can be computed from index stats. {es-pull}33701[#33701]
Limit the number of concurrent requests per node {es-pull}31206[#31206] (issue: {es-issue}31192[#31192])
Default max concurrent search req. numNodes * 5 {es-pull}31171[#31171] (issues: {es-issue}30783[#30783], {es-issue}30994[#30994])
Change ScriptException status to 400 (bad request) {es-pull}30861[#30861] (issue: {es-issue}12315[#12315])
Change default value to true for transpositions parameter of fuzzy query {es-pull}26901[#26901]
Introducing "took" time (in ms) for _msearch {es-pull}23767[#23767] (issue: {es-issue}23131[#23131])
[Zen2] Reconfigure cluster as its membership changes {es-pull}34592[#34592] (issue: {es-issue}33924[#33924])
Zen2: Fail fast on disconnects {es-pull}34503[#34503]
[Zen2] Add storage-layer disruptions to CoordinatorTests {es-pull}34347[#34347]
[Zen2] Add low-level bootstrap implementation {es-pull}34345[#34345]
[Zen2] Gather votes from all nodes {es-pull}34335[#34335]
Zen2: Add Cluster State Applier {es-pull}34257[#34257]
[Zen2] Add safety phase to CoordinatorTests {es-pull}34241[#34241]
[Zen2] Integrate FollowerChecker with Coordinator {es-pull}34075[#34075]
Integrate LeaderChecker with Coordinator {es-pull}34049[#34049]
Zen2: Trigger join when active master detected {es-pull}34008[#34008]
Zen2: Update PeerFinder term on term bump {es-pull}33992[#33992]
[Zen2] Calculate optimal cluster configuration {es-pull}33924[#33924]
[Zen2] Introduce FollowersChecker {es-pull}33917[#33917]
Zen2: Integrate publication pipeline into Coordinator {es-pull}33771[#33771]
Zen2: Add DisruptableMockTransport {es-pull}33713[#33713]
[Zen2] Implement basic cluster formation {es-pull}33668[#33668]
[Zen2] Introduce LeaderChecker {es-pull}33024[#33024]
Zen2: Add leader-side join handling logic {es-pull}33013[#33013]
[Zen2] Add PeerFinder#onFoundPeersUpdated {es-pull}32939[#32939]
[Zen2] Introduce PreVoteCollector {es-pull}32847[#32847]
[Zen2] Introduce ElectionScheduler {es-pull}32846[#32846]
[Zen2] Introduce ElectionScheduler {es-pull}32709[#32709]
[Zen2] Add HandshakingTransportAddressConnector {es-pull}32643[#32643] (issue: {es-issue}32246[#32246])
[Zen2] Add UnicastConfiguredHostsResolver {es-pull}32642[#32642] (issue: {es-issue}32246[#32246])
Zen2: Cluster state publication pipeline {es-pull}32584[#32584] (issue: {es-issue}32006[#32006])
[Zen2] Introduce gossip-like discovery of master nodes {es-pull}32246[#32246]
Add core coordination algorithm for cluster state publishing  {es-pull}32171[#32171] (issue: {es-issue}32006[#32006])
Add term and config to cluster state {es-pull}32100[#32100] (issue: {es-issue}32006[#32006])
Remove version read/write logic in Verify Response {es-pull}30879[#30879] (issue: {es-issue}30807[#30807])
Enable muted Repository test {es-pull}30875[#30875] (issue: {es-issue}30807[#30807])
Bad regex in CORS settings should throw a nicer error {es-pull}29108[#29108]
Adjust SSLDriver behavior for JDK11 changes {es-pull}32145[#32145] (issues: {es-issue}32122[#32122], {es-issue}32144[#32144])
Netty4SizeHeaderFrameDecoder error {es-pull}31057[#31057]
Fix memory leak in http pipelining {es-pull}30815[#30815] (issue: {es-issue}30801[#30801])
Fix issue with finishing handshake in ssl driver {es-pull}30580[#30580]
Ensure realtime _get and _termvectors don’t run on the network thread {es-pull}33814[#33814] (issue: {es-issue}27500[#27500])
[bug] fuzziness custom auto {es-pull}33462[#33462] (issue: {es-issue}33454[#33454])
Fix inner hits retrieval when stored fields are disabled (none) {es-pull}33018[#33018] (issue: {es-issue}32941[#32941])
Set maxScore for empty TopDocs to Nan rather than 0 {es-pull}32938[#32938]
Handle leniency for cross_fields type in multi_match query {es-pull}27045[#27045] (issue: {es-issue}23210[#23210])
Raise IllegalArgumentException instead if query validation failed {es-pull}26811[#26811] (issue: {es-issue}26799[#26799])