Kibana+ElasticSearch實現索引資料的幾種查詢方式

阿新 • • 發佈：2019-02-08

1.match_all搜尋,直接返回所有文件

GET /school/_search
{
  "query": {
    "match_all": {
      
    }
  }
}

返回結果大致如下:

{
  "took": 13,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 23,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "stats": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "min": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {
          "query": {
            "match": {
              "name": "海哥"
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {
          "query": {
            "multi_match": {
              "query": "海哥",
              "fields": [
                "name",
                "address"
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "filter": {
                "term": {
                  "word_count": 2000
                }
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {
          "query": {
            "constant_score": {
              "filter": {
                "match": {
                  "title": "ElasticSearch"
                }
              },
              "boost": 2
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "must_not": [
                {
                  "term": {
                    "word_count": "2000"
                  }
                }
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      }
    ]
  }
}

引數大致解釋:

took: 執行搜尋耗時，毫秒為單位
time_out: 搜尋是否超時
_shards: 多少分片被搜尋，成功多少，失敗多少
hits：搜尋結果展示
hits.total: 匹配條件的文件總數
hits.hits: 返回結果展示，預設返回十個
hits.max_score：最大匹配得分
hits._score: 返回文件的匹配得分（得分越高，匹配程度越高，越靠前）
_index _type _id 作為剝層定位到特定的文件
_source 文件源

2.執行查詢

2.1 只顯示name和address

POST /school/_search
{
  "query": { "match_all": {} },
  "_source": ["name", "address"]
}

查詢結果:

{
  "took": 313,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 23,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {}
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "address": "山東煙臺",
          "name": "張小花"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {}
      }
    ]
  }
}

2.2 返回name為haige的document

POST /school/_search
{
  "query": { "match": { "name": "張小花" } }
}

查詢結果:

{
  "took": 439,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 2,
    "max_score": 2.634553,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 2.634553,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.8630463,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}

2.3 返回name包含"海"的所有document

POST /school/_search
{
  "query": { "match": { "name": "海" } }
}

查詢結果:

{
  "took": 68,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山東濟寧",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

2.4 返回name中包含term "海" 或 "花" 的所有document

POST /school/_search
{
  "query": { "match": { "name": "海 花" } }
}

{
  "took": 26,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 3,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山東濟寧",
          "age": 27,
          "date": "1998-03-16"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 0.8781843,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.2876821,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}

2.5 匹配phrase "海花"

POST /school/_search
{
 "query": { "match_phrase": { "name": "海 花" }}
}

查詢結果:

{
  "took": 5,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 0,
    "max_score": null,
    "hits": []
  }
}

2.6 返回name中包含"海"和"哥"的所有賬戶(AND)

POST /school/_search
{
  "query": {
    "bool": {
      "must": [
        { "match": { "name": "海" } },
        { "match": { "name": "哥" } }
      ]
    }
  }
}

查詢結果:

{
  "took": 208,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 2.0834162,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 2.0834162,
        "_source": {
          "name": "海哥",
          "address": "山東濟寧",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

2.7 返回name中包含"海"或"花"的所有document

POST /school/_search
{
  "query": {
    "bool": {
      "should": [
        { "match": { "name": "海" } },
        { "match": { "name": "花" } }
      ]
    }
  }
}

查詢結果:

{
  "took": 19,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 3,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山東濟寧",
          "age": 27,
          "date": "1998-03-16"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "bXfXcWIB-npqvsX5w2Vc",
        "_score": 0.8781843,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 0.2876821,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      }
    ]
  }
}

2.8 查詢name中既不包含"海",也不包含"哥"的所有document

POST /school/_search
{
  "query": {
    "bool": {
      "must_not": [
        { "match": { "name": "海" } },
        { "match": { "name": "哥" } }
      ]
    }
  }
}

查詢結果:

{
  "took": 264,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 22,
    "max_score": 1,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "b3ffcWIB-npqvsX5SmVm",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "c3fjcWIB-npqvsX5G2Wh",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "stats": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dHfjcWIB-npqvsX5uWWr",
        "_score": 1,
        "_source": {
          "aggs": {
            "grades_word_count": {
              "min": {
                "field": "word_count"
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dXfkcWIB-npqvsX5hmWx",
        "_score": 1,
        "_source": {
          "query": {
            "match": {
              "name": "海哥"
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "dnflcWIB-npqvsX5S2V0",
        "_score": 1,
        "_source": {
          "query": {
            "multi_match": {
              "query": "海哥",
              "fields": [
                "name",
                "address"
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fXfqcWIB-npqvsX5yGXf",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "filter": {
                "term": {
                  "word_count": 2000
                }
              }
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "fnfrcWIB-npqvsX5mGXq",
        "_score": 1,
        "_source": {
          "query": {
            "constant_score": {
              "filter": {
                "match": {
                  "title": "ElasticSearch"
                }
              },
              "boost": 2
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "gHfucWIB-npqvsX5HWUB",
        "_score": 1,
        "_source": {
          "query": {
            "bool": {
              "must_not": [
                {
                  "term": {
                    "word_count": "2000"
                  }
                }
              ]
            }
          }
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "HYVJOGIBUtf8tEPshwDC",
        "_score": 1,
        "_source": {
          "name": "張小花",
          "address": "山東煙臺",
          "age": 24,
          "date": "1996-07-24"
        }
      },
      {
        "_index": "school",
        "_type": "student",
        "_id": "cHffcWIB-npqvsX59mXN",
        "_score": 1,
        "_source": {
          "aggs": {
            "group_by_word_count": {
              "terms": {
                "field": "word_count"
              }
            }
          }
        }
      }
    ]
  }
}

2.9 返回name中包含"海",且地址不是"山東煙臺"的所有document

POST /school/_search
{
  "query": {
    "bool": {
      "must": [
        { "match": { "name": "海" } }
      ],
      "must_not": [
        { "match": { "address": "山東煙臺" } }
      ]
    }
  }
}

查詢結果:

{
  "took": 73,
  "timed_out": false,
  "_shards": {
    "total": 3,
    "successful": 3,
    "skipped": 0,
    "failed": 0
  },
  "hits": {
    "total": 1,
    "max_score": 1.0417081,
    "hits": [
      {
        "_index": "school",
        "_type": "student",
        "_id": "3",
        "_score": 1.0417081,
        "_source": {
          "name": "海哥",
          "address": "山東濟寧",
          "age": 27,
          "date": "1998-03-16"
        }
      }
    ]
  }
}

3. 過濾查詢

3.1 在所有document中尋找age在0-25歲之間(閉區間)的學生

POST /school/_search
{
  "query": {
    "filtered": {
      "query": { "match_all": {} },
      "filter": {
        "range": {
          "age": {
            "gte": 0,
            "lte": 25
          }
        }
      }
    }
  }
}

4.談論query和filter的效率

一般認為filter的速度快於query的速度
- filter不會計算相關度得分，效率高
- filter的結果可以快取到記憶體中，方便再用

Kibana+ElasticSearch實現索引資料的幾種查詢方式

1.match_all搜尋,直接返回所有文件 GET /school/_search { "query": { "match_all": { } } } 返回結果大致如下: { "took": 13, "timed_o

Java Hbase資料幾種查詢方式

/**Name : KcnaufHadoopManagement *Author : Zhang Bing *Created : 2013-7-31 *Function : delete of hbase */ package com.exercise.hbas

索引的幾種掃描方式

http table 技術分享 -1 9.png alt logs image 索引索引的幾種掃描方式

索引的幾種使用方式

查找浪費相對掃描遇到 l數據庫系統需求 mem HASH Hash這個詞，可以說，自打我們開始碼的那一天起，就開始不停地見到和使用到了。其實，hash就是一種（key=>value）形式的鍵值對，如數學中的函數映射，允許多個key對應相同的value，但不

SQLAlchemy 幾種查詢方式總結

記錄總數查詢： from sqlalchemy import func # count User records, without # using a subquery. session.query(func.count(User.id)) # return count of user "id" group

JDBC 資料庫的幾種查詢方式（二）

1.資料庫中的查詢jdbc.queryForObject( )和jdbc.query( );我的理解就是一個返回的物件，一個返回集合（集合可能不貼切） String sql = "select username from user where username

C# 實現AOP 的幾種常見方式

AOP為Aspect Oriented Programming的縮寫，意為：面向切面程式設計，通過預編譯方式和執行期動態代理實現程式功能的中統一處理業務邏輯的一種技術，比較常見的場景是：日誌記錄，錯誤捕獲、效能監控等 AOP的本質是通過代理物件來間接執行真實物件，在代理類中

Mybatis 的幾種查詢方式

<?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE mapper PUBLIC "-//mybatis.org//DTD Mapper 3.0//EN" "http://mybatis.org/dtd

Hibernate主要有如下幾種查詢方式：

導航物件圖檢索方式根據己經載入的物件，導航到其他物件。 OID檢索方式按照物件的OID來檢索物件。 HQL檢索方式使用面向物件的HQL查詢語言。 HQL(Hibernate QueryLanguage) 是面向物件的查詢語言，它和SQL查詢語言有些相

Hibernate的幾種查詢方式

HQL 通過Hibernate提供的查詢語言進行查詢。Hibernate Query lanague 　　EJBQL(JPQL 1.0) 是EJB提供的查詢語言　　QBC(query by cretira)通過Cretira介面進行查詢　　QBE(query by Example) 通過Examp

web實現資料互動的幾種常見方式

前言在當今社會，作為一名前端程式猿，並不是一昧的去製作靜態頁面就可以滿足滴；你說你會製作網頁，好吧，只能說你算是一個前端程式猿。但這是你作為一個程式猿最基本的能力，並不會為你進行加分；　　我們都明白，要想提高競爭力，提高自己的技能是十灰重要的。前後臺的資

Elasticsearch幾種查詢語法

1、query string search 2、query DSL 3、query filter 4、full-text search 5、phrase search 6、highlight search 1、query string search 搜尋全部

js實現常見的幾種演算法（陣列去重、字元統計、二分查詢等）

1、陣列去重：利用物件屬性進行篩選 function filter(arr){ let obj={}; let newArr=[]; for (let i=0;i<arr.

Elasticsearch+Hbase實現海量資料秒回查詢

---------------------------------------------------------------------------------------------[版權申明：本文系作者原創，轉載請註明出處] 文章出處：http://blog.csdn.

06.實現servlet的幾種方式，以及接口或者類之間的關系

ssa 圖片 servlet 容器實例化設備 blog public ide 接口：Servlet、ServletConfig、ServletRequest、ServletResponse、HttpServletRequest、HttpServletResponse、S

JS實現繼承的幾種方式（轉）

多繼承 logs 影響 .cn sta 初始化定義附錄 style 轉自：幻天芒的博客前言 JS作為面向對象的弱類型語言，繼承也是其非常強大的特性之一。那麽如何在JS中實現繼承呢？讓我們拭目以待。 JS繼承的實現方式既然要實現繼承，那麽首先我們得有一個父類，

JS實現繼承的幾種方式

簡單成員類構造缺陷屬性 con html 但是內存 JS實現繼承的幾種方式前言 JS作為面向對象的弱類型語言，繼承也是其非常強大的特性之一。那麽如何在JS中實現繼承呢？讓我們拭目以待。 JS繼承的實現方式既然要實現繼承，那麽首先我們得有一個父類，代碼如

JavaScript實現繼承的幾種方式總結一

相同實踐 extend sta 執行 instance () class new 雖然在ES6中有了繼承，使用extends關鍵字就能實現。本篇講的不是這種，而是ES6之前的幾種實現繼承的方式。（一）原型鏈 ECMAScript中將原型鏈作為實現繼承的主要方法。其基本思

java實現同步的幾種方式（總結）

副本增刪改否則都是 fin ret 語義 value art 為何要使用同步？ java允許多線程並發控制，當多個線程同時操作一個可共享的資源變量時（如數據的增刪改查），將會導致數據不準確，相互之間產生沖突，因此加入同步鎖以避免在該線程沒有完成操

JS類對象實現繼續的幾種方式

var test 子類實例化傳參 blog spa sim func prototype 0. ES6可以直接使用class,extends來繼承. 1. 原型繼承 1 2 父類: 3 4 function Persio

Kibana+ElasticSearch實現索引資料的幾種查詢方式

相關推薦