English 中文(简体)
如何将所有文件都列入一个有色人客户的弹性研究指数?
原标题:How to get all documents under an elasticsearch index with python client ?

I m trying to get all index document using python client but the result show me only the first document This is my python code :

res = es.search(index="92c603b3-8173-4d7a-9aca-f8c115ff5a18", doc_type="doc", body = {
 size  : 10000,
 query : {
     match_all  : {}
}
})
print("%d documents found" % res[ hits ][ total ])
data = [doc for doc in res[ hits ][ hits ]]
for doc in data:
    print(doc)
    return "%s %s %s" % (doc[ _id ], doc[ _source ][ 0 ], doc[ _source ][ 5 ])
问题回答

尝试“思想”而不是“思想”

res = es.search(index="92c603b3-8173-4d7a-9aca-f8c115ff5a18", doc_type="_doc", body = {
 size  : 100,
 query : {
     match_all  : {}
}
})

也可以使用<条码>弹性研究-dsl及其检索标本,使您能够通过<条码><><>>>查询所有文件。

import elasticsearch
from elasticsearch_dsl import Search

client = elasticsearch.Elasticsearch()
search = Search(using=client, index="92c603b3-8173-4d7a-9aca-f8c115ff5a18")

for hit in search.scan():
    print(hit)

you can find info from here https://discuss.elastic.co/t/get-all-documents-from-an-index/86977/5

es = Elasticsearch(["http://x.x.x.x:9200/"])
doc = {"size": 10000, "query": {"match_all": {}}}

resObj = es.search(index="myIndex", doc_type="myType", body=doc, scroll="1m")

download_alldata = []
download_alldata.extend(resObj["hits"]["hits"])

total_data_size = resObj["hits"]["total"]["value"]

allbar = tqdm(total=total_data_size, desc="processing")

download_data = []
download_data.extend(resObj["hits"]["hits"])
allbar.update(len(resObj["hits"]["hits"]))

while True:
    try:
        i = es.scroll(scroll_id=resObj["_scroll_id"], scroll="1m")["hits"][
            "hits"
        ]

        download_data.extend(i)
        # print(t)
        allbar.update(len(i))

        if len(i) == 0:
            break
    except Exception as e:
        break
    
    
print(len(download_data))

你可以尝试以下提问。 它将归还所有文件。

result = es.search(index="index_name", body={"query":{"match_all":{}}})

我急切地看到,如果你只增加数据,就必须更新该指数。 使用:

es.indices.refresh(index="index_name")




相关问题
Can Django models use MySQL functions?

Is there a way to force Django models to pass a field to a MySQL function every time the model data is read or loaded? To clarify what I mean in SQL, I want the Django model to produce something like ...

An enterprise scheduler for python (like quartz)

I am looking for an enterprise tasks scheduler for python, like quartz is for Java. Requirements: Persistent: if the process restarts or the machine restarts, then all the jobs must stay there and ...

How to remove unique, then duplicate dictionaries in a list?

Given the following list that contains some duplicate and some unique dictionaries, what is the best method to remove unique dictionaries first, then reduce the duplicate dictionaries to single ...

What is suggested seed value to use with random.seed()?

Simple enough question: I m using python random module to generate random integers. I want to know what is the suggested value to use with the random.seed() function? Currently I am letting this ...

How can I make the PyDev editor selectively ignore errors?

I m using PyDev under Eclipse to write some Jython code. I ve got numerous instances where I need to do something like this: import com.work.project.component.client.Interface.ISubInterface as ...

How do I profile `paster serve` s startup time?

Python s paster serve app.ini is taking longer than I would like to be ready for the first request. I know how to profile requests with middleware, but how do I profile the initialization time? I ...

Pragmatically adding give-aways/freebies to an online store

Our business currently has an online store and recently we ve been offering free specials to our customers. Right now, we simply display the special and give the buyer a notice stating we will add the ...

Converting Dictionary to List? [duplicate]

I m trying to convert a Python dictionary into a Python list, in order to perform some calculations. #My dictionary dict = {} dict[ Capital ]="London" dict[ Food ]="Fish&Chips" dict[ 2012 ]="...