Cannot reproduce a POST search query

Hi,

I have searched for this into the issues before opening this one, but I cannot see a similar case. I want to perform a search query.

• Index: clients
• doc type: client
• Path: /clients/client/_search
• Method: POST
• Body:

{
  "query": {
    "bool": {
      "must": [
        {
          "query_string": {
            "query": "del*",
            "fields": [
              "firstName",
              "lastName"
            ]
          }
        },
        {
          "match": {
            "merchantId": "44UudEcyFMbpLOGzG2HWpfngJ8o2"
          }
        }
      ]
    }
  }
}

Doing this with curl:

curl -X POST "https://xyz/clients/client/_search?pretty" -H 'Content-Type: application/json' -d'
{
  "query": {
    "bool": {
      "must": [
        {
          "query_string": {
            "query": "ale*",
            "fields": [
              "firstName",
              "lastName"
            ]
          }
        },
        {
          "match": {
            "merchantId": "44UudEcyFMbpLOGzG2HWpfngJ8o2"
          }
        }
      ]
    }
  }
}
'

Gives me 2 hits (correct!).

Same with POSTMAN (as attached) .

Now, the problem.

Here’s my code:

return client.search({
                index: 'clients',
                type: 'client',
                body: {
                    query: {
                        bool: {
                            must: [
                                {
                                    query_string: {
                                        query: "ale*",
                                        fields: ["firstName", "lastName"]
                                    }
                                },
                                {
                                    match: {
                                        'merchantId': merchantId // Defined and logged <-
                                    }
                                }
                            ]
                        }
                    }
                }
            }
        );

The result is empty, the log gives me this:

  starting request {
    "method": "POST",
    "path": "/clients/client/_search",
    "body": {
      "query": {
        "bool": {
          "must": [
            {
              "query_string": {
                "query": "ale*",
                "fields": [
                  "firstName",
                  "lastName"
                ]
              }
            },
            {
              "match": {
                "merchantId": "44UudEcyFMbpLOGzG2HWpfngJ8o2"
              }
            }
          ]
        }
      }
    },
    "query": { }
  }


info: Elasticsearch DEBUG: 2018-09-21T14:16:07Z
  Request complete

info: ->! { took: 1,
  timed_out: false,
  _shards: { total: 1, successful: 1, skipped: 0, failed: 0 },
  hits: { total: 0, max_score: null, hits: [] } }

What am I missing?

Thanks!

[lorenzosfarra]

I am not creating the data, the data is there from days. Anyway, “brutally” executing your code works just fine, so definitely is something I have to figure out in my custom code. Thanks again for your support ( I close by myself 😃 )!

[delvedor]

I created this simple example where I get back all the data.

'use strict'

const sleep = require('then-sleep')
const elasticsearch = require('elasticsearch')
const client = new elasticsearch.Client({
  host: 'localhost:9200',
  api: '6.2'
})

client.bulk({
  body: [
    { index: { _index: 'clients', _type: 'client' } },
    { 'firstName': 'Alessandro', 'lastName': 'Del Piero', 'phoneNumber': '[phone]', 'merchantId': '44UudEcyFMbpLOGzG2HWpfngJ8o2' },
    { index: { _index: 'clients', _type: 'client' } },
    { 'firstName': 'Alessandro', 'lastName': 'Costacurta', 'phoneNumber': '[phone]', 'merchantId': '44UudEcyFMbpLOGzG2HWpfngJ8o2' },
    { index: { _index: 'clients', _type: 'client' } },
    { 'firstName': 'Alessandro', 'lastName': 'Nesta', 'phoneNumber': '[phone]', 'merchantId': '90339203812831293' }
  ]
}, async (err, res) => {
  if (err) throw err

  await sleep(2000)

  const result = await client.search({
    index: 'clients',
    type: 'client',
    body: {
      query: {
        bool: {
          must: [
            {
              query_string: {
                query: 'ale*',
                fields: ['firstName', 'lastName']
              }
            },
            {
              match: {
                'merchantId': '44UudEcyFMbpLOGzG2HWpfngJ8o2'
              }
            }
          ]
        }
      }
    }
  })
  console.log(JSON.stringify(result, null, 2))

  // use a custom elasticsearch instance for run this test!
  // this command will delete every index!
  await client.indices.delete({ index: '*', ignore: 404 })
}

I was asking if you are running the request just after the indexing operation because Elasticsearch is a near real-time engine. This means that the indexed data cannot be available instantaneously, but there is a time span where is not available. By default, that time span is 1 second, so if you run two requests against your express server:

1. index data
2. search data

And there is less than one second between the requests you will not find the data.

That’s why there is a sleep function in my code, and if you remove it, or you change the timeout at 200ms, you will not find anything.

If you want to know more, or how to change the index refresh time, I suggest you read this fantastic document 😃