Harness doesn't create ES Index
See original GitHub issueWhen I want to create an Engine from my engine-template, Harness doesnt create an Index in Elasticsearch. Does anyone know why?
My sample engin.json looks like
{
"engineId": "ecommerce",
"engineFactory": "com.actionml.engines.ur.UREngine",
"sparkConf": {
"master": "local",
"spark.driver-memory": "8g",
"spark.executor-memory": "16g",
"spark.serializer": "org.apache.spark.serializer.KryoSerializer",
"spark.kryo.registrator": "org.apache.mahout.sparkbindings.io.MahoutKryoRegistrator",
"spark.kryo.referenceTracking": "false",
"spark.kryoserializer.buffer": "300m",
"spark.es.index.auto.create": "true",
"es.index.auto.create": "true"
},
"algorithm": {
"indicators": [
{
"name": "buy"
},
{
"name": "detail-view"
},
{
"name": "search-terms"
}
]
}
}
Further in the logs the output shows that ES index name:
is null
Issue Analytics
- State:
- Created 4 years ago
- Reactions:1
- Comments:12
Top Results From Across the Web
Harness YAML Code Reference - Harness.io Docs
Learn the YAML code keys and values used in the Harness Manager code editor to describe Harness Services, Environments, Workflows, and other components....
Read more >Create index API | Elasticsearch Guide [8.5] | Elastic
You can use the create index API to add a new index to an Elasticsearch cluster. When creating an index, you can specify...
Read more >EsHadoopIllegalArgumentExcept...
Only harness is not able to write to it, excepting for creating those byte size indices. I have also added all the configuration...
Read more >Testing with component harnesses - Angular Material
The Angular CDK provides code for creating component test harnesses. ... The example above retrieves all button harnesses and uses an array index...
Read more >spring - createIndex=true doesn't create the index mapping in ...
You need to have a Spring Data Elasticsearch repository with the entity class that has this annotation in your application, and the index...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@pferrel - i discovered the source of the issue i was having, and just neglected to update here, so here’s what was the problem. engine creation, and event adding was fine, and when I would call the “train” endpoint, that was failing, and I simply failed to notice that step was failing, so the training failed, thus no index was ever created and the queries obviously would fail.
the reason training was failing was that i didn’t have sample data for a few of the indicators. i feel like this should be allowed (no data for an indicator, so that training can complete) but i do understand it. i have since worked around this factor and am now seeing everything work correctly.
OK… It seems like I must first add event with primary indicator, and then train engine… on train it create index and everything start works 😉