question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Harness doesn't create ES Index

See original GitHub issue

When I want to create an Engine from my engine-template, Harness doesnt create an Index in Elasticsearch. Does anyone know why?

My sample engin.json looks like

{
	"engineId": "ecommerce",
	"engineFactory": "com.actionml.engines.ur.UREngine",
	"sparkConf": {
		"master": "local",
		"spark.driver-memory": "8g",
		"spark.executor-memory": "16g",
		"spark.serializer": "org.apache.spark.serializer.KryoSerializer",
		"spark.kryo.registrator": "org.apache.mahout.sparkbindings.io.MahoutKryoRegistrator",
		"spark.kryo.referenceTracking": "false",
		"spark.kryoserializer.buffer": "300m",
		"spark.es.index.auto.create": "true",
		"es.index.auto.create": "true"
	},
	"algorithm": {
		"indicators": [
			{
				"name": "buy"
			},
			{
				"name": "detail-view"
			},
			{
				"name": "search-terms"
			}
		]
	}
}

Further in the logs the output shows that ES index name: is null

Issue Analytics

  • State:open
  • Created 4 years ago
  • Reactions:1
  • Comments:12

github_iconTop GitHub Comments

3reactions
blindercommented, Sep 6, 2020

@pferrel - i discovered the source of the issue i was having, and just neglected to update here, so here’s what was the problem. engine creation, and event adding was fine, and when I would call the “train” endpoint, that was failing, and I simply failed to notice that step was failing, so the training failed, thus no index was ever created and the queries obviously would fail.

the reason training was failing was that i didn’t have sample data for a few of the indicators. i feel like this should be allowed (no data for an indicator, so that training can complete) but i do understand it. i have since worked around this factor and am now seeing everything work correctly.

2reactions
piotr-sikora-vcommented, Apr 21, 2021

OK… It seems like I must first add event with primary indicator, and then train engine… on train it create index and everything start works 😉

Read more comments on GitHub >

github_iconTop Results From Across the Web

Harness YAML Code Reference - Harness.io Docs
Learn the YAML code keys and values used in the Harness Manager code editor to describe Harness Services, Environments, Workflows, and other components....
Read more >
Create index API | Elasticsearch Guide [8.5] | Elastic
You can use the create index API to add a new index to an Elasticsearch cluster. When creating an index, you can specify...
Read more >
EsHadoopIllegalArgumentExcept...
Only harness is not able to write to it, excepting for creating those byte size indices. I have also added all the configuration...
Read more >
Testing with component harnesses - Angular Material
The Angular CDK provides code for creating component test harnesses. ... The example above retrieves all button harnesses and uses an array index...
Read more >
spring - createIndex=true doesn't create the index mapping in ...
You need to have a Spring Data Elasticsearch repository with the entity class that has this annotation in your application, and the index...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found