question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

The Property type 'ANY?' can not be stored in a Spark column.

See original GitHub issue

We are trying to test drive CAPS on our graph. However, on initialization, we get the following error:

The property type 'ANY?' for property 'images' can not be stored in a Spark column.

We don’t particularly care about that field or node as of now. How can we workaround this issue?

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:18 (12 by maintainers)

github_iconTop GitHub Comments

2reactions
DarthMaxcommented, Jul 30, 2018

Depending on the database size the procedure can run for quite long. As Philip already pointed out we improved the performance of the procedure considerably. If you want to make use of these changes you could try building CAPS yourself.

Todo this run the following steps:

  1. Clone this repository
  2. run mvn clean install -DskipTest -Dcluster
  3. Copy the file okapi-neo4j-procedues-1.0.0-SNAPSHOT-cluster.jar from CHECKOUT_DIR/okapi-neo4j-procedures/target into the plugins directory of your Neo4j installation
  4. Either use the file spark-cypher-1.0.0-SNAPSHOT-cluster.jar from CHECKOUT_DIR/spark-cypher/target or make sure to update the spark-cypher version to 1.0.0-SNAPSHOT in your project
  5. run CALL org.opencypher.okapi.procedures.schema in Neo4j browser
  6. ???
  7. Profit!

😃

1reaction
pstutzcommented, Jul 30, 2018

The schema is easy to serialize & parse to/from JSON, in case you would like to store it. I’ll close this issue for now, please feel free to reopen it if you should run into these issues with the next release. The PR that allows to pass in a schema is here, in case you would like to experiment with that option.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Spark for Python - can't cast a string column to decimal ...
After the DataFrame is created, I want to cast the column 'gen_val' (that is stored in the variable results.inputColumns ) from String type...
Read more >
Spark SQL, DataFrames and Datasets Guide
A DataFrame is a Dataset organized into named columns. ... The entry point into all functionality in Spark is the SparkSession class.
Read more >
Working with Spark MapType DataFrame Column
In this article, I will explain how to create a Spark DataFrame MapType (map) column using org.apache.spark.sql.types.MapType class and applying some.
Read more >
Dealing with null in Spark
The Spark csv() method demonstrates that null is used for values that are unknown or missing when files are read into DataFrames. nullable ......
Read more >
Generated Values - EF Core
How to configure value generation for properties when using Entity Framework Core.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found