Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Multiple `[error] WARNING: Illegal reflective access` when running Spark and Flink on the sandbox from intelliJ sbt console

See original GitHub issue

reported by @blublinsky When running Spark and Flink streamlets in the sandbox, we see multiple warnings about ‘illegal reflective access’

[error] WARNING: An illegal reflective access operation has occurred
[error] WARNING: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/Users/boris/Library/Caches/Coursier/v1/https/repo1.maven.org/maven2/org/apache/flink/flink-core/1.10.0/flink-core-1.10.0.jar) to field java.util.Properties.serialVersionUID
[error] WARNING: Please consider reporting this to the maintainers of org.apache.flink.api.java.ClosureCleaner
[error] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[error] WARNING: All illegal access operations will be denied in a future release
[error] WARNING: An illegal reflective access operation has occurred
[error] WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/Users/boris/Library/Caches/Coursier/v1/https/repo1.maven.org/maven2/org/apache/spark/spark-unsafe_2.12/2.4.5/spark-unsafe_2.12-2.4.5.jar) to method java.nio.Bits.unaligned()
[error] WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
[error] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[error] WARNING: All illegal access operations will be denied in a future release

Update: These warnings have only been observed when running sbt runLocal from inside the sbt console of intelliJ IDE. From the system terminal, local sandbox runs without problems. To reproduce these warnings, run https://github.com/lightbend/StarbucksPipeline in intelliJ.

Issue Analytics

State:
Created 3 years ago
Comments:7 (7 by maintainers)

Top GitHub Comments

1reaction

yuchaoran2011commented, Jul 13, 2020

@blublinsky and I have confirmed that although our Macs have Java 8 as default, IntelliJ was using JDK 11 in its embedded sbt shell. After configuring IntelliJ to use JDK 11 with sbt, this issue went away. Closing this issue as it’s not caused by Cloudflow.

0reactions

yuchaoran2011commented, Jun 19, 2020

@RayRoestenburg Np. Updated the title and Gerard’s comment at the top to include these details.

Top Results From Across the Web

WARNING: An illegal reflective access operation has occurred

Hello, I am new to JAVA programming with IntelliJ and have a question. I am trying to create JAVA web application with TomEE-plume-7.0.4......

How to fix Hadoop WARNING: An illegal reflective access ...

How to fix Hadoop WARNING: An illegal reflective access operation has occurred error on Ubuntu ; Use Java 8 for Hadoop. Spark, Scala,...

Launch multiple SparkApplications at same time error. #1466

Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access ...

SLF4J Warning: Class Path Contains Multiple SLF4J Bindings

When we use SLF4J in our applications, we sometimes see a warning message about multiple bindings in the classpath printed to the console....

Apache Spark Running With Warnings With Illegal Reflective

reported by @blublinsky When running Spark and Flink streamlets in the sandbox, we see multiple warnings about 'illegal reflective access' [error] WARNING: ...