Multiple `[error] WARNING: Illegal reflective access` when running Spark and Flink on the sandbox from intelliJ sbt console
See original GitHub issuereported by @blublinsky When running Spark and Flink streamlets in the sandbox, we see multiple warnings about ‘illegal reflective access’
[error] WARNING: An illegal reflective access operation has occurred
[error] WARNING: Illegal reflective access by org.apache.flink.api.java.ClosureCleaner (file:/Users/boris/Library/Caches/Coursier/v1/https/repo1.maven.org/maven2/org/apache/flink/flink-core/1.10.0/flink-core-1.10.0.jar) to field java.util.Properties.serialVersionUID
[error] WARNING: Please consider reporting this to the maintainers of org.apache.flink.api.java.ClosureCleaner
[error] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[error] WARNING: All illegal access operations will be denied in a future release
[error] WARNING: An illegal reflective access operation has occurred
[error] WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/Users/boris/Library/Caches/Coursier/v1/https/repo1.maven.org/maven2/org/apache/spark/spark-unsafe_2.12/2.4.5/spark-unsafe_2.12-2.4.5.jar) to method java.nio.Bits.unaligned()
[error] WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
[error] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
[error] WARNING: All illegal access operations will be denied in a future release
Update:
These warnings have only been observed when running sbt runLocal
from inside the sbt console of intelliJ IDE. From the system terminal, local sandbox runs without problems. To reproduce these warnings, run https://github.com/lightbend/StarbucksPipeline in intelliJ.
Issue Analytics
- State:
- Created 3 years ago
- Comments:7 (7 by maintainers)
Top Results From Across the Web
WARNING: An illegal reflective access operation has occurred
Hello, I am new to JAVA programming with IntelliJ and have a question. I am trying to create JAVA web application with TomEE-plume-7.0.4......
Read more >How to fix Hadoop WARNING: An illegal reflective access ...
How to fix Hadoop WARNING: An illegal reflective access operation has occurred error on Ubuntu ; Use Java 8 for Hadoop. Spark, Scala,...
Read more >Launch multiple SparkApplications at same time error. #1466
Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access ...
Read more >SLF4J Warning: Class Path Contains Multiple SLF4J Bindings
When we use SLF4J in our applications, we sometimes see a warning message about multiple bindings in the classpath printed to the console....
Read more >Apache Spark Running With Warnings With Illegal Reflective
reported by @blublinsky When running Spark and Flink streamlets in the sandbox, we see multiple warnings about 'illegal reflective access' [error] WARNING: ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@blublinsky and I have confirmed that although our Macs have Java 8 as default, IntelliJ was using JDK 11 in its embedded sbt shell. After configuring IntelliJ to use JDK 11 with sbt, this issue went away. Closing this issue as it’s not caused by Cloudflow.
@RayRoestenburg Np. Updated the title and Gerard’s comment at the top to include these details.