No Under File System Factory found for: hdfs://namenode1:8020/
See original GitHub issueAlluxio Version:
version: alluxio-2.4.1-1
Describe the bug
when I execute ./bin/alluxio-start.sh all Mount
, there was an error from ./logs/master.log:
2021-01-11 02:45:51,481 WARN ExtensionFactoryRegistry - No factory implementation supports the path hdfs://namenode1:8020/
2021-01-11 02:45:51,530 ERROR AlluxioMaster - Fatal error: Failed to create master process
java.lang.RuntimeException: java.lang.RuntimeException: Failed to start masters
at alluxio.master.AlluxioMasterProcess.<init>(AlluxioMasterProcess.java:125)
at alluxio.master.AlluxioMasterProcess$Factory.create(AlluxioMasterProcess.java:400)
at alluxio.master.AlluxioMaster.main(AlluxioMaster.java:45)
Caused by: java.lang.RuntimeException: Failed to start masters
at alluxio.master.MasterUtils.createMasters(MasterUtils.java:57)
at alluxio.master.AlluxioMasterProcess.<init>(AlluxioMasterProcess.java:123)
... 2 more
Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: No Under File System Factory found for: hdfs://namenode1:8020/
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at alluxio.util.CommonUtils.invokeAll(CommonUtils.java:592)
at alluxio.util.CommonUtils.invokeAll(CommonUtils.java:554)
at alluxio.master.MasterUtils.createMasters(MasterUtils.java:55)
... 3 more
Caused by: java.lang.IllegalArgumentException: No Under File System Factory found for: hdfs://namenode1:8020/
at alluxio.underfs.UnderFileSystem$Factory.create(UnderFileSystem.java:95)
at alluxio.underfs.AbstractUfsManager.getOrAdd(AbstractUfsManager.java:128)
at alluxio.underfs.AbstractUfsManager.lambda$addMount$0(AbstractUfsManager.java:167)
at alluxio.underfs.UfsManager$UfsClient.acquireUfsResource(UfsManager.java:60)
at alluxio.master.file.DefaultFileSystemMaster.getRootMountInfo(DefaultFileSystemMaster.java:495)
at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:437)
at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:418)
at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:51)
at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:28)
at alluxio.master.MasterUtils.lambda$createMasters$0(MasterUtils.java:49)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2021-01-11 02:46:02,082 INFO NettyUtils - EPOLL_MODE is available
2021-01-11 02:46:03,354 ERROR MasterHealthCheckClient - Exception thrown in the master process check
java.lang.IllegalStateException: Master process is not running on the host namenode1
at alluxio.master.MasterHealthCheckClient$ProcessCheckRunnable.run(MasterHealthCheckClient.java:213)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
I don’t konw how to solve it, and below is my configuration:
alluxio.master.hostname=namenode1
alluxio.master.journal.type=UFS
alluxio.master.mount.table.root.ufs=hdfs://namenode1:8020/
alluxio.master.mount.table.root.option.alluxio.underfs.version=3.1
alluxio.underfs.hdfs.configuration=/etc/hadoop/3.1.4.0-315/0/core-site.xml:/etc/hadoop/3.1.4.0-315/0/hdfs-site.xml
alluxio.master.embedded.journal.addresses=namenode1:19200,namenode2:19200,namenode3:19200
alluxio.master.security.impersonation.yarn.users=*
alluxio.master.security.impersonation.hive.users=*
alluxio.master.security.impersonation.impala.users=*
alluxio.master.security.impersonation.cydw.users=*
Issue Analytics
- State:
- Created 3 years ago
- Comments:11 (3 by maintainers)
Top Results From Across the Web
format Alluxio: No Under File System Factory found for: hdfs ...
I want to Deploy Alluxio on a Cluster with HA.My CDH version: 3.0.0+cdh6.3.2. I build Alluxio with a specific Hadoop release version: mvn ......
Read more >no under file system factory found for hdfs - Google Groups
The Alluxio tests work fine for underfs and I can see those files in Alluxio and HDFS. However, from Spark, when writing a...
Read more >Introduction - Alluxio v2.9.0 (stable) Documentation
Common file system operations such as directory listing and renaming often incur significant performance overhead. When accessing data in cloud storage, ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
我尝试过
alluxio.master.mount.table.root.option.alluxio.underfs.version=3.2
和alluxio.master.journal.ufs.option.alluxio.underfs.version=3.2
都不行,用alluxio.underfs.version=3.2
反而成功了…Could not resolve dependencies for project org.alluxio:alluxio-underfs-hdfs:jar:2.4.0: Failed to collect dependencies at org.alluxio:alluxio-shaded-hadoop:jar:3.1.0 Could you send an email with alluxio-underfs-hdfs-3.1.0-2.4.x.jar? isliuxinxin@yeah.net