question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

No Under File System Factory found for: hdfs://namenode1:8020/

See original GitHub issue

Alluxio Version: version: alluxio-2.4.1-1

Describe the bug when I execute ./bin/alluxio-start.sh all Mount, there was an error from ./logs/master.log:

2021-01-11 02:45:51,481 WARN  ExtensionFactoryRegistry - No factory implementation supports the path hdfs://namenode1:8020/
2021-01-11 02:45:51,530 ERROR AlluxioMaster - Fatal error: Failed to create master process
java.lang.RuntimeException: java.lang.RuntimeException: Failed to start masters
        at alluxio.master.AlluxioMasterProcess.<init>(AlluxioMasterProcess.java:125)
        at alluxio.master.AlluxioMasterProcess$Factory.create(AlluxioMasterProcess.java:400)
        at alluxio.master.AlluxioMaster.main(AlluxioMaster.java:45)
Caused by: java.lang.RuntimeException: Failed to start masters
        at alluxio.master.MasterUtils.createMasters(MasterUtils.java:57)
        at alluxio.master.AlluxioMasterProcess.<init>(AlluxioMasterProcess.java:123)
        ... 2 more
Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: No Under File System Factory found for: hdfs://namenode1:8020/
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at alluxio.util.CommonUtils.invokeAll(CommonUtils.java:592)
        at alluxio.util.CommonUtils.invokeAll(CommonUtils.java:554)
        at alluxio.master.MasterUtils.createMasters(MasterUtils.java:55)
        ... 3 more
Caused by: java.lang.IllegalArgumentException: No Under File System Factory found for: hdfs://namenode1:8020/
        at alluxio.underfs.UnderFileSystem$Factory.create(UnderFileSystem.java:95)
        at alluxio.underfs.AbstractUfsManager.getOrAdd(AbstractUfsManager.java:128)
        at alluxio.underfs.AbstractUfsManager.lambda$addMount$0(AbstractUfsManager.java:167)
        at alluxio.underfs.UfsManager$UfsClient.acquireUfsResource(UfsManager.java:60)
        at alluxio.master.file.DefaultFileSystemMaster.getRootMountInfo(DefaultFileSystemMaster.java:495)
        at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:437)
        at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:418)
        at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:51)
        at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:28)
        at alluxio.master.MasterUtils.lambda$createMasters$0(MasterUtils.java:49)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)

2021-01-11 02:46:02,082 INFO  NettyUtils - EPOLL_MODE is available
2021-01-11 02:46:03,354 ERROR MasterHealthCheckClient - Exception thrown in the master process check
java.lang.IllegalStateException: Master process is not running on the host namenode1
        at alluxio.master.MasterHealthCheckClient$ProcessCheckRunnable.run(MasterHealthCheckClient.java:213)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:748)

I don’t konw how to solve it, and below is my configuration:

alluxio.master.hostname=namenode1
alluxio.master.journal.type=UFS
alluxio.master.mount.table.root.ufs=hdfs://namenode1:8020/
alluxio.master.mount.table.root.option.alluxio.underfs.version=3.1
alluxio.underfs.hdfs.configuration=/etc/hadoop/3.1.4.0-315/0/core-site.xml:/etc/hadoop/3.1.4.0-315/0/hdfs-site.xml

alluxio.master.embedded.journal.addresses=namenode1:19200,namenode2:19200,namenode3:19200

alluxio.master.security.impersonation.yarn.users=*
alluxio.master.security.impersonation.hive.users=*
alluxio.master.security.impersonation.impala.users=*
alluxio.master.security.impersonation.cydw.users=*

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:11 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
DLUTLiuFengyicommented, May 27, 2021

我尝试过 alluxio.master.mount.table.root.option.alluxio.underfs.version=3.2alluxio.master.journal.ufs.option.alluxio.underfs.version=3.2 都不行,用 alluxio.underfs.version=3.2 反而成功了…

0reactions
isLiuXinxincommented, Mar 17, 2021

Could not resolve dependencies for project org.alluxio:alluxio-underfs-hdfs:jar:2.4.0: Failed to collect dependencies at org.alluxio:alluxio-shaded-hadoop:jar:3.1.0 Could you send an email with alluxio-underfs-hdfs-3.1.0-2.4.x.jar? isliuxinxin@yeah.net

Read more comments on GitHub >

github_iconTop Results From Across the Web

format Alluxio: No Under File System Factory found for: hdfs ...
I want to Deploy Alluxio on a Cluster with HA.My CDH version: 3.0.0+cdh6.3.2. I build Alluxio with a specific Hadoop release version: mvn ......
Read more >
no under file system factory found for hdfs - Google Groups
The Alluxio tests work fine for underfs and I can see those files in Alluxio and HDFS. However, from Spark, when writing a...
Read more >
Introduction - Alluxio v2.9.0 (stable) Documentation
Common file system operations such as directory listing and renaming often incur significant performance overhead. When accessing data in cloud storage, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found