Error in Setting up Hive and Oozie Metastore using _hdiManagementClient.Clusters.Create method

When you pass in Hive and Oozie Metastore information to ClusterCreateParamters objects it always complain about not able to connect to the Azure SQL Server. I have verified the SQL Server credentials and the flag on the server to allow access to Azure services. I am able to create HdInsight server attaching it to Azure Sql Server for metastor using portal but not using the Azure SDK.

Are we storing the connection string for the hive configs in the Ambari Server log table.

        var parameters = new ClusterCreateParameters
        {
            ClusterSizeInNodes = NewClusterNumNodes,
            Location = NewClusterLocation,
            ClusterType = NewClusterType,
            OSType = NewClusterOSType,
            Version = NewClusterVersion,

            DefaultStorageAccountName = ExistingStorageName,
            DefaultStorageAccountKey = ExistingStorageKey,
            DefaultStorageContainer = ExistingContainer,

            UserName = NewClusterUsername,
            Password = NewClusterPassword,
            SshUserName = SSHUserName,
            SshPassword = SSHPassword,

            HiveMetastore = new Metastore(AzureSqlServerName, "hive", AzureSqlUserName, AzureSqlPassword),
            OozieMetastore = new Metastore(AzureSqlServerName, "oozie", AzureSqlUserName, AzureSqlPassword)
        };

[amadav]

Got it working. I was trying with the same deployment name and the cluster name for multiple times and changing those worked. I am guessing there is some king of caching for the deployments which couldn’t reflect the latest state.

[Bizz247]

Yeah so I found out this issue for me was caused by not having the right encoding on the JSON file that’s being uploaded. PowerShell uses ucs-2 by default when doing an out-file… if you choose utf8 on -encoding in PowerShell v5.1 it will actually encode to utf8bom which also no good.

PowerShell 6 has a “new” encoding that’s called utf8nobom which will ACTUALLY out-file to regular utf-8… when in doubt validate with notepad++ !!