@
rama
Hive view will internally use: webhdfs file system uri
So please check if the following property is set properly or not?
Click HDFS > Configs > Advanced > Advanced hdfs-site > dfs.namenode.http-address. When you enter the value in the view definition, pre-pend "webhdfs://" to the value you find in the advanced HDFS configuration settings.
For example,
webhdfs://c6401.ambari.apache.org:50070
Please see:
https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/section_get_v...
I should've realized that you're on Azure and using WASB, I am not 100 % sure but see if you can take the external address of the FS.defaultFS property and add to Hive view. You need to fill out the following properties in your Hive view with their associated values. This is in case it is HA, in case you also have kerberos, you need to add those properties as well. Keep in mind you need public address for each URL not the ones that says internal in their name. I have example REST API calls to create Ambari views in this script, properties in the curl calls are needed to setup views to function
https://github.com/dbist/ambari-chef
in that link go to recipes then ambari_views_setup.rb file for examples
"webhdfs.client.failover.proxy.provider" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider", "webhdfs.ha.namenode.http-address.nn1" : "u1201.ambari.apache.org:50070", "webhdfs.ha.namenode.http-address.nn2" : "u1201.ambari.apache.org:50070", "webhdfs.ha.namenode.https-address.nn1" : null, "webhdfs.ha.namenode.https-address.nn2" : null, "webhdfs.ha.namenode.rpc-address.nn1" : "u1201.ambari.apache.org:8020", "webhdfs.ha.namenode.rpc-address.nn2" : "u1202.ambari.apache.org:8020", "webhdfs.ha.namenodes.list" : "nn1,nn2", "webhdfs.nameservices" : "hacluster", "webhdfs.url" : "webhdfs://hacluster", "hive.host" : "u1203.ambari.apache.org", "hive.http.path" : "cliservice", "hive.http.port" : "10001", "hive.metastore.warehouse.dir" : "/apps/hive/warehouse", "hive.port" : "10000", "hive.transport.mode" : "binary", "yarn.ats.url" : "http://u1202.ambari.apache.org:8188", "yarn.resourcemanager.url" : "u1202.ambari.apache.org:8088"
@rama
Hive view will internally use: webhdfs file system uri
So please check if the following property is set properly or not?
Click HDFS > Configs > Advanced > Advanced hdfs-site > dfs.namenode.http-address. When you enter the value in the view definition, pre-pend "webhdfs://" to the value you find in the advanced HDFS configuration settings.
For example, webhdfs://c6401.ambari.apache.org:50070
Please see: https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/section_get_v...
@rama
Please use the search filter to find the property mentioned.
Search for "dfs.namenode.http-address" in the "Properties Filter" text box which is present in the
HDFS > Configs > Advanced (In this page) you will find a search box beside the "Manage Config Groups" just put the property "dfs.namenode.http-address" there to search.
@rama
Hope the following article will help:
https://community.hortonworks.com/articles/49434/ambari-hive-view-webhdfs-filesystem-uri-in-hdfs-nn....
You do not need to edit the "dfs.namenode.http-address' instead you need to refer to that value so that it can be used inside your Hive View.
Manage Ambai --> Views --> HiveView (check its property "WebHDFS FileSystem URI*") this value need to be changed.
When it comes to setting WebHDFS FileSystem URI* , make sure you set to webhdfs://${dfs.nameservices} where ${dfs.nameservices} is the value defined in the "hdfs-site.xml" With *NO* Port to be specified. (When NameNode HA is configured)
Restart ambari-server
HI @jss
I could find some configuration difference here
In PROD cluster ->managed ambari->views>hive->hive views->cluster configuration is set to "Local Ambari Managed Cluster" and its working fine
IN Dev cluster ->managed ambari->views>hive->hive views->cluster configuration is set to " custom" here it is not working
So should i change to "Local Ambari Managed Cluster"
if you want to me do this one , after save this should i need to restart the ambari server?
please suggest me