添加链接
link管理
链接快照平台
  • 输入网页链接,自动生成快照
  • 标签化管理网页链接

@ rama

Hive view will internally use: webhdfs file system uri So please check if the following property is set properly or not?

Click HDFS > Configs > Advanced > Advanced hdfs-site > dfs.namenode.http-address. When you enter the value in the view definition, pre-pend "webhdfs://" to the value you find in the advanced HDFS configuration settings.

For example, webhdfs://c6401.ambari.apache.org:50070

Please see: https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/section_get_v...

I should've realized that you're on Azure and using WASB, I am not 100 % sure but see if you can take the external address of the FS.defaultFS property and add to Hive view. You need to fill out the following properties in your Hive view with their associated values. This is in case it is HA, in case you also have kerberos, you need to add those properties as well. Keep in mind you need public address for each URL not the ones that says internal in their name. I have example REST API calls to create Ambari views in this script, properties in the curl calls are needed to setup views to function https://github.com/dbist/ambari-chef in that link go to recipes then ambari_views_setup.rb file for examples

"webhdfs.client.failover.proxy.provider" : "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",      "webhdfs.ha.namenode.http-address.nn1" : "u1201.ambari.apache.org:50070",      "webhdfs.ha.namenode.http-address.nn2" : "u1201.ambari.apache.org:50070",      "webhdfs.ha.namenode.https-address.nn1" : null,      "webhdfs.ha.namenode.https-address.nn2" : null,      "webhdfs.ha.namenode.rpc-address.nn1" : "u1201.ambari.apache.org:8020",      "webhdfs.ha.namenode.rpc-address.nn2" : "u1202.ambari.apache.org:8020",      "webhdfs.ha.namenodes.list" : "nn1,nn2",      "webhdfs.nameservices" : "hacluster",      "webhdfs.url" : "webhdfs://hacluster",      "hive.host" : "u1203.ambari.apache.org",      "hive.http.path" : "cliservice",      "hive.http.port" : "10001",      "hive.metastore.warehouse.dir" : "/apps/hive/warehouse",      "hive.port" : "10000",      "hive.transport.mode" : "binary",      "yarn.ats.url" : "http://u1202.ambari.apache.org:8188",      "yarn.resourcemanager.url" : "u1202.ambari.apache.org:8088"
						

@rama

Hive view will internally use: webhdfs file system uri So please check if the following property is set properly or not?

Click HDFS > Configs > Advanced > Advanced hdfs-site > dfs.namenode.http-address. When you enter the value in the view definition, pre-pend "webhdfs://" to the value you find in the advanced HDFS configuration settings.

For example, webhdfs://c6401.ambari.apache.org:50070

Please see: https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/section_get_v...

@rama

Please use the search filter to find the property mentioned.

Search for "dfs.namenode.http-address" in the "Properties Filter" text box which is present in the

HDFS > Configs > Advanced (In this page) you will find a search box beside the "Manage Config Groups" just put the property "dfs.namenode.http-address" there to search.

@rama

Hope the following article will help:

https://community.hortonworks.com/articles/49434/ambari-hive-view-webhdfs-filesystem-uri-in-hdfs-nn....

You do not need to edit the "dfs.namenode.http-address' instead you need to refer to that value so that it can be used inside your Hive View.

Manage Ambai --> Views --> HiveView (check its property "WebHDFS FileSystem URI*") this value need to be changed.

When it comes to setting WebHDFS FileSystem URI* , make sure you set to webhdfs://${dfs.nameservices}   where ${dfs.nameservices} is the value defined in the "hdfs-site.xml"   With *NO* Port to be specified.  (When NameNode HA is configured)
Restart ambari-server  

HI @jss

I could find some configuration difference here

In PROD cluster ->managed ambari->views>hive->hive views->cluster configuration is set to "Local Ambari Managed Cluster" and its working fine

IN Dev cluster ->managed ambari->views>hive->hive views->cluster configuration is set to " custom" here it is not working

So should i change to "Local Ambari Managed Cluster"

if you want to me do this one , after save this should i need to restart the ambari server?

please suggest me