Member since
09-13-2022
22
Posts
0
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
218 | 12-26-2022 07:55 PM | |
172 | 12-12-2022 10:10 PM | |
437 | 11-10-2022 06:29 PM |
01-08-2023
06:44 AM
hello i am having same issue too any solution?
... View more
01-02-2023
06:45 PM
I ran pyspark code the first time it was fine, the second time it dies and show this on every single cell of my zeppelin notebook, and also other notebook that I am running with pyspark, I have to t restart the interpreter order to fix this. Traceback (most recent call last): File "/var/folders/zh/dvdnf74d1t9cq78hjjm3xft80000gn/T/zeppelin_pyspark-1462033700144752464.py", line 343, in sc.setJobGroup(jobGroup, "Zeppelin") File "/Users/titusfong/spark/python/pyspark/context.py", line 902, in setJobGroup self._jsc.setJobGroup(groupId, description, interruptOnCancel) AttributeError: 'NoneType' object has no attribute 'setJobGroup'
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache Zeppelin
12-26-2022
07:55 PM
i solved it by re configure spark.jars & spark.submit.Pyfiles in spark interpreters
... View more
12-22-2022
11:59 PM
where can i get that jar ?
... View more
12-22-2022
06:29 PM
yes i already did that but still TypeError: 'JavaPackage' object is not callable
... View more
12-22-2022
12:17 AM
when i tried to running this note %spark2.pyspark import pyspark from pyspark_llap import HiveWarehouseSession hive = HiveWarehouseSession.session(spark).build() df = hive.execute(" show databases ") the result is File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 228, in session return HiveWarehouseBuilder.session(session) File "/tmp/spark-00e8a412-9248-4a78-803f-3ca9d8ddac2d/userFiles-2f95cdc1-3caa-42d7-8356-5b022b67b3b9/pyspark_hwc-1.0.0.3.1.0.0-78.zip/pyspark_llap/sql/session.py", line 44, in session jvm.com.hortonworks.spark.sql.hive.llap.HiveWarehouseBuilder.session(jsparkSession)) TypeError: 'JavaPackage' object is not callable how do i fix it ? thanks
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
-
Apache Zeppelin
12-20-2022
08:24 PM
i am also get this error? anybody can solve it?
... View more
12-20-2022
07:02 PM
nothing just url to ranger in master 1
... View more
12-20-2022
12:10 AM
i just install hive llap anda the problem is in log hive-server2-interactive.err ``` ERROR [Thread-9] util.PolicyRefresher: PolicyRefresher(serviceName={{repo_name}}): failed to refresh policies. Will continue to use last known version of policies (-1) java.lang.IllegalArgumentException: Illegal character in path at index 35: /service/plugins/policies/download/{{repo_name}} at java.net.URI.create(URI.java:852) at com.sun.jersey.api.client.Client.resource(Client.java:434) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:275) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:126) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.URISyntaxException: Illegal character in path at index 35: /service/plugins/policies/download/{{repo_name}} at java.net.URI$Parser.fail(URI.java:2845) at java.net.URI$Parser.checkChars(URI.java:3018) at java.net.URI$Parser.parseHierarchical(URI.java:3102) at java.net.URI$Parser.parse(URI.java:3060) at java.net.URI.<init>(URI.java:588) at java.net.URI.create(URI.java:850) ... 7 more ``` and in task log accour error }
WARN cli.LlapStatusServiceDriver: Watch timeout 600s exhausted before desired state RUNNING is attained.
2022-12-20 09:51:42,858 - LLAP app 'llap0' current state is LAUNCHING.
2022-12-20 09:51:42,858 - LLAP app 'llap0' current state is LAUNCHING.
2022-12-20 09:51:42,858 - LLAP app 'llap0' deployment unsuccessful.
Command failed after 1 tries anybody can help me?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
12-18-2022
06:39 PM
appear new error after doing that WARN cli.LlapStatusServiceDriver: Watch timeout 400s exhausted before desired state RUNNING is attained.
2022-12-19 09:24:02,846 - LLAP app 'llap0' current state is LAUNCHING.
2022-12-19 09:24:02,847 - LLAP app 'llap0' current state is LAUNCHING.
2022-12-19 09:24:02,847 - LLAP app 'llap0' deployment unsuccessful.
Command failed after 1 tries
... View more
12-15-2022
11:25 PM
i try to start hive llap but when i start always failed and this logs from task log WARN conf.HiveConf: HiveConf of name hive.heapsize does not exist
ERROR cli.LlapStatusServiceDriver: FAILED: null
java.lang.NullPointerException: null
at org.apache.hadoop.hive.llap.cli.LlapStatusServiceDriver.run(LlapStatusServiceDriver.java:199) [hive-llap-server-3.1.0.jar:3.1.0]
at org.apache.hadoop.hive.llap.cli.LlapStatusServiceDriver.main(LlapStatusServiceDriver.java:712) [hive-llap-server-3.1.0.jar:3.1.0]
FAILED: null
Command failed after 1 tries anybody can help ? thanks
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
12-12-2022
10:10 PM
this setting in spark interpreter zeppelin
... View more
12-12-2022
10:10 PM
its admin:admin but its solve by add user=hive in spark.sql.hive.hiveserver2.jdbc.url = jdbc:hive2://ipserver:2181,ipserver:2181,ipserver:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;user=hive
... View more
12-12-2022
08:08 PM
in zeppelin i run show databases; and show tables works but when pyspark to select * from tables get error permission denied user = anonymous java.security.AccessControlException: Permission denied: user=anonymous, access=READ, inode="/warehouse/tablespace/managed/hive when i check getfacl in /warehouse/tablespace/managed/hive user zeppelin can rwx the directory why does zeppelin read as user anonymous ? anybody can help ? thanks
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Zeppelin
-
HDFS
12-04-2022
07:56 PM
when i try running pyspark command pyspark is not responding
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Spark
-
Apache Zeppelin
11-27-2022
10:44 PM
have you set in Advanced nifi-properties nifi.security.user.login.identity.provider = ldap-provider nifi.cluster.is.node = false (setting false if standalone) nifi.security.identity.mapping.pattern.dn = ^CN=(.*?), OU=(.*?), O=(.*?), L=(.*?), ST=(.*?), C=(.*?)$ nifi.security.identity.mapping.value.dn = $1@$2
... View more
11-10-2022
06:29 PM
solved when i check in yarn ui the application cant kill so i use user yarn in cli and kill heap application
... View more
11-07-2022
11:51 PM
i am using hive and tez.whenever i am performing insert query its returns following error: execution error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.teztask
... View more
Labels:
09-15-2022
12:29 AM
Hi, i want to ask about nifi login, i can login but cant acces nifi ui in nifi-user log success. this my nifi-user.log and error in nifi ui thank you
... View more
Labels:
09-13-2022
02:38 AM
Hi,
I am trying to secure NiFi authentication using LDAP configuration. ). I am able to get to the login screen, but then I am getting an error on logging in ( The supplied username and password are invalid) even though the username and password are correct.Can someone help me in the direction, on what might be the problem?
... View more
Labels: