1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1999 | 04-03-2024 06:39 AM | |
| 3167 | 01-12-2024 08:19 AM | |
| 1725 | 12-07-2023 01:49 PM | |
| 2505 | 08-02-2023 07:30 AM | |
| 3517 | 03-29-2023 01:22 PM |
10-11-2016
08:41 PM
TensorFlow 0.11 is out export TF_BINARY_URL=https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.11.0rc0-cp27-none-linux_x86_64.whl
... View more
10-11-2016
07:54 PM
1 Kudo
I have installed it on an HDF 2.0 Node on Centos7 and on an HDP 2.5 Node on Centos 7 on OpenStack. This will even install easier on Ubuntu. Make sure you have Python 2.7+ and PIP installed. http://hoolihan.net/blog-tim/2016/03/02/installing-tensorflow-on-centos/ sudo pip install --upgrade https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.7.1-cp27-none-linux_x86_64.whl
... View more
10-11-2016
06:25 PM
do you have an example zeppelin notebook to share?
... View more
10-11-2016
05:57 PM
See the virtualbox faq: https://forums.virtualbox.org/viewtopic.php?t=8669
... View more
10-11-2016
05:41 PM
https://community.hortonworks.com/questions/49237/this-kernel-requires-an-x86-64-cpu-but-only-detect.html Can you run other VMs? By default Windows and Windows BIOS is disabled and doesn't allow for this.
... View more
10-10-2016
03:42 PM
1 Kudo
In-depth video is helpful: https://www.youtube.com/watch?v=5a3HywxY2kQ https://cwiki.apache.org/confluence/display/METRON/Metron+Architecture#MetronArchitecture-Step1-TelemetryEventBuffer Adding a new event source https://cwiki.apache.org/confluence/display/METRON/Adding+a+New+Telemetry+Data+Source Look through the source: https://github.com/apache/incubator-metron/tree/4a4cb8b117dbb66bbfb4915bca9d871a06682c28/metron-platform/metron-enrichment Profiling Behavior of Entities https://github.com/apache/incubator-metron/tree/4a4cb8b117dbb66bbfb4915bca9d871a06682c28/metron-analytics/metron-profiler https://cwiki.apache.org/confluence/display/METRON/Metron+Wiki Models are stored and data is compared against it.
... View more
10-07-2016
03:39 PM
3 Kudos
With NiFi 1.00 I ingested a lot of image data from drones, mostly to get metadata like geo. I also ingested a resized version of the image in case I wanted to use it. I found a use for it. I am pulling this out very simply with Spring for a simple HTML page. So I wrote a quick Java program to pull out fields I stored in Phoenix (from the metadata) and I wanted to display the image. I could have streamed it out of HDFS using HDFS libraries to read the file and then stream it. sql = "select datekey, fileName, gPSAltitude, gPSLatitude, gPSLongitude, orientation,geolat,geolong,inception from dronedata1 order by datekey asc";
out.append(STATIC_HEADER);
PreparedStatement ps = connection.prepareStatement(sql);
ResultSet res = ps.executeQuery();
while (res.next()) {
try {
out.append("<br><br>\n<table width=100%><tr><td valign=top><img src=\"");
out.append("http://tspanndev10.field.hortonworks.com:50070/webhdfs/v1/drone/").
append(res.getString("fileName")).append("?op=OPEN\"></td>");
out.append("<td valign=top>Date: ").append(res.getString("datekey"));
out.append("\n<br>Lat: ").append(res.getString("geolat"));
out.append("\n<br>Long: ").append(res.getString("geolong"));
out.append("\n<br><br>\n</td></tr></table>\n");
} catch (Exception e) {
e.printStackTrace();
}
}
It was a lot easier to use the built-in WebHDFS to display an image. Wrapping the Web API call to the image file in an HTML IMG SRC tag loads our image. http://node1:50070/webhdfs/v1/drone/Bebop2_20160920083655-0400.jpg?op=OPEN It's pretty simple and you can use this with a MEAN application, Python Flask or your non-JVM front-end of choice. And now you have a solid distributed host for your images. I recommend this only for internal sites and public images. Having this data publicly available on the cloud is dangerous!
... View more
Labels:
10-06-2016
06:53 PM
Use Falcon for Map Reduce, Sqoop and Flume jobs. Use NiFi for everything else.
... View more
10-06-2016
06:49 PM
WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist
WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value
WARN cli.LlapServiceDriver: Ignoring unknown llap server parameter: [hive.aux.jars.path]
Failed: Working memory + cache (Xmx=4.00GB + cache=1.00GB) has to be smaller than the container sizing (5.00GB)
java.lang.IllegalArgumentException: Working memory + cache (Xmx=4.00GB + cache=1.00GB) has to be smaller than the container sizing (5.00GB) at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) I am working from this: http://hortonworks.com/hadoop-tutorial/interactive-sql-hadoop-hive-llap/ I am trying to see which setting I set too high.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive