1973
Posts
1225
Kudos Received
124
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
779 | 04-03-2024 06:39 AM | |
1502 | 01-12-2024 08:19 AM | |
772 | 12-07-2023 01:49 PM | |
1331 | 08-02-2023 07:30 AM | |
1923 | 03-29-2023 01:22 PM |
05-25-2017
04:59 PM
1 Kudo
https://dzone.com/articles/deep-learning-on-big-data-platforms https://dzone.com/articles/tensorflow-on-the-edge-part-2-of-5 https://dzone.com/articles/deep-learning-for-data-engineers-part-1 https://dzone.com/articles/deep-learning-and-machine-learning-guide-part-iii https://dzone.com/articles/deep-learning-and-machine-learning-guide-part-ii https://dzone.com/articles/machine-learning-resources https://dzone.com/articles/tensorflow-on-the-edge TensorFlow, MXNet and Deep Learning4J all work well with HDP 2.6 https://community.hortonworks.com/articles/83872/data-lake-30-containerization-erasure-coding-gpu-p.html https://community.hortonworks.com/articles/104649/using-cloudbreak-recipes-to-deploy-anaconda-and-te.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html https://community.hortonworks.com/articles/54954/setting-up-gpu-enabled-tensorflow-to-work-with-zep.html https://community.hortonworks.com/articles/80339/iot-capturing-photos-and-analyzing-the-image-with.html https://community.hortonworks.com/articles/59349/hdf-20-flow-for-ingesting-real-time-tweets-from-st.html https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/83100/deep-learning-iot-workflows-with-raspberry-pi-mqtt.html
... View more
08-30-2016
01:22 PM
Hello Everyone, I have tried to connect to Hadoop(Hortonworks) from Ploybase, but I am getting an error "Access to the remote server is denied because no login-mapping exists: , Has anyone encountered this before , Hi there, Has anyone tried to connect to hadoop using polybase, I am trying to connect after applying the settings mentioned above, but getting error "Access to the remote server is denied because no login-mapping exists "
... View more
06-10-2016
03:10 AM
1 Kudo
Sqoop GUI is available in Sqoop2 but HDP is still using sqoop1. Cloudera is using sqoop2 which has GUI.
... View more
06-13-2016
03:28 PM
It's in progress and hopefully will be in the next release https://community.emc.com/message/925027#925027
... View more
08-17-2016
09:18 PM
that's great thanks
... View more
11-22-2017
04:45 PM
Druid is another option and is supported in HDP 2.6
... View more
06-10-2016
02:41 PM
2 Kudos
I'm not aware of the concept of Spark's Accumulators exposed as "first-class" objects in Pig and have always advised that you would need to build a UDF for such activities if you couldn't simply get away with filtering the things to count (such as "good" records and "rejects") into separate aliases then count them up. Here is a blog post going down the UDF path; https://dzone.com/articles/counters-apache-pig. Good luck & I'd love to hear if there was something I've been missing all along directly from Pig.
... View more
06-07-2016
12:13 PM
I did a couple test queries on a 15GB data set once, uncompressed was slowest everything else was more or less identical. I tested Snappy and Zlib in 64 and 256MB stripes. However it was heavily tuned for short running queries on a single column so the majority of time was not in the execution. You might have slightly different results in a heavily CPU restricted system. However as Gopal said proper sorting and distribution is much more important.
... View more
06-07-2016
02:11 AM
any example on github?
... View more