Member since
01-17-2018
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
164 | 10-30-2019 09:37 AM |
10-30-2019
09:37 AM
I created a hack to solve this problem. In the ConvertJSONtoSQL processor I put table name = personal information. Notice the space. This generated the sql like so: insert into personal information <snipped> Then using a ReplaceTextProcessor I did a find and replace so such that the sql inserts were converted to the following: insert into `personal information` <snipped> This works but is very hacky...would love to see the correct way to get the back ticks to work
... View more
10-24-2019
09:34 AM
I'm using the ConvertJSONToSQL processor, and the MySql table has a space in the name. It appears to be the problem because when I remove the name from the table it works as expected.
I can successfully query the table from various tools and the mysql command line using back ticks "`" around the table name.
The table name: personal information
I've tried the following:
`personal information`
"personal information"
'personal information'
\"personal information\" [personal information]
Any suggestions?
... View more
Labels:
12-29-2018
10:47 PM
I have Kafka installed on my local mac, OUTSIDE THE SANDBOX VM, and I can't list topics in the kafka broker from my mac. Kafka install location on my local mac outside vm: <on-my-mac> - /Users/bjacobs/dev/servers/kafka/kafka_2.11-1.1.1/bin I am trying to run the following command from my local machine against zookeeper inside the sandbox VM: <on-my-mac>./bin/kafka-topics.sh --zookeeper localhost:2181 --list I get the following error: 2018-12-28 16:27:04,243] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: Connection refused
at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2018-12-28 16:27:06,004] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.net.ConnectException: Connection refused
at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[2018-12-28 16:27:06,394] WARN Session 0x0 for server localhost/127.0.0.1:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
java.io.IOException: Connection reset by peer
at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:283)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:236)
at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:226)
at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:382)
at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:68)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:366)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) Producer and Consumer Working However, I can produce and consume to/from the HDF 3.1 Kafka broker using the console producer and consumer on my local mac. Additionally, kafkacat will produce and consume to/from the HDF 3.1 kafka broker running in the VM. Why isn't zookeeper available to my mac? I haven't changed any of the port configurations on the VM. Any help would be greatly appreciated! **************************************************************************** ***** Please let me know if you can reproduce this problem **** ****************************************************************************
... View more
Labels:
02-13-2018
07:55 PM
Apache Atlas Lineage - REST API Example That links shows how to programmatically create lineage. However, the URL in the doc appears to be invalid: POST /v2/types/entitydef Posting to above URI results in a NotFoundException. Should that have been: POST /v2/types/typedefs Any help would be grateful appreciated.
... View more
Labels:
01-17-2018
05:41 PM
Here is an apache atlas hive column entity: {
"referredEntities": {
},
"entity": {
"typeName": "hive_column",
"attributes": {
"owner": null,
"qualifiedName": "make",
"name": "make",
"description": null,
"comment": null,
"position": 0,
"type": "make",
"table": {
"guid": "03fca616-ee26-4273-bf73-afb10fd1127c",
"typeName": "hive_table"
}
},
"guid": "d4ef03da-4659-4001-9597-02649a24e30b",
"status": "ACTIVE",
"createdBy": "admin",
"updatedBy": "admin",
"createTime": 1516120300604,
"updateTime": 1516132015809,
"version": 0,
"classifications": [
]
}
} The above JSON contains a version property which has the value of 0. I have changed the name property, qualifiedName property in the UI but the version value has remained 0. Can someone explain what causes that value to change and explain how versioning works in Apache Atlas?
... View more
Labels: