Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

apache ignite

apache ignite

Super Collaborator

Hi:

one question about apache ignite, when you put data into hive, automatically the data will be put into apache ignite cache?

or when you write data into apache ignite automatically the data will be put into hive??

thanks

3 REPLIES 3

Re: apache ignite

New Contributor

I think Hive can treat ignite as file system and reads/writes will go through it. You might also want to check the ignite forums.

https://apacheignite.readme.io/v1.3/docs/running-apache-hive-over-ignited-hadoop

Re: apache ignite

Super Collaborator

Thanks it can help, and there are any integration with LDAP/AD, RANGER AND ATLAS for this? I mean its transparenly?

Highlighted

Re: apache ignite

New Contributor

The easiest way would be to deploy Apache Ignite cache on top of Hive and access data through Apache Ignite key-value, SQL, or compute APIs. You can also configure Ignite CacheStore to automatically write-through and read-through data to and from Hive. This way all updates performed in Ignite will be propagated to Hive.

More info on Ignite CacheStore:

https://apacheignite.readme.io/docs/3rd-party-store#read-through-and-write-through

,

I think the best way is to put Apache Ignite on top of Hive and implement Ignite CacheStore API to automatically write-through and read-through to and from Hive. This way, whenever the data is updated in Ignite, it will be automatically updated in Hive as well. The reverse is also true, whenever you access data that is not loaded in Ignite cache, it will be automatically loaded from Hive.

More info on Ignite CacheStore:

https://apacheignite.readme.io/docs/3rd-party-store#read-through-and-write-through