Atlas集成外部框架
Atlas集成Hbase
1)进入/opt/module/atlas/conf/目录,修改配置文件
vim atlas-application.properties
#修改atlas存储数据主机
atlas.graph.storage.hostname=hadoop101:2181
2)进入到/opt/module/atlas/conf/hbase路径,添加Hbase集群的配置文件到${Atlas_Home}
ln -s /opt/module/hbase-2.2.4/conf/ /opt/module/atlas/conf/hbase/
3)在/opt/module/atlas/conf/atlas-env.sh中添加HBASE_CONF_DIR
vim atlas-env.sh
#添加HBase配置文件路径
export HBASE_CONF_DIR=/opt/module/hbase-2.2.4/conf
Atlas集成Solr
1)进入/opt/module/atlas/conf目录,修改配置文件
vim atlas-application.properties
# 修改如下配置
atlas.graph.index.search.backend=solr
atlas.graph.index.search.solr.mode=cloud
atlas.graph.index.search.solr.zookeeper-url=hadoop101:2181
2)将Atlas自带的Solr文件夹拷贝到外部Solr文件夹
cp -r solr/ /opt/module/solr-7.7.3/
bin/solr start -force
bin/solr create -force -c vertex_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2
bin/solr create -force -c edge_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2
bin/solr create -force -c fulltext_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2
Atlas集成Kafka
1)进入/opt/module/atlas/conf/目录,修改配置文件atlas-application.properties
vim atlas-application.properties
atlas.notification.embedded=false
atlas.kafka.data=/opt/module/kafka_2.11-2.4.1/logs
atlas.kafka.zookeeper.connect=hadoop101:2181
atlas.kafka.bootstrap.servers=hadoop101:9092
atlas.kafka.zookeeper.session.timeout.ms=400
atlas.kafka.zookeeper.connection.timeout.ms=200
atlas.kafka.zookeeper.sync.time.ms=20
atlas.kafka.auto.commit.interval.ms=1000
atlas.kafka.hook.group.id=atlas
Atlas集成Hive
1)进入/opt/module/atlas/conf/目录,修改配置文件atlas-application.properties
vim atlas-application.properties
######### Hive Hook Configs #######
atlas.hook.hive.synchronous=false
atlas.hook.hive.numRetries=3
atlas.hook.hive.queueSize=10000
atlas.cluster.name=primary
2)在/opt/module/hive/conf/hive-site.xml文件中设置Atlas hook
cd /opt/module/apache-hive-3.1.2-bin/conf/
vim hive-site.xml
<property>
<name>hive.exec.post.hooks</name>
<value>org.apache.atlas.hive.hook.HiveHook</value>
</property>
cd /opt/software/
tar zxvf apache-atlas-2.2.0-hive-hook.tar.gz -C /opt/module/
mv hive-env.sh.template hive-env.sh
cd apache-atlas-hive-hook-2.2.0/
cp -r hook /opt/module/atlas/
cd /opt/module/apache-hive-3.1.2-bin/conf/
vim hive-env.sh
export HIVE_AUX_JARS_PATH=/opt/module/atlas/hook/hive
3)将atlas-application.properties 拷贝到/opt/module/hive/conf 目录下