Atlas集成外部框架

Atlas集成Hbase

1）进入/opt/module/atlas/conf/目录，修改配置文件

vim atlas-application.properties

#修改atlas存储数据主机

atlas.graph.storage.hostname=hadoop101:2181

2）进入到/opt/module/atlas/conf/hbase路径，添加Hbase集群的配置文件到${Atlas_Home}

ln -s /opt/module/hbase-2.2.4/conf/ /opt/module/atlas/conf/hbase/

3）在/opt/module/atlas/conf/atlas-env.sh中添加HBASE_CONF_DIR

vim atlas-env.sh

#添加HBase配置文件路径

export HBASE_CONF_DIR=/opt/module/hbase-2.2.4/conf

Atlas集成Solr

1）进入/opt/module/atlas/conf目录，修改配置文件

vim atlas-application.properties

# 修改如下配置
atlas.graph.index.search.backend=solr
atlas.graph.index.search.solr.mode=cloud
atlas.graph.index.search.solr.zookeeper-url=hadoop101:2181

2）将Atlas自带的Solr文件夹拷贝到外部Solr文件夹

cp -r solr/ /opt/module/solr-7.7.3/
bin/solr start -force
bin/solr create -force -c vertex_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2
bin/solr create -force -c edge_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2
bin/solr create -force -c fulltext_index -d /opt/module/solr-7.7.3/atlas_conf -shards 3 -replicationFactor 2

Atlas集成Kafka

1）进入/opt/module/atlas/conf/目录，修改配置文件atlas-application.properties

vim atlas-application.properties

atlas.notification.embedded=false
atlas.kafka.data=/opt/module/kafka_2.11-2.4.1/logs
atlas.kafka.zookeeper.connect=hadoop101:2181
atlas.kafka.bootstrap.servers=hadoop101:9092
atlas.kafka.zookeeper.session.timeout.ms=400
atlas.kafka.zookeeper.connection.timeout.ms=200
atlas.kafka.zookeeper.sync.time.ms=20
atlas.kafka.auto.commit.interval.ms=1000
atlas.kafka.hook.group.id=atlas

Atlas集成Hive

1）进入/opt/module/atlas/conf/目录，修改配置文件atlas-application.properties

vim atlas-application.properties

######### Hive Hook Configs #######
atlas.hook.hive.synchronous=false
atlas.hook.hive.numRetries=3
atlas.hook.hive.queueSize=10000
atlas.cluster.name=primary

2）在/opt/module/hive/conf/hive-site.xml文件中设置Atlas hook

cd /opt/module/apache-hive-3.1.2-bin/conf/
vim hive-site.xml

<property>
   <name>hive.exec.post.hooks</name>
   <value>org.apache.atlas.hive.hook.HiveHook</value>
</property>

cd /opt/software/
tar zxvf apache-atlas-2.2.0-hive-hook.tar.gz -C /opt/module/
mv hive-env.sh.template hive-env.sh
cd apache-atlas-hive-hook-2.2.0/
cp -r hook /opt/module/atlas/
cd /opt/module/apache-hive-3.1.2-bin/conf/
vim hive-env.sh

export HIVE_AUX_JARS_PATH=/opt/module/atlas/hook/hive

3)将atlas-application.properties 拷贝到/opt/module/hive/conf 目录下