Skip to content

Conversation

@divija21
Copy link

@divija21 divija21 commented Jul 3, 2025

ATLAS-3924 :

This PR introduces a new documentation file HookHive.md to explain the Hive Metastore Hook, which was originally implemented under ATLAS-3148 but lacked official usage guidance on the Apache Atlas documentation site that is mentioned in [ATLAS-3924]

The documentation aims to make it easy for users to configure and understand the purpose of the Hive Metastore Hook.

It includes :

  1. Overview: Role of the hook in capturing Hive DDL operations (like CREATE/DROP TABLE).
  2. Configuration Instructions:
  • How to enable the hook via hive.metastore.event.listeners.
    
  • Steps to copy hook files into Hive
    
  • Update instructions for hive-env.sh and atlas-application.properties.
    
  1. Atlas Hook Properties:
  • Kafka/Zookeeper configuration
  • Threading, retries, and cluster settings
  1. How It Works:
  • DDL events from Hive are pushed to Atlas Kafka topic .
    

Demonstration of Setup in Action
Hive CLI - HiveCli
Atlas UI (Database View) - Atlas.odt
Atlas UI (Atlas UI (Table View))- Atlas.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant