question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Feature Proposal: Add support for displaying Primary Key/Partition column in table details page

See original GitHub issue

Expected Behavior or Use Case

Table details page should display which column(s) are Primary key and partition keys for the table. Please note not all databases support primary key so this needs to be enabled only for once that support it, for e.g., Snowflake

Service or Ingestion ETL

All 3 amundsen services (amundsenfrontend, amundsensearch and amundsenmetadata) and amundsendatabuilder needs to be modified.

Possible Implementation

We had a light discussion on #amundsen slack channel (see thread). One way would be to add attributes to ColumnMetadata model to indicate if this column is primary key or partition key or both. Another implementation would be ( as mentioned in the thread) to do this via column level badges.

We need to modify amundsenfrontend, amundsenmetadata and amundsendatabuilder just to highlight the column in table details. We can update the amundsensearch service if we would like to support advance search on primary and partition columns.

Context

Displaying Primary and Partition key has been a top requested feature by analysts and data scientists. It helps them identify which column they need to use in their SQL filter by condition.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
Alagappancommented, Aug 7, 2020

@feng-tao please let me know if I can help with anything on this feature (PR, design reviews, docs or code reviews)

1reaction
feng-taocommented, Aug 7, 2020

thanks @Alagappan

Read more comments on GitHub >

github_iconTop Results From Across the Web

Work with feature tables | Databricks on AWS
Learn how to work with feature tables in Databricks Feature Store. ... The primary key can consist of one or more columns. Create...
Read more >
Database table partitioning - GitLab Docs
Table partitioning is a powerful database feature that allows a table's data to be split into smaller physical tables that act as a...
Read more >
Primary Key Constraint | CockroachDB Docs
A primary key constraint specifies columns that can be used to uniquely identify rows in a table.
Read more >
15.10 - PRIMARY KEY - Teradata Database
A column or column set is the primary key for table_name. The defined column set makes each row in the table unique. The...
Read more >
4.1 Specifying Partitioning When Creating Tables and Indexes
You can create an auto-list partitioned table using only the partitioning key values that are known. As data is loaded into the table,...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found