[UX] Point in time in OpenSearch Dashboards (WIP)

Overview

OpenSearch Dashboards Point in time (PIT) search feature allow users (including but not limited to Developers, DevOps, and Data Analyst) to create and manage point in time search from OpenSearch Dashboards stack management, discover, visualize and dashboard. It helps user maintain a fixed data set which can be re-used by different queries in order to achieve consistent results.

Use Cases

1. Users create a PIT based on existing index pattern or indices, give the PIT a name and a expiration date.
2. Users explore the existing index pattern in Discover, and create a PIT to get fixed data set in time.
3. Users create visualization based on the existing index pattern in Visualize, and create a PIT to freeze the visualization result and share with others.
4. Users view and manage PITs in stack management, perform tasks such as extend expiration time, bulk delete, rename and create new PIT based on existing ones.

We are looking for more use cases, please comment if you know a use case not covered above. 😃

Ref: Point In Time Search opensearch-project/OpenSearch#1147

Flow structure

There are four flows in exploration for PIT search, Minimum viable product (MVP) will include Stack Management flow and Discover flow. Visualize flow and Dashboard flow are working in progress (WIP).

Stack Management Flow (MVP)

• From Stack Management > Point in Time > view and manage PITs
• From Stack Management > Index Pattern > create PIT based on existing index pattern
• From Stack Management > Saved Objects > relationship (parent/child), view PITs and its’ relationship with other objects 

Discover Flow (MVP)

• From Discover > Change Data Source > create PIT or change to existing PIT

Visualize Flow (WIP)

• From Visualize > Change Data Source > create PIT or change to existing PIT

Dashboard Flow (WIP)

• From Dashboard > Edit Panel > create PIT or change to existing PIT / Show expired PIT Panel

Design Mockups

1. Stack Management Flow (MVP)

• Access Point in Time in Stack Management

• Create new PIT in the flyout

• Perform tasks such as extend expiration time, bulk delete, rename and create new PIT based on existing ones.

• View PIT Details

• Create new PIT based on existing index pattern

• View PIT in saved Objects

2. Discover Flow (MVP)

• Switch data source to existing PIT
• Create New PIT based on selected index pattern

3. Visualize Flow (WIP)

• Switch data source to existing PIT created based on the selected index pattern
• Create new PIT based on selected index pattern

4. Dashboard Flow (WIP)

• Create new PIT for the selected panel
• Click PIT icon to open the PIT flyout and edit
• Expired PIT icon turn red and graph become monochrome (we may not have the expired PIT data, consider empty state pattern instead)

Thank you for reading, comments and suggestions are welcome 🤗.

[dblock]

Moving this to https://github.com/opensearch-project/OpenSearch-Dashboards.

[kavilla]

@ashwin-pc

I believe on the data source side it would be essentially a view at the data at that specific time compared to timestamps of the data.

Like a snapshot of the data. If I remember the implementation details on the engine side completely partitioned from the data that OpenSearch Dashboards normally hits.