question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add data processed info into dbt run logs for all statement types

See original GitHub issue

Describe the feature

When using BigQuery dbt run logs should show the data scan value for create table statement and not just for script.

Describe alternatives you’ve considered

No alternative

Additional context

This specific improvement is about BigQuery. However, this might apply for other database too I do not have experience to give specific examples.

Who will this benefit?

Everyone using dbt to get easier access to usage.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:16 (14 by maintainers)

github_iconTop GitHub Comments

3reactions
drewbanincommented, Jun 22, 2020

Huh, I think that this is a string templating issue, and I think Jinja could be a good tool to solve that kind of problem 😃

I think we should keep the focus narrow for this particular PR, but in the future, I would like to:

  1. Provide a config option that accepts a templated string for the model status
  2. Provide a context that has variables in scope (like job, materialization, status, runtime, etc)

What do y’all think?

0reactions
meurant-naudecommented, Sep 13, 2020

Thanks all. Much appreciated

Read more comments on GitHub >

github_iconTop Results From Across the Web

Add data processed info into dbt run logs for all statement types
Describe the feature When using BigQuery dbt run logs should show the data scan value for create table statement and not just for...
Read more >
SQL models - dbt Developer Hub
To check out the SQL that dbt is running, you can look in: dbt Cloud: Within the run output, click on a model...
Read more >
Events and logs - dbt Developer Hub
With every task that dbt performs, it generates events. It records those events as log messages, and writes them (in real time) to...
Read more >
Debugging errors - dbt Developer Hub
The logs/dbt.log file contains all the queries that dbt runs, and additional logging. Recent errors will be at the bottom of the file....
Read more >
Incremental models - dbt Developer Hub
Incremental models. Overview​. Incremental models are built as tables in your data warehouseA data warehouse is a data management system used for data...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found