question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Reorder database mappings to improve loading times

See original GitHub issue

Acceptance Criteria (Required on creation)

  • The database mappings are ordered in a way that BuilderExceptions don’t occur

Hints

  • BuilderExceptions occur when loading MyBatis mappings and cross-referenced scripts are not yet loaded.
  • The failed mappings are retried later on again. This increases the loading time of all mappings overall.

Links

n/a

Breakdown

  • Identify the references due to which script loading is failing
  • Reorder the mappings to load to get rid of the loading failures

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

2reactions
tmetzkecommented, Oct 24, 2022

Hi @tobiasschaefer,

good point regarding edits/updates, I wasn’t aware actually, and will keep that in mind in the future 👍

Regarding time reductions:

Module Old time (sec) New time (sec) Improvement
Overall 1740 1500 ~14%
Engine Core 300 220 ~27%
Engine Spring 150 90 ~40%
Spring Boot Starter Core 53 38 ~28%
Spring Boot Starter Webapps 43 32 ~26%
Camunda Run Core 60 40 ~33%

Hope that helps 🙂

0reactions
tobiasschaefercommented, Oct 24, 2022

Hi @tmetzke ,

thanks a lot for those numbers (unfortunately I first missed the updates 1 and 2 because edits of existing comments don’t seem to trigger notifications).

Those numbers are quite impressive - especially when extrapolated to all camunda7 installations world wide. Test suites of Spring Boot applications which use @DirtiesContext will profit a lot 🙂

Regarding “update 2”. What was the initial time so that I can assess how much those 4 minutes are worth?

And how much faster (absolute and relative values) are the Spring and Spring-Boot related modules?

I’d love to hear some numbers. Even if the changes look trivial it took me quite some time to narrow down the issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Improve performance while loading data - Ask TOM
I am presently working on a Data Warehouse project which is using Informatica for mapping and loading data into an Oracle database (8.1.7...
Read more >
How-to improve data loading performance on SQL Managed ...
In this blog post we shall consider some of the strategies for improving data loading performance in Azure SQL Managed Instance.
Read more >
SQL Server ORDER BY performance tips
This article will help you uncover the performance secrets of the SQL Server ORDER BY statement.
Read more >
Loading 40 Millions of records in Fact table- Performance Issue
Please Help me Out, I have One fact table which is Truncate and Insert @ daily basis , I am loading data from...
Read more >
Loading Big Data Faster - IRI CoSort
Loading in sorted order had a 42% lower sustained rows/second load rate; Unsorted inserts into indexes force more internal database work (block management...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found