[1.7.8] No activities after small load (~80000 messages in 20hours)

See also https://issues.jboss.org/browse/ENTESB-11407

This is a…

[ ] Feature request
[ ] Regression (a behavior that used to work and stopped working in a new release)
[x] Bug report  
[ ] Documentation issue or request

Description

After putting some small load (~3 messages /s ) for couple of hours no activities are listed in integrations. I hit this also on i-dev cluster and openshift pro. GET https://syndesis-test.b6ff.rh-idev.openshiftapps.com/api/v1/activity/integrations/i-LilthRWl7ZNNJJhTBQNz results in 504 Gateway timeout. Looks like connection to DB is really slow.

There is syndesis-test project on i-dev cluster that can be used for investigation.

[zregvart]

I think I’m settling on two chages:

• adding the jsondb_activity_idx index as: CREATE INDEX CONCURRENTLY jsondb_activity_idx ON jsondb (path DESC);
• changing the query for DELETE to: WITH d AS (SELECT path FROM jsondb WHERE path LIKE '/activity/exchanges/i-LjGDJG5NPX6fkTQoWYHz/%' ORDER BY path DESC FOR KEY SHARE SKIP LOCKED OFFSET 50 ROWS) DELETE FROM jsondb WHERE path IN (SELECT path FROM d)

[heiko-braun]

Migrated to https://issues.jboss.org/browse/ENTESB-11407