Migration breaks due to java.io.IOException: Mark invalid

Which version and edition of Flyway are you using?

6.5.0

If this is not the latest version, can you reproduce the issue with the latest one as well?

(Many bugs are fixed in newer releases and upgrading will often resolve the issue)

Which client are you using? (Command-line, Java API, Maven plugin, Gradle plugin)

Java API

Which database are you using (type & version)?

Oracle 12c

Which operating system are you using?

Windows (locally) / Linux (CI Build with Jenkins)

What did you do?

Before running integration tests with jUnit we create the database schema from scratch. There are 912 script files at the moment. I use the Java API to set placeholders and start the migration.

What did you expect to see?

All migrations are applied and the tests are started.

This works absolutely fine for the previous versions I used:

• 6.4.1
• 6.4.4

What did you see instead?

When using version 6.5.0 the migration always breaks at script number 46 with the following error message:

org.flywaydb.core.api.FlywayException: Unable to parse statement in db/migration/V1.000046__<some-name>.sql at line 2 col 1. See https://flywaydb.org/documentation/knownparserlimitations for more information: Mark invalid at org.flywaydb.core.internal.parser.Parser.getNextStatement(Parser.java:294) at org.flywaydb.core.internal.parser.Parser.access$000(Parser.java:41) at org.flywaydb.core.internal.parser.Parser$ParserSqlStatementIterator.next(Parser.java:733) at org.flywaydb.core.internal.parser.Parser$ParserSqlStatementIterator.next(Parser.java:698) at org.flywaydb.core.internal.sqlscript.ParserSqlScript.parse(ParserSqlScript.java:82) at org.flywaydb.core.internal.sqlscript.ParserSqlScript.validate(ParserSqlScript.java:127) at org.flywaydb.core.internal.sqlscript.ParserSqlScript.executeInTransaction(ParserSqlScript.java:196) at org.flywaydb.core.internal.resolver.sql.SqlMigrationExecutor.canExecuteInTransaction(SqlMigrationExecutor.java:93) at org.flywaydb.core.internal.command.DbMigrate.isExecuteGroupInTransaction(DbMigrate.java:312) at org.flywaydb.core.internal.command.DbMigrate.applyMigrations(DbMigrate.java:275) at org.flywaydb.core.internal.command.DbMigrate.migrateGroup(DbMigrate.java:244) at org.flywaydb.core.internal.command.DbMigrate.access$100(DbMigrate.java:54) at org.flywaydb.core.internal.command.DbMigrate$2.call(DbMigrate.java:162) at org.flywaydb.core.internal.command.DbMigrate$2.call(DbMigrate.java:159) at org.flywaydb.core.internal.jdbc.TableLockingExecutionTemplate$1.call(TableLockingExecutionTemplate.java:38) at org.flywaydb.core.internal.jdbc.TransactionalExecutionTemplate.execute(TransactionalExecutionTemplate.java:66) at org.flywaydb.core.internal.jdbc.TableLockingExecutionTemplate.execute(TableLockingExecutionTemplate.java:33) at org.flywaydb.core.internal.database.base.Connection.lock(Connection.java:129) at org.flywaydb.core.internal.schemahistory.JdbcTableSchemaHistory.lock(JdbcTableSchemaHistory.java:140) at org.flywaydb.core.internal.command.DbMigrate.migrateAll(DbMigrate.java:159) at org.flywaydb.core.internal.command.DbMigrate.migrate(DbMigrate.java:137) at org.flywaydb.core.Flyway$1.execute(Flyway.java:206) at org.flywaydb.core.Flyway$1.execute(Flyway.java:158) at org.flywaydb.core.Flyway.execute(Flyway.java:527) at org.flywaydb.core.Flyway.migrate(Flyway.java:158) at finance.egp.reporting.merger.ReportingMergerTest.lambda$static$0(ReportingMergerTest.java:166) at finance.egp.framework.fusion.test.FusionApplicationTestStage.populateSchema(FusionApplicationTestStage.java:101) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh.populateSchema$accessor$8sqzLu5M(Unknown Source) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh$auxiliary$5wCia11p.call(Unknown Source) at com.tngtech.jgiven.impl.intercept.ByteBuddyMethodInterceptor$1.proceed(ByteBuddyMethodInterceptor.java:43) at com.tngtech.jgiven.impl.intercept.StepInterceptorImpl.doIntercept(StepInterceptorImpl.java:117) at com.tngtech.jgiven.impl.intercept.StepInterceptorImpl.intercept(StepInterceptorImpl.java:84) at com.tngtech.jgiven.impl.intercept.ByteBuddyMethodInterceptor.interceptSuper(ByteBuddyMethodInterceptor.java:47) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh.populateSchema(Unknown Source) at finance.egp.framework.fusion.test.FusionApplicationTestStage.unloading_tenant(FusionApplicationTestStage.java:172) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh.unloading_tenant$accessor$8sqzLu5M(Unknown Source) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh$auxiliary$9PDNIpXs.call(Unknown Source) at com.tngtech.jgiven.impl.intercept.ByteBuddyMethodInterceptor$1.proceed(ByteBuddyMethodInterceptor.java:43) at com.tngtech.jgiven.impl.intercept.StepInterceptorImpl.doIntercept(StepInterceptorImpl.java:117) at com.tngtech.jgiven.impl.intercept.StepInterceptorImpl.intercept(StepInterceptorImpl.java:84) at com.tngtech.jgiven.impl.intercept.ByteBuddyMethodInterceptor.interceptSuper(ByteBuddyMethodInterceptor.java:47) at finance.egp.framework.fusion.test.FusionApplicationTestStage$ByteBuddy$hNCI3voh.unloading_tenant(Unknown Source) at finance.egp.reporting.merger.ReportingMergerTest.GIVEN_the_analytics_datamodel_WHEN_merged_THEN_all_necessary_data_is_copied_correctly(ReportingMergerTest.java:100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.springframework.test.context.junit4.statements.RunBeforeTestExecutionCallbacks.evaluate(RunBeforeTestExecutionCallbacks.java:73) at org.springframework.test.context.junit4.statements.RunAfterTestExecutionCallbacks.evaluate(RunAfterTestExecutionCallbacks.java:83) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.springframework.test.context.junit4.statements.RunBeforeTestMethodCallbacks.evaluate(RunBeforeTestMethodCallbacks.java:75) at org.springframework.test.context.junit4.statements.RunAfterTestMethodCallbacks.evaluate(RunAfterTestMethodCallbacks.java:86) at com.tngtech.jgiven.junit.JGivenMethodRule$1.evaluate(JGivenMethodRule.java:73) at org.springframework.test.context.junit4.statements.SpringRepeat.evaluate(SpringRepeat.java:84) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:251) at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.runChild(SpringJUnit4ClassRunner.java:97) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.springframework.test.context.junit4.statements.RunBeforeTestClassCallbacks.evaluate(RunBeforeTestClassCallbacks.java:61) at org.springframework.test.context.junit4.statements.RunAfterTestClassCallbacks.evaluate(RunAfterTestClassCallbacks.java:70) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.springframework.test.context.junit4.SpringJUnit4ClassRunner.run(SpringJUnit4ClassRunner.java:190) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33) at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:230) at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:58)

This seems to be the interesting part:

Caused by: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:512) at java.io.FilterReader.reset(FilterReader.java:117) at java.io.FilterReader.reset(FilterReader.java:117) at org.flywaydb.core.internal.parser.PlaceholderReplacingReader.reset(PlaceholderReplacingReader.java:177) at java.io.FilterReader.reset(FilterReader.java:117) at org.flywaydb.core.internal.parser.PositionTrackingReader.reset(PositionTrackingReader.java:56) at java.io.FilterReader.reset(FilterReader.java:117) at org.flywaydb.core.internal.parser.RecordingReader.reset(RecordingReader.java:48) at java.io.FilterReader.reset(FilterReader.java:117) at org.flywaydb.core.internal.parser.PeekingReader.refillPeekBuffer(PeekingReader.java:80) at org.flywaydb.core.internal.parser.PeekingReader.peek(PeekingReader.java:183) at org.flywaydb.core.internal.parser.PeekingReader.peek(PeekingReader.java:165) at org.flywaydb.core.internal.parser.Parser.readToken(Parser.java:483) at org.flywaydb.core.internal.parser.Parser.getNextStatement(Parser.java:161) ... 76 more

[juliahayward]

Fixed in 6.5.2

[petarov]

I had the same java.io.IOException: Mark invalid issue yesterday. Downgrading to 6.4.4 as suggested seems to have fixed it.