Environment variables can not load by Gemfile since v0.8.29.

Hello. Now I am in trouble…

Up to 0.8.28, environment variables could be loaded in liquid by the following method. But, since 0.8.29, environmental variables can not be read by the above method.

My Gemfile

source 'https://rubygems.org/'

gem 'embulk-input-...'
gem 'embulk-filter-...'
...

gem 'dotenv'

begin
  require 'dotenv'
  Dotenv.load(File.expand_path('../../.env', __FILE__))
rescue LoadError => e
rescue => e
end

dotenv is a library that can manage environment variables with yaml.

My .env

DATABASE_HOST=localhost
DATABASE_USER=username
DATABASE_PASS=password
DATABASE_NAME=some_database

My liquid file

in:
  type: mysql
  host: {{ env.DATABASE_HOST }}
  user: {{ env.DATABASE_USER }}
  password: {{ env.DATABASE_PASS }}
  database: {{ env.DATABASE_NAME }}
  query: |
    select * from users limit 1

out:
  type: stdout

Run embulk

$ embulk run -b embulk_bundle config.yml

Did something change around environment variables?

It is running Gemfile on things like Digdag’s --params-file. https://docs.digdag.io/command_reference.html

[dmikurube]

@toyama0919 @toyama-h I think this issue would be worked-around by #790, which is released soon as v0.8.33. Can you try that?

[dmikurube]

@toyama0919 Thanks for your report! Got it… Since v0.8.29, JRuby instances not for plugins (e.g. subcommands, Liquid, Bundler, …) are independent from others to avoid creating (global) JRuby instances in the bootstrap.

Hmm…, let me think about that. That would be non-trivial to keep the un-JRuby’ed bootstrap.