New feature: Index folder from outside

Gauging whether it would be interesting to allow softlinks to top-level subfolders outside the current BIDS root, at BIDSLayout instantiation.

In other words: it would be very useful (use case: templateflow/python-client#12) to implement internally the behavior of symlinking a (consistent) sub-XXX folder from outside from the top BIDS root. Especially for filesystems not supporting symlinks.

WDTY?

For the particular use case I linked, this feature would make it very easy to integrate new templates (tpl-XXXX) which are like subjects of BIDS to the base installation.

[tyarkoni]

Any objection to closing this, @oesteban? Unless you have other thoughts, I don’t think this is viable without a lot of work, and I think it presents problems from a spec standpoint too as it encourages users to have broken partial BIDS structures (e.g., a single subject directory with no parent dataset_description.json, etc.).

[tyarkoni]

I guess I’m not really sold… I can see the utility for the use case you describe, but it introduces some complexities that would be a bit of a pain to handle. For one thing, I see no particular reason to only allow subject directs to be indexed this way… what about other partial structures? But doing that would then require us to internally parse everything in index_external to figure out where it fits… and that could be ambiguous.

As you say, the current indexing approach should in principle respect symlinks (we may want to check that it does—I don’t think we have tests for it, and I wouldn’t be surprised if we currently use realpath in ways that might break things). Assuming that’s true, why not just have the user create those themselves?