Feeding in dictionary of data?

Hey all!

One thing I really enjoyed about Tensorflow was the feeddict option where I could then access the data by the keys to easily access and process the data in chunks. E.g

{
    "data_to_be_embedded": ... #Some (batch_size, N , M) matrix
    "timeseries data": ... # (batch_size, timeseries_window)
}

I suppose one option would be to define multiple models and wrap them all into a single function which applies them key-value by key-value. Is there a more “idiomatic” way of doing this in Haiku?

[tomhennigan]

Thank you! Do you know if there are any plans to split oryx out of TFP? It seems generic enough that it could stand on its own.

There has been some discussion about creating a standalone version of oryx’s fetch apis (sow, reap etc) since that side of the library is very robust (e.g. behaviour under transforms/control flow is well defined, although there are some questions about while_loop), and definitely useful as a standalone component (e.g. to power logging our other use cases where you want intermediate values). I’d hope that will happen within the next 3-6mo.

[IanQS]

Thank you! I’m closing hte issue out now