question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Ludwig integration on custom platform

See original GitHub issue

Hello, I am trying to integrate some ludwig features inside our platform and I would ask you basically two things:

QUESTION 1

The first consists in the numpy version: why in requirements.txt numpy>=1.15,<1.16 is specified? what is the main reason? Because in our platform we use latest version of numpy (1.16.1 with pip) and if I’m not wrong, this version creates problem with ludwig:

ImportError: Missing required dependencies ['numpy']

Installing numpy>=1.15,<1.16 is ok but it could make conflicts with other features that are in our platform.


QUESTION 2 This is a technical question: I am trying to implement a regression predictor that has text in input and its output is a two value tuple between 0 and 1 (x , y where 0<x<1 and 0<y<1, formally ). This is my model definition:

 'input_features': [ {'name': 'text', 
                            'type': 'text' , 
                            'encoder': 'rnn', 
                            'cell': 'lstm', 
                            'bidirectional': 'true'} ], 
'output_features': [
                                {'name': 'x', 
                                'type': 'numerical'    }, 
                                {'name': 'y', 
                                'type': 'numerical'}
                            ]

But in this way I get sometimes outputs (in the inference phase) < 0 or > 1. How can I tell output_features to produce numerical numbers between 0 and 1 ( sigmoid layer ) ?

Thanks for your support!

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:1
  • Comments:6

github_iconTop GitHub Comments

1reaction
w4nderlustcommented, Mar 22, 2019

As it was a pretty quick thing to do, I ended up adding a clip parameter to numerical output features too. now you can have:

output_features:
-
  name: x
  type: numerical
  clip: [0, 1]

Enjoy 😃 Closing it but feel free to comment further if needed.

0reactions
simonefranciacommented, Mar 25, 2019

Ok I think I solved. What I did is to use the configuration of the packages of out platform, and with this configuration of package I trained the model, in order to be compatible with it in inference mode. Hope that it can be helpful for something in the future!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Ludwig integration on custom platform · Issue #238 - GitHub
Hello, I am trying to integrate some ludwig features inside our platform and I would ask you basically two things: QUESTION 1.
Read more >
Ludwig AI v0.4 — Introducing Declarative MLOps with Ray ...
Integration with Ray for large-scale distributed training that combines Dask and Horovod; A new distributed hyperparameter search integration ...
Read more >
Ludwig
Ludwig provides an extendable interface to integrate with third-party systems for ... configuration to customize the pipeline to meet your requirements.
Read more >
Introducing Ludwig, a Code-Free Deep Learning Toolbox - Uber
Uber AI developed Ludwig, a code-free deep learning toolbox, to make deep learning more accessible to non-experts and enable faster model ...
Read more >
End-to-End AutoML with Ludwig on Ray - YouTube
(Travis Addair, Horovod) Ludwig is an open source AutoML framework that allows you to train and deploy state-of-the-art deep learning models ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found