question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Is your feature request related to a problem? Please describe. Serving a trained model in production.

Describe the solution you’d like I’d like to understand how to interface with tensorflow.

Describe alternatives you’ve considered I’m able to save and load a model, but not sure how to restore and serve it using TF.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

2reactions
madisonmaycommented, Oct 9, 2018

Hi @dimidd, thanks for the feature request.

At the moment the development branch does not support exposing the model through tensorflow serving. However, we’re in the middle of a large refactor (#148) that should migrate finetune onto the tensorflow estimator API. Can’t make any promises, but as tensorflow serving has explicit support for the estimator framework it seems likely that exposing some functionality to make finetune work with tensorflow serving will be straightforward. Will keep you posted via this ticket.

–Madison

1reaction
dimiddcommented, Oct 31, 2018

Thanks! I’ll dive into the code.

Read more comments on GitHub >

github_iconTop Results From Across the Web

A guide to ML model serving - Ubuntu
Model served as an API ... The most commonly used method today is model serving or model as a service. ... Modern MLOps...
Read more >
Best Tools to Do ML Model Serving - neptune.ai
Best Tools to Do ML Model Serving · 1. BentoML · 2. Cortex · 3. TensorFlow Serving · 4. TorchServe · 5. KFServing...
Read more >
Deploying Machine Learning Models, Part 2: model serving
In practice, it usually means that a model is deployed as a web service, and other services can communicate with it, ask for...
Read more >
Introduction to Model Serving - Coursera
This week, I'll give you an introduction to model serving, where you will explore methods for deploying models before getting hands-on and ...
Read more >
Serving ML Models in Production: Common Patterns - Anyscale
Through this, we've seen 4 common patterns of machine learning in production: pipeline, ensemble, business logic, and online learning. In the ML ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found