question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Compile error while using pipelinemodel.writebundle

See original GitHub issue

Hi, i am trying to use mleap with spark and export the model.Followed the steps [https://github.com/combust/mleap/wiki/Serializing-a-Spark-ML-Pipeline-and-Scoring-with-MLeap](Mleap wiki). Observed the following error

Error:(105, 21) value writeBundle is not a member of org.apache.spark.ml.PipelineModel
      pipelinemodel.writeBundle.save(bf)(sbc).get

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:5 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
hollinwilkinscommented, Aug 23, 2018

Follow instructions here: http://mleap-docs.combust.ml/spark/ Make sure to:

import ml.combust.mleap.spark.SparkSupport._
0reactions
ancasarbcommented, Mar 3, 2019

We’ve re-implemented the serving layer, using either grpc or http (spring boot). You can take a look at the new serving layer, using the links below.

https://github.com/combust/mleap/tree/master/mleap-serving https://github.com/combust/mleap/tree/master/mleap-executor https://github.com/combust/mleap/tree/master/mleap-spring-boot

More examples in Java can also be found here: https://github.com/combust/mleap/blob/master/mleap-runtime/src/test/scala/ml/combust/mleap/runtime/javadsl/JavaDSLSpec.java.

Thank you!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Convert Spark Pipeline TFIDF Model Into MLeap Bundle
Using the MLeap libraries, the Spark pipeline model can be converted into MLeap bundle. In the following section of code, the Spark pipeline...
Read more >
Pyspark ML pipeline error when fitting pipeline - Stack Overflow
1 Answer 1 · 1. Hamza i tried this but not work it seems there is no parameter handleInvalid for CountVectorizer, the source...
Read more >
Part 2: Spark MLeap Bundles to S3 - StreamSets
Serialized pipelines (bundles) can be deserialized back into Spark for batch-mode scoring or the MLeap runtime to power realtime API services.
Read more >
MLeap Model Export Demo (Scala) - Databricks documentation
Use MLeap to serialize the PipelineModel to zip File or to directory. Move the PipelineModel files to your deployment project or data store....
Read more >
PipelineModel — PySpark 3.3.1 documentation - Apache Spark
Represents a compiled pipeline with transformers and fitted models. New in version 1.3.0. Methods. clear (param).
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found