question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

POST Error indexing images via Embeddings API service

See original GitHub issue

I’m getting the following error, when indexing images using POST to the txtai service url http://txtai.default.127.0.0.1.sslip.io/add.

"detail":[{"loc":["body"],"msg":"value is not a valid list","type":"type_error.list"}]}

Possible related to the FastAPI endpoint?

The same cluster is successful with text documents, but unsure how to index images.

Is it possible to periodically index images in a remote s3 directory via a workflow?

My current workflow YAML is:

writable: true
path: /tmp/index.tar.gz
cloud:
  provider: s3
  container: index
  key: "<key>"
  secret: "<secret>"
  host: txtai.s3.amazonaws.com
  port: 80

embeddings:
  path: "sentence-transformers/clip-ViT-B-32-multilingual-v1"
  content: true

I’m hoping to implement the Images embedding search in a workflow configuration, as in the examples/images.ipynb notebook

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:14 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
davidmezzetticommented, Sep 20, 2022

Sorry for the delay. I don’t have a good idea on why it’s not working with a serverless setup. I’ll try to run the image workflow with a local k8s instance to see what is happening.

0reactions
davidmezzetticommented, Oct 12, 2022

Glad you were able to find something that worked for you.

I ran the workflow above and it worked for me. Not sure what’s going on but given you’ve identified a solution I’m going to go ahead and close this.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Semantic search with embeddings: index anything
I will explain how semantic search works: encoding items as embeddings, indexing them, and using these indices for fast search in order to ......
Read more >
How Nyckel Built An API for Semantic Image Search - Pinecone
Indexing. Once you have embeddings, searching for images becomes a problem of finding the closest vectors to the embedding for that particular query....
Read more >
rom1504/clip-retrieval - GitHub
100M text+image embeddings can be processed in 20h using a 3080. ... the data using the clip index; clip back hosts the indices...
Read more >
Easily get high-quality embeddings with SentenceTransformers!
SentenceTransformers is a Python framework for state-of-the-art sentence, text, and image embeddings. Its API is super simple to use: ...
Read more >
Word embeddings | Text - TensorFlow
You will train your own word embeddings using a simple Keras model for a ... and then visualize them in the Embedding Projector...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found