PIL.UnidentifiedImageError: cannot identify image file

I made tsv builder for custom image inference

but error occurs when I run it with my tsv file

PIL.UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x7f8897ba1e50>

I find that str convert into float64 automatically when I save tsv file with pandas

here’s my custom make_tsv function

---

def make_tsv(datapath, img_list, start_index):

    data = pd.DataFrame({"unique_id": [], "img_id": [], "caption": [], "predicted_object_labels": [], "base64_str": []})
    for i, img_name in enumerate(img_list):
        print("index: ", i)
        print("img_name: ", img_name)
        img = Image.open(os.path.join(datapath, img_name))
        img_buffer = BytesIO()
        img.save(img_buffer, format=img.format)
        byte_data = img_buffer.getvalue()
        unique_id = start_index + i
        img_id = img_name.split(".")[-2]
        caption = ""
        predicted_object_labels = ""
        base64_str = base64.b64encode(byte_data)
        temp_dataframe = pd.DataFrame({"unique_id": [unique_id], "img_id": [img_id], "caption": [caption], \
                                            "predicted_object_labels": [predicted_object_labels], \
                                            "base64_str": [str(base64_str)]})

        data = pd.concat([data, temp_dataframe], ignore_index=True)
        
    return data

---

and I can’t find solution yet.

can u give me advise??

[SangMyeongWoh]

Hi, the definitions of the 4th-indexed columns are different between your tsv file (predicted_object_labels) and caption_test.tsv (base64_str). Please check the schema of your dataframe and make it conform with our provided tsv file.

Im really appreciate with your aid.

I was fool

I’ll check what u said first.

[yangapku]

By the way, the necessity of using base64_str = base64.b64encode(byte_data).decode("utf-8") instead of base64_str = base64.b64encode(byte_data) is to avoid obtaining a string like “b’/9j/4AAQSkZJRgA’” in your tsv file and further cause some errors.